Synthesis filter bank optimization in two-dimensional separable subband coding systems

Subband coding is a popular and well established technique used in visual communications, such as image and video transmission. In the absence of quantization and transmission errors, the analysis and synthesis filters in a subband coding scheme can be designed to obtain perfect reconstruction of the input signal, but this is no longer the optimal solution in the presence of quantization of the subband coefficients. We presuppose the use of a two-dimensional (2-D) separable subband scheme and we address the problem of designing, for a given analysis filter bank and assuming uniform quantization of the subband coefficients, the set of row and column synthesis filters that minimize the mean squared reconstruction error at the output of the subband system. Since the corresponding optimization problem is inherently nonlinear, we propose a suboptimal solution that extends a one-dimensional (l-D) optimal filter design procedure, already presented in the literature, to a 2-D separable synthesis filter bank. The separable 2-D extension is not trivial, since the processing in one direction, e.g., the rows, alters the statistics of the signals for the design of the filters in the other direction, e.g., the columns. To further simplify the filter design, we propose to model the input image as a 2-D separable Markov process plus an additive white component. Several design examples using both synthetic signals and real world images are presented, showing that the filters designed using the proposed technique can give a significant gain with respect to the perfect reconstruction solution, especially when the dither technique is used for quantization. The simulation results also show that the proposed image model can be conveniently used in the synthesis filter design procedure.