1-D filter banks have been well developed until today. However, many signals, such as image, video, 3D sound, radar, sonar, are multidimensional, and require the design of multidimensional filter banks. With the fast development of communication technology, signal processing system needs more room to store data during the processing, transmission and reception. In order to reduce the data to be processed, save storage and lower the complexity, multirate sampling techniques were introduced to achieve these goals. Filter banks can be used in various areas, such as image coding, voice coding, radar and so on. Many 1D filter issues were well studied and researchers proposed many 1D filter bank design approaches. But there are still many multidimensional filter bank design problems that need to be solved. Some methods may not well reconstruct the signal, some methods are complex and hard to implement. The simplest approach to design a multi-dimensional filter bank is to cascade 1D filter banks in the form of a tree structure where the decimation matrix is diagonal and data is processed in each dimension separately. Such systems are referred to as separable systems. However, the region of support for the filter banks might not be separable. In that case designing of filter bank gets complex. In most cases we deal with non-separable systems. A filter bank consists of an analysis stage and a synthesis stage. Each stage consists of a set of filters in parallel. The filter bank design is the design of the filters in the analysis and synthesis stages. The analysis filters divide the signal into overlapping or non-overlapping subbands depending on the application requirements. The synthesis filters should be designed to reconstruct the input signal back from the subbands when the outputs of these filters are combined. Processing is typically performed after the analysis stage. These filter banks can be designed as
Infinite impulse response (IIR) or
Finite impulse response (FIR). In order to reduce the data rate, downsampling and upsampling are performed in the analysis and synthesis stages, respectively.
Existing approaches Below are several approaches on the design of multidimensional filter banks. For more details, please check the
ORIGINAL references.
Multidimensional perfect-reconstruction filter banks When it is necessary to reconstruct the divided signal back to the original one, perfect-reconstruction (PR) filter banks may be used. Let H(
z) be the transfer function of a filter. The size of the filter is defined as the order of corresponding polynomial in every dimension. The symmetry or anti-symmetry of a polynomial determines the
linear phase property of the corresponding filter and is related to its size. Like the 1D case, the
aliasing term A(z) and transfer function T(z) for a 2 channel filter bank are: A(
z)=1/2(H0(-
z) F0 (
z)+H1 (-
z) F1 (
z)); T(
z)=1/2(H0 (
z) F0 (
z)+H1 (
z) F1 (
z)), where H0 and H1 are decomposition filters, and F0 and F1 are reconstruction filters. The input signal can be perfectly reconstructed if the alias term is cancelled and T(
z) equal to a monomial. So the necessary condition is that T'(
z) is generally symmetric and of an odd-by-odd size. Linear phase PR filters are very useful for image processing. This two-channel filter bank is relatively easy to implement. But two channels sometimes are not enough. Two-channel filter banks can be cascaded to generate multi-channel filter banks.
Multidimensional directional filter banks and surfacelets M-dimensional directional filter banks (MDFB) are a family of filter banks that can achieve the directional decomposition of arbitrary M-dimensional signals with a simple and efficient tree-structured construction. It has many distinctive properties like: directional decomposition, efficient tree construction, angular resolution and perfect reconstruction. In the general M-dimensional case, the ideal frequency supports of the MDFB are hypercube-based hyperpyramids. The first level of decomposition for MDFB is achieved by an N-channel undecimated filter bank, whose component filters are M-D "hourglass"-shaped filter aligned with the w1,...,wM respectively axes. After that, the input signal is further decomposed by a series of 2-D iteratively resampled checkerboard filter banks
IRCli(
Li)(i=2,3,...,M), where
IRCli(
Li)operates on 2-D slices of the input signal represented by the dimension pair (n1,ni) and superscript (Li) means the levels of decomposition for the ith level filter bank. Note that, starting from the second level, we attach an IRC filter bank to each output channel from the previous level, and hence the entire filter has a total of 2(
L1+...+
LN) output channels.
Multidimensional oversampled filter banks Oversampled filter banks are multirate filter banks where the number of output samples at the analysis stage is larger than the number of input samples. It is proposed for robust applications. One particular class of oversampled filter banks is nonsubsampled filter banks without downsampling or upsampling. The perfect reconstruction condition for an oversampled filter bank can be stated as a matrix inverse problem in the polyphase domain. For IIR oversampled filter bank, perfect reconstruction have been studied in Wolovich and Kailath. in the context of control theory. While for FIR oversampled filter bank we have to use different strategy for 1-D and M-D. FIR filter are more popular since it is easier to implement. For 1-D oversampled FIR filter banks, the Euclidean algorithm plays a key role in the matrix inverse problem. However, the Euclidean algorithm fails for multidimensional (MD) filters. For MD filter, we can convert the FIR representation into a polynomial representation. In Charo, This approach based on multivariate matrix factorization can be used in different areas. The algorithmic theory of polynomial ideals and modules can be modified to address problems in processing, compression, transmission, and decoding of multidimensional signals. The general multidimensional filter bank (Figure 7) can be represented by a pair of analysis and synthesis polyphase matrices H(z) and G(z) of size N\times M and M\times N, where
N is the number of channels and M\stackrel{\rm def}{=}|M| is the absolute value of the determinant of the sampling matrix. Also H(z) and G(z) are the z-transform of the polyphase components of the analysis and synthesis filters. Therefore, they are
multivariate Laurent polynomials, which have the general form: :F(z)=\sum_{k\in \mathbf{Z}^{d}}f[k]z^{k}=\sum_{k\in \mathbf{Z}^{d}}f[k_{1},...,k_{d}]z_{1}^{k_{1}}...z_{d}^{k_{d}}. Laurent polynomial matrix equation need to be solve to design perfect reconstruction filter banks: :G(z)H(z)=I_. In the multidimensional case with multivariate polynomials we need to use the theory and algorithms of Gröbner bases. Gröbner bases can be used to characterizing perfect reconstruction multidimensional filter banks, but it first need to extend from polynomial matrices to
Laurent polynomial matrices. The Gröbner-basis computation can be considered equivalently as Gaussian elimination for solving the polynomial matrix equation G(z)H(z)=I_. If we have set of polynomial vectors :\mathrm{Module}\left\{ h_{1}(z),...,h_{N}(z)\right\} \stackrel{\rm def}{=}\{c_{1}(z)h_{1}(z)+...+c_{N}(z)h_{N}(z)\} where c_{1}(z),...,c_{N}(z) are polynomials. The Module is analogous to the
span of a set of vectors in linear algebra. The theory of Gröbner bases implies that the Module has a unique reduced Gröbner basis for a given order of power products in polynomials. If we define the Gröbner basis as \left\{ b_{1}(z),...,b_{N}(z)\right\}, it can be obtained from \left\{ h_{1}(z),...,h_{N}(z)\right\} by a finite sequence of reduction (division) steps. Using reverse engineering, we can compute the basis vectors b_{i}(z) in terms of the original vectors h_{j}(z) through a K\times N transformation matrix W_{ij}(z) as: :b_{i}(z)=\sum_{j=1}^{N}W_{ij}(z)h_{j}(z),i=1,...,K
Mapping-based multidimensional filter banks Designing filters with good frequency responses is challenging via Gröbner bases approach. Mapping based design in popularly used to design nonseparable multidimensional filter banks with good frequency responses. The mapping approaches have certain restrictions on the kind of filters; however, it brings many important advantages, such as efficient implementation via lifting/ladder structures. Here we provide an example of two-channel filter banks in 2D with sampling matrix D_{1}=\left[\begin{array}{cc} 2 & 0\\ 0 & 1 \end{array}\right] We would have several possible choices of ideal frequency responses of the channel filter H_{0}(\xi) and G_{0}(\xi). (Note that the other two filters H_{1}(\xi) and G_{1}(\xi) are supported on complementary regions.) All the frequency regions in Figure can be critically sampled by the rectangular lattice spanned by D_1. So imagine the filter bank achieves perfect reconstruction with FIR filters. Then from the polyphase domain characterization it follows that the filters H1(z) and G1(z) are completely specified by H0(z) and G0(z), respectively. Therefore, we need to design H0(x) and G0(z) which have desired frequency responses and satisfy the polyphase-domain conditions. H_{0}(z_{1},z_{2})G_{0}(z_{1},z_{2})+H_{0}(-z_{1},z_{2})G_{0}(-z_{1},z_{2})=2 There are different mapping technique that can be used to get above result.
Filter-bank design in the frequency domain When perfect reconstruction is not needed, the design problem can be simplified by working in frequency domain instead of using FIR filters. Note that the frequency domain method is not limited to the design of nonsubsampled filter banks (read ).
Direct frequency-domain optimization Many of the existing methods for designing 2-channel filter banks are based on transformation of variable technique. For example, McClellan transform can be used to design 1-D 2-channel filter banks. Though the 2-D filter banks have many similar properties with the 1-D prototype, but it is difficult to extend to more than 2-channel cases. In Nguyen, and Lu. In Nguyen's paper, In Lee's 1999 paper, In this paper, the authors proposed that the FIR filter with 128 taps be used as a basic filter, and decimation factor is computed for RJ matrices. They did simulations based on different parameters and achieve a good quality performances in low decimation factor. ==Directional filter banks==