Optimized Cosine-Modulated Filter Banks Using the Frequency Response Masking Approach

"An optimization procedure for cosine-modulated filter banks (CMFB) using the frequency-response masking approach is proposed. In the given method, we perform minimization of the maximum attenuation level in the filter\u2019s stopband, subject to intersymbol interference (ISI) and intercarrier interference (ICI) constraints. For optimization, a quasiNewton algorithm with line search is used, and we propose a simplified analytical expressions to impose the interference constraints. The result is lower levels of ISI and ICI for a pre-determined filter order, or reduced filter complexity for given levels of interferences."