Calle Silos, Fernando de laValverde Albacete, Francisco JoséGallardo Antolín, AscensiónPeláez Moreno, Carmen2015-10-142015-10-142015-11IEEE/ACM Transactions on Audio, Speech, and Language Processing (2015). 23(11), 2070-2080.2329-9290https://hdl.handle.net/10016/21710In this paper, we present advances in the modeling of the masking behavior of the human auditory system (HAS) to enhance the robustness of the feature extraction stage in automatic speech recognition (ASR). The solution adopted is based on a nonlinear filtering of a spectro-temporal representation applied simultaneously to both frequency and time domains-as if it were an image-using mathematical morphology operations. A particularly important component of this architecture is the so-called structuring element (SE) that in the present contribution is designed as a single three-dimensional pattern using physiological facts, in such a way that closely resembles the masking phenomena taking place in the cochlea. A proper choice of spectro-temporal representation lends validity to the model throughout the whole frequency spectrum and intensity spans assuming the variability of the masking properties of the HAS in these two domains. The best results were achieved with the representation introduced as part of the power normalized cepstral coefficients (PNCC) together with a spectral subtraction step. This method has been tested on Aurora 2, Wall Street Journal and ISOLET databases including both classical hidden Markov model (HMM) and hybrid artificial neural networks (ANN)-HMM back-ends. In these, the proposed front-end analysis provides substantial and significant improvements compared to baseline techniques: up to 39.5% relative improvement compared to MFCC, and 18.7% compared to PNCC in the Aurora 2 database.13application/pdfeng© 2015 IEEE.Spectro-temporal processingCochlear masking modelsMorphological filteringAutomatic speech recognitionAuditory-based featuresPNCCresearch articleTelecomunicaciones10.1109/TASLP.2015.2464691open access2070112080IEEE-ACM Transactions on audio speech and language processing23AR/0000017269