Recognizing Voice Over IP: A Robust Front-End for Speech Recognition on the World Wide Web

Thumbnail Image
Publication date
Defense date
Journal Title
Journal ISSN
Volume Title
IEEE Circuits & Systems Society : IEEE Signal Processing Society : IEEE Communications Society : IEEE Computer Society
Google Scholar
Research Projects
Organizational Units
Journal Issue
The Internet Protocol (IP) environment poses two relevant sources of distortion to the speech recognition problem: lossy speech coding and packet loss. In this paper, we propose a new front-end for speech recognition over IP networks. Specifically, we suggest extracting the recognition feature vectors directly from the encoded speech (i.e., the bit stream) instead of decoding it and subsequently extracting the feature vectors. This approach offers two significant benefits. First, the recognition system is only affected by the quantization distortion of the spectral envelope. Thus, we are avoiding the influence of other sources of distortion due to the encoding-decoding process. Second, when packet loss occurs, our front-end becomes more effective since it is not constrained to the error handling mechanism of the codec. We have considered the ITU G.723.1 standard codec, which is one of the most preponderant coding algorithms in voice over IP (VoIP) and compared the proposed front-end with the conventional approach in two automatic speech recognition (ASR) tasks, namely, speaker-independent isolated digit recognition and speaker-independent continuous speech recognition. In general, our approach outperforms the conventional procedure, for a variety of simulated packet loss rates. Furthermore, the improvement is higher as network conditions worsen.
Internet, Internet telephony, Decoding, Encoding, Error handling, Information resources, Protocols, Speech coding, Speech recognition, ITU G.723.1 standard codec
Bibliographic citation
IEEE Transactions on multimedia. Vol. 3, no. 2, Junio 2001, pp.209—218