An Interactive System leveraging Automatic Speech Recognition and Machine Translation for learning Hindi as a Second Language

Abstract

When English speakers are in the early stages of learning Hindi, formulating sentences in Hindi is often attempted by a verbatim translation of English words to corresponding Hindi words. Due to this reason, they are unable to learn Hindi sentences correctly. We have tried to overcome this problem by use of technology for second language learners. The use of Automatic Speech Recognition, and Machine Translation for second language learning, here learning Hindi by English speaker, has been illustrated by taking English speech as input and translating the given English sentences and words into Hindi and then displaying its equivalent construct in Devanagari script. The interactive system under study displays and speaks the same. It has been observed that a second language can be learnt faster by frequently listening to the vocabulary and sentences of the language. Thus the system furnishes the functionality of speaking the sentence in Hindi once it is represented in Devanagari script. The English sentences and words from the grammar tool books are given as input to the system for experimentation. We have observed that the critical problem encountered while doing so is the translation of English to Hindi. Another problem encountered at times is insertion error for letters (only surfaced). The system cannot translate sentences represented using continuous tense and perfect continuous tense correctly. The overall accuracy of the system, otherwise, is approximately 67% which can help the second language learners in the beginning.