Breaking Barriers: Translating English Audio And Text To Indian Sign Language With Regional Subtitles
Keywords:
Indian Sign Language (ISL)Abstract
Communication is essential in daily life, but the hearing-impaired community often faces challenges in connecting with others. While sign language helps bridge this gap, its accessibility remains limited due to a lack of widespread awareness. This paper presents a system that translates English text and audio into Indian Sign Language (ISL), combined with subtitles in 9 regional languages, including Telugu, Hindi, Tamil, Bengali, and more. Using speech-to-text conversion and ISL gesture synthesis powered by advanced deep learning techniques, the system enhances inclusivity. It translates audio into text, generates matching ISL gestures, and adds subtitles in users’ chosen regional language. Evaluated for accuracy and ease of use, this system shows promise as an assistive tool to empower hearing-impaired individuals and promote communication across language barriers.
Downloads
References
1. S. Sabharwal and P. Singla, "Translation of Indian Sign Language to Text-A Comprehensive Review," International Journal of Intelligent Systems and Applications in Engineering, vol. 12, no. 14s, pp. 309–319, 2024. [Online]. Available: https://ijisae.org/index.php/IJISAE/article/view/466716
2. "Literature Review on Indian Sign Language Recognition System," International Research Journal of Engineering and Technology, vol. 9, no. 7, pp. 2447–2451, 2022. [Online]. Available: https://www.irjet.net/archives/V9/i7/IRJET-V9I7447.pdf24
3. "Sign Language Translation Systems: A Systematic Literature Review," International Journal of Software Science and Computational Intelligence, vol. 14, no. 1, pp. 1–20, 2022. [Online]. Available: https://dl.acm.org/doi/10.4018/IJSSCI.3114483
4. S. Kusum Choudhary, K. C. Y. Rangampeta, and E. S. Reddy, "Empowering Communication for Indian Sign Language Users Through AI-Driven Real-Time Translation," International Journal of Engineering Innovations and Management Strategies, vol. 1, no. 7, pp. 1–7, Dec. 2024. [Online]. Available: https://philarchive.org/archive/KUSECF5
5. R. J. Ms., S. Sahani, and P. K. Yadav, "A Review on Advances in Indian Sign Language Recognition: Techniques, Models, and Applications," International Journal for Research in Applied Science and Engineering Technology, vol. 12, no. 11, pp. 1–10, Nov. 2024. [Online]. Available: https://www.ijraset.com/research-paper/advances-in-indian-sign-language-recognition-techniques-models-and-applications7
6. "A Review On Sign Language Recognition And Translation Systems," International Journal of Creative Research Thoughts, vol. 12, no. 1, pp. 1–6, 2024. [Online]. Available: https://www.ijcrt.org/papers/IJCRT2411161.pdf
7. [Anonymous], "Indian Sign Language Recognition System Using Deep Learning," International Journal of Engineering Research & Technology (IJERT), vol. 12, no. 3, pp. 1–6, 2023. [Online]. Available: https://www.ijert.org/research/indian-sign-language-recognition-system-using-deep-learning-IJERTV12IS030001.pdf
8. [Anonymous], "ISL Recognition Using Vision-Based Approaches," International Journal of Computer Applications, vol. 58, no. 12, pp. 20–25, 2022. [Online]. Available: https://www.ijcaonline.org/archives/volume58/number12/isl-recognition.pdf
9. S. Halder and R. Tayade, "Real-Time Indian Sign Language Recognition Using MediaPipe and Machine Learning," International Journal of Computer Science and Mobile Computing, vol. 10, no. 5, pp. 45–52, 2021. [Online]. Available: https://www.ijcsmc.com/docs/papers/May2021/V10I5202104.pdf
10. S. Sood, A. Kaur, and P. Singh, "AAWAAZ: Indian Sign Language Recognition Using HSV Histograms and Harris Algorithm," International Journal of Computer Applications, vol. 175, no. 9, pp. 1–6, 2020. [Online]. Available: https://www.ijcaonline.org/archives/volume175/number9/sood-2020-ijca-920123.pdf
