Hand Sign Detection (ASL) Using AI and Image Processing
Abstract
The increasing need for accessible communication
for the hearing-impaired community has led to
advancements in technology, particularly in the field
of
Hand Sign Detection for American Sign
Language (ASL). This project explores the
development of an AI-driven hand sign detection
system using image processing techniques in
Python. By leveraging convolutional neural
networks (CNNs) and machine learning algorithms,
the
system is capable of recognizing and
interpreting ASL gestures from live video streams or
static images.The model is trained on a dataset of
ASL hand signs, using Python libraries such as
OpenCV for image preprocessing and TensorFlow
or Keras for building and training the neural
network. The system processes input images,
identifies hand gestures, and maps them to their
corresponding ASL letters or words, providing real
time feedback. This project aims to bridge
communication gaps by offering a tool that can be
used for learning ASL or assisting in daily
interactions between the hearing and hearing
impaired communities. The proposed system has
applications in educational tools, assistive
technologies, and real-time translation services.
With further training and optimization, it has the
potential to improve the quality of life for
individuals who rely on sign language as their primary mode of communication.
Downloads
References
[1] K. Cheng, “Top 10 & 25 American sign language
signs for beginners – the most know top 10 & 25
ASL signs to learn first: Start ASL,” Start ASL
Learn American Sign Language with our Complete
3-Level Course!, 29-Sep-2021. [Online]. Available:
Top 10 & 25 American Sign Language Signs for
Beginners – The Most Know Top 10 & 25 ASL
Signs to Learn First.
[2] Mittal, P. Kumar, P. P. Roy, R. Balasubramanian,
and B.B. Chaudhuri, "A Modified LSTM Model for
Continuous Sign Language Recognition Using Leap
Motion," in IEEE Sensors Journal, vol. 19, no. 16,
pp. 7056-7063, 15 Aug.15, 2020.
[3] V. Sharma, M. Jaiswal, A. Sharma, S. Saini and R.
Tomar, "Dynamic Two Hand Gesture Recognition
using CNN-LSTM based networks," 2021 IEEE
International Symposium on Smart Electronic
Systems (iSES), 2021,pp. 224-229, doi: 10.11.09.
[4] M. Wurangian, “American sign language alphabet
recognition,”
Medium,15-Mar-2021. [Online].
Available: American Sign Language Alphabet
Recognition | by Marshall Wurangian
| MLearning.ai | Medium.
[5] A. Dennisan, “American sign language alphabet
recognition using Deep Learning,” ArXiv, 10-Feb
2022. [Online]. Available: American Sign Language
Alphabet Recognition using Deep Learning.
[6] P. Likhar, N. K. Bhagat and R. G N, "Deep Learning
Methods for Indian Sign Language Recognition,"
2020 IEEE 10th International Conference on
Consumer Electronics (ICCE- Berlin), 2020, pp. 1
6.
[7] Shivashankara, Ss, and S. Srinath. “American sign
language recognition system: an optimal approach.”
International Journal of Image, Graphics and Signal
Processing 11, no. 8 (2022): 18.
[8] D. G. Lowe, Distinctive Image Features from Scale
Invariant Keypoints, International Journal of
Computer Vision, vol. 13, no. 2, pp. 111122, 2020.