Hand Gesture Recognition
Keywords:
Robot Car Movement, Gesture Recognition, Random Forest, Deep Learning, CNN, layer modification, Arduino-Uno Controller.Abstract
This paper describes the implementation of
movement control for robotic car using hand gesture
recognition which uses deep learning algorithm.
Therefore, proposed technique is hassle free as
control is not based on joysticks or switches. There
are six conditions considered for robot car movement
control as ‘Backword’, ‘Forward’, ‘Left’, ‘No-
Motion’, ‘Right’ and ‘Stop’ using different hand
gestures. There are many researchers worked on this
area using different sensors, machine learning
algorithms and deep learning algorithms. Limitations
of the state of art techniques are studied in this paper
and designed a new modified convolutional neural
network (CNN) for gesture recognition which
controls movement of robot car. Dataset is created
which generates 1000 Gray scale images for each type
of gesture. Training modified CNN model gives
prediction accuracy of 98.4024 % while random
forest machine learning classifier gives prediction
accuracy of 69%. It is observed that proposed model
gives better accuracy compared to state of art
technique for controlling movement of robot car
using hand gesture. Obtained hand gesture class can
be send to robot using Arduino controller for
controlling movement.
Downloads
References
[1] Saleem Ullah1, Zain Mumtaz1,etAl. (2019)
,An Automated Robot-Car Control System with
Hand-Gestures and Mobile Application Using
Arduino, © 2019 by the author(s). Distributed
under a Creative Commons CC BY license,
https://www.researchgate.net/publication/33018299
[2] Marc Peral. etAl. (2022) , ‘Efficient Hand
Gesture Recognition for Human-Robot
Interaction’, Journals & Magazines ,IEEE
Robotics and Automation , Volume: 7 Issue: 4.
[3] Tanuja Jha etAl. (2018) , ‘Real Time Hand
Gesture Recognition for Robotic Control’, 978-
1-5386-5657-0/18/$31.00 c 2018 IEEE
[4] F. Arce, J. M. G. Valdez,” Accelerometer-
Based Hand Gesture Recognition Using
Artificial Neural Networks” in Soft Computing
for Intelligent Control and Mobile Robotics
Studies in Computational Intelligence, 2011.
[5] Gesture Controlled Robot using Kinect
http://www.eyantra.org/home/projectswiki/
item/180-gesturecontrolled-robotusingfirebirdv-
and-kinect
[6] R. Wang, J. Popovic, ”Real-time handtracking
with a color glove,” ACM Transactions
on Graphics,2009.
[7] C.-C. Chang, I.-Y Chen, and Y.-S. Huang,
"Hand Pose Recognition Using Curvature Scale
Space", IEEE International Conference on
Pattern Recognition, 2002.
[8] Chethana N S, Divya Prabha,M Z Kurian,
“Static Hand Gesture Recognition System for
Device Control”, International Journal of
Electrical, Electronics and Data
Communication, ISSN: 2320-2084, Vol 3,April-
2015.
[9] Abhijit Nale, Ankush Barkade, Pravin
Ekhande, and Shreyas Dayal, “Hand Gesture
Recognition for Robotic Car Control”,
IJARCST, Vol. 3, Issue 1 (2015).
[10] (DIP) Digital Image Processing by S.
Jayaraman, S. Esakkirajan ,T. Veerakumar,
August 10, 2013, ISBN: 978-0-07- 014479-8