HAND SIGN LANGUAGE RECOGNITION USING AUGMENTED REALITY AND MACHINE LEARNING


Mohammed Asif, Sameer Shrikhande, Hardik Pingale, Abhishek Joshi, Prof. Priyanka Sonawane
K.C. College of Engineering and Management Studies and Research, University of Mumbai, Thane
Abstract
Effective communication is a cornerstone of human interaction, fostering societal cohesion and development. Throughout history, communication has evolved from primitive drawings to complex languages, shaping our societys fabric. However, amidst this progression, individuals with speech and hearing impairments have often faced significant challenges in communication. Despite constituting a minority, their needs are paramount and must not be overlooked. Recognizing the diverse classification of languages into verbal and non-verbal forms, it becomes evident that non-verbal languages play a crucial role, especially for Individuals with Hearing and Speech Impairments (IWSHI). These individuals rely on non-verbal communication methods to interact with the world around them, yet they often face barriers due to the lack of understanding and accessibility. To address this challenge, the HSLR app serves as a transformative tool, enabling IWSHI to communicate confidently. Leveraging technologies such as Augmented Reality (AR) and Machine Learning (ML), our app facilitates real-time recognition of hand signs, providing instantaneous translations for seamless communication. Additionally, the integration of AR technology enhances the user experience, offering immersive and interactive sign-language communication platforms. The MediaPipe model used in real-time achieves high accuracy in recognizing sign language due to the ample dataset we provided.
Keywords: Hand Sign Language Recognition (HSLR), Augmented Reality (AR), Machine Learning (ML), American Sign Language (ASL), Computer Vision, MediaPipe
Journal Name :
EPRA International Journal of Research & Development (IJRD)

VIEW PDF
Published on : 2024-04-21

Vol : 9
Issue : 4
Month : April
Year : 2024
Copyright © 2024 EPRA JOURNALS. All rights reserved
Developed by Peace Soft