Sign Language Recognition Using Artificial Intelligence
Saved in:
| Title: | Sign Language Recognition Using Artificial Intelligence |
|---|---|
| Language: | English |
| Authors: | Sreemathy, R., Turuk, Mousami, Kulkarni, Isha, Khurana, Soumya |
| Source: | Education and Information Technologies. May 2023 28(5):5259-5278. |
| Availability: | Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/ |
| Peer Reviewed: | Y |
| Page Count: | 20 |
| Publication Date: | 2023 |
| Document Type: | Journal Articles Reports - Descriptive |
| Descriptors: | Sign Language, Artificial Intelligence, Communication (Thought Transfer), Deafness, Cognitive Ability, Imagery, Information Technology, Technology Uses in Education, Foreign Countries |
| Geographic Terms: | India |
| DOI: | 10.1007/s10639-022-11391-z |
| ISSN: | 1360-2357 1573-7608 |
| Abstract: | Sign language is the natural way of communication of speech and hearing-impaired people. Using Indian Sign Language (ISL) interpretation system, hearing impaired people may interact with normal people with the help of Human Computer Interaction (HCI). This paper presents a method for automatic recognition of two-handed signs of Indian Sign language (ISL). The three phases of this work include preprocessing, feature extraction and classification. We trained a BPN with Histogram Oriented Gradient (HOG) features. The trained model is used for testing the real time gestures. The overall accuracy achieved was 89.5% with 5184 input features and 50 hidden neurons. A deep learning approach was also implemented using AlexNet, GoogleNet, VGG-16 and VGG-19 which gave accuracies of 99.11%, 95.84%, 98.42% and 99.11% respectively. MATLAB is used as the simulation platform. The proposed technology is used as a teaching assistant for specially abled persons and has demonstrated an increase in cognitive ability of 60-70% in children. This system demonstrates image processing and machine learning approaches to recognize alphabets from the Indian sign language, which can be used as an ICT (information and communication technology) tool to enhance their cognitive capability. |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | EJ1377509 |
| Database: | ERIC |
| Abstract: | Sign language is the natural way of communication of speech and hearing-impaired people. Using Indian Sign Language (ISL) interpretation system, hearing impaired people may interact with normal people with the help of Human Computer Interaction (HCI). This paper presents a method for automatic recognition of two-handed signs of Indian Sign language (ISL). The three phases of this work include preprocessing, feature extraction and classification. We trained a BPN with Histogram Oriented Gradient (HOG) features. The trained model is used for testing the real time gestures. The overall accuracy achieved was 89.5% with 5184 input features and 50 hidden neurons. A deep learning approach was also implemented using AlexNet, GoogleNet, VGG-16 and VGG-19 which gave accuracies of 99.11%, 95.84%, 98.42% and 99.11% respectively. MATLAB is used as the simulation platform. The proposed technology is used as a teaching assistant for specially abled persons and has demonstrated an increase in cognitive ability of 60-70% in children. This system demonstrates image processing and machine learning approaches to recognize alphabets from the Indian sign language, which can be used as an ICT (information and communication technology) tool to enhance their cognitive capability. |
|---|---|
| ISSN: | 1360-2357 1573-7608 |
| DOI: | 10.1007/s10639-022-11391-z |
