View in EDS

Sign Language Recognition Using Artificial Intelligence

Saved in:
Bibliographic Details
Title: Sign Language Recognition Using Artificial Intelligence
Language: English
Authors: Sreemathy, R., Turuk, Mousami, Kulkarni, Isha, Khurana, Soumya
Source: Education and Information Technologies. May 2023 28(5):5259-5278.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 20
Publication Date: 2023
Document Type: Journal Articles
Reports - Descriptive
Descriptors: Sign Language, Artificial Intelligence, Communication (Thought Transfer), Deafness, Cognitive Ability, Imagery, Information Technology, Technology Uses in Education, Foreign Countries
Geographic Terms: India
DOI: 10.1007/s10639-022-11391-z
ISSN: 1360-2357
1573-7608
Abstract: Sign language is the natural way of communication of speech and hearing-impaired people. Using Indian Sign Language (ISL) interpretation system, hearing impaired people may interact with normal people with the help of Human Computer Interaction (HCI). This paper presents a method for automatic recognition of two-handed signs of Indian Sign language (ISL). The three phases of this work include preprocessing, feature extraction and classification. We trained a BPN with Histogram Oriented Gradient (HOG) features. The trained model is used for testing the real time gestures. The overall accuracy achieved was 89.5% with 5184 input features and 50 hidden neurons. A deep learning approach was also implemented using AlexNet, GoogleNet, VGG-16 and VGG-19 which gave accuracies of 99.11%, 95.84%, 98.42% and 99.11% respectively. MATLAB is used as the simulation platform. The proposed technology is used as a teaching assistant for specially abled persons and has demonstrated an increase in cognitive ability of 60-70% in children. This system demonstrates image processing and machine learning approaches to recognize alphabets from the Indian sign language, which can be used as an ICT (information and communication technology) tool to enhance their cognitive capability.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1377509
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1377509
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Sign Language Recognition Using Artificial Intelligence
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sreemathy%2C+R%2E%22">Sreemathy, R.</searchLink><br /><searchLink fieldCode="AR" term="%22Turuk%2C+Mousami%22">Turuk, Mousami</searchLink><br /><searchLink fieldCode="AR" term="%22Kulkarni%2C+Isha%22">Kulkarni, Isha</searchLink><br /><searchLink fieldCode="AR" term="%22Khurana%2C+Soumya%22">Khurana, Soumya</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Education+and+Information+Technologies%22"><i>Education and Information Technologies</i></searchLink>. May 2023 28(5):5259-5278.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 20
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Descriptive
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Sign+Language%22">Sign Language</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Communication+%28Thought+Transfer%29%22">Communication (Thought Transfer)</searchLink><br /><searchLink fieldCode="DE" term="%22Deafness%22">Deafness</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Ability%22">Cognitive Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Imagery%22">Imagery</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Technology%22">Information Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22India%22">India</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s10639-022-11391-z
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1360-2357<br />1573-7608
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Sign language is the natural way of communication of speech and hearing-impaired people. Using Indian Sign Language (ISL) interpretation system, hearing impaired people may interact with normal people with the help of Human Computer Interaction (HCI). This paper presents a method for automatic recognition of two-handed signs of Indian Sign language (ISL). The three phases of this work include preprocessing, feature extraction and classification. We trained a BPN with Histogram Oriented Gradient (HOG) features. The trained model is used for testing the real time gestures. The overall accuracy achieved was 89.5% with 5184 input features and 50 hidden neurons. A deep learning approach was also implemented using AlexNet, GoogleNet, VGG-16 and VGG-19 which gave accuracies of 99.11%, 95.84%, 98.42% and 99.11% respectively. MATLAB is used as the simulation platform. The proposed technology is used as a teaching assistant for specially abled persons and has demonstrated an increase in cognitive ability of 60-70% in children. This system demonstrates image processing and machine learning approaches to recognize alphabets from the Indian sign language, which can be used as an ICT (information and communication technology) tool to enhance their cognitive capability.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1377509
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1377509
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10639-022-11391-z
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 5259
    Subjects:
      – SubjectFull: Sign Language
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Communication (Thought Transfer)
        Type: general
      – SubjectFull: Deafness
        Type: general
      – SubjectFull: Cognitive Ability
        Type: general
      – SubjectFull: Imagery
        Type: general
      – SubjectFull: Information Technology
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: India
        Type: general
    Titles:
      – TitleFull: Sign Language Recognition Using Artificial Intelligence
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sreemathy, R.
      – PersonEntity:
          Name:
            NameFull: Turuk, Mousami
      – PersonEntity:
          Name:
            NameFull: Kulkarni, Isha
      – PersonEntity:
          Name:
            NameFull: Khurana, Soumya
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 1360-2357
            – Type: issn-electronic
              Value: 1573-7608
          Numbering:
            – Type: volume
              Value: 28
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Education and Information Technologies
              Type: main
ResultId 1