Human-Level Natural Language Understanding: False Progress and Real Challenges

Saved in:
Bibliographic Details
Title: Human-Level Natural Language Understanding: False Progress and Real Challenges
Language: English
Authors: Bignoli, Perrin G.
Source: ProQuest LLC. 2013Ph.D. Dissertation, Rensselaer Polytechnic Institute.
Availability: ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Peer Reviewed: N
Page Count: 426
Publication Date: 2013
Document Type: Dissertations/Theses - Doctoral Dissertations
Descriptors: Natural Language Processing, Syntax, Semantics, Pragmatics, Language Proficiency, Computer Software, Corporations, Computational Linguistics, Task Analysis, Evaluation Methods
ISBN: 978-1-303-75727-3
Abstract: The field of Natural Language Processing (NLP) focuses on the study of how utterances composed of human-level languages can be understood and generated. Typically, there are considered to be three intertwined levels of structure that interact to create meaning in language: syntax, semantics, and pragmatics. Not only is a large amount of language-specific information required to learn syntactic patterns and semantic constructions, but also an even vaster amount of commonsense and world knowledge is required to interpret language at the pragmatic level. Because the task of creating a system that is fully capable of processing language at the human level of proficiency is extremely daunting, researchers have mostly focused on developing constrained models of specific aspects of NLP, such as Part-of-Speech tagging or named entity resolution. However, a number of more comprehensive NLP platforms, produced by companies such as IBM, Google, Microsoft, and Apple have taken on the task of providing fully functional, natural-language-driven services. Based on the level of success reported by researchers, as well as from the advertisement campaigns of companies that deal with NLP technology, it would seem that the NLP problem is well on its way to being solved by the techniques currently employed by the field. Currently, knowledge-lean, statistical, machine-learning like approaches dominate the NLP research arena. These approaches have largely displaced earlier knowledge-rich, expert-system like approaches, because of their increased flexibility and robustness. Because NLP is widely considered to be an "AI-hard" problem, the resolution of the challenges of making a human-level NLP system would have huge implications for both Cognitive Science and AI in general. Unfortunately, it turns out that much of the present optimism in the NLP field is essentially hyperbole. An in depth analysis of knowledge-lean NLP techniques will demonstrate that they are significantly underpowered for handling tasks such as basic syntactic parsing, let alone full natural language understanding. To make matters worse, the NLP field has been led down this path in large part due to the kinds of evaluation methods used to gauge success on individual NLP tasks. Once these metrics are analyzed, it is straightforward to see how they can create confusion and misleading results. In light of these findings, it is the intent of this document to demonstrate the case for modifying the current knowledge-lean NLP culture with techniques that are derived from Cognitive Science. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Abstractor: As Provided
Entry Date: 2016
Access URL: https://gateway.proquest.com/openurl?url_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation&res_dat=xri:pqm&rft_dat=xri:pqdiss:3613268
Accession Number: ED566331
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: ED566331
AccessLevel: 3
PubType: Dissertation/ Thesis
PubTypeId: dissertation
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Human-Level Natural Language Understanding: False Progress and Real Challenges
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Bignoli%2C+Perrin+G%2E%22">Bignoli, Perrin G.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ProQuest+LLC%22"><i>ProQuest LLC</i></searchLink>. 2013Ph.D. Dissertation, Rensselaer Polytechnic Institute.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 426
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2013
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Dissertations/Theses - Doctoral Dissertations
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Syntax%22">Syntax</searchLink><br /><searchLink fieldCode="DE" term="%22Semantics%22">Semantics</searchLink><br /><searchLink fieldCode="DE" term="%22Pragmatics%22">Pragmatics</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Corporations%22">Corporations</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+Linguistics%22">Computational Linguistics</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink>
– Name: ISBN
  Label: ISBN
  Group: ISBN
  Data: 978-1-303-75727-3
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The field of Natural Language Processing (NLP) focuses on the study of how utterances composed of human-level languages can be understood and generated. Typically, there are considered to be three intertwined levels of structure that interact to create meaning in language: syntax, semantics, and pragmatics. Not only is a large amount of language-specific information required to learn syntactic patterns and semantic constructions, but also an even vaster amount of commonsense and world knowledge is required to interpret language at the pragmatic level. Because the task of creating a system that is fully capable of processing language at the human level of proficiency is extremely daunting, researchers have mostly focused on developing constrained models of specific aspects of NLP, such as Part-of-Speech tagging or named entity resolution. However, a number of more comprehensive NLP platforms, produced by companies such as IBM, Google, Microsoft, and Apple have taken on the task of providing fully functional, natural-language-driven services. Based on the level of success reported by researchers, as well as from the advertisement campaigns of companies that deal with NLP technology, it would seem that the NLP problem is well on its way to being solved by the techniques currently employed by the field. Currently, knowledge-lean, statistical, machine-learning like approaches dominate the NLP research arena. These approaches have largely displaced earlier knowledge-rich, expert-system like approaches, because of their increased flexibility and robustness. Because NLP is widely considered to be an "AI-hard" problem, the resolution of the challenges of making a human-level NLP system would have huge implications for both Cognitive Science and AI in general. Unfortunately, it turns out that much of the present optimism in the NLP field is essentially hyperbole. An in depth analysis of knowledge-lean NLP techniques will demonstrate that they are significantly underpowered for handling tasks such as basic syntactic parsing, let alone full natural language understanding. To make matters worse, the NLP field has been led down this path in large part due to the kinds of evaluation methods used to gauge success on individual NLP tasks. Once these metrics are analyzed, it is straightforward to see how they can create confusion and misleading results. In light of these findings, it is the intent of this document to demonstrate the case for modifying the current knowledge-lean NLP culture with techniques that are derived from Cognitive Science. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2016
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://gateway.proquest.com/openurl?url_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation&res_dat=xri:pqm&rft_dat=xri:pqdiss:3613268" linkWindow="_blank">http://gateway.proquest.com/openurl?url_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation&res_dat=xri:pqm&rft_dat=xri:pqdiss:3613268</link>
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED566331
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED566331
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 426
    Subjects:
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Syntax
        Type: general
      – SubjectFull: Semantics
        Type: general
      – SubjectFull: Pragmatics
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Corporations
        Type: general
      – SubjectFull: Computational Linguistics
        Type: general
      – SubjectFull: Task Analysis
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
    Titles:
      – TitleFull: Human-Level Natural Language Understanding: False Progress and Real Challenges
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bignoli, Perrin G.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2013
          Identifiers:
            – Type: isbn-print
              Value: 978-1-303-75727-3
          Titles:
            – TitleFull: ProQuest LLC
              Type: main
ResultId 1