Novice Perceptions on Effective Elements of PostgreSQL Error Messages

Saved in:
Bibliographic Details
Title: Novice Perceptions on Effective Elements of PostgreSQL Error Messages
Language: English
Authors: Toni Taipalus (ORCID 0000-0003-4060-3431), Hilkka Grahn (ORCID 0000-0001-7567-7807), Saima Ritonummi (ORCID 0000-0001-6708-7639), Valtteri Siitonen (ORCID 0000-0001-7610-4584), Tero Vartiainen (ORCID 0000-0003-3843-8561), Denis Zhidkikh (ORCID 0000-0003-1335-8346)
Source: ACM Transactions on Computing Education. 2025 25(2).
Availability: Association for Computing Machinery. 1601 Broadway 10th Floor, New York, NY 10119. Tel: 800-342-6626; Tel: 212-626-0500; Fax: 212-944-1318; e-mail: acmhelp@acm.org; Web site: http://toce.acm.org/
Peer Reviewed: Y
Page Count: 19
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Computer Science Education, Novices, Information Systems, Programming Languages, Feedback (Response), Syntax, Error Patterns, Natural Language Processing, Computer Mediated Communication, Troubleshooting, Undergraduate Students, Foreign Countries
Geographic Terms: Finland
DOI: 10.1145/3732790
ISSN: 1946-6226
Abstract: SQL compiler error messages are the primary way users receive feedback when they encounter syntax errors or other issues in their SQL queries. Effective error messages can enhance the user experience by providing clear, informative, and actionable feedback. Despite the age of SQL compilers, it still remains largely unclear what contributes to an effective SQL error message. With 2,052 answers yielded by 165 participants for qualitative analysis, this study is an attempt to understand what novices perceive as effective elements in SQL error messages. The results uniformly indicate that communicating the precise error position, articulating what is wrong in the query with clear natural language, and showing hints on how to fix the error are perceived as the most effective elements for error recovery. These insights have potential to be utilized in providing more effective error messages in SQL compilers and SQL learning environments, and for guiding generative AI for enhanced error messages in order to minimize frustration caused by cryptic error messages, improving learning and adoption, and reducing debugging time.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1476240
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1476240
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Novice Perceptions on Effective Elements of PostgreSQL Error Messages
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Toni+Taipalus%22">Toni Taipalus</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4060-3431">0000-0003-4060-3431</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hilkka+Grahn%22">Hilkka Grahn</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7567-7807">0000-0001-7567-7807</externalLink>)<br /><searchLink fieldCode="AR" term="%22Saima+Ritonummi%22">Saima Ritonummi</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6708-7639">0000-0001-6708-7639</externalLink>)<br /><searchLink fieldCode="AR" term="%22Valtteri+Siitonen%22">Valtteri Siitonen</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7610-4584">0000-0001-7610-4584</externalLink>)<br /><searchLink fieldCode="AR" term="%22Tero+Vartiainen%22">Tero Vartiainen</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3843-8561">0000-0003-3843-8561</externalLink>)<br /><searchLink fieldCode="AR" term="%22Denis+Zhidkikh%22">Denis Zhidkikh</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1335-8346">0000-0003-1335-8346</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ACM+Transactions+on+Computing+Education%22"><i>ACM Transactions on Computing Education</i></searchLink>. 2025 25(2).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Association for Computing Machinery. 1601 Broadway 10th Floor, New York, NY 10119. Tel: 800-342-6626; Tel: 212-626-0500; Fax: 212-944-1318; e-mail: acmhelp@acm.org; Web site: http://toce.acm.org/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 19
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+Education%22">Computer Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Novices%22">Novices</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Systems%22">Information Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Programming+Languages%22">Programming Languages</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Syntax%22">Syntax</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Mediated+Communication%22">Computer Mediated Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Troubleshooting%22">Troubleshooting</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Finland%22">Finland</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1145/3732790
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1946-6226
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: SQL compiler error messages are the primary way users receive feedback when they encounter syntax errors or other issues in their SQL queries. Effective error messages can enhance the user experience by providing clear, informative, and actionable feedback. Despite the age of SQL compilers, it still remains largely unclear what contributes to an effective SQL error message. With 2,052 answers yielded by 165 participants for qualitative analysis, this study is an attempt to understand what novices perceive as effective elements in SQL error messages. The results uniformly indicate that communicating the precise error position, articulating what is wrong in the query with clear natural language, and showing hints on how to fix the error are perceived as the most effective elements for error recovery. These insights have potential to be utilized in providing more effective error messages in SQL compilers and SQL learning environments, and for guiding generative AI for enhanced error messages in order to minimize frustration caused by cryptic error messages, improving learning and adoption, and reducing debugging time.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1476240
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1476240
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1145/3732790
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
    Subjects:
      – SubjectFull: Computer Science Education
        Type: general
      – SubjectFull: Novices
        Type: general
      – SubjectFull: Information Systems
        Type: general
      – SubjectFull: Programming Languages
        Type: general
      – SubjectFull: Feedback (Response)
        Type: general
      – SubjectFull: Syntax
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Computer Mediated Communication
        Type: general
      – SubjectFull: Troubleshooting
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Finland
        Type: general
    Titles:
      – TitleFull: Novice Perceptions on Effective Elements of PostgreSQL Error Messages
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Toni Taipalus
      – PersonEntity:
          Name:
            NameFull: Hilkka Grahn
      – PersonEntity:
          Name:
            NameFull: Saima Ritonummi
      – PersonEntity:
          Name:
            NameFull: Valtteri Siitonen
      – PersonEntity:
          Name:
            NameFull: Tero Vartiainen
      – PersonEntity:
          Name:
            NameFull: Denis Zhidkikh
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 1946-6226
          Numbering:
            – Type: volume
              Value: 25
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: ACM Transactions on Computing Education
              Type: main
ResultId 1