Learning by Evaluating as an Interview Primer to Inform Design Thinking

Saved in:
Bibliographic Details
Title: Learning by Evaluating as an Interview Primer to Inform Design Thinking
Language: English
Authors: Scott Thorne (ORCID 0000-0002-3742-8903), Nathan Mentzer (ORCID 0000-0001-9788-7901), Scott Bartholomew (ORCID 0000-0002-1680-2433), Greg J. Strimel (ORCID 0000-0002-4847-4526), Jason Ware (ORCID 0000-0003-4615-3451)
Source: International Journal of Technology and Design Education. 2025 35(3):1013-1030.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 18
Publication Date: 2025
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: 2101235
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Design, Teaching Methods, Feedback (Response), Reflection, Critical Thinking, Undergraduate Students, Interviews, Qualitative Research
DOI: 10.1007/s10798-024-09933-2
ISSN: 0957-7572
1573-1804
Abstract: This conceptual replication study, building upon Bartholomew (2020), addresses a notable gap in the literature by investigating the potential of using learning by evaluating (LbE) as an interview primer for individual assignments in design coursework. While peer feedback commonly involves both giving and receiving feedback, LbE uniquely focuses on the benefits of giving feedback to engage students actively in learning, reflection, and critical thinking. In this study, the LbE process is utilized to foster student insights that may be transferred to their own work in the preparation and conducting of qualitative research interviews. Conducted as a quasi-experimental study in an entry-level design thinking course with a large sample of undergraduate students (n = 325) this research explores specific ways that exposure to LbE as an evaluative process enhances students' abilities to perform qualitative research interviews, even without explicit teacher feedback. Findings, consistent with previous studies on LbE, indicate that students exposed to the intervention prepared a higher proportion of open-ended questions in their interview guides, demonstrating improved preparation for each interview. However, the transfer of preparation to performance revealed that certain skills such as asking probing questions and prompting for information, beyond the scope of the preparation of an interview guide, may have contributed to the observation that interview lengths did not significantly improve. Methodologically, this study employed random sampling, and a comparisons of treatment and control group interview guides and interview duration were conducted through independent samples t-tests. The significance of these findings suggest that LbE is an effective pedagogical strategy, specifically for individualized student work, expanding upon findings of previous studies. Educators and researchers may find this exploration of peer feedback through LbE on design thinking and qualitative research interviews to be of particular value as they seek to optimize the impact of peer feedback in enhancing student learning experiences.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1485234
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwGTlEhLFLkaRB1uc82nbYqRAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDMVpmTZZCz5lJEJ6uAIBEICBm7r9qWVgYBQySBkiC4np8LLYc7oof88fiS7Oesd-C8HtQIvWHjiXDZ47dcRaeqzEcDam1s2EyCBe-25QMrAiuOaNtMT7ayRq6Aeou8qElLMhq4vKtUV1RSMisu9Q-y7VxmBwgHIFCCHcmA7gi04ijY7ALj1v9PYFHkAloUVOo_4Q-ye82SglSgat_PkMDxKo2MMTLfOGz_AAxUka
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1485234
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Learning by Evaluating as an Interview Primer to Inform Design Thinking
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Scott+Thorne%22">Scott Thorne</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-3742-8903">0000-0002-3742-8903</externalLink>)<br /><searchLink fieldCode="AR" term="%22Nathan+Mentzer%22">Nathan Mentzer</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0001-9788-7901">0000-0001-9788-7901</externalLink>)<br /><searchLink fieldCode="AR" term="%22Scott+Bartholomew%22">Scott Bartholomew</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-1680-2433">0000-0002-1680-2433</externalLink>)<br /><searchLink fieldCode="AR" term="%22Greg+J%2E+Strimel%22">Greg J. Strimel</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-4847-4526">0000-0002-4847-4526</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jason+Ware%22">Jason Ware</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0003-4615-3451">0000-0003-4615-3451</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Technology+and+Design+Education%22"><i>International Journal of Technology and Design Education</i></searchLink>. 2025 35(3):1013-1030.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2101235
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Design%22">Design</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Reflection%22">Reflection</searchLink><br /><searchLink fieldCode="DE" term="%22Critical+Thinking%22">Critical Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Interviews%22">Interviews</searchLink><br /><searchLink fieldCode="DE" term="%22Qualitative+Research%22">Qualitative Research</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s10798-024-09933-2
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0957-7572<br />1573-1804
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This conceptual replication study, building upon Bartholomew (2020), addresses a notable gap in the literature by investigating the potential of using learning by evaluating (LbE) as an interview primer for individual assignments in design coursework. While peer feedback commonly involves both giving and receiving feedback, LbE uniquely focuses on the benefits of giving feedback to engage students actively in learning, reflection, and critical thinking. In this study, the LbE process is utilized to foster student insights that may be transferred to their own work in the preparation and conducting of qualitative research interviews. Conducted as a quasi-experimental study in an entry-level design thinking course with a large sample of undergraduate students (n = 325) this research explores specific ways that exposure to LbE as an evaluative process enhances students' abilities to perform qualitative research interviews, even without explicit teacher feedback. Findings, consistent with previous studies on LbE, indicate that students exposed to the intervention prepared a higher proportion of open-ended questions in their interview guides, demonstrating improved preparation for each interview. However, the transfer of preparation to performance revealed that certain skills such as asking probing questions and prompting for information, beyond the scope of the preparation of an interview guide, may have contributed to the observation that interview lengths did not significantly improve. Methodologically, this study employed random sampling, and a comparisons of treatment and control group interview guides and interview duration were conducted through independent samples t-tests. The significance of these findings suggest that LbE is an effective pedagogical strategy, specifically for individualized student work, expanding upon findings of previous studies. Educators and researchers may find this exploration of peer feedback through LbE on design thinking and qualitative research interviews to be of particular value as they seek to optimize the impact of peer feedback in enhancing student learning experiences.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1485234
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1485234
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10798-024-09933-2
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 1013
    Subjects:
      – SubjectFull: Design
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Feedback (Response)
        Type: general
      – SubjectFull: Reflection
        Type: general
      – SubjectFull: Critical Thinking
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Interviews
        Type: general
      – SubjectFull: Qualitative Research
        Type: general
    Titles:
      – TitleFull: Learning by Evaluating as an Interview Primer to Inform Design Thinking
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Scott Thorne
      – PersonEntity:
          Name:
            NameFull: Nathan Mentzer
      – PersonEntity:
          Name:
            NameFull: Scott Bartholomew
      – PersonEntity:
          Name:
            NameFull: Greg J. Strimel
      – PersonEntity:
          Name:
            NameFull: Jason Ware
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 0957-7572
            – Type: issn-electronic
              Value: 1573-1804
          Numbering:
            – Type: volume
              Value: 35
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: International Journal of Technology and Design Education
              Type: main
ResultId 1