Measuring the amorphous: Substantive and methodological outcomes from concept maps.
Saved in:
| Title: | Measuring the amorphous: Substantive and methodological outcomes from concept maps. |
|---|---|
| Authors: | Foley, Rider W.1 (AUTHOR) rider@virginia.edu, Ferguson, Sean M.1 (AUTHOR) smf6v@virginia.edu, Pollack, Catherine C.2,3 (AUTHOR) catherine.c.pollack.gr@dartmouth.edu |
| Source: | Journal of Engineering Education. Jan2021, Vol. 110 Issue 1, p161-183. 23p. |
| Subject Terms: | *Concept mapping, *Engineering students, *Undergraduates, *Focus groups, Engineering ethics |
| Abstract: | Background: Accreditation organizations broadened program assessment criteria in ways that present challenges for the evaluation of learning outcomes. This is especially the case in courses where there are not narrowly defined questions or definitive solutions, such as engineering ethics. While protocols for learning assessment exist, there is limited research exploring sociotechnical learning outcomes in a manner that combines theoretical, empirical, and procedural aspects of assessment. Purpose/Hypothesis: This paper shares 3 years of research into the effectiveness of concept maps as an assessment tool for engineering students in courses that prioritize professional skills development and sociotechnical thinking. We show that concept maps can offer evidence of knowledge formation and learning outcomes associated with courses that introduce complex problems with multiple possible interpretations or viable solutions. Design/Method: A concept mapping activity was completed by 614 undergraduate engineering students at the start and end of three different courses to evaluate sociotechnical thinking. Student‐level longitudinal changes were evaluated using paired t tests and simple linear regression. The concept mapping activity was improved iteratively in response to pilot tests and focus groups. Results: Undergraduate engineers demonstrated greater complexity in the representation of sociotechnical relationships as observed in the structure and content of the concept maps. The methodological results offer lessons about the administration and analysis of concept maps often excluded from conversations on course and curriculum level assessment. Conclusions: Concept maps offer insights into student learning outcomes, and they can be deployed and analyzed with minimal resources. However, assessments must be carefully designed to account for administrative and analytical challenges. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Engineering Education is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 148778237 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Measuring the amorphous: Substantive and methodological outcomes from concept maps. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Foley%2C+Rider+W%2E%22">Foley, Rider W.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> rider@virginia.edu</i><br /><searchLink fieldCode="AR" term="%22Ferguson%2C+Sean+M%2E%22">Ferguson, Sean M.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> smf6v@virginia.edu</i><br /><searchLink fieldCode="AR" term="%22Pollack%2C+Catherine+C%2E%22">Pollack, Catherine C.</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<i> catherine.c.pollack.gr@dartmouth.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Engineering+Education%22">Journal of Engineering Education</searchLink>. Jan2021, Vol. 110 Issue 1, p161-183. 23p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Concept+mapping%22">Concept mapping</searchLink><br />*<searchLink fieldCode="DE" term="%22Engineering+students%22">Engineering students</searchLink><br />*<searchLink fieldCode="DE" term="%22Undergraduates%22">Undergraduates</searchLink><br />*<searchLink fieldCode="DE" term="%22Focus+groups%22">Focus groups</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering+ethics%22">Engineering ethics</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Background: Accreditation organizations broadened program assessment criteria in ways that present challenges for the evaluation of learning outcomes. This is especially the case in courses where there are not narrowly defined questions or definitive solutions, such as engineering ethics. While protocols for learning assessment exist, there is limited research exploring sociotechnical learning outcomes in a manner that combines theoretical, empirical, and procedural aspects of assessment. Purpose/Hypothesis: This paper shares 3 years of research into the effectiveness of concept maps as an assessment tool for engineering students in courses that prioritize professional skills development and sociotechnical thinking. We show that concept maps can offer evidence of knowledge formation and learning outcomes associated with courses that introduce complex problems with multiple possible interpretations or viable solutions. Design/Method: A concept mapping activity was completed by 614 undergraduate engineering students at the start and end of three different courses to evaluate sociotechnical thinking. Student‐level longitudinal changes were evaluated using paired t tests and simple linear regression. The concept mapping activity was improved iteratively in response to pilot tests and focus groups. Results: Undergraduate engineers demonstrated greater complexity in the representation of sociotechnical relationships as observed in the structure and content of the concept maps. The methodological results offer lessons about the administration and analysis of concept maps often excluded from conversations on course and curriculum level assessment. Conclusions: Concept maps offer insights into student learning outcomes, and they can be deployed and analyzed with minimal resources. However, assessments must be carefully designed to account for administrative and analytical challenges. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Engineering Education is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=148778237 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/jee.20373 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 23 StartPage: 161 Subjects: – SubjectFull: Concept mapping Type: general – SubjectFull: Engineering students Type: general – SubjectFull: Undergraduates Type: general – SubjectFull: Focus groups Type: general – SubjectFull: Engineering ethics Type: general Titles: – TitleFull: Measuring the amorphous: Substantive and methodological outcomes from concept maps. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Foley, Rider W. – PersonEntity: Name: NameFull: Ferguson, Sean M. – PersonEntity: Name: NameFull: Pollack, Catherine C. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Text: Jan2021 Type: published Y: 2021 Identifiers: – Type: issn-print Value: 10694730 Numbering: – Type: volume Value: 110 – Type: issue Value: 1 Titles: – TitleFull: Journal of Engineering Education Type: main |
| ResultId | 1 |
