Understanding Cross-Country Differences in Assessment Simulations: Insights from South African and Canadian Students

Saved in:
Bibliographic Details
Title: Understanding Cross-Country Differences in Assessment Simulations: Insights from South African and Canadian Students
Language: English
Authors: Igor Kotlyar (ORCID 0000-0002-3514-0586), Noel J. Pearse (ORCID 0000-0001-7583-9845), Joe Krasman
Source: Discover Education. 2024 3.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 23
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Foreign Countries, Undergraduate Students, Artificial Intelligence, Computer Simulation, Student Attitudes, Evaluation, Scores, Language Usage, Language Patterns, Intercultural Communication, Cultural Differences, Developed Nations, Developing Institutions
Geographic Terms: South Africa, Canada
DOI: 10.1007/s44217-024-00125-7
ISSN: 2731-5525
Abstract: AI-based simulations for educational and assessment purposes are gaining global recognition. Informed by cultural comparison research, this study investigates cross-country variations in users' utilization and perceptions of a simulation-based assessment. Specifically, we conducted a comparative analysis between a sample of South African and Canadian students to uncover potential differences in assessment scores, communication patterns, and reactions vis-a-vis a simulation assessment for evaluating teamwork skills. Data were collected from over 500 undergraduate students in South Africa and Canada who completed a simulation assessment and reported their reactions and perceptions. The findings yielded several noteworthy observations. First, South African students attained higher assessment scores than Canadian students; although, the difference did not quite reach statistical significance at p < 0.05. Second, significant variations were observed in the quantity and style of communication. South African students used fewer words and more polite language, while Canadian students tended to use more decisive language and provided more explanations and help to their virtual teammates. Third, South African students were more likely to perceive their virtual teammates as "human" and were less concerned whether they were real people or virtual. Lastly, compared with their Canadian counterparts, South African students reported more positive reactions and perceived the assessment to be more accurate. These findings warrant further investigation.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1421867
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1421867
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Understanding Cross-Country Differences in Assessment Simulations: Insights from South African and Canadian Students
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Igor+Kotlyar%22&quot;&gt;Igor Kotlyar&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;http://orcid.org/0000-0002-3514-0586&quot;&gt;0000-0002-3514-0586&lt;/externalLink&gt;)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Noel+J%2E+Pearse%22&quot;&gt;Noel J. Pearse&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;http://orcid.org/0000-0001-7583-9845&quot;&gt;0000-0001-7583-9845&lt;/externalLink&gt;)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Joe+Krasman%22&quot;&gt;Joe Krasman&lt;/searchLink&gt;
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;SO&quot; term=&quot;%22Discover+Education%22&quot;&gt;&lt;i&gt;Discover Education&lt;/i&gt;&lt;/searchLink&gt;. 2024 3.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles&lt;br /&gt;Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: &lt;searchLink fieldCode=&quot;EL&quot; term=&quot;%22Higher+Education%22&quot;&gt;Higher Education&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;EL&quot; term=&quot;%22Postsecondary+Education%22&quot;&gt;Postsecondary Education&lt;/searchLink&gt;
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Foreign+Countries%22&quot;&gt;Foreign Countries&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Undergraduate+Students%22&quot;&gt;Undergraduate Students&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Artificial+Intelligence%22&quot;&gt;Artificial Intelligence&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Computer+Simulation%22&quot;&gt;Computer Simulation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Student+Attitudes%22&quot;&gt;Student Attitudes&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Evaluation%22&quot;&gt;Evaluation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Scores%22&quot;&gt;Scores&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Language+Usage%22&quot;&gt;Language Usage&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Language+Patterns%22&quot;&gt;Language Patterns&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Intercultural+Communication%22&quot;&gt;Intercultural Communication&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Cultural+Differences%22&quot;&gt;Cultural Differences&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Developed+Nations%22&quot;&gt;Developed Nations&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Developing+Institutions%22&quot;&gt;Developing Institutions&lt;/searchLink&gt;
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22South+Africa%22&quot;&gt;South Africa&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Canada%22&quot;&gt;Canada&lt;/searchLink&gt;
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s44217-024-00125-7
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2731-5525
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: AI-based simulations for educational and assessment purposes are gaining global recognition. Informed by cultural comparison research, this study investigates cross-country variations in users&#39; utilization and perceptions of a simulation-based assessment. Specifically, we conducted a comparative analysis between a sample of South African and Canadian students to uncover potential differences in assessment scores, communication patterns, and reactions vis-a-vis a simulation assessment for evaluating teamwork skills. Data were collected from over 500 undergraduate students in South Africa and Canada who completed a simulation assessment and reported their reactions and perceptions. The findings yielded several noteworthy observations. First, South African students attained higher assessment scores than Canadian students; although, the difference did not quite reach statistical significance at p &lt; 0.05. Second, significant variations were observed in the quantity and style of communication. South African students used fewer words and more polite language, while Canadian students tended to use more decisive language and provided more explanations and help to their virtual teammates. Third, South African students were more likely to perceive their virtual teammates as &quot;human&quot; and were less concerned whether they were real people or virtual. Lastly, compared with their Canadian counterparts, South African students reported more positive reactions and perceived the assessment to be more accurate. These findings warrant further investigation.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1421867
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1421867
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s44217-024-00125-7
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
    Subjects:
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Computer Simulation
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Evaluation
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Language Usage
        Type: general
      – SubjectFull: Language Patterns
        Type: general
      – SubjectFull: Intercultural Communication
        Type: general
      – SubjectFull: Cultural Differences
        Type: general
      – SubjectFull: Developed Nations
        Type: general
      – SubjectFull: Developing Institutions
        Type: general
      – SubjectFull: South Africa
        Type: general
      – SubjectFull: Canada
        Type: general
    Titles:
      – TitleFull: Understanding Cross-Country Differences in Assessment Simulations: Insights from South African and Canadian Students
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Igor Kotlyar
      – PersonEntity:
          Name:
            NameFull: Noel J. Pearse
      – PersonEntity:
          Name:
            NameFull: Joe Krasman
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 2731-5525
          Numbering:
            – Type: volume
              Value: 3
          Titles:
            – TitleFull: Discover Education
              Type: main
ResultId 1