View in EDS

Different paths, same destination? Comparison of two approaches to developing situational judgment tests for cross‐cultural competence.

Saved in:
Bibliographic Details
Title: Different paths, same destination? Comparison of two approaches to developing situational judgment tests for cross‐cultural competence.
Authors: Chen, Xiaowen, Burns, Gary N.
Source: Applied Psychology: An International Review. Aug2025, Vol. 74 Issue 4, p1-28. 28p.
Subjects: Self-evaluation, Satisfaction, Cultural competence, Educational tests & measurements, Psychological adaptation, Descriptive statistics, Experimental design, Work sampling, Psychometrics, Test validity, Judgment (Psychology), Psychological tests, Employee reviews, Comparative studies, Reliability (Personality trait), Cultural pluralism
Geographic Terms: United States
Abstract: Assessing cross‐cultural competence (3C) remains a challenge, as traditional self‐report measures often fail to capture the complexity of intercultural interactions and are vulnerable to validity concerns. Situational judgment tests (SJTs) offer a promising alternative by simulating real‐world decision‐making in intercultural contexts. This study develops and evaluates two distinct SJTs via two item development methods, work‐sampling and construct‐based, in measuring 3C. Using a within‐person design, we examine their psychometric properties, including reliability, internal structure, face validity, susceptibility to social desirability bias, and criterion validity. Both SJTs demonstrate acceptable reliability and correlations with a self‐report 3C measure, overseas life satisfaction, and sociocultural adaptation. However, the construct‐based SJT appears more susceptible to social desirability and has lower face validity compared to the work‐sampling SJT. Only the work‐sampling SJT explained peer‐rated multicultural team performance. We contribute to the refinement of 3C assessment by developing the SJTs that could serve as viable alternatives to self‐report scales. Our findings also suggest that work sampling SJTs may offer certain advantages over construct‐based SJTs in measuring 3C. [ABSTRACT FROM AUTHOR]
Copyright of Applied Psychology: An International Review is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 187526957
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Different paths, same destination? Comparison of two approaches to developing situational judgment tests for cross‐cultural competence.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Chen%2C+Xiaowen%22">Chen, Xiaowen</searchLink><br /><searchLink fieldCode="AR" term="%22Burns%2C+Gary+N%2E%22">Burns, Gary N.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Applied+Psychology%3A+An+International+Review%22">Applied Psychology: An International Review</searchLink>. Aug2025, Vol. 74 Issue 4, p1-28. 28p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Self-evaluation%22">Self-evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Satisfaction%22">Satisfaction</searchLink><br /><searchLink fieldCode="DE" term="%22Cultural+competence%22">Cultural competence</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+tests+%26+measurements%22">Educational tests & measurements</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+adaptation%22">Psychological adaptation</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink><br /><searchLink fieldCode="DE" term="%22Work+sampling%22">Work sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br /><searchLink fieldCode="DE" term="%22Judgment+%28Psychology%29%22">Judgment (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+tests%22">Psychological tests</searchLink><br /><searchLink fieldCode="DE" term="%22Employee+reviews%22">Employee reviews</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+studies%22">Comparative studies</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability+%28Personality+trait%29%22">Reliability (Personality trait)</searchLink><br /><searchLink fieldCode="DE" term="%22Cultural+pluralism%22">Cultural pluralism</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22United+States%22">United States</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Assessing cross‐cultural competence (3C) remains a challenge, as traditional self‐report measures often fail to capture the complexity of intercultural interactions and are vulnerable to validity concerns. Situational judgment tests (SJTs) offer a promising alternative by simulating real‐world decision‐making in intercultural contexts. This study develops and evaluates two distinct SJTs via two item development methods, work‐sampling and construct‐based, in measuring 3C. Using a within‐person design, we examine their psychometric properties, including reliability, internal structure, face validity, susceptibility to social desirability bias, and criterion validity. Both SJTs demonstrate acceptable reliability and correlations with a self‐report 3C measure, overseas life satisfaction, and sociocultural adaptation. However, the construct‐based SJT appears more susceptible to social desirability and has lower face validity compared to the work‐sampling SJT. Only the work‐sampling SJT explained peer‐rated multicultural team performance. We contribute to the refinement of 3C assessment by developing the SJTs that could serve as viable alternatives to self‐report scales. Our findings also suggest that work sampling SJTs may offer certain advantages over construct‐based SJTs in measuring 3C. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Applied Psychology: An International Review is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=187526957
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/apps.70024
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 28
        StartPage: 1
    Subjects:
      – SubjectFull: Self-evaluation
        Type: general
      – SubjectFull: Satisfaction
        Type: general
      – SubjectFull: Cultural competence
        Type: general
      – SubjectFull: Educational tests & measurements
        Type: general
      – SubjectFull: Psychological adaptation
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Experimental design
        Type: general
      – SubjectFull: Work sampling
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Test validity
        Type: general
      – SubjectFull: Judgment (Psychology)
        Type: general
      – SubjectFull: Psychological tests
        Type: general
      – SubjectFull: Employee reviews
        Type: general
      – SubjectFull: Comparative studies
        Type: general
      – SubjectFull: Reliability (Personality trait)
        Type: general
      – SubjectFull: Cultural pluralism
        Type: general
      – SubjectFull: United States
        Type: general
    Titles:
      – TitleFull: Different paths, same destination? Comparison of two approaches to developing situational judgment tests for cross‐cultural competence.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Chen, Xiaowen
      – PersonEntity:
          Name:
            NameFull: Burns, Gary N.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Text: Aug2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 0269994X
          Numbering:
            – Type: volume
              Value: 74
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Applied Psychology: An International Review
              Type: main
ResultId 1