Shaping University Teaching towards Measurement for Accountability: Problems of the Graduate Skills Assessment Test

Saved in:
Bibliographic Details
Title: Shaping University Teaching towards Measurement for Accountability: Problems of the Graduate Skills Assessment Test
Language: English
Authors: Chanock, Kate, Clerehan, Rosemary, Moore, Tim, Prince, Anne
Source: Australian Universities' Review. 2004 47(1):22-29.
Availability: National Tertiary Education Union. PO Box 1323, South Melbourne 3205, Australia. Tel: +61-3-92541910; Fax: +61-3-92541915; e-mail: editor@aur.org.au; Web site: http://www.aur.org.au
Peer Reviewed: Y
Page Count: 8
Publication Date: 2004
Document Type: Journal Articles
Reports - Evaluative
Education Level: Higher Education
Descriptors: Higher Education, Educational Research, Graduates, Foreign Countries, Politics of Education, Teaching Methods, Accountability, Interpersonal Competence
Geographic Terms: Australia
ISSN: 0818-8068
Abstract: Over the last decade, in both Australia and Britain, universities have been under increasing pressure to make themselves accountable for the extent to which they cultivate in their students transferable skills and "attributes" that will prepare them for the rapidly-changing world of employment. The Government's "Striving for Quality" document begins by pointing out that "Australia is actively positioning itself within an international "knowledge-based economy," which has placed new demands on higher education." The Government has questioned the effectiveness of higher education in this regard, in view of the Nielsen survey on employer satisfaction with graduates conducted in 2000. Here, employers reported that graduates often had weaknesses in the areas of "creativity and flair"; oral (and, to a lesser extent, written) communication; "interpersonal skills"; and "understanding of business practice." Much consideration has been given to the question of what role universities should play in the preparation for work; and, concomitantly, to ways of measuring the outcome of their efforts. This article looks at a testing instrument commissioned by the Department of Education, Science and Training (DEST) and developed by the Australian Council for Educational Research (ACER). This "Graduate Skills Assessment" (GSA) Test is still at a pilot stage, but the Government has shown some interest in it as a method of quality assurance, and appears to be leaving it open as a policy option in the future. It is timely therefore to look closely at what this test promises and how it works. On its website, ACER has made available a sample set of questions representing the types of questions that might be asked in any iteration of the GSA. It has also posted an example of the assessment report that candidates receive, showing them their score, how it compares to "the distribution of the results for the middle 60% of students from fields of study similar to [theirs]," and what the scores at each level indicate about the candidate's skills in each category. In this article, the authors quote from the sample questions, and from the descriptions of what ACER says can be inferred about a candidate who scores at Level 3 (the highest level). The authors consider to what extent particular sample questions seem able to test what they purport to test, at the level at which they claim to test it. The authors comment only on the ones that are publicly available.
Abstractor: ERIC
Number of References: 22
Entry Date: 2009
Accession Number: EJ848184
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ848184
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ848184
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Shaping University Teaching towards Measurement for Accountability: Problems of the Graduate Skills Assessment Test
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Chanock%2C+Kate%22">Chanock, Kate</searchLink><br /><searchLink fieldCode="AR" term="%22Clerehan%2C+Rosemary%22">Clerehan, Rosemary</searchLink><br /><searchLink fieldCode="AR" term="%22Moore%2C+Tim%22">Moore, Tim</searchLink><br /><searchLink fieldCode="AR" term="%22Prince%2C+Anne%22">Prince, Anne</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Australian+Universities'+Review%22"><i>Australian Universities' Review</i></searchLink>. 2004 47(1):22-29.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: National Tertiary Education Union. PO Box 1323, South Melbourne 3205, Australia. Tel: +61-3-92541910; Fax: +61-3-92541915; e-mail: editor@aur.org.au; Web site: http://www.aur.org.au
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 8
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2004
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Graduates%22">Graduates</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Politics+of+Education%22">Politics of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Accountability%22">Accountability</searchLink><br /><searchLink fieldCode="DE" term="%22Interpersonal+Competence%22">Interpersonal Competence</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Australia%22">Australia</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0818-8068
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Over the last decade, in both Australia and Britain, universities have been under increasing pressure to make themselves accountable for the extent to which they cultivate in their students transferable skills and "attributes" that will prepare them for the rapidly-changing world of employment. The Government's "Striving for Quality" document begins by pointing out that "Australia is actively positioning itself within an international "knowledge-based economy," which has placed new demands on higher education." The Government has questioned the effectiveness of higher education in this regard, in view of the Nielsen survey on employer satisfaction with graduates conducted in 2000. Here, employers reported that graduates often had weaknesses in the areas of "creativity and flair"; oral (and, to a lesser extent, written) communication; "interpersonal skills"; and "understanding of business practice." Much consideration has been given to the question of what role universities should play in the preparation for work; and, concomitantly, to ways of measuring the outcome of their efforts. This article looks at a testing instrument commissioned by the Department of Education, Science and Training (DEST) and developed by the Australian Council for Educational Research (ACER). This "Graduate Skills Assessment" (GSA) Test is still at a pilot stage, but the Government has shown some interest in it as a method of quality assurance, and appears to be leaving it open as a policy option in the future. It is timely therefore to look closely at what this test promises and how it works. On its website, ACER has made available a sample set of questions representing the types of questions that might be asked in any iteration of the GSA. It has also posted an example of the assessment report that candidates receive, showing them their score, how it compares to "the distribution of the results for the middle 60% of students from fields of study similar to [theirs]," and what the scores at each level indicate about the candidate's skills in each category. In this article, the authors quote from the sample questions, and from the descriptions of what ACER says can be inferred about a candidate who scores at Level 3 (the highest level). The authors consider to what extent particular sample questions seem able to test what they purport to test, at the level at which they claim to test it. The authors comment only on the ones that are publicly available.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 22
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2009
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ848184
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ848184
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 8
        StartPage: 22
    Subjects:
      – SubjectFull: Higher Education
        Type: general
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Graduates
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Politics of Education
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Accountability
        Type: general
      – SubjectFull: Interpersonal Competence
        Type: general
      – SubjectFull: Australia
        Type: general
    Titles:
      – TitleFull: Shaping University Teaching towards Measurement for Accountability: Problems of the Graduate Skills Assessment Test
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Chanock, Kate
      – PersonEntity:
          Name:
            NameFull: Clerehan, Rosemary
      – PersonEntity:
          Name:
            NameFull: Moore, Tim
      – PersonEntity:
          Name:
            NameFull: Prince, Anne
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2004
          Identifiers:
            – Type: issn-print
              Value: 0818-8068
          Numbering:
            – Type: volume
              Value: 47
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Australian Universities' Review
              Type: main
ResultId 1