View in EDS

Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement

Saved in:
Bibliographic Details
Title: Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement
Language: English
Authors: Hatcher, Tim, Colton, Sharon
Source: Journal of European Industrial Training. 2007 31(7):570-587.
Availability: Emerald. 875 Massachusetts Avenue 7th Floor, Cambridge, MA 02139. Tel: 888-622-0075; Fax: 617-354-6875; e-mail: america@emeraldinsight.com; Web site: http://www.emeraldinsight.com
Peer Reviewed: Y
Physical Description: PDF
Page Count: 18
Publication Date: 2007
Document Type: Journal Articles
Reports - Research
Education Level: Adult Education
Descriptors: Delphi Technique, Readability, Research Methodology, Content Validity, Human Resources, Interrater Reliability, Field Tests, Adult Learning, Internet, Teaching Methods, Labor Force Development, Evaluation Methods, Training Methods
DOI: 10.1108/03090590710820060
ISSN: 0309-0590
Abstract: Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an excellent tool in establishing content validity for an HRD-related construct, e.g. adult learning principles. A review of related literature revealed no existing research that used a web-based Delphi technique to validate measurements used in training and development (T&D) or HRD. Design/methodology/approach: Research methods included: a thorough review of the literature to construct an item pool of adult learning principles and instructional methods, and a Delphi expert panel consensus. The mean, mode, standard deviation, interquartile range, and skewness of the data were calculated from the voting procedures for determination of consensus. Evidence of reliability was indicated by the interrater reliability coefficient from a field test. In addition, the Gunning FOG Index for readability was calculated to improve the readability of the instrument. Findings: To address the first research question the authors suggest that a valid instrument can be developed by a diverse Delphi expert panel that measures the application of adult learning principles to fully-mediated world wide web-based training. The second research question was answered by illustrating that the internet can assist a group of diverse and geographically dispersed subject-matter experts in establishing a content valid measurement of instructional methods and techniques that demonstrate the application of adult learning principles to fully-mediated web-based training. And, finally, the paper concludes that a Delphi process can be established as a web-based method to validate research measures. Practical implications: This research helps to address the critical issue of how research is used in practice. Reasons why this research lends itself more to practice than other HRD research using more common qualitative or quantitative methods include: it is a relatively simple procedure requiring less than expert-level skills; the Delphi uses expert opinion that is commonly used in training and development practice; and results are easy to interpret and practical. Originality/value: This research is unique in its approach to developing a content valid instrument using state-of-the-art technology coupled with a updated Delphi method. It is valuable to HRD and other professionals and researchers interested in developing valid measures across cultures and where experts are geographically dispersed. (Contains 1 figure, 4 tables and 1 note.)
Abstractor: As Provided
Number of References: 35
Entry Date: 2008
Accession Number: EJ801498
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ801498
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hatcher%2C+Tim%22">Hatcher, Tim</searchLink><br /><searchLink fieldCode="AR" term="%22Colton%2C+Sharon%22">Colton, Sharon</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+European+Industrial+Training%22"><i>Journal of European Industrial Training</i></searchLink>. 2007 31(7):570-587.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Emerald. 875 Massachusetts Avenue 7th Floor, Cambridge, MA 02139. Tel: 888-622-0075; Fax: 617-354-6875; e-mail: america@emeraldinsight.com; Web site: http://www.emeraldinsight.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: PhysDesc
  Label: Physical Description
  Group: PhysDesc
  Data: PDF
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2007
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Adult+Education%22">Adult Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Delphi+Technique%22">Delphi Technique</searchLink><br /><searchLink fieldCode="DE" term="%22Readability%22">Readability</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Content+Validity%22">Content Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Human+Resources%22">Human Resources</searchLink><br /><searchLink fieldCode="DE" term="%22Interrater+Reliability%22">Interrater Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Field+Tests%22">Field Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Adult+Learning%22">Adult Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Internet%22">Internet</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Labor+Force+Development%22">Labor Force Development</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Training+Methods%22">Training Methods</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1108/03090590710820060
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0309-0590
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an excellent tool in establishing content validity for an HRD-related construct, e.g. adult learning principles. A review of related literature revealed no existing research that used a web-based Delphi technique to validate measurements used in training and development (T&D) or HRD. Design/methodology/approach: Research methods included: a thorough review of the literature to construct an item pool of adult learning principles and instructional methods, and a Delphi expert panel consensus. The mean, mode, standard deviation, interquartile range, and skewness of the data were calculated from the voting procedures for determination of consensus. Evidence of reliability was indicated by the interrater reliability coefficient from a field test. In addition, the Gunning FOG Index for readability was calculated to improve the readability of the instrument. Findings: To address the first research question the authors suggest that a valid instrument can be developed by a diverse Delphi expert panel that measures the application of adult learning principles to fully-mediated world wide web-based training. The second research question was answered by illustrating that the internet can assist a group of diverse and geographically dispersed subject-matter experts in establishing a content valid measurement of instructional methods and techniques that demonstrate the application of adult learning principles to fully-mediated web-based training. And, finally, the paper concludes that a Delphi process can be established as a web-based method to validate research measures. Practical implications: This research helps to address the critical issue of how research is used in practice. Reasons why this research lends itself more to practice than other HRD research using more common qualitative or quantitative methods include: it is a relatively simple procedure requiring less than expert-level skills; the Delphi uses expert opinion that is commonly used in training and development practice; and results are easy to interpret and practical. Originality/value: This research is unique in its approach to developing a content valid instrument using state-of-the-art technology coupled with a updated Delphi method. It is valuable to HRD and other professionals and researchers interested in developing valid measures across cultures and where experts are geographically dispersed. (Contains 1 figure, 4 tables and 1 note.)
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 35
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2008
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ801498
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ801498
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1108/03090590710820060
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 570
    Subjects:
      – SubjectFull: Delphi Technique
        Type: general
      – SubjectFull: Readability
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Content Validity
        Type: general
      – SubjectFull: Human Resources
        Type: general
      – SubjectFull: Interrater Reliability
        Type: general
      – SubjectFull: Field Tests
        Type: general
      – SubjectFull: Adult Learning
        Type: general
      – SubjectFull: Internet
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Labor Force Development
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Training Methods
        Type: general
    Titles:
      – TitleFull: Using the Internet to Improve HRD Research: The Case of the Web-Based Delphi Research Technique to Achieve Content Validity of an HRD-Oriented Measurement
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hatcher, Tim
      – PersonEntity:
          Name:
            NameFull: Colton, Sharon
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2007
          Identifiers:
            – Type: issn-print
              Value: 0309-0590
          Numbering:
            – Type: volume
              Value: 31
            – Type: issue
              Value: 7
          Titles:
            – TitleFull: Journal of European Industrial Training
              Type: main
ResultId 1