On Internal Validity in Multiple Baseline Designs

Saved in:
Bibliographic Details
Title: On Internal Validity in Multiple Baseline Designs
Language: English
Authors: Pustejovsky, James E.
Source: Society for Research on Educational Effectiveness. 2014.
Availability: Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org
Peer Reviewed: Y
Page Count: 9
Publication Date: 2014
Document Type: Reports - Research
Descriptors: Validity, Research Design, Hierarchical Linear Modeling, Case Studies, Models
Abstract: Single-case designs are a class of research designs for evaluating intervention effects on individual cases. The designs are widely applied in certain fields, including special education, school psychology, clinical psychology, social work, and applied behavior analysis. The multiple baseline design (MBD) is the most frequently used single-case design, and is often described as having desirable internal validity characteristics. This paper examines how the use of certain hierarchical linear models that have been proposed for the MBD affect internal validity, focusing specifically on the two key features described above. First, the author considers a deliberate but non-random method of treatment assignment. I demonstrate that the treatment effect estimate from a conventional multi-level model can be biased under this mechanism, then provide an expression for the magnitude of the bias. Second, he argues that the main analytic models proposed for the MBD fail to capture the benefits of staggered treatment introduction. The author proposes an alternative model that does account for this key feature and, based on the model, he defines an index measuring the strength of control offered by the MBD. A table and figure are appended.
Abstractor: ERIC
Number of References: 21
Entry Date: 2016
Accession Number: ED562733
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED562733
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED562733
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: On Internal Validity in Multiple Baseline Designs
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Pustejovsky%2C+James+E%2E%22">Pustejovsky, James E.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Society+for+Research+on+Educational+Effectiveness%22"><i>Society for Research on Educational Effectiveness</i></searchLink>. 2014.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2014
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink><br /><searchLink fieldCode="DE" term="%22Hierarchical+Linear+Modeling%22">Hierarchical Linear Modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Case+Studies%22">Case Studies</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Single-case designs are a class of research designs for evaluating intervention effects on individual cases. The designs are widely applied in certain fields, including special education, school psychology, clinical psychology, social work, and applied behavior analysis. The multiple baseline design (MBD) is the most frequently used single-case design, and is often described as having desirable internal validity characteristics. This paper examines how the use of certain hierarchical linear models that have been proposed for the MBD affect internal validity, focusing specifically on the two key features described above. First, the author considers a deliberate but non-random method of treatment assignment. I demonstrate that the treatment effect estimate from a conventional multi-level model can be biased under this mechanism, then provide an expression for the magnitude of the bias. Second, he argues that the main analytic models proposed for the MBD fail to capture the benefits of staggered treatment introduction. The author proposes an alternative model that does account for this key feature and, based on the model, he defines an index measuring the strength of control offered by the MBD. A table and figure are appended.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 21
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2016
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED562733
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED562733
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
    Subjects:
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Hierarchical Linear Modeling
        Type: general
      – SubjectFull: Case Studies
        Type: general
      – SubjectFull: Models
        Type: general
    Titles:
      – TitleFull: On Internal Validity in Multiple Baseline Designs
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Pustejovsky, James E.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2014
          Titles:
            – TitleFull: Society for Research on Educational Effectiveness
              Type: main
ResultId 1