View in EDS HTML Full Text PDF Full Text

Preliminary evaluation of a questionnaire for assessing fidelity of early intervention for psychosis services.

Saved in:
Bibliographic Details
Title: Preliminary evaluation of a questionnaire for assessing fidelity of early intervention for psychosis services.
Authors: Kinkaid, Miriam (AUTHOR), Fuhrer, Rebecca (AUTHOR), McGowan, Stephen (AUTHOR), Malla, Ashok (AUTHOR)
Source: Social Psychiatry & Psychiatric Epidemiology. Jan2025, Vol. 60 Issue 1, p55-65. 11p.
Subjects: Convenience sampling (Statistics), Intraclass correlation, Bland-Altman plot, Public health, Family assessment
Abstract: Purpose: Fast, easy, and cost-effective methods are needed for fidelity assessment, quality improvement initiatives, and population-based studies in Early Intervention for Psychosis (EIP) services. Having an online questionnaire assessing the fidelity of EIP services, completed by staff self-reports, and having evidence of reliability and validity, could fill that gap. We assess the reliability and validity of the Early Intervention for Psychosis Services Fidelity Questionnaire (EIPS-FQ), developed in Part I of this set of papers. Methods: A convenience sample of 10 EIP teams in England was used. Two staff members completed online questionnaires assessing recent and past fidelity. An external rater completed the same questionnaire for the two time periods, using a random sample of patient medical records, program documentation, and interviews with staff. The intra-class correlation coefficient (ICC) was calculated to assess inter-rater reliability. Validity was assessed using Bland-Altman plots, absolute mean differences, and the ICC. Results: The fidelity score measuring recent fidelity ranged from 54.2 to 82.7, out of a possible 100. The ICC assessing reliability of the fidelity score was 0.40 (95% CI: 0.0-0.81). The ICCs for the fidelity sub-category scores ranged from 0 to 0.76. Two sub-categories, comprehensive assessments and family involvement and intervention, had low ICCs, regardless of period examined. Conclusions: This first attempt at validating the EIPS-FQ has demonstrated that the reliability of the EIPS-FQ is moderate/low, and therefore requires modification prior to use. The next iteration of the fidelity questionnaire will clarify or remove items which had very low reliability and add evidence-based components not identified in the Delphi exercise. [ABSTRACT FROM AUTHOR]
Copyright of Social Psychiatry & Psychiatric Epidemiology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 182635732
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Preliminary evaluation of a questionnaire for assessing fidelity of early intervention for psychosis services.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kinkaid%2C+Miriam%22">Kinkaid, Miriam</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Fuhrer%2C+Rebecca%22">Fuhrer, Rebecca</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22McGowan%2C+Stephen%22">McGowan, Stephen</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Malla%2C+Ashok%22">Malla, Ashok</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Social+Psychiatry+%26+Psychiatric+Epidemiology%22">Social Psychiatry & Psychiatric Epidemiology</searchLink>. Jan2025, Vol. 60 Issue 1, p55-65. 11p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Convenience+sampling+%28Statistics%29%22">Convenience sampling (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Intraclass+correlation%22">Intraclass correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Bland-Altman+plot%22">Bland-Altman plot</searchLink><br /><searchLink fieldCode="DE" term="%22Public+health%22">Public health</searchLink><br /><searchLink fieldCode="DE" term="%22Family+assessment%22">Family assessment</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Fast, easy, and cost-effective methods are needed for fidelity assessment, quality improvement initiatives, and population-based studies in Early Intervention for Psychosis (EIP) services. Having an online questionnaire assessing the fidelity of EIP services, completed by staff self-reports, and having evidence of reliability and validity, could fill that gap. We assess the reliability and validity of the Early Intervention for Psychosis Services Fidelity Questionnaire (EIPS-FQ), developed in Part I of this set of papers. Methods: A convenience sample of 10 EIP teams in England was used. Two staff members completed online questionnaires assessing recent and past fidelity. An external rater completed the same questionnaire for the two time periods, using a random sample of patient medical records, program documentation, and interviews with staff. The intra-class correlation coefficient (ICC) was calculated to assess inter-rater reliability. Validity was assessed using Bland-Altman plots, absolute mean differences, and the ICC. Results: The fidelity score measuring recent fidelity ranged from 54.2 to 82.7, out of a possible 100. The ICC assessing reliability of the fidelity score was 0.40 (95% CI: 0.0-0.81). The ICCs for the fidelity sub-category scores ranged from 0 to 0.76. Two sub-categories, comprehensive assessments and family involvement and intervention, had low ICCs, regardless of period examined. Conclusions: This first attempt at validating the EIPS-FQ has demonstrated that the reliability of the EIPS-FQ is moderate/low, and therefore requires modification prior to use. The next iteration of the fidelity questionnaire will clarify or remove items which had very low reliability and add evidence-based components not identified in the Delphi exercise. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Social Psychiatry & Psychiatric Epidemiology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=182635732
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s00127-024-02703-4
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 55
    Subjects:
      – SubjectFull: Convenience sampling (Statistics)
        Type: general
      – SubjectFull: Intraclass correlation
        Type: general
      – SubjectFull: Bland-Altman plot
        Type: general
      – SubjectFull: Public health
        Type: general
      – SubjectFull: Family assessment
        Type: general
    Titles:
      – TitleFull: Preliminary evaluation of a questionnaire for assessing fidelity of early intervention for psychosis services.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kinkaid, Miriam
      – PersonEntity:
          Name:
            NameFull: Fuhrer, Rebecca
      – PersonEntity:
          Name:
            NameFull: McGowan, Stephen
      – PersonEntity:
          Name:
            NameFull: Malla, Ashok
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: Jan2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 09337954
          Numbering:
            – Type: volume
              Value: 60
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Social Psychiatry & Psychiatric Epidemiology
              Type: main
ResultId 1