An Alternative Data Collection Design for Equating with Very Small Samples. Research Report. ETS RR-08-11
Saved in:
| Title: | An Alternative Data Collection Design for Equating with Very Small Samples. Research Report. ETS RR-08-11 |
|---|---|
| Language: | English |
| Authors: | Puhan, Gautam, Moses, Tim, Grant, Mary |
| Source: | ETS Research Report Series. Mar 2008. |
| Availability: | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
| Peer Reviewed: | Y |
| Page Count: | 43 |
| Publication Date: | 2008 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Data Collection, Equated Scores, Item Sampling, Sample Size, Test Format, Test Construction, Error of Measurement, Statistical Bias |
| ISSN: | 2330-8516 |
| Abstract: | A single group (SG) equating design with nearly equivalent test forms (SiGNET) design was developed by Grant (2006) to equate small volume tests. The basis of this design is that examinees take two largely overlapping test forms within a single administration. The scored items for the operational form are divided into mini-tests called testlets. An additional testlet is created but not scored for the first form. If the scored testlets are Testlets 1-6 and the unscored testlet is Testlet 7, then the first form is composed of Testlets 1-6, the second form is composed of Testlets 2-7, and Testlets 2-6 are common to both test forms. They are administered as a single "administered form", and when a sufficient number of examinees have taken the administered form for an SG equating, the second form (Testlets 2-7) is equated to the first form (Testlets 1-6) using SG equating. As evident, there are at least two merits of the SiGNET design over the nonequivalent groups with anchor test (NEAT) design. First, it facilitates the use of an SG equating design, which has the least random equating error, and second, it allows for the accumulation of sufficient data to equate the second form. Since the examinees scores are based on only the first form (i.e., the operational form), the two forms can be administered until sufficient data are collected to equate the second form. This study compared equatings under the SiGNET and NEAT designs and found reduced bias and error for the SiGNET design in very small sample size situations (e.g., N = 10 or 15). Implications for practice using the SiGNET design are also discussed. |
| Abstractor: | As Provided |
| Number of References: | 14 |
| Entry Date: | 2016 |
| Accession Number: | EJ1111282 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1111282 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1111282 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: An Alternative Data Collection Design for Equating with Very Small Samples. Research Report. ETS RR-08-11 – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Puhan%2C+Gautam%22">Puhan, Gautam</searchLink><br /><searchLink fieldCode="AR" term="%22Moses%2C+Tim%22">Moses, Tim</searchLink><br /><searchLink fieldCode="AR" term="%22Grant%2C+Mary%22">Grant, Mary</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22ETS+Research+Report+Series%22"><i>ETS Research Report Series</i></searchLink>. Mar 2008. – Name: Avail Label: Availability Group: Avail Data: Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 43 – Name: DatePubCY Label: Publication Date Group: Date Data: 2008 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Data+Collection%22">Data Collection</searchLink><br /><searchLink fieldCode="DE" term="%22Equated+Scores%22">Equated Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Sampling%22">Item Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Sample+Size%22">Sample Size</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Error+of+Measurement%22">Error of Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Bias%22">Statistical Bias</searchLink> – Name: ISSN Label: ISSN Group: ISSN Data: 2330-8516 – Name: Abstract Label: Abstract Group: Ab Data: A single group (SG) equating design with nearly equivalent test forms (SiGNET) design was developed by Grant (2006) to equate small volume tests. The basis of this design is that examinees take two largely overlapping test forms within a single administration. The scored items for the operational form are divided into mini-tests called testlets. An additional testlet is created but not scored for the first form. If the scored testlets are Testlets 1-6 and the unscored testlet is Testlet 7, then the first form is composed of Testlets 1-6, the second form is composed of Testlets 2-7, and Testlets 2-6 are common to both test forms. They are administered as a single "administered form", and when a sufficient number of examinees have taken the administered form for an SG equating, the second form (Testlets 2-7) is equated to the first form (Testlets 1-6) using SG equating. As evident, there are at least two merits of the SiGNET design over the nonequivalent groups with anchor test (NEAT) design. First, it facilitates the use of an SG equating design, which has the least random equating error, and second, it allows for the accumulation of sufficient data to equate the second form. Since the examinees scores are based on only the first form (i.e., the operational form), the two forms can be administered until sufficient data are collected to equate the second form. This study compared equatings under the SiGNET and NEAT designs and found reduced bias and error for the SiGNET design in very small sample size situations (e.g., N = 10 or 15). Implications for practice using the SiGNET design are also discussed. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: Ref Label: Number of References Group: RefInfo Data: 14 – Name: DateEntry Label: Entry Date Group: Date Data: 2016 – Name: AN Label: Accession Number Group: ID Data: EJ1111282 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1111282 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 43 Subjects: – SubjectFull: Data Collection Type: general – SubjectFull: Equated Scores Type: general – SubjectFull: Item Sampling Type: general – SubjectFull: Sample Size Type: general – SubjectFull: Test Format Type: general – SubjectFull: Test Construction Type: general – SubjectFull: Error of Measurement Type: general – SubjectFull: Statistical Bias Type: general Titles: – TitleFull: An Alternative Data Collection Design for Equating with Very Small Samples. Research Report. ETS RR-08-11 Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Puhan, Gautam – PersonEntity: Name: NameFull: Moses, Tim – PersonEntity: Name: NameFull: Grant, Mary IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 03 Type: published Y: 2008 Identifiers: – Type: issn-electronic Value: 2330-8516 Titles: – TitleFull: ETS Research Report Series Type: main |
| ResultId | 1 |
