Small-Sample Adjustments for Tests of Moderators and Model Fit in Robust Variance Estimation in Meta-Regression
Saved in:
| Title: | Small-Sample Adjustments for Tests of Moderators and Model Fit in Robust Variance Estimation in Meta-Regression |
|---|---|
| Language: | English |
| Authors: | Tipton, Elizabeth, Pustejovsky, James E., Society for Research on Educational Effectiveness (SREE) |
| Source: | Society for Research on Educational Effectiveness. 2015. |
| Availability: | Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org |
| Peer Reviewed: | Y |
| Page Count: | 9 |
| Publication Date: | 2015 |
| Document Type: | Reports - Research |
| Descriptors: | Randomized Controlled Trials, Sample Size, Effect Size, Hypothesis Testing, Regression (Statistics), Robustness (Statistics), Mathematical Models, Simulation, Statistical Bias, Sampling, Economics, Hierarchical Linear Modeling, Meta Analysis |
| Abstract: | Randomized experiments are commonly used to evaluate the effectiveness of educational interventions. The goal of the present investigation is to develop small-sample corrections for multiple contrast hypothesis tests (i.e., F-tests) such as the omnibus test of meta-regression fit or a test for equality of three or more levels of a categorical moderator. Drawing on work that addresses related, simpler problems and special cases of cluster-robust variance estimation, the authors develop three small-sample tests based on different approximations to the distribution of a robust Wald test statistic. In the remainder of the study, the authors describe their modeling assumptions, proposed tests, and some initial simulation result. These approximations are drawn from a wide array of areas within statistics, ranging from econometrics to survey sampling. The paper presents both new analytic work describing these small-sample corrected test statistics and the results of a large simulation study that compares these potential solutions, as well as a discussion of the implications of our findings for practice. Tables and figures are appended. |
| Abstractor: | ERIC |
| Number of References: | 8 |
| Entry Date: | 2015 |
| Accession Number: | ED562265 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED562265 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED562265 AccessLevel: 3 PubType: Report PubTypeId: report PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Small-Sample Adjustments for Tests of Moderators and Model Fit in Robust Variance Estimation in Meta-Regression – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Tipton%2C+Elizabeth%22">Tipton, Elizabeth</searchLink><br /><searchLink fieldCode="AR" term="%22Pustejovsky%2C+James+E%2E%22">Pustejovsky, James E.</searchLink><br /><searchLink fieldCode="AR" term="%22Society+for+Research+on+Educational+Effectiveness+%28SREE%29%22">Society for Research on Educational Effectiveness (SREE)</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Society+for+Research+on+Educational+Effectiveness%22"><i>Society for Research on Educational Effectiveness</i></searchLink>. 2015. – Name: Avail Label: Availability Group: Avail Data: Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 9 – Name: DatePubCY Label: Publication Date Group: Date Data: 2015 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Randomized+Controlled+Trials%22">Randomized Controlled Trials</searchLink><br /><searchLink fieldCode="DE" term="%22Sample+Size%22">Sample Size</searchLink><br /><searchLink fieldCode="DE" term="%22Effect+Size%22">Effect Size</searchLink><br /><searchLink fieldCode="DE" term="%22Hypothesis+Testing%22">Hypothesis Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Regression+%28Statistics%29%22">Regression (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Robustness+%28Statistics%29%22">Robustness (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+Models%22">Mathematical Models</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation%22">Simulation</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Bias%22">Statistical Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Sampling%22">Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Economics%22">Economics</searchLink><br /><searchLink fieldCode="DE" term="%22Hierarchical+Linear+Modeling%22">Hierarchical Linear Modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Meta+Analysis%22">Meta Analysis</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Randomized experiments are commonly used to evaluate the effectiveness of educational interventions. The goal of the present investigation is to develop small-sample corrections for multiple contrast hypothesis tests (i.e., F-tests) such as the omnibus test of meta-regression fit or a test for equality of three or more levels of a categorical moderator. Drawing on work that addresses related, simpler problems and special cases of cluster-robust variance estimation, the authors develop three small-sample tests based on different approximations to the distribution of a robust Wald test statistic. In the remainder of the study, the authors describe their modeling assumptions, proposed tests, and some initial simulation result. These approximations are drawn from a wide array of areas within statistics, ranging from econometrics to survey sampling. The paper presents both new analytic work describing these small-sample corrected test statistics and the results of a large simulation study that compares these potential solutions, as well as a discussion of the implications of our findings for practice. Tables and figures are appended. – Name: AbstractInfo Label: Abstractor Group: Ab Data: ERIC – Name: Ref Label: Number of References Group: RefInfo Data: 8 – Name: DateEntry Label: Entry Date Group: Date Data: 2015 – Name: AN Label: Accession Number Group: ID Data: ED562265 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED562265 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 9 Subjects: – SubjectFull: Randomized Controlled Trials Type: general – SubjectFull: Sample Size Type: general – SubjectFull: Effect Size Type: general – SubjectFull: Hypothesis Testing Type: general – SubjectFull: Regression (Statistics) Type: general – SubjectFull: Robustness (Statistics) Type: general – SubjectFull: Mathematical Models Type: general – SubjectFull: Simulation Type: general – SubjectFull: Statistical Bias Type: general – SubjectFull: Sampling Type: general – SubjectFull: Economics Type: general – SubjectFull: Hierarchical Linear Modeling Type: general – SubjectFull: Meta Analysis Type: general Titles: – TitleFull: Small-Sample Adjustments for Tests of Moderators and Model Fit in Robust Variance Estimation in Meta-Regression Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Society for Research on Educational Effectiveness (SREE) – PersonEntity: Name: NameFull: Tipton, Elizabeth – PersonEntity: Name: NameFull: Pustejovsky, James E. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2015 Titles: – TitleFull: Society for Research on Educational Effectiveness Type: main |
| ResultId | 1 |
