The Power and Type I Error of Wilcoxon-Mann-Whitney, Welch's 't,' and Student's 't' Tests for Likert-Type Data
Saved in:
| Title: | The Power and Type I Error of Wilcoxon-Mann-Whitney, Welch's 't,' and Student's 't' Tests for Likert-Type Data |
|---|---|
| Language: | English |
| Authors: | Simsek, Ahmet Salih (ORCID |
| Source: | International Journal of Assessment Tools in Education. 2023 10(1):114-128. |
| Availability: | International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate |
| Peer Reviewed: | Y |
| Page Count: | 15 |
| Publication Date: | 2023 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Error of Measurement, Likert Scales, Nonparametric Statistics, Statistical Analysis, Statistical Studies, Monte Carlo Methods, Statistical Significance, Sample Size, Effect Size, Data Collection, Data Analysis, Generalizability Theory |
| ISSN: | 2148-7456 |
| Abstract: | Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and non-parametric tests when each Likert-type item was analyzed independently in survey studies. The main purpose of the study is to examine the statistical power of Wilcoxon-Mann-Whitney, Welch's t, and Student's t tests for Likert-type data, which are pairwise comparison tests. For this purpose, a Monte Carlo simulation study was conducted. The statistical significance of the selected tests was examined under the conditions of sample size, group size ratio, and effect size. The results showed that the Wilcoxon-Mann-Whitney test was superior to its counterparts, especially for small samples and unequal group sizes. However, the Student's t-test for Likert-type data had similar statistical power to the Wilcoxon-Mann-Whitney test under conditions of equal group sizes when the sample size was 200 or more. Consistent with the empirical results, practical recommendations were provided for researchers on what to consider when collecting and analyzing Likert-type data. |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | EJ1393760 |
| Database: | ERIC |
| Abstract: | Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and non-parametric tests when each Likert-type item was analyzed independently in survey studies. The main purpose of the study is to examine the statistical power of Wilcoxon-Mann-Whitney, Welch's t, and Student's t tests for Likert-type data, which are pairwise comparison tests. For this purpose, a Monte Carlo simulation study was conducted. The statistical significance of the selected tests was examined under the conditions of sample size, group size ratio, and effect size. The results showed that the Wilcoxon-Mann-Whitney test was superior to its counterparts, especially for small samples and unequal group sizes. However, the Student's t-test for Likert-type data had similar statistical power to the Wilcoxon-Mann-Whitney test under conditions of equal group sizes when the sample size was 200 or more. Consistent with the empirical results, practical recommendations were provided for researchers on what to consider when collecting and analyzing Likert-type data. |
|---|---|
| ISSN: | 2148-7456 |
