Adoption and impact of a learning analytics dashboard supporting the advisor—Student dialogue in a higher education institute in Latin America.
Saved in:
| Title: | Adoption and impact of a learning analytics dashboard supporting the advisor—Student dialogue in a higher education institute in Latin America. |
|---|---|
| Authors: | De Laet, Tinne Tinne.DeLaet@kuleuven.be, Millecamp, Martijn, Ortiz‐Rojas, Margarita, Jimenez, Alberto, Maya, Ricardo, Verbert, Katrien |
| Source: | British Journal of Educational Technology. Jul2020, Vol. 51 Issue 4, p1002-1018. 17p. 2 Color Photographs, 1 Diagram, 1 Chart, 5 Graphs. |
| Subject Terms: | *Mathematical models of learning, *Educational evaluation, *Counseling in higher education, *Academic achievement, *Teenagers, *Higher education, Quantitative research |
| Geographic Terms: | Latin America |
| Abstract: | This paper presents a case study on the adoption and the impact of new modules in a learning analytics dashboard supporting the dialogue between student advisors and students when advising on a study plan for the next academic semester in Escuela Superior Politecnica del Litoral, a higher education institute in Ecuador. The impact and the adoption of the new dashboard modules were assessed using a mixed‐methods approach. The quantitative approach builds on data of 172 advisors in 34 programs and 4481 advising sessions in 2019 (post) and 4747 advising sessions in 2018 (pre) to assess the adoption and use of the dashboard, the level of support experienced by the advisors, the impact of the new dashboard modules on the difference between the advised study plan and the plan students register for, and students' academic achievement. The qualitative approach with observations of 14 staged advising dialogues and semi‐structured interviews with eight advisors was used to assess how the dashboard was used and to get deeper understanding of the perceived usefulness and impact of the dashboard. The results show that an institution‐wide deployment of dashboard modules tailored to the needs of the advisors can be achieved and can increase the level of support perceived by the advisors and significantly decrease the gap between the suggested study plans in advising dialogues and the study plans that students actually register for. On the short‐term, however, no significant changes in academic achievement were observed. Practitioner NotesWhat is already known about this topic? Academic advising can positively impact retention, academic achievement and study completion.Learning analytics dashboards are promising pieces of educational technology for academic advising as they can trigger reflection and sense‐making of educational data.Evaluation of learning analytics dashboards is often still immature and not well‐connected to the actual goals of the dashboards. Large‐scale evaluations looking at impact of dashboards are even scarcer.What this paper adds? This paper adds, to the scarce scientific evidence on academic advising dashboards, a large‐scale case study on a dashboard supporting the advisor student dialogue during the composition of well‐balanced study plans.The paper presents research evidence of the impact of the dashboard on the support advisors experience, the study plans suggested by the advisors and the ones actually registered by the students and students' academic achievement. Evidence is based on a quantitative analysis, using data of 172 advisors from 34 programs representing more than 9000 advising dialogues, and a qualitative analysis using observations and interviews.Implications for practice and/or policy Dashboards to support academic advising dialogues can be realized institution‐wide at scale. Training of student advisors supports a large scale deployment.Well‐designed dashboards that focus on addressing needs of advisors increase the level of support that advisor experience when advising students.Dashboard accommodating the simulation of study plans and the workload associated with them, succeed in decreasing the variance in suggested plans between advisors and reduce the gap between the study plans that advisors suggest to student and the study plans that students actually register for. Short‐term impact on academic achievement was not observed. [ABSTRACT FROM AUTHOR] |
| Copyright of British Journal of Educational Technology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 143852234 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Adoption and impact of a learning analytics dashboard supporting the advisor—Student dialogue in a higher education institute in Latin America. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22De+Laet%2C+Tinne%22">De Laet, Tinne</searchLink><i> Tinne.DeLaet@kuleuven.be</i><br /><searchLink fieldCode="AR" term="%22Millecamp%2C+Martijn%22">Millecamp, Martijn</searchLink><br /><searchLink fieldCode="AR" term="%22Ortiz‐Rojas%2C+Margarita%22">Ortiz‐Rojas, Margarita</searchLink><br /><searchLink fieldCode="AR" term="%22Jimenez%2C+Alberto%22">Jimenez, Alberto</searchLink><br /><searchLink fieldCode="AR" term="%22Maya%2C+Ricardo%22">Maya, Ricardo</searchLink><br /><searchLink fieldCode="AR" term="%22Verbert%2C+Katrien%22">Verbert, Katrien</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22British+Journal+of+Educational+Technology%22">British Journal of Educational Technology</searchLink>. Jul2020, Vol. 51 Issue 4, p1002-1018. 17p. 2 Color Photographs, 1 Diagram, 1 Chart, 5 Graphs. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Mathematical+models+of+learning%22">Mathematical models of learning</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+evaluation%22">Educational evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22Counseling+in+higher+education%22">Counseling in higher education</searchLink><br />*<searchLink fieldCode="DE" term="%22Academic+achievement%22">Academic achievement</searchLink><br />*<searchLink fieldCode="DE" term="%22Teenagers%22">Teenagers</searchLink><br />*<searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br /><searchLink fieldCode="DE" term="%22Quantitative+research%22">Quantitative research</searchLink> – Name: SubjectGeographic Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Latin+America%22">Latin America</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This paper presents a case study on the adoption and the impact of new modules in a learning analytics dashboard supporting the dialogue between student advisors and students when advising on a study plan for the next academic semester in Escuela Superior Politecnica del Litoral, a higher education institute in Ecuador. The impact and the adoption of the new dashboard modules were assessed using a mixed‐methods approach. The quantitative approach builds on data of 172 advisors in 34 programs and 4481 advising sessions in 2019 (post) and 4747 advising sessions in 2018 (pre) to assess the adoption and use of the dashboard, the level of support experienced by the advisors, the impact of the new dashboard modules on the difference between the advised study plan and the plan students register for, and students' academic achievement. The qualitative approach with observations of 14 staged advising dialogues and semi‐structured interviews with eight advisors was used to assess how the dashboard was used and to get deeper understanding of the perceived usefulness and impact of the dashboard. The results show that an institution‐wide deployment of dashboard modules tailored to the needs of the advisors can be achieved and can increase the level of support perceived by the advisors and significantly decrease the gap between the suggested study plans in advising dialogues and the study plans that students actually register for. On the short‐term, however, no significant changes in academic achievement were observed. Practitioner NotesWhat is already known about this topic? Academic advising can positively impact retention, academic achievement and study completion.Learning analytics dashboards are promising pieces of educational technology for academic advising as they can trigger reflection and sense‐making of educational data.Evaluation of learning analytics dashboards is often still immature and not well‐connected to the actual goals of the dashboards. Large‐scale evaluations looking at impact of dashboards are even scarcer.What this paper adds? This paper adds, to the scarce scientific evidence on academic advising dashboards, a large‐scale case study on a dashboard supporting the advisor student dialogue during the composition of well‐balanced study plans.The paper presents research evidence of the impact of the dashboard on the support advisors experience, the study plans suggested by the advisors and the ones actually registered by the students and students' academic achievement. Evidence is based on a quantitative analysis, using data of 172 advisors from 34 programs representing more than 9000 advising dialogues, and a qualitative analysis using observations and interviews.Implications for practice and/or policy Dashboards to support academic advising dialogues can be realized institution‐wide at scale. Training of student advisors supports a large scale deployment.Well‐designed dashboards that focus on addressing needs of advisors increase the level of support that advisor experience when advising students.Dashboard accommodating the simulation of study plans and the workload associated with them, succeed in decreasing the variance in suggested plans between advisors and reduce the gap between the study plans that advisors suggest to student and the study plans that students actually register for. Short‐term impact on academic achievement was not observed. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of British Journal of Educational Technology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=143852234 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/bjet.12962 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 17 StartPage: 1002 Subjects: – SubjectFull: Mathematical models of learning Type: general – SubjectFull: Educational evaluation Type: general – SubjectFull: Counseling in higher education Type: general – SubjectFull: Academic achievement Type: general – SubjectFull: Teenagers Type: general – SubjectFull: Higher education Type: general – SubjectFull: Quantitative research Type: general – SubjectFull: Latin America Type: general Titles: – TitleFull: Adoption and impact of a learning analytics dashboard supporting the advisor—Student dialogue in a higher education institute in Latin America. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: De Laet, Tinne – PersonEntity: Name: NameFull: Millecamp, Martijn – PersonEntity: Name: NameFull: Ortiz‐Rojas, Margarita – PersonEntity: Name: NameFull: Jimenez, Alberto – PersonEntity: Name: NameFull: Maya, Ricardo – PersonEntity: Name: NameFull: Verbert, Katrien IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Text: Jul2020 Type: published Y: 2020 Identifiers: – Type: issn-print Value: 00071013 Numbering: – Type: volume Value: 51 – Type: issue Value: 4 Titles: – TitleFull: British Journal of Educational Technology Type: main |
| ResultId | 1 |
