View in EDS HTML Full Text PDF Full Text

The Efficacy of Animation and Visualization in Teaching Data Structures: A Case Study

Saved in:
Bibliographic Details
Title: The Efficacy of Animation and Visualization in Teaching Data Structures: A Case Study
Language: English
Authors: Genady Kogan (ORCID 0009-0004-2974-1547), Hadas Chassidim (ORCID 0000-0002-3575-9602), Irina Rabaev (ORCID 0000-0002-8542-8342)
Source: Educational Technology Research and Development. 2024 72(4):2349-2372.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 24
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Descriptors: Animation, Teaching Methods, Instructional Effectiveness, Learning Experience, Comparative Analysis, Objective Tests, Usability, Data Analysis, Intention, Statistics Education, Visual Aids, Student Attitudes, Computer Software
DOI: 10.1007/s11423-024-10382-w
ISSN: 1042-1629
1556-6501
Abstract: The main goal of this study was to evaluate the impact of an animation and visualization of data structures (AVDS) tool on both perceptions and objective test performance. The study involved a rigorous experiment that assessed the usability, acceptability, and effectiveness of the AVDS tool in solving exercises. A total of 78 participants responded to questionnaires and were exposed to the AVDS tool, after which they completed a performance test, half (39) with the AVDS tool (the experimental group) and half (39) without the tool (the control group). Findings showed that the usability of AVDS was good; the experimental group even perceived AVDS usability as excellent. The results show that perceived usefulness, perceived ease of use, and attitudes toward usage jointly led to positive intention to use the AVDS tool. Furthermore, perceived ease of use was a key factor influencing participants' intention to use AVDS. In addition, the AVDS system improved test results and provided flexibility in use, enhancing learning experience and performance.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1439490
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwF2PoE80W05PrstEG7957TbAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDF2ORBnLR28Pg-qwmwIBEICBm4tY8ntDOrDYwmFvhTlTzDaUSgqONvV5lrBQ6mFSYH5iaqXAIfxZ4tdiYREcqPNPSZF0neLhA1p5WbrF0mcmsT7fotdqhWsjIutk5THvPIhpjqkRZdUioig6hB5UF8Hn4P6uTf3K5dzFNDFbtNSsBGwCe3Y0dzG9GPccPH1cLK8ztpjw72jt_jFDC_D4V15xLBQx3kwSM7GlW9kG
Text:
  Availability: 1
  Value: <anid>AN0179669791;etr01aug.24;2024Sep18.06:50;v2.2.500</anid> <title id="AN0179669791-1">The efficacy of animation and visualization in teaching data structures: a case study </title> <p>The main goal of this study was to evaluate the impact of an animation and visualization of data structures (AVDS) tool on both perceptions and objective test performance. The study involved a rigorous experiment that assessed the usability, acceptability, and effectiveness of the AVDS tool in solving exercises. A total of 78 participants responded to questionnaires and were exposed to the AVDS tool, after which they completed a performance test, half (<reflink idref="bib39" id="ref1">39</reflink>) with the AVDS tool (the experimental group) and half (<reflink idref="bib39" id="ref2">39</reflink>) without the tool (the control group). Findings showed that the usability of AVDS was good; the experimental group even perceived AVDS usability as excellent. The results show that perceived usefulness, perceived ease of use, and attitudes toward usage jointly led to positive intention to use the AVDS tool. Furthermore, perceived ease of use was a key factor influencing participants' intention to use AVDS. In addition, the AVDS system improved test results and provided flexibility in use, enhancing learning experience and performance.</p> <p>Keywords: Animation and visualization of data structures; System usability scale; Technology acceptance mode; Structural equation modelling; Linear regression model</p> <hd id="AN0179669791-2">Introduction</hd> <p>The fields of computer science and software engineering require a strong understanding of data structures and algorithms. These concepts form the foundation for solving complex problems and are necessary for developing efficient and scalable software systems. Understanding algorithms and data structures pose a significant challenge for undergraduate computer science and software engineering students (Kitchin, [<reflink idref="bib20" id="ref3">20</reflink>]). Computer code, words, and individual pictures represent static descriptions, specific views, or instances of a dynamic process. This should be given special attention during the learning process because some students cannot translate static descriptions such as these into a dynamic process in their imagination (Kitzie, [<reflink idref="bib21" id="ref4">21</reflink>]). As a result, these students often have difficulty understanding the algorithm's code. In addition to empirical and mathematical analysis, algorithm visualization (AV) is another technique used in teaching data structures and algorithms. Visualization is the process of data abstraction, operations, semantics of the algorithm software, and the creation of graphical content of the abstractions. Creating a visualization of the algorithm should make it easier to understand (Seaver, [<reflink idref="bib29" id="ref5">29</reflink>]; Rajala et al., [<reflink idref="bib26" id="ref6">26</reflink>]).</p> <p>Research has demonstrated that visualization and animation can effectively enhance student learning outcomes in data structures courses. Osman and Elmusharaf (Osman & Elmusharaf, [<reflink idref="bib24" id="ref7">24</reflink>]) conducted an experiment to compare the performance of computer science and information technology students with and without a visualized learning environment. The study found that using the visualized learning environment positively impacted student understanding and performance, as reflected in their scores on the final exam. Nathasya et al. ([<reflink idref="bib23" id="ref8">23</reflink>]) integrated algorithm visualization, presenting DS-PITON as a tool to help students understand data structure implementation. The study aimed to address the limitations of traditional algorithm visualization tools, which do not provide enough technical details. Their study showed that using the integrated DS-PITON tool improved students' assessment scores and helped moderate-paced students complete assessments faster. Andreev et al. ([<reflink idref="bib5" id="ref9">5</reflink>]) examined the use of visualization technologies in distance education and found that visualization improves the quality and effectiveness of training, and that visualization tools help to improve distance learning for students. However, they acknowledged the need for further research to explore other aspects of visualization in professional training. Perháč and Šimoňák ([<reflink idref="bib25" id="ref10">25</reflink>]) developed a new algorithm visualization system designed to teach data structures and algorithms. Their study aimed to improve the usability, extensibility, availability, and functionality of existing systems. The newly-developed system provided most functionalities for data structure visualization and was evaluated as easy to understand and helpful in learning. The respondents requested the addition of new visualizations and functionalities, indicating the potential for further development in this area.</p> <p>This paper explores the benefits of incorporating animations and visualizations in teaching and learning data structures and algorithms in computer science courses. We describe the case study performed during the fall of 2021 in a Data Structures course at SCE[<reflink idref="bib1" id="ref11">1</reflink>] College. For this study, we developed a dedicated interactive website tool tailored to support the Data Structures course at our institution. The tool encompasses all the data structures and algorithms taught in the course. We demonstrate the potential impact of using visual aids in the classroom, including willingness to use the tool to clarify complex concepts and ease of using the tool, and enhanced problem-solving skills.</p> <hd id="AN0179669791-3">Research objectives</hd> <p>The primary objective of this research was to design and implement a free online animation and visualization tool to complement the undergraduate Data Structures course and evaluate its impact on student comprehension and performance. The developed tool covers the data structures taught in the course, providing the visual capability to represent the algorithm execution process. We investigated the effect of this specialized tool on students' comprehension and academic performance in the Data Structures course at the Sami Shamoon College of Engineering.</p> <p>We formulated the following research questions:</p> <p></p> <ulist> <item> RQ1. How do students evaluate the use of animation and imaging technology in learning data structures concepts?</item> <p></p> <item> RQ2. How do students accept the AVDS tool?</item> <p></p> <item> RQ3. How will the use of AVDS affect the understanding of algorithms and learning?</item> </ulist> <p>Based on the research questions, the following hypotheses were formulated:</p> <p></p> <ulist> <item> H.1. Using animation and imaging technology in teaching data structures will be useful to students.</item> <p></p> <item> H.2.1. Perceived ease of use (PEOU) will have a positive impact on users' attitudes toward using (ATU) the AVDS tool.</item> <p></p> <item> H.2.2. Perceived usefulness (PU) will positively influence users' ATU the AVDS tool.</item> <p></p> <item> H.2.3. The PEOU will positively influence users' PU towards the AVDS tool.</item> <p></p> <item> H.3.1. Using animation and imaging technology in teaching data structures will enhance students' performance in solving exercises.</item> <p></p> <item> H.3.2. Students can complete more questions in a given amount of time (i.e., completion time will be shortened).</item> </ulist> <hd id="AN0179669791-4">Methodology</hd> <p>The study was carried out using a performance test as an objective measurement designed by the research team (Appendix A, Table 12). In addition, we applied the common standardized questionnaires, a Technology Acceptance Model (TAM) and System Usability Scale (SUS) questionnaires (Appendix A, Tables 10 and 11), which are acceptable for testing new technologies.</p> <p>The content of the questionnaires and the order of their presentation were precisely determined in advance. The SUS and TAM questionnaires were translated from English by three people and then validated by three others. The questionnaires included closed-ended questions in which students needed to choose an answer from a pre-determined set of answers. The performance test included two types of questions: open-ended and partially closed-ended; the latter required written justification of the answer. The answers were coded according to the percentage of correctness from 0 to 100.</p> <hd id="AN0179669791-5">Participants</hd> <p>A survey was taken among second-year students enrolled in the Data Structures course at the SCE College, Beer Sheva, Israel. Of 162 students in the course, 78 showed interest in participating in the research study: 23 females (mean age 21, SD = 2.56) and 55 males (mean age = 21, SD =1.97). Since all the students study in the same department and have completed all pre-course requirements, we assume they are similar to each other in terms of their educational background and academic level, and they can be classified as a homogeneous population.</p> <hd id="AN0179669791-6">Questionnaires</hd> <p>The SUS is a standardized questionnaire used to measure the perceived usability of a system (Suharsih et al., [<reflink idref="bib31" id="ref12">31</reflink>]). The SUS score is calculated by obtaining responses from participants on a 10-item questionnaire. Every item contribution score ranged between 1 (strongly disagree) and 5 (strongly agree) (Brooke et al., [<reflink idref="bib10" id="ref13">10</reflink>]).</p> <p>The TAM (Al-Emran and Shaalan, [<reflink idref="bib4" id="ref14">4</reflink>]; Agbo et al., [<reflink idref="bib2" id="ref15">2</reflink>]; Dimitrijević and Devedžić, [<reflink idref="bib14" id="ref16">14</reflink>]) questionnaire used in the study measures three key factors related to the acceptance of the AVDS tool:</p> <p></p> <ulist> <item> Perceived usefulness (Davis et al., [<reflink idref="bib12" id="ref17">12</reflink>]): The extent to which individuals believe that using the AVDS tool will enhance their test performance and time efficiency.</item> <p></p> <item> Perceived ease of use (Davis et al., [<reflink idref="bib12" id="ref18">12</reflink>]): The extent to which a student's use of AVDS tools is free of effort.</item> <p></p> <item> Attitude toward usage (Davis, [<reflink idref="bib11" id="ref19">11</reflink>]): The extent to which an individual's attitude is favorably or unfavorably disposed toward using the AVDS tool and the influence of this attitude on the intention to use the tool.</item> </ulist> <p>These factors are measured to determine the level of acceptance and adoption of the AVDS tool and to provide insights into areas that need improvement.</p> <hd id="AN0179669791-7">Performance test</hd> <p>The performance test (see Appendix A, Table 12) helped researchers learn about the efficiency of the tool. For the test, we chose the AVL tree topic, a self-balancing binary search tree developed in 1963 (Adelson-Velskii & Landis, [<reflink idref="bib1" id="ref20">1</reflink>]). The AVL topic was taught in class a week before the experiment. The test consisted of six questions and lasted about 20 min. During the test, students in an experimental group used the developed Data Structures online tool, while the control group solved without that assistance. The AVDS tool helped the student solve the questions or verify the answers. At the time of the experiment, the system did not show the steps of the algorithm, but did provide a final answer only. To assess the students' understanding of the solution, the assessment included more than just the final answer. It required students to explain the steps involved. For example, students needed to determine if a rotation was necessary during the insertion of a new node in the given AVL tree.</p> <hd id="AN0179669791-8">Data structures online tool</hd> <p>We found several publicly available AV tools: Data structure visualization, Visualgo, CS1332 Visualization Tool, Algorithm Visualizer, Vamonos, and Algorithm Wiki. However, the lack of several functionalities and features posed difficulties in utilizing them in our course and study. Some tools may not cover basic data structures, have restrictive licenses that prevent customization for education and research, lack required controls for navigating through data structures and algorithms, or do not cover some topics in enough detail. In addition, some tools do not provide the essential levels of freedom for students, such as zooming and panning to focus on specific data regions, the ability to easily export the visualized data, or to save the history for future reference. Another issue encountered is the unavailability of all necessary visualizations for our course within a single package. For these reasons, developing an alternative tool tailored to our needs seemed the best alternative.</p> <p>We designed and implemented a free online animation and visualization tool that complements the undergraduate Data Structures course and provides an interactive learning experience on a deep level. The AVDS tool we developed is the one we utilized in our study. The AVDS tool covers a classic set of algorithms and data structures commonly studied in the undergraduate data structures course. The source code for the tool is available on the GitHub repository (https://github.com/genakogan/data-structures-21-sce.git), allowing others to build upon or modify it as they see fit. The AVDS tool can be especially helpful for students seeking to understand the code behind the visualization, as they can see precisely how the algorithms and data structures are implemented. While understanding the source code may require some technical skills, such as programming experience with JavaScript, HTML, and CSS, the GitHub repository can be a valuable resource for educators and students seeking to gain a deeper understanding of algorithms and data structures through visualization.</p> <hd id="AN0179669791-9">Experimental procedure</hd> <p>The experiment involved three stages: (<reflink idref="bib1" id="ref21">1</reflink>) Survey preparation, (<reflink idref="bib2" id="ref22">2</reflink>) Survey conduction, and (<reflink idref="bib3" id="ref23">3</reflink>) Data analysis. Below, we provide an overview of each, with Fig. 1 illustrating the experimental pipeline.</p> <p>Graph: Fig. 1 The experimental pipeline</p> <p>Stage 1: Survey preparation. The preparation consisted of the following steps:</p> <p></p> <ulist> <item> 1.1: Preparing the teaching staff. The teaching assistants received an explanation of the technology (AVDS) and its use, as well as an explanation of the experimental procedure.</item> <p></p> <item> 1.2: Preparing the tool demonstration. A short video presenting the AVDS tool was recorded before the experiments. This video was available to the students before the beginning of the experiment (stage 2.1). The video demonstrated the AVDS tool described in Sect. 3.4, which students used during the survey.</item> <p></p> <item> 1.3: Random assignment of students to experimental and control groups, with 39 participants in each.</item> <p></p> <item> 1.4: AVL lecture, which was taught in class a week before the experiment.</item> </ulist> <p>Stage 2: Conducting the survey. The experiment took place during the practical session, the next week after the AVL tree topic was introduced in the lecture. The experiment was carried out as a sequence of the following steps (summarized in Table 1):</p> <p></p> <ulist> <item> 2.1: The students in both groups were provided with an explanation and clarification about how to use the AVDS online tool.</item> <p></p> <item> 2.2: The students in each group completed a TAM questionnaire.</item> <p></p> <item> 2.3: The students took the test: the experimental group used the AVDS tool, and the control group took the test without the AVDS tool. The test duration was approximately 20 min.</item> <p></p> <item> 2.4: The students in the experimental group completed a TAM questionnaire a second time.</item> <p></p> <item> 2.5: The students in both groups completed the SUS questionnaire.</item> </ulist> <p>Stage 3: Data analysis. The data analysis included cross-referencing data within the experimental group and between the groups, analyzing the results, and drawing conclusions.</p> <p>Table 1 Conducting the survey</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" /><th align="left"><p>Stages of the survey</p></th><th align="left"><p>Control group</p></th><th align="left"><p>Experimental group</p></th></tr></thead><tbody><tr><td align="left"><p>AVDS tool explanation</p></td><td align="left"><p>2.1</p></td><td align="left"><p>+</p></td><td align="left"><p>+</p></td></tr><tr><td align="left"><p>TAM questionnaire ('before')</p></td><td align="left"><p>2.2</p></td><td align="left"><p>+</p></td><td align="left"><p>+</p></td></tr><tr><td align="left"><p>Test performance</p></td><td align="left"><p>2.3</p></td><td align="left"><p>+</p></td><td align="left"><p>+</p></td></tr><tr><td align="left"><p>TAM questionnaire ('after')</p></td><td align="left"><p>2.4</p></td><td align="left"><p>−</p></td><td align="left"><p>+</p></td></tr><tr><td align="left"><p>SUS questionnaire</p></td><td align="left"><p>2.5</p></td><td align="left"><p>+</p></td><td align="left"><p>+</p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0179669791-10">Experimental design and variables</hd> <p>To analyze the results, we used integrated experimental sampling (De Datta, [<reflink idref="bib13" id="ref24">13</reflink>]). Integrated experimental sampling enables analysts to perform comparisons between groups as well as within the groups. There are three components in experimental design used to establish cause-and-effect relationships between variables by controlling for extraneous variables and reducing bias (Gribbons & Herman, [<reflink idref="bib15" id="ref25">15</reflink>]):</p> <p></p> <ulist> <item> <emph>X—</emph>Activation of the manipulation, in our case, using the AVDS tool.</item> <p></p> <item> <emph>O</emph>—Indicates an observation or measurement of the dependent variables: <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mrow><msub><mi>O</mi><mn>1</mn></msub><mo>,</mo><msub><mi>O</mi><mn>2</mn></msub><mo>,</mo><mo>...</mo><mo>,</mo><msub><mi>O</mi><mn>7</mn></msub></mrow></math> </ephtml> .</item> <p></p> <item> <emph>R</emph>—Random division into groups.</item> </ulist> <p>The study involved several observations that are defined in Table 2, including a pre-test and a post-test TAM questionnaire, a performance test, and a SUS questionnaire. Table 3 shows the steps of the experimental design used to evaluate the performance of the AVDS system. Using random division (<emph>R</emph>), the study included two groups: the experimental group (with access to the AVDS tool) and the control group (without access to the AVDS). The participants in both groups were given a TAM questionnaire ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> , <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> , <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ). The experimental group used the AVDS tool (<emph>X</emph>) during the performance test, while the control group did not ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>3</mn></msub></math> </ephtml> , <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>4</mn></msub></math> </ephtml> ). Additionally, both groups were given a SUS questionnaire ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>6</mn></msub></math> </ephtml> , <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>7</mn></msub></math> </ephtml> ).</p> <p>Table 2 Definition of observations</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left"><p>Measurement</p></th><th align="left"><p>Definition</p></th></tr></thead><tbody><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq9.gif" /></p></td><td align="left"><p>TAM questionnaire for the experimental group before the performance test</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq10.gif" /></p></td><td align="left"><p>TAM questionnaire for the control group before the performance test</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>3</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq11.gif" /></p></td><td align="left"><p>The performance test for the experimental group</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>4</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq12.gif" /></p></td><td align="left"><p>The performance test for the control group</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq13.gif" /></p></td><td align="left"><p>TAM questionnaire for the experimental group after the performance test</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>6</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq14.gif" /></p></td><td align="left"><p>SUS questionnaire for the control group</p></td></tr><tr><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi mathvariant="bold">O</mi><mn>7</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq15.gif" /></p></td><td align="left"><p>SUS questionnaire for the experimental group</p></td></tr></tbody></table> </ephtml> </p> <p>Table 3 AVDS system performance evaluation—a pre- and post-test design</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" /><th align="left" colspan="6"><p>Steps</p></th></tr><tr><th align="left"><p>Groups</p></th><th align="left"><p>Random division</p></th><th align="left"><p>TAM</p></th><th align="left"><p>AVDS tool</p></th><th align="left"><p>Performance test, response time</p></th><th align="left"><p>TAM</p></th><th align="left"><p>SUS</p></th></tr></thead><tbody><tr><td align="left"><p>Experimental group (with the AVDS tool)</p></td><td align="left"><p><italic>R</italic></p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq16.gif" /></p></td><td align="left"><p><italic>X</italic></p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>3</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq17.gif" /></p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq18.gif" /></p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>6</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq19.gif" /></p></td></tr><tr><td align="left"><p>Control group (without the AVDS tool)</p></td><td align="left"><p><italic>R</italic></p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq20.gif" /></p></td><td align="left"><p>–</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>4</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq21.gif" /></p></td><td align="left"><p>–</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>7</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq22.gif" /></p></td></tr></tbody></table> </ephtml> </p> <p> <emph>Independent Variables.</emph> The independent variables were: (<reflink idref="bib1" id="ref26">1</reflink>) Use of the AVDS tool; (<reflink idref="bib2" id="ref27">2</reflink>) Perceived usability of the AVDS tool; (<reflink idref="bib3" id="ref28">3</reflink>) Perceived usefulness of the AVDS tool; (<reflink idref="bib4" id="ref29">4</reflink>) Perceived ease of use of the AVDS tool; (<reflink idref="bib5" id="ref30">5</reflink>) Attitudes toward the use of the AVDS tool; (<reflink idref="bib6" id="ref31">6</reflink>) Experience using the AVDS; (<reflink idref="bib7" id="ref32">7</reflink>) Group assignment (experimental/control).</p> <p> <emph>Dependent Variables.</emph> Dependent variables included: (<reflink idref="bib1" id="ref33">1</reflink>) Evaluation of the usability of the AVDS tool; (<reflink idref="bib2" id="ref34">2</reflink>) Assessment of the usefulness of the AVDS tool; (<reflink idref="bib3" id="ref35">3</reflink>) Acceptance of the AVDS tool; (<reflink idref="bib4" id="ref36">4</reflink>) Performance in solving exercises; (<reflink idref="bib5" id="ref37">5</reflink>) Response time to complete questions.</p> <hd id="AN0179669791-11">Analysis and findings</hd> <p>The results of the questionnaire surveys, based on 78 student responses, were analyzed using a combination of statistical tools, including the SPSS 28[<reflink idref="bib2" id="ref38">2</reflink>] analysis software, IBM SPSS AMOS 27 module for structural equation modeling (SEM) analysis (Bahcivan et al., [<reflink idref="bib6" id="ref39">6</reflink>]; Blunch, [<reflink idref="bib8" id="ref40">8</reflink>]; Guo et al., [<reflink idref="bib16" id="ref41">16</reflink>]; Yildiz Durak, [<reflink idref="bib34" id="ref42">34</reflink>]), and KaleidaGraph[<reflink idref="bib3" id="ref43">3</reflink>] for graph construction.</p> <hd id="AN0179669791-12">System usability scale score—(H.1.)</hd> <p>The SUS scores were converted to percentile ranks and adjective ratings (such as "very good" or "poor"). The combination of percentile ranks and adjective ratings can provide a more precise picture of the usability of a product or system (Bangor et al., [<reflink idref="bib7" id="ref44">7</reflink>]; Brooke, [<reflink idref="bib9" id="ref45">9</reflink>]).</p> <p>The percentile ranks of both groups are presented in Fig. 2 (left-experimental group, right-control group). The mean score of the experimental group was 79.17, which is considered "Excellent," while the control group had a score of 69.23, which is considered "Good."</p> <p>These results suggest that the AVDS tool was perceived as more usable by the experimental than the control group, with higher levels of ease of use and user perception of effectiveness and efficiency.</p> <p>Graph: Fig. 2 Percentile ranks: left—experimental group, right—control group</p> <hd id="AN0179669791-13">Technology acceptance model—(H2.1., H2.2. and H2.3.)</hd> <p>The study used a two-measurement model with three constructs: PU, PEOU, and ATU, depicted in Fig. 3. The TAM constructs are measured using multiple items, each of which measures a different aspect of the construct (see Appendix A, Table 10 for details).</p> <p>Graph: Fig. 3 The measurement model for the TAM questionnaire</p> <p>The validity and reliability of these measures are evaluated to improve confidence in the results and quality of these models:</p> <p></p> <ulist> <item> First model with AVDS before ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> ) and after ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ) the performance test (experimental group).</item> <p></p> <item> Second model without AVDS before ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) performance test (control group) and with AVDS after ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ) performance test (experimental group).</item> </ulist> <p>This improves confidence in the results and quality of the models, ensuring accurate reflection of intended constructs and consistent results, thereby enhancing credibility and providing overall confidence in the model.</p> <hd id="AN0179669791-14">Improving and validating the model</hd> <p>The results of a Cronbach's alpha reliability coefficient, shown in Table 4, indicate the internal consistency of the scale by measuring the degree of interrelatedness among the questionnaire items. The table displays the corrected item-total correlation for each item, and the Cronbach's alpha result if the item is deleted from the scale. It suggests that the PEOU2 and PEOU4 items measure a similar construct and explain the high R-squared value. Removing PEOU2 from the model shown in Fig. 3 decreased the R-squared value of the attitude toward usage variable below one. Overall, the results demonstrate high internal consistency and reliability of the TAM questionnaire items.</p> <p>Table 4 Items statistics</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left"><p>Items</p></th><th align="left"><p>Corrected item-total correlation</p></th><th align="left"><p>Cronbach's alpha if item deleted</p></th></tr></thead><tbody><tr><td align="left"><p>PEOU1</p></td><td char="." align="char"><p>0.807</p></td><td char="." align="char"><p>0.883</p></td></tr><tr><td align="left"><p>PEOU2</p></td><td char="." align="char"><p>0.820</p></td><td char="." align="char"><p>0.879</p></td></tr><tr><td align="left"><p>PEOU3</p></td><td char="." align="char"><p>0.761</p></td><td char="." align="char"><p>0.902</p></td></tr><tr><td align="left"><p>PEOU4</p></td><td char="." align="char"><p>0.817</p></td><td char="." align="char"><p>0.879</p></td></tr></tbody></table> </ephtml> </p> <p>Adding a double-curved arrow between two error terms can be a potential solution for a Heywood case (Wang et al., [<reflink idref="bib32" id="ref46">32</reflink>]). A Heywood case refers to a scenario in the SEM model where the estimated covariance matrix of latent variables produces unfeasible or unreasonable results, such as negative variances or correlations greater than 1.0. In Fig. 4, the solid double-curved arrow is used to represent a correlated error in the first model, and the dashed double-curved arrow is used for the second model. This indicates that the error terms share a common source of variance, which could be due to similar conceptual content. This approach can help improve the model's fit and address issues with model identification.</p> <p>Graph: Fig. 4 Improved TAM models</p> <p>The results of model validation demonstrate a moderate to good model fit to the data, with reasonable fit indices (see Appendix B, Table 13), including RMSEA and RMR, which indicate a close model fit and a good fit, respectively. The factor loadings of the indicators (Appendix B, Table 14) were found to be greater than 0.4, demonstrating the construct validity of the instrument. The convergent validity was good, with AVE values greater than 0.5 (Appendix B, Table 15). The discriminant validity was satisfactory, with the exception of one case where the construct PEOU had poor discriminant validity to ATU (see Appendix B, Table 16). Finally, the constructs had acceptable consistency, as shown by the composite reliability values, which were greater than or equal to 0.6 (Appendix B, Table 17).</p> <hd id="AN0179669791-15">Hypotheses testing</hd> <p>The chi-square for the structural model was calculated before and after applying the weight constraints to the research hypotheses (Al-Aulamie, [<reflink idref="bib3" id="ref47">3</reflink>]). Table 5 shows the chi-square, degrees of freedom, and p-value for two structural models, before and after applying weight constraints, and the difference between them. The results indicate that the constrained models have a higher chi-square and lower p-value than the unconstrained models, suggesting that the relationships among the variables differ between cases at the model level.</p> <p>Table 5 Chi-square difference</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="4"><p>First model</p></th></tr><tr><th align="left"><p>Structural model</p></th><th align="left"><p>Chi-square</p></th><th align="left"><p>df</p></th><th align="left"><p>p-val</p></th></tr></thead><tbody><tr><td align="left"><p>Unconstrained</p></td><td align="left"><p>165.231</p></td><td align="left"><p>80</p></td><td align="left" /></tr><tr><td align="left"><p>Constrained</p></td><td align="left"><p>201.232</p></td><td align="left"><p>91</p></td><td align="left" /></tr><tr><td align="left"><p>Difference</p></td><td align="left"><p>36.001</p></td><td align="left"><p>11</p></td><td align="left"><p>.000</p></td></tr><tr><td align="left"><p>Number of groups</p></td><td align="left" /><td align="left"><p>2</p></td><td align="left" /></tr><tr><td align="left"><p>Invariant</p></td><td align="left" colspan="3"><p>Groups are different at the model level</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="4"><p>Second model</p></th></tr></thead><tbody><tr><td align="left"><p>Unconstrained</p></td><td align="left"><p>162.1</p></td><td align="left"><p>80</p></td><td align="left" /></tr><tr><td align="left"><p>Constrained</p></td><td align="left"><p>200.4</p></td><td align="left"><p>93</p></td><td align="left" /></tr><tr><td align="left"><p>Difference</p></td><td align="left"><p>38.3</p></td><td align="left"><p>13</p></td><td align="left"><p>.000</p></td></tr><tr><td align="left"><p>Number of groups</p></td><td align="left" /><td align="left"><p>2</p></td><td align="left" /></tr><tr><td align="left"><p>Invariant</p></td><td align="left" colspan="3"><p>Groups are different at the model level</p></td></tr></tbody></table> </ephtml> </p> <p>After establishing a significant difference between the cases presented in Table 5, the next step is identifying the hypotheses that may account for these differences. Identification is accomplished by performing the weight constraints method separately on each hypothesis in two models.</p> <p>For the first model, the first hypothesis (H2.1) was verified using the relationship between PEOU and ATU (see Table 6). The t-values calculated for PEOU and ATU are equal to 3.480 and 5.502, respectively, for before ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> ) and after ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) using AVDS. Both t-values are greater than the Z-score which is equal to 1.977. Thus, the relationship between variables related to PEOU of technology with an ATU is acceptable because it gives a positive and significant influence, meaning that hypothesis H2.1 can be proven acceptable. The standardized coefficient showed that to be the case after using AVDS, resulting in a stronger relationship ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.755, p <.01) than before using AVDS ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.752, p <.01).</p> <p>In the second hypothesis (H2.2), by examining the relationship between PU and ATU, the resulting t-value of 2.567, which represents the result before ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> ) using AVDS, and 2.224 after ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) using AVDS, is stated to be greater than 1.977. It can be concluded that the relationship between variables on the construct of PU of AVDS technology is proven to have a positive and significant influence on ATU, which means that H2.2 is proven to be accepted. The standardized coefficient showed that the case before using AVDS has a stronger relationship ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.345, p =.010) than after using AVDS ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.274, p =.026).</p> <p>The third hypothesis (H2.3) was tested using the relationship between PEOU and PU variables and produced a t-value of 4.665 > 1.977 after using AVDS. At the same time, the case before using AVDS showed that the t-value is less than the Z-score (t = 1.829, Z-score = 1.977; p =.067). Thus, the relationship between variables regarding the PEOU of technology on the PU has a positive and significant influence, meaning that H2.3 is proven to be accepted only after using AVDS ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.726, p <.01).</p> <p>Table 6 Significantly different hypotheses over cases <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> and <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml></p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq38.gif" /> With AVDS (i.e., before) experimental eroup </p></th></tr><tr><th align="left"><p>Hypothesis</p></th><th align="left"><p>Paths</p></th><th align="left"><p>Standardized coefficient</p></th><th align="left"><p>p-value</p></th><th align="left"><p>t-value</p></th></tr></thead><tbody><tr><td align="left"><p>H2.1</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq39.gif" /> ATU</p></td><td align="left"><p>0.752</p></td><td align="left"><p>***</p></td><td align="left"><p>3.480</p></td></tr><tr><td align="left"><p>H2.2</p></td><td align="left"><p>PU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq40.gif" /> ATU</p></td><td align="left"><p>0.345</p></td><td align="left"><p>.010</p></td><td align="left"><p>2.567</p></td></tr><tr><td align="left"><p>H2.3</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq41.gif" /> PU</p></td><td align="left"><p>0.752</p></td><td align="left"><p>.067</p></td><td align="left"><p>1.829</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p>O<sub>5</sub> With AVDS (i.e., after) experimental group</p></th></tr></thead><tbody><tr><td align="left"><p>H2.1</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq43.gif" /> ATU</p></td><td align="left"><p>0.755</p></td><td align="left"><p>***</p></td><td align="left"><p>5.502</p></td></tr><tr><td align="left"><p>H2.2</p></td><td align="left"><p>PU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq44.gif" /> ATU</p></td><td align="left"><p>0.274</p></td><td align="left"><p>.026</p></td><td align="left"><p>2.224</p></td></tr><tr><td align="left"><p>H2.3</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq45.gif" /> PU</p></td><td align="left"><p>0.726</p></td><td align="left"><p>***</p></td><td align="left"><p>4.665</p></td></tr></tbody></table> </ephtml> </p> <p>***p-value ≤.01 = Accepted, **p-value ≤.05 = accepted</p> <p>The structural model test revealed that the variance in the dependent variable PU that was explained by the independent variable PEOU, differed between <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> (12%) and <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> (53%). Additionally, the predictors PU and PEOU accounted for 98% of the variation in ATU for <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> and 95% for <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> , according to the <emph>R</emph> square value, which means that this model is rational, although other unknown factors may impact dependent variables.</p> <p>For the second model (see Table 7) hypothesis H2.1 was verified using the relationship between PEOU and ATU. The t-values calculated for PEOU and ATU equal 3.790 and 5.586, respectively, for the control group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) and experimental group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ). Both t-values are greater than the Z-score, which is equal to 1.977. Thus, the relationship between variables related to the PEOU of technology with an ATU is acceptable because it gives a positive and significant influence, meaning that hypothesis H2.1 can be proven acceptable. A standardized coefficient showed that the control group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) had stronger relationship ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.753, p <.01) than the experimental group ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.740, p <.01) (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ).</p> <p>Hypothesis H2.2 was checked out using the relationship between PU and ATU variables. In this case, it was found that the t-value for the experimental group is equal to 2.500, which is greater than the Z-score. At the same time, a comparison of the t-value with the Z-score carried out for the control group showed that, in that case, the t-value was less than the Z-score (t = 1.471, Z-score = 1.977; p =.141). Therefore, the relationship between variables on the construct of PU is proven to have a positive and significant influence on ATU, which means that H2.2 is proven to be accepted only for the experimental group ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.302, p =.012) (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ).</p> <p>Hypothesis H2.3 was tested using the relationship between PEOU and PU variables. The t-value of 5.618 > 1.977 (Z-score) for the control group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) and 4.415 > 1.977 (Z-score) for the experimental group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ). Thus, the relationship between variables has a positive and significant influence meaning that H2.3 from both relations can be accepted. A standardized coefficient showed that the control group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> ) had a stronger relationship ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.831, p <.01) than the experimental group (case <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> ) ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.696, p <.01).</p> <p>Table 7 Significantly different hypotheses over cases <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> and <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml></p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq68.gif" /><bold>- </bold>Without AVDS (i.e., before) control group </p></th></tr><tr><th align="left"><p>Hypothesis</p></th><th align="left"><p>Paths</p></th><th align="left"><p>Standardized coefficient</p></th><th align="left"><p>p-val</p></th><th align="left"><p>t-val</p></th></tr></thead><tbody><tr><td align="left"><p>H2.1</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq69.gif" /> ATU</p></td><td align="left"><p>0.753</p></td><td align="left"><p>***</p></td><td align="left"><p>3.790</p></td></tr><tr><td align="left"><p>H2.2</p></td><td align="left"><p>PU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq70.gif" /> ATU</p></td><td align="left"><p>0.254</p></td><td align="left"><p>.141</p></td><td align="left"><p>1.471</p></td></tr><tr><td align="left"><p>H2.3</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq71.gif" /> PU</p></td><td align="left"><p>0.831</p></td><td align="left"><p>***</p></td><td align="left"><p>5.618</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq72.gif" />- With AVDS (i.e., after) experimental group </p></th></tr></thead><tbody><tr><td align="left"><p>H2.1</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq73.gif" /> ATU</p></td><td align="left"><p>0.740</p></td><td align="left"><p>***</p></td><td align="left"><p>5.586</p></td></tr><tr><td align="left"><p>H2.2</p></td><td align="left"><p>PU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq74.gif" /> ATU</p></td><td align="left"><p>0.302</p></td><td align="left"><p>0.012</p></td><td align="left"><p>2.500</p></td></tr><tr><td align="left"><p>H2.3</p></td><td align="left"><p>PEOU <math xmlns="http://www.w3.org/1998/Math/MathML"><mo stretchy="false" xmlns="">→</mo></math><inline-graphic href="11423_2024_10382_Article_IEq75.gif" /> PU</p></td><td align="left"><p>0.696</p></td><td align="left"><p>***</p></td><td align="left"><p>4.415</p></td></tr></tbody></table> </ephtml> </p> <p>***p-value.01 = accepted, **p-value.05 = accepted</p> <p>Additionally, the results of the structural model test showed that the impact of the independent variable PEOU on the dependent variable PU differed between cases <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> (12%) and <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> (53%). The predictors PU and PEOU were found to explain 95% of the variation in ATU for both cases, indicating that the model has a high level of explanatory power. However, it is important to note that the model may not account for other unknown factors that could also impact the dependent variables.</p> <hd id="AN0179669791-16">Multiple linear regression for performance—(H3.1. and H3.2.)</hd> <p>A significant difference existed in the test scores of the experimental and control groups (see Fig. 5). For the experimental group, the test scores were considerably higher: more than <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mn>75</mn><mo>%</mo></mrow></math> </ephtml> of students who got grades from 80 to 100 belonged to the group that used the AVDS tool. The findings also indicate uniform distribution among the students that used the AVDS tool: 37 students out of 39 received grades above 80. Furthermore, students in the experimental group demonstrated significantly shorter response times.</p> <p>Graph: Fig. 5 Test and time performance</p> <p>Additionally, we used multiple linear regression to predict the performance test (Table 8). The model is developed for the following case: control group <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> without AVDS (i.e., before the test) and experimental group <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> with AVDS (i.e., after the test), which answers the TAM questionnaire after using the tool. The performance test is based on four significant main effects: PU1 (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .027), ATU3 (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .004), PEOU3 (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .030), and group with (after) or without AVDS (before) (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .001). A significant regression equation was found (F(4.73) = 13.728, p <.001), with an adjusted <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msup><mi>R</mi><mn>2</mn></msup></math> </ephtml> of 0.398. The predicted test performance of participants is equal to 0.424 + 9.431 (ATU3) − 4.415 (PU1) − 5.602 (PEOU3) + 32.428 (before and after). For the first main effect, higher perceived flexible use leads to a higher performance test ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 9.431, SE = 3.137). In addition, it can be concluded that for the experimental group that used AVDS, the higher perceived improvement performance ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>-</mo></math> </ephtml> 4.415, SE = 1.959) resulted in lower test performance. Similar to the previous findings, higher perceived easiness to the question PEOU3 ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>-</mo></math> </ephtml> 5.602, SE = 2.527) led to lower test performance. Generally, the test performance was higher for the experimental group ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 32.428, SE = 4.9).</p> <p>Table 8 Multiple regression for performance test</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left"><p>Multiple R</p></th><th align="left"><p>R<math xmlns="http://www.w3.org/1998/Math/MathML"><msup xmlns=""><mrow /><mn>2</mn></msup></math><inline-graphic href="11423_2024_10382_Article_IEq94.gif" /></p></th><th align="left"><p>Adjusted R<math xmlns="http://www.w3.org/1998/Math/MathML"><msup xmlns=""><mrow /><mn>2</mn></msup></math><inline-graphic href="11423_2024_10382_Article_IEq95.gif" /></p></th><th align="left"><p>Standard error</p></th><th align="left"><p>F</p></th><th align="left"><p>df1</p></th><th align="left"><p>df2</p></th><th align="left"><p>Sig. F</p></th></tr></thead><tbody><tr><td align="left" colspan="8"><p>Model summary</p></td></tr><tr><td align="left"><p>0.655</p></td><td align="left"><p>0.429</p></td><td align="left"><p>0.398</p></td><td align="left"><p>20.03</p></td><td align="left"><p>13.728</p></td><td align="left"><p>4</p></td><td align="left"><p>73</p></td><td align="left"><p>< 0.001</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="3"><p>Variables</p></th><th align="left"><p>B</p></th><th align="left"><p>Sth. error</p></th><th align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mi xmlns="">β</mi></math><inline-graphic href="11423_2024_10382_Article_IEq96.gif" /></p></th><th align="left"><p>t</p></th><th align="left"><p>Sig</p></th></tr></thead><tbody><tr><td align="left" colspan="8"><p>Coefficients</p></td></tr><tr><td align="left" colspan="3"><p>Constant</p></td><td align="left"><p>0.424</p></td><td align="left"><p>12.980</p></td><td align="left" /><td align="left"><p>0.033</p></td><td align="left"><p>0.974</p></td></tr><tr><td align="left" colspan="3"><p>Group with (after) or without (before) AVDS.</p></td><td align="left"><p>32.428</p></td><td align="left"><p>4.898</p></td><td align="left"><p>0.632</p></td><td align="left"><p>6.621</p></td><td align="left"><p>< 0.001</p></td></tr><tr><td align="left" colspan="3"><p>Using AVDS technology will improve my performance when working with the AVL tree. (PU1)</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq97.gif" /> 4.415 </p></td><td align="left"><p>1.959</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq98.gif" /> 0.304 </p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq99.gif" /> 2.253 </p></td><td align="left"><p>0.027</p></td></tr><tr><td align="left" colspan="3"><p>I believe the use of AVDS will be flexible. (ATU3)</p></td><td align="left"><p>9.431</p></td><td align="left"><p>3.137</p></td><td align="left"><p>0.524</p></td><td align="left"><p>3.007</p></td><td align="left"><p>0.004</p></td></tr><tr><td align="left" colspan="3"><p>It will be easy for me to become an experienced ADVS user. (PEOU3)</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq100.gif" /> 5.602 </p></td><td align="left"><p>2.527</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq101.gif" /> 0.348 </p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq102.gif" /> 2.217 </p></td><td align="left"><p>0.030</p></td></tr></tbody></table> </ephtml> </p> <p>The second multiple linear regression was calculated to predict performance time (Table 9). The model was developed for the groups described previously in the first regression. The performance time is based on three significant effects: (a) PEOU2 (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .008), (b) PEOU3 (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .035), and (c) group with (after) AVDS or without (before) AVDS (p <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>≤</mo></math> </ephtml> .001). A significant regression equation was found: (F(<reflink idref="bib3" id="ref48">3</reflink>,<reflink idref="bib74" id="ref49">74</reflink>) = 15.700, p <.001), with an adjusted <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msup><mi>R</mi><mn>2</mn></msup></math> </ephtml> of 0.364. The predicted performance test of participants is equal to 15.700–1.066 (PEOU2) + 0.756 (PEOU3) − 4.707 (before and after). For the first main effect, for the experimental group that used AVDS, the PEOU2 ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>-</mo></math> </ephtml> 1.066, SE = 0.388) led to lower performance time results. Moreover, the higher PEOU3 ( <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mi>β</mi></math> </ephtml> = 0.76, SE = 0.353) resulted in higher time performance. Mostly, the performance time decreased for the experimental group (ES = <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mo>-</mo></math> </ephtml> 4.71, SE = 0.8).</p> <p>Table 9 Multiple regression for performance time</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left"><p>Multiple R</p></th><th align="left"><p>R<math xmlns="http://www.w3.org/1998/Math/MathML"><msup xmlns=""><mrow /><mn>2</mn></msup></math><inline-graphic href="11423_2024_10382_Article_IEq111.gif" /></p></th><th align="left"><p>Adjusted R<math xmlns="http://www.w3.org/1998/Math/MathML"><msup xmlns=""><mrow /><mn>2</mn></msup></math><inline-graphic href="11423_2024_10382_Article_IEq112.gif" /></p></th><th align="left"><p>Standard Error</p></th><th align="left"><p>F</p></th><th align="left"><p>df1</p></th><th align="left"><p>df2</p></th><th align="left"><p>Sig. F</p></th></tr></thead><tbody><tr><td align="left" colspan="8"><p>Model summary</p></td></tr><tr><td align="left"><p>0.624</p></td><td align="left"><p>0.389</p></td><td align="left"><p>0.364</p></td><td align="left"><p>3.33404</p></td><td align="left"><p>15.7008</p></td><td align="left"><p>3</p></td><td align="left"><p>74</p></td><td align="left"><p>< 0.001</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="3"><p>Variables</p></th><th align="left"><p>B</p></th><th align="left"><p>Sth. error</p></th><th align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mi xmlns="">β</mi></math><inline-graphic href="11423_2024_10382_Article_IEq113.gif" /></p></th><th align="left"><p>t</p></th><th align="left"><p>Sig</p></th></tr></thead><tbody><tr><td align="left" colspan="8"><p>Coefficients</p></td></tr><tr><td align="left" colspan="3"><p>Constant</p></td><td align="left"><p>25.960</p></td><td align="left"><p>2.220</p></td><td align="left" /><td align="left"><p>11.693</p></td><td align="left"><p>< 0.001</p></td></tr><tr><td align="left" colspan="3"><p>Group with (i.e., after) or without AVDS (i.e., before)</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq114.gif" /> 4.707 </p></td><td align="left"><p>0.796</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq115.gif" /> 0.566 </p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq116.gif" /> 5.911 </p></td><td align="left"><p>< 0.001</p></td></tr><tr><td align="left" colspan="3"><p>It will be easy for me to use ADVS for my desired purpose. (PEOU2)</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq117.gif" /> 1.066 </p></td><td align="left"><p>0.388</p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq118.gif" /> 0.365 </p></td><td align="left"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><mo xmlns="">-</mo></math><inline-graphic href="11423_2024_10382_Article_IEq119.gif" /> 2.747 </p></td><td align="left"><p>0.008</p></td></tr><tr><td align="left" colspan="3"><p>It will be easy for me to become an experienced ADVS user. (PEOU3)</p></td><td align="left"><p>b</p></td><td align="left"><p>0.353</p></td><td align="left"><p>0.290</p></td><td align="left"><p>2.142</p></td><td align="left"><p>0.035</p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0179669791-17">Limitations of the study</hd> <p>This study has limitations. Firstly, the small sample size may be unreliable, as RMR, NFI, GFI, RMSEA, and regression coefficients among variables are often done by Maximum Likelihood (Rao et al., [<reflink idref="bib27" id="ref50">27</reflink>]), which assumes normal distribution among the indicator variables. As a general rule, sample size requirements for SEM are often much larger than for other types of statistical analyses, such as multiple regression. A minimum sample size of 200 to 300 observations is often recommended for SEM, but the specific requirements will depend on the specific model and the data being analyzed. (Wolf et al., [<reflink idref="bib33" id="ref51">33</reflink>]). Secondly, this study may not fully capture the periodicity of AVDS usage. Therefore, the results of this study should be viewed as preliminary evidence for examining the relationship between students and their intention to use the AVDS system. Thirdly, the development of the site was based mainly on the course staff requirements, and was evaluated by the students' course. Although, results show that most of the participants found the system with high usability, ∼ 1% of the participants in both groups rated usability as 'worst imaginable'. Therefore, the next phase of the development should take into account the requirements of the pilot outcomes and the students' inputs.</p> <hd id="AN0179669791-18">Discussion</hd> <p>This research aimed to examine the efficacy of the AVDS tool in improving students' learning and understanding of data structures and algorithms. The study found that the AVDS tool had a positive impact on students' perception of usability, usefulness, and acceptance of the tool. The results showed that the AVDS tool was acceptable and effective for students' learning.</p> <p>The SUS score of the AVDS tool for the control group was 69.23 (in the "Good" category); for the experimental group, the score was 79.17 (in the "Excellent" category). This indicates that the AVDS tool is good and acceptable.</p> <p>Using the TAM theory, the study explored the factors influencing the adoption of the AVDS tool by students. The findings suggested that students' perception of the AVDS tool's ease of use significantly affected their attitudes toward using the tool. If students found the tool easy to use, they were more likely to consider it useful and have a positive attitude toward integrating technology into learning. The study also showed that the AVDS tool improved students' performance in terms of grades and completion time, such that <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mo>∼</mo><mn>95</mn><mo>%</mo></mrow></math> </ephtml> of them achieved grades above 80. These findings suggest that the developed AVDS tool was an effective learning medium that was easy for users to learn, understand, and operate. Overall, the study's findings can be used to enhance understanding of user acceptance of the AVDS tool and lead to more successful adoption. The results of our study align with previous research (Andreev et al., [<reflink idref="bib5" id="ref52">5</reflink>]; Nathasya et al., [<reflink idref="bib23" id="ref53">23</reflink>]; Osman & Elmusharaf, [<reflink idref="bib24" id="ref54">24</reflink>]; Perháč & Šimoňák, [<reflink idref="bib25" id="ref55">25</reflink>]) which demonstrated that using visualized learning environments positively impacts student understanding, performance, and assessment completion times.</p> <p>The application can help promote the learning of the Data Structures and Algorithms topics in the undergraduate computer science and software engineering courses. Beyond the common functionalities, the proposed tool provides valuable analytics for the teaching staff, e.g., usage reports for each topic. These reports can be utilized to prioritize more challenging topics during the course.</p> <hd id="AN0179669791-19">Conclusions and future work</hd> <p>This study investigated the effects of the AVDS tool, using a wide range of variables including TAM, SUS, and the students' performance. According to the SUS results, we found that the experimental group perceived the usability of AVDS to be "Excellent", while the control group estimated it only as "Good".</p> <p>Similarly, TAM findings showed that the experience with AVDS led to positive intentions to use the tool and higher levels of ease of use, effectiveness, and efficiency. Moreover, there is evidence that the use of AVDS elevated the overall learning experience and achievement levels. The students in the experimental group obtained higher and more uniform scores than those in the control group, and it took them less time to solve tasks than the control group.</p> <p>At present, our team is actively enhancing the application by improving its functionalities and addressing usability issues identified in the current study. Recently we conducted a second additional pilot to evaluate the effectiveness of the additional developments and now we are analyzing its outcomes. The current version of the website may be accessed at https://ds-sce.sce-fpm.com/.</p> <hd id="AN0179669791-20">Funding</hd> <p>Open access funding provided by Sami Shamoon College of Engineering. No funding was received for conducting this study.</p> <hd id="AN0179669791-21">Data availability</hd> <p>Not applicable.</p> <hd id="AN0179669791-22">Code availability</hd> <p>https://github.com/genakogan/data-structures-21-sce.git.</p> <hd id="AN0179669791-23">Declarations</hd> <p></p> <hd id="AN0179669791-24">Conflict of interest</hd> <p>The authors have no competing interests to declare that are relevant to the content of this article.</p> <hd id="AN0179669791-25">Ethical approval</hd> <p>The study was conducted in compliance with ethical standards and regulations and was approved by the college ethical committee.</p> <hd id="AN0179669791-26">Appendices</hd> <p></p> <hd id="AN0179669791-27">A: questionnaires and performance test</hd> <p>See Appendix Table 10, 11, 12.</p> <p>Table 10 TAM questionnaire</p> <p> <ephtml> <table frame="hsides" rules="groups"><tbody><tr><td align="left" colspan="2"><p>Perceived usefulness (PU)</p></td></tr><tr><td align="left" colspan="2"><p> PU1: Using AVDS technology will allow you to complete tasks associated with the AVL tree faster.</p></td></tr><tr><td align="left" colspan="2"><p> PU2: Using AVDS technology will increase my productivity when working with the AVL tree.</p></td></tr><tr><td align="left" colspan="2"><p> PU3: Using AVDS technology will increase the efficiency of working with the AVL tree.</p></td></tr><tr><td align="left" colspan="2"><p> PU4: Using AVDS technology will simplify the tasks associated with the AVL tree.</p></td></tr><tr><td align="left" colspan="2"><p> PU5: Using AVDS technology will improve my performance when working with the AVL tree.</p></td></tr><tr><td align="left" colspan="2"><p>Attitudetoward AVDS tool (ATU)</p></td></tr><tr><td align="left" colspan="2"><p> ATU1: AVDS technology comes in handy for me when exploring the AVL tree.</p></td></tr><tr><td align="left" colspan="2"><p> ATU2: I believe that interaction with the AVDS system will be clear and comfortable for me.</p></td></tr><tr><td align="left" colspan="2"><p> ATU3: I believe the use of AVDS will be flexible.</p></td></tr><tr><td align="left" colspan="2"><p>Perceived ease of use (PEOU)</p></td></tr><tr><td align="left" colspan="2"><p> PEOU1: It will be easy for me to learn how to use AVDS.</p></td></tr><tr><td align="left" colspan="2"><p> PEOU2: It will be easy for me to use AVDS for my desired purpose.</p></td></tr><tr><td align="left" colspan="2"><p> PEOU3: It will be easy for me to become an experienced AVDS user.</p></td></tr><tr><td align="left" colspan="2"><p> PEOU4: It will be easy for me to use AVDS.</p></td></tr></tbody></table> </ephtml> </p> <p>Participants ranked each question from 1 (strongly disagree) to 7 (strongly agree)</p> <p>Table 11 SUS questionnaire</p> <p> <ephtml> <table frame="hsides" rules="groups"><tbody><tr><td align="left"><p>1</p></td><td align="left"><p>I think that I would like to use this system frequently</p></td></tr><tr><td align="left"><p>2</p></td><td align="left"><p>I found the system unnecessarily complex</p></td></tr><tr><td align="left"><p>3</p></td><td align="left"><p>I thought the system was easy to use</p></td></tr><tr><td align="left"><p>4</p></td><td align="left"><p>I think that I would need the support of a technical person to be able to use this system</p></td></tr><tr><td align="left"><p>5</p></td><td align="left"><p>I found the various functions in this system were well integrated</p></td></tr><tr><td align="left"><p>6</p></td><td align="left"><p>I thought there was too much inconsistency in this system</p></td></tr><tr><td align="left"><p>7</p></td><td align="left"><p>I would imagine that most people would learn to use this system very quickly</p></td></tr><tr><td align="left"><p>8</p></td><td align="left"><p>I found the system very cumbersome to use</p></td></tr><tr><td align="left"><p>9</p></td><td align="left"><p>I felt very confident using the system</p></td></tr><tr><td align="left"><p>10</p></td><td align="left"><p>I needed to learn a lot of things before I could get going with this system</p></td></tr></tbody></table> </ephtml> </p> <p>Participants ranked each question from 1 (strongly disagree) to 5 (strongly agree)</p> <p>Table 12 Performance test</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" /><th align="left"><p>Questions</p></th></tr></thead><tbody><tr><td align="left" rowspan="2"><p>1</p></td><td align="left"><p>Construct the AVL tree for the following set of keys by inserting node after node starting from an empty tree: 1, 4, 5, 10, 16, 6, 21, 7</p></td></tr><tr><td align="left"><p>Is rotation required after inserting a new node? If "yes" - which node was rotated to fix the tree structure</p></td></tr><tr><td align="left"><p>1.1</p></td><td align="left"><p>Was rotation required when you inserted key 1: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.2</p></td><td align="left"><p>Was rotation required when you inserted key 4: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.3</p></td><td align="left"><p>Was rotation required when you inserted key 5: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.4</p></td><td align="left"><p>Was rotation required when you inserted key 10: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.5</p></td><td align="left"><p>Was rotation required when you inserted key 16: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.6</p></td><td align="left"><p>Was rotation required when you inserted key 6: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.7</p></td><td align="left"><p>Was rotation required when you inserted key 21: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>1.8</p></td><td align="left"><p>Was rotation required when you inserted key 7: "yes"/"no". If your answer is 'yes', on which node was the rotation performed?</p></td></tr><tr><td align="left"><p>2</p></td><td align="left"><p>Delete key 1 from the constructed AVL tree</p></td></tr><tr><td align="left"><p>3</p></td><td align="left"><p>What is the predecessor of a node with key 10?</p></td></tr><tr><td align="left"><p>4</p></td><td align="left"><p>What is the successor of a node with the key 5?</p></td></tr><tr><td align="left"><p>5</p></td><td align="left"><p>Specify the order of the pre-order traversal</p></td></tr><tr><td align="left"><p>6</p></td><td align="left"><p>Specify the order of the post-order traversal</p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0179669791-28">B: additional results</hd> <p>See Appendix Table 13, 14, 15, 16, 17</p> <p>Table 13 Confirmatory factor analysis</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" /><th align="left"><p>First model</p></th><th align="left"><p>Second model</p></th><th align="left"><p>Recommended criterion</p></th></tr></thead><tbody><tr><td align="left"><p>Chi-squared</p></td><td align="left"><p>168.379; p-value = 0.000; df = 74</p></td><td align="left"><p>179.684; p-value =.000; df = 82</p></td><td align="left"><p>p-value < 0.05 (Joseph et al., <xref ref-type="bibr" rid="bibr17">2022</xref>)</p></td></tr><tr><td align="left"><p>CMIN/DF</p></td><td align="left"><p>2.275</p></td><td align="left"><p>2.191</p></td><td align="left"><p>< 3 (Kenny & McCoach, <xref ref-type="bibr" rid="bibr18">2003</xref>)</p></td></tr><tr><td align="left"><p>RMSEA</p></td><td align="left"><p>0.130</p></td><td align="left"><p>0.125</p></td><td align="left"><p>0.03–0.08 (Kenny & McCoach, <xref ref-type="bibr" rid="bibr18">2003</xref>; Kenny et al., <xref ref-type="bibr" rid="bibr19">2015</xref>)</p></td></tr><tr><td align="left"><p>RMR</p></td><td align="left"><p>0.262</p></td><td align="left"><p>0.635</p></td><td align="left"><p>0.03–0.08 (Kenny & McCoach, <xref ref-type="bibr" rid="bibr18">2003</xref>)</p></td></tr><tr><td align="left"><p>GFI</p></td><td align="left"><p>0.762</p></td><td align="left"><p>0.750</p></td><td align="left"><p>> 0.90 (Kenny & McCoach, <xref ref-type="bibr" rid="bibr18">2003</xref>)</p></td></tr><tr><td align="left"><p>CFI</p></td><td align="left"><p>0.807</p></td><td align="left"><p>0.875</p></td><td align="left"><p>> 0.95 (Kenny & McCoach, <xref ref-type="bibr" rid="bibr18">2003</xref>; Steiger, <xref ref-type="bibr" rid="bibr30">1980</xref>; Kline, <xref ref-type="bibr" rid="bibr22">1998</xref>)</p></td></tr><tr><td align="left"><p>NFI</p></td><td align="left"><p>0.719</p></td><td align="left"><p>0.798</p></td><td align="left"><p>> 0.90 (Kline, <xref ref-type="bibr" rid="bibr22">1998</xref>)</p></td></tr><tr><td align="left"><p>IFI</p></td><td align="left"><p>0.820</p></td><td align="left"><p>0.879</p></td><td align="left"><p>> 0.90 (Steiger, <xref ref-type="bibr" rid="bibr30">1980</xref>; Kline, <xref ref-type="bibr" rid="bibr22">1998</xref>; Schumacker & Lomax, <xref ref-type="bibr" rid="bibr28">2004</xref>)</p></td></tr></tbody></table> </ephtml> </p> <p>Table 14 Cross loading factor</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" /><th align="left" colspan="4"><p>First model</p></th><th align="left" colspan="4"><p>Second model</p></th></tr><tr><th align="left" /><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq121.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq122.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq123.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq124.gif" /></p></th></tr><tr><th align="left"><p>Indicator</p></th><th align="left"><p>Loading factor</p></th><th align="left"><p>Result</p></th><th align="left"><p>Loading factor</p></th><th align="left"><p>Result</p></th><th align="left"><p>Loading factor</p></th><th align="left"><p>Result</p></th><th align="left"><p>Loading factor</p></th><th align="left"><p>Result</p></th></tr></thead><tbody><tr><td align="left"><p>PU1</p></td><td align="left"><p>0.718****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.729****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.827****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.715****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PU2</p></td><td align="left"><p>0.837****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.597****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.854****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.597****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PU3</p></td><td align="left"><p>0.732****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.950****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.756****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.954****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PU4</p></td><td align="left"><p>0.731****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.768****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.880****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.768****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PU5</p></td><td align="left"><p>0.762****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.854****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.892****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.838****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>ATU1</p></td><td align="left"><p>0.364****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.555****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.894****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.564****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>ATU2</p></td><td align="left"><p>0.724****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.811****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.906****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.820****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>ATU3</p></td><td align="left"><p>0.692****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.946****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.835****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.912****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PEOU1</p></td><td align="left"><p>0.868****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.783****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.755****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.806****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PEOU3</p></td><td align="left"><p>0.666****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.947****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.809****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.942****</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PEOU4</p></td><td align="left"><p>0.731****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.946****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.843****</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.945****</p></td><td align="left"><p>Valid</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> -with AVDS (i.e., before) experimental group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> -without AVDS (i.e., before) control group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> -with AVDS (i.e., after) experimental group</p> <p>**** p ≤ 0.001 level (2-tailed)</p> <p>Table 15 Average variance extracted</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p>First model</p></th></tr><tr><th align="left" /><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq129.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq130.gif" /></p></th></tr></thead><tbody><tr><td align="left"><p>Construct</p></td><td align="left"><p>AVE</p></td><td align="left"><p>Result</p></td><td align="left"><p>AVE</p></td><td align="left"><p>Result</p></td></tr><tr><td align="left"><p>PU</p></td><td align="left"><p>0.574</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.622</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.577</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.802</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.378</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.620</p></td><td align="left"><p>Valid</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p>Second model</p></th></tr><tr><th align="left" /><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq131.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq132.gif" /></p></th></tr></thead><tbody><tr><td align="left"><p>Construct</p></td><td align="left"><p>AVE</p></td><td align="left"><p>Result</p></td><td align="left"><p>AVE</p></td><td align="left"><p>Result</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.711</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.543</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.645</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.810</p></td><td align="left"><p>Valid</p></td></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.772</p></td><td align="left"><p>Valid</p></td><td align="left"><p>0.607</p></td><td align="left"><p>Valid</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> - with AVDS (i.e., before) experimental group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> - without AVDS (i.e., before) control group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> - with AVDS (i.e., after) experimental group</p> <p>Table 16 Discriminant validity</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="7"><p>First model</p></th></tr><tr><th align="left" /><th align="left" colspan="3"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq136.gif" /></p></th><th align="left" colspan="3"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq137.gif" /></p></th></tr><tr><th align="left" /><th align="left"><p>PU</p></th><th align="left"><p>PEOU</p></th><th align="left"><p>ATU</p></th><th align="left"><p>PU</p></th><th align="left"><p>PEOU</p></th><th align="left"><p>ATU</p></th></tr></thead><tbody><tr><td align="left"><p>PU</p></td><td align="left"><p>0.757</p></td><td align="left" /><td align="left" /><td align="left"><p>0.788</p></td><td align="left" /><td align="left" /></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.357**</p></td><td align="left"><p>0.759</p></td><td align="left" /><td align="left"><p>0.367**</p></td><td align="left"><p>0.895</p></td><td align="left" /></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.532***</p></td><td align="left"><p>0.609***</p></td><td align="left"><p>0.614</p></td><td align="left"><p>0.583***</p></td><td align="left"><p>0.711***</p></td><td align="left"><p>0.787</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="7"><p>Second model</p></th></tr><tr><th align="left" /><th align="left" colspan="3"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq138.gif" /></p></th><th align="left" colspan="3"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq139.gif" /></p></th></tr></thead><tbody><tr><td align="left" /><td align="left"><p>PU</p></td><td align="left"><p>PEOU</p></td><td align="left"><p>ATU</p></td><td align="left"><p>PU</p></td><td align="left"><p>PEOU</p></td><td align="left"><p>ATU</p></td></tr><tr><td align="left"><p>PU</p></td><td align="left"><p>0.843</p></td><td align="left" /><td align="left" /><td align="left"><p>0.736</p></td><td align="left" /><td align="left" /></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.742***</p></td><td align="left"><p>0.803</p></td><td align="left" /><td align="left"><p>0.367**</p></td><td align="left"><p>0.9</p></td><td align="left" /></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.842***</p></td><td align="left"><p>0.9***</p></td><td align="left"><p>0.878</p></td><td align="left"><p>0.583***</p></td><td align="left"><p>0.711***</p></td><td align="left"><p>0.779</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> - with AVDS (i.e., before) experimental group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> - without AVDS (i.e., before) control group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> - with AVDS (i.e., after) experimental group</p> <p>*** p ≤ 0.01 level (2-tailed); ** p ≤ 0.05 level (2-tailed)</p> <p>Table 17 Composite reliability and Cronbach's alpha</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p>First model</p></th></tr><tr><th align="left" /><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>1</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq145.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq146.gif" /></p></th></tr></thead><tbody><tr><td align="left"><p>Construct</p></td><td align="left"><p>CR</p></td><td align="left"><p>CA</p></td><td align="left"><p>CR</p></td><td align="left"><p>CA</p></td></tr><tr><td align="left"><p>PU</p></td><td align="left"><p>0.870</p></td><td align="left"><p>0.880</p></td><td align="left"><p>0.889</p></td><td align="left"><p>0.858</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.802</p></td><td align="left"><p>0.689</p></td><td align="left"><p>0.923</p></td><td align="left"><p>0.860</p></td></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.629</p></td><td align="left"><p>0.6</p></td><td align="left"><p>0.824</p></td><td align="left"><p>0.735</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" colspan="5"><p>Second model</p></th></tr><tr><th align="left" /><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>2</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq147.gif" /></p></th><th align="left" colspan="2"><p><math xmlns="http://www.w3.org/1998/Math/MathML"><msub xmlns=""><mi>O</mi><mn>5</mn></msub></math><inline-graphic href="11423_2024_10382_Article_IEq148.gif" /></p></th></tr></thead><tbody><tr><td align="left"><p>Construct</p></td><td align="left"><p>CR</p></td><td align="left"><p>CA</p></td><td align="left"><p>CR</p></td><td align="left"><p>CA</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.925</p></td><td align="left"><p>0.940</p></td><td align="left"><p>0.830</p></td><td align="left"><p>0.858</p></td></tr><tr><td align="left"><p>PEOU</p></td><td align="left"><p>0.845</p></td><td align="left"><p>0.912</p></td><td align="left"><p>0.927</p></td><td align="left"><p>0.860</p></td></tr><tr><td align="left"><p>ATU</p></td><td align="left"><p>0.910</p></td><td align="left"><p>0.920</p></td><td align="left"><p>0.817</p></td><td align="left"><p>0.735</p></td></tr></tbody></table> </ephtml> </p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>1</mn></msub></math> </ephtml> - with AVDS (i.e., before) experimental group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>2</mn></msub></math> </ephtml> - without AVDS (i.e., before) control group</p> <p> <ephtml> <math xmlns="http://www.w3.org/1998/Math/MathML"><msub><mi>O</mi><mn>5</mn></msub></math> </ephtml> - with AVDS (i.e., after) experimental group</p> <hd id="AN0179669791-29">Publisher's Note</hd> <p>Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p> <ref id="AN0179669791-30"> <title> References </title> <blist> <bibl id="bib1" idref="ref11" type="bt">1</bibl> <bibtext> Adelson-Velskii, M, & Landis, E. M. (1963). An algorithm for the organization of information. Tech. rep, Joint Publications Research Service Washington DC. https://zhjwpku.com/assets/pdf/AED2-10-avl-paper.pdf</bibtext> </blist> <blist> <bibl id="bib2" idref="ref15" type="bt">2</bibl> <bibtext> Agbo FJ, Oyelere SS, Suhonen J, Tukiainen M. Design, development, and evaluation of a virtual reality game-based application to support computational thinking. Educational Technology Research and Development. 2022; 71: 1-33. 10.1007/s11423-022-10161-5</bibtext> </blist> <blist> <bibl id="bib3" idref="ref23" type="bt">3</bibl> <bibtext> Al-Aulamie, A. (2013). Enhanced technology acceptance model to explain and predict learners' behavioural intentions in learning management systems. PhD Thesis, University of Bedfordshire, <ulink href="http://hdl.handle.net/10547/323773">http://hdl.handle.net/10547/323773</ulink></bibtext> </blist> <blist> <bibl id="bib4" idref="ref14" type="bt">4</bibl> <bibtext> Al-Emran M, Shaalan K. Recent advances in technology acceptance models and theories. Springe. 2021. 10.1007/978-3-030-64987-6</bibtext> </blist> <blist> <bibl id="bib5" idref="ref9" type="bt">5</bibl> <bibtext> Andreev AN, Emtseva OV, Babkina ES, Dolzhenkov VN, Kudryashova NV. The effectiveness of using visualization tools and forms in distance learning. Revista Tempos E Espaços Em Educação. 2021; 14; 33: 2. 10.20952/revtee.v14i33.16053</bibtext> </blist> <blist> <bibl id="bib6" idref="ref31" type="bt">6</bibl> <bibtext> Bahcivan E, Gurer MD, Yavuzalp N, Akayoglu S. Investigating the relations among pre-service teachers' teaching/learning beliefs and educational technology integration competencies: A structural equation modeling study. Journal of Science Education and Technology. 2019; 28: 579-588. 10.1007/s10956-019-09788-6</bibtext> </blist> <blist> <bibl id="bib7" idref="ref32" type="bt">7</bibl> <bibtext> Bangor A, Kortum P, Miller J. Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies. 2009; 4; 3: 114-123</bibtext> </blist> <blist> <bibl id="bib8" idref="ref40" type="bt">8</bibl> <bibtext> Blunch N. Introduction to structural equation modeling using IBM SPSS statistics and AMOS. 2012; Sage</bibtext> </blist> <blist> <bibl id="bib9" idref="ref45" type="bt">9</bibl> <bibtext> Brooke J. Sus-a quick and dirty usability scale. Usability Evaluation in Industry. 1996; 189; 194: 4. 10.1201/9781498710411</bibtext> </blist> <blist> <bibtext> Brooke J. Sus: a retrospective. Journal of Usability Studies. 2013; 8; 2: 29-40</bibtext> </blist> <blist> <bibtext> Davis FD. User acceptance of information technology: system characteristics, user perceptions and behavioral impacts. International Journal of Man-Machine Studies. 1993; 38; 3: 475-48. 10.1006/imms.1993.1022</bibtext> </blist> <blist> <bibtext> Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: A comparison of two theoretical models. Management Science. 1989; 35; 8: 982-1003. 10.1287/mnsc.35.8.982</bibtext> </blist> <blist> <bibtext> De Datta SK. A handbook on the methodology for an integrated experiment: survey on rice yield constraints. 1978; Int. Rice Res. Inst.</bibtext> </blist> <blist> <bibtext> Dimitrijević S, Devedžić V. Utilitarian and experiential aspects in acceptance models for learning technology. Educational Technology Research and Development. 2021; 69: 627-65. 10.1007/s11423-021-09970-x</bibtext> </blist> <blist> <bibtext> Gribbons B, Herman J. True and quasi-experimental designs. Practical Assessment, Research, and Evaluation. 1996; 5; 1: 1. 10.7275/fs4z-nb61</bibtext> </blist> <blist> <bibtext> Guo Q, Qiao C, Ibrahim B. The mechanism of influence between ict and students'science literacy: a hierarchical and structural equation modelling study. Journal of Science Education and Technology. 2022; 31; 2: 272-288. 10.1007/s10956-021-09954-9</bibtext> </blist> <blist> <bibtext> Joseph F, Black WC, Babin BJ, Anderson RE. Multivariate data analysis: A global perspective. Pearson Educatio. 2010; 10: 2141158</bibtext> </blist> <blist> <bibtext> Kenny DA, McCoach DB. Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling. 2003; 10; 3: 333-35. 10.1207/S15328007SEM1003_1</bibtext> </blist> <blist> <bibtext> Kenny DA, Kaniskan B, McCoach DB. The performance of rmsea in models with small degrees of freedom. Sociological Methods & Research. 2015; 44; 3: 486-507. 10.1177/0049124114543236</bibtext> </blist> <blist> <bibtext> Kitchin R. Thinking critically about and researching algorithms. Information, Communication & Society. 2017; 20; 1: 14-29. 10.1080/1369118X.2016.1154087</bibtext> </blist> <blist> <bibtext> Kitzie V. "that looks like me or something i can do": Affordances and constraints in the online identity work of us lgbtq+ millennials. Journal of the Association for Information Science and Technology. 2019; 70; 12: 1340-1351. 10.1002/asi.24217</bibtext> </blist> <blist> <bibtext> Kline RB. Structural equation modeling. 1998; Guilford</bibtext> </blist> <blist> <bibtext> Nathasya RA, Karnalim O, Ayub M. Integrating program and algorithm visualisation for learning data structure implementation. Egyptian Informatics Journal. 2019; 20; 3: 193-20. 10.1016/j.eij.2019.05.001</bibtext> </blist> <blist> <bibtext> Osman WI, Elmusharaf MM. Effectiveness of combining algorithm and program animation: A case study with data structure course. Issues in Informing Science and Information Technology. 2014; 11: 155-168. 10.28945/1986</bibtext> </blist> <blist> <bibtext> Perháč P, Šimoňák S. Interactive system for algorithm and data structure visualization. Computer Science Journal of Moldova. 2022; 30; 1: 28-48. 10.56415/csjm.v30.02</bibtext> </blist> <blist> <bibtext> Rajala T, Laakso MJ, Kaila E, Salakoski T. Ville: A language-independent program visualization tool. Proceedings of the Seventh Baltic Sea Conference on Computing Education Research-Citeseer. 2007; 88: 151-159</bibtext> </blist> <blist> <bibtext> Rao C, Miller J, Rao D. Essential statistical methods for medical statistics. 2011; Elsevier</bibtext> </blist> <blist> <bibtext> Schumacker RE, Lomax RG. A beginner's guide to structural equation modeling. Psychology Pres. 2004. 10.4324/9780203851319</bibtext> </blist> <blist> <bibtext> Seaver N. What should an anthropology of algorithms do?. Cultural Anthropology. 2018; 33; 3: 375-38. 10.14506/ca33.3.04</bibtext> </blist> <blist> <bibtext> Steiger, J. H. (1980). Statistically based tests for the number of common factors. In: Paper presented at the Annual Meeting of the Psychometric Society, Iowa Cyty.</bibtext> </blist> <blist> <bibtext> Suharsih R, Febriani R, Triputra S. Usability of jawara sains mobile learning application using system usability scale (sus). Jurnal Online Informatika. 2021; 6; 1: 41-5. 10.15575/join.v6i1.700</bibtext> </blist> <blist> <bibtext> Wang S, De Boeck P, Yotebieng M. Heywood cases in unidimensional factor models and item response models for binary data. Applied Psychological Measurement. 2021; 47; 2: 141-15. 10.1177/01466216231151701</bibtext> </blist> <blist> <bibtext> Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and psychological measurement. 2013; 73; 6: 913-934. 10.1177/0013164413495237</bibtext> </blist> <blist> <bibtext> Yildiz Durak H. Examining the acceptance and use of online social networks by preservice teachers within the context of unified theory of acceptance and use of technology model. Journal of Computing in Higher Education. 2019; 31; 1: 173-20. 10.1007/s12528-018-9200-6</bibtext> </blist> </ref> <ref id="AN0179669791-31"> <title> Footnotes </title> <blist> <bibtext> https://en.sce.ac.il/</bibtext> </blist> <blist> <bibtext> https://<ulink href="http://www.ibm.com/docs/en/SSLVMB%5f28.0.0/pdf/IBM%5fSPSS%5fStatistics%5fBrief%5fGuide.pdf">www.ibm.com/docs/en/SSLVMB%5f28.0.0/pdf/IBM%5fSPSS%5fStatistics%5fBrief%5fGuide.pdf</ulink></bibtext> </blist> <blist> <bibtext> https://123.physics.ucdavis.edu/reports_files/KaleidaGraph-Manual.pdf</bibtext> </blist> </ref> <aug> <p>By Genady Kogan; Hadas Chassidim and Irina Rabaev</p> <p>Reported by Author; Author; Author</p> <p></p> <p>Genady Kogan is a faculty member at Shamoon College of Engineerings Department of Software Engineering. He holds B.Sc., M.Sc in Software Engineering from the Shamoon College of Engineering.</p> <p>Hadas Chassidim is a faculty member at Shamoon College of Engineerings Department of Software Engineering. She holds B.Sc., M.Sc. and Ph.D degrees in Industrial Engineering from Ben-Gurion University (2013). Her research deals with software quality and testing, human-computer interaction, usable privacy and security.</p> <p>Irina Rabaev received her Ph.D. in Computer Science from Ben-Gurion University of the Negev, Israel. Currently, she is a faculty member at the Shamoon Academic College of Engineering, Beer-Sheva, Israel. Irina is one of the co-developers of the online Data Structures course on campus.il. Over the years, he has been awarded multiple times for outstanding teaching.</p> </aug> <nolink nlid="nl1" bibid="bib39" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib20" firstref="ref3"></nolink> <nolink nlid="nl3" bibid="bib21" firstref="ref4"></nolink> <nolink nlid="nl4" bibid="bib29" firstref="ref5"></nolink> <nolink nlid="nl5" bibid="bib26" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib24" firstref="ref7"></nolink> <nolink nlid="nl7" bibid="bib23" firstref="ref8"></nolink> <nolink nlid="nl8" bibid="bib25" firstref="ref10"></nolink> <nolink nlid="nl9" bibid="bib31" firstref="ref12"></nolink> <nolink nlid="nl10" bibid="bib10" firstref="ref13"></nolink> <nolink nlid="nl11" bibid="bib14" firstref="ref16"></nolink> <nolink nlid="nl12" bibid="bib12" firstref="ref17"></nolink> <nolink nlid="nl13" bibid="bib11" firstref="ref19"></nolink> <nolink nlid="nl14" bibid="bib13" firstref="ref24"></nolink> <nolink nlid="nl15" bibid="bib15" firstref="ref25"></nolink> <nolink nlid="nl16" bibid="bib16" firstref="ref41"></nolink> <nolink nlid="nl17" bibid="bib34" firstref="ref42"></nolink> <nolink nlid="nl18" bibid="bib32" firstref="ref46"></nolink> <nolink nlid="nl19" bibid="bib74" firstref="ref49"></nolink> <nolink nlid="nl20" bibid="bib27" firstref="ref50"></nolink> <nolink nlid="nl21" bibid="bib33" firstref="ref51"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1439490
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Efficacy of Animation and Visualization in Teaching Data Structures: A Case Study
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Genady+Kogan%22">Genady Kogan</searchLink> (ORCID <externalLink term="http://orcid.org/0009-0004-2974-1547">0009-0004-2974-1547</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hadas+Chassidim%22">Hadas Chassidim</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-3575-9602">0000-0002-3575-9602</externalLink>)<br /><searchLink fieldCode="AR" term="%22Irina+Rabaev%22">Irina Rabaev</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-8542-8342">0000-0002-8542-8342</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Educational+Technology+Research+and+Development%22"><i>Educational Technology Research and Development</i></searchLink>. 2024 72(4):2349-2372.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 24
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research<br />Tests/Questionnaires
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Animation%22">Animation</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Experience%22">Learning Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Objective+Tests%22">Objective Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Usability%22">Usability</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Intention%22">Intention</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics+Education%22">Statistics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+Aids%22">Visual Aids</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s11423-024-10382-w
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1042-1629<br />1556-6501
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The main goal of this study was to evaluate the impact of an animation and visualization of data structures (AVDS) tool on both perceptions and objective test performance. The study involved a rigorous experiment that assessed the usability, acceptability, and effectiveness of the AVDS tool in solving exercises. A total of 78 participants responded to questionnaires and were exposed to the AVDS tool, after which they completed a performance test, half (39) with the AVDS tool (the experimental group) and half (39) without the tool (the control group). Findings showed that the usability of AVDS was good; the experimental group even perceived AVDS usability as excellent. The results show that perceived usefulness, perceived ease of use, and attitudes toward usage jointly led to positive intention to use the AVDS tool. Furthermore, perceived ease of use was a key factor influencing participants' intention to use AVDS. In addition, the AVDS system improved test results and provided flexibility in use, enhancing learning experience and performance.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1439490
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1439490
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11423-024-10382-w
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 2349
    Subjects:
      – SubjectFull: Animation
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Learning Experience
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Objective Tests
        Type: general
      – SubjectFull: Usability
        Type: general
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: Intention
        Type: general
      – SubjectFull: Statistics Education
        Type: general
      – SubjectFull: Visual Aids
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Computer Software
        Type: general
    Titles:
      – TitleFull: The Efficacy of Animation and Visualization in Teaching Data Structures: A Case Study
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Genady Kogan
      – PersonEntity:
          Name:
            NameFull: Hadas Chassidim
      – PersonEntity:
          Name:
            NameFull: Irina Rabaev
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1042-1629
            – Type: issn-electronic
              Value: 1556-6501
          Numbering:
            – Type: volume
              Value: 72
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Educational Technology Research and Development
              Type: main
ResultId 1