View in EDS HTML Full Text PDF Full Text

Productive Disciplinary Engagement in High- and Low-Outcome Student Groups: Observations from Three Collaborative Science Learning Contexts

Saved in:
Bibliographic Details
Title: Productive Disciplinary Engagement in High- and Low-Outcome Student Groups: Observations from Three Collaborative Science Learning Contexts
Language: English
Authors: Koretsky, Milo D., Vauras, Marja (ORCID 0000-0002-0043-9975), Jones, Cheryl, Iiskala, Tuike, Volet, Simone
Source: Research in Science Education. Sep 2021 51:159-182.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 24
Publication Date: 2021
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: EEC1261930
Document Type: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Higher Education
Postsecondary Education
Descriptors: Cooperative Learning, Science Education, Outcomes of Education, Learner Engagement, Cognitive Processes, High School Students, Secondary School Science, College Science, Veterinary Medicine, Undergraduate Students, Science Achievement, High Achievement, Low Achievement, Expertise
DOI: 10.1007/s11165-019-9838-8
ISSN: 0157-244X
Abstract: This study explored how productive disciplinary engagement (PDE) is associated with the level of cognitive activity and collective group outcome in collaborative learning across multiple contexts. Traditionally, PDE has been studied in a single collaborative learning environment, without analysis of how these environments fulfill the supporting conditions for PDE. In addition, research on the quality of a collective learning outcome and product in relation to the extent of the group's PDE during actual collaborative learning processes is scarce. In this study, the learning processes of low- and high-outcome small groups were compared within three collaborative learning contexts: high school general science, second year university veterinary science, and fourth year university engineering. Two meaningful and self-contained phases from each context were selected for analysis. The same theory-based analytical methods were used across contexts. The findings revealed similar patterns in the high school science and second year university veterinary science data sets, where high-outcome groups displayed a greater proportion of high-level cognitive activity while working on the task. Thus, they could be distinctively perceived as high- and low-performing groups. These high-performing groups' interactions also reflected more of the supporting conditions associated with PDE than the low-performing groups. An opposite pattern was found in the fourth year university engineering data set, calling for interpretation grounded in the literature on the nature and development of expertise. This study reveals the criticality of using comparable analytical methods across different contexts to enable discrepancies to emerge, thus refining our contextualized understanding of PDE in collaborative science learning.
Abstractor: As Provided
Entry Date: 2021
Accession Number: EJ1311983
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwE60YHPlV25oN_z8G53EtuSAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDEj-HSXL54LmGl3P_wIBEICBm3Xg-5g8bqL1HUX8tlZUrp1MpmMUuCv9MgmWek79TX54OVkVpbbVxLvOARAxbAAO1uqsMWkDu_6CCKa_WQxmtgvlVc9ctWU44w_e9bkEr_2Q-uAKIvruNOaGOXSQTQRnB6gim-yMq_BIEWRbTnkfghCktgkJZTqCTinKiUnlnvDkvnPdTggJZOkSJOuy80VCN-Si07Nh45BH47nD
Text:
  Availability: 1
  Value: <anid>AN0152948400;g7202sep.21;2021Oct13.02:23;v2.2.500</anid> <title id="AN0152948400-1">Productive Disciplinary Engagement in High- and Low-Outcome Student Groups: Observations From Three Collaborative Science Learning Contexts </title> <p>This study explored how productive disciplinary engagement (PDE) is associated with the level of cognitive activity and collective group outcome in collaborative learning across multiple contexts. Traditionally, PDE has been studied in a single collaborative learning environment, without analysis of how these environments fulfill the supporting conditions for PDE. In addition, research on the quality of a collective learning outcome and product in relation to the extent of the group's PDE during actual collaborative learning processes is scarce. In this study, the learning processes of low- and high-outcome small groups were compared within three collaborative learning contexts: high school general science, second year university veterinary science, and fourth year university engineering. Two meaningful and self-contained phases from each context were selected for analysis. The same theory-based analytical methods were used across contexts. The findings revealed similar patterns in the high school science and second year university veterinary science data sets, where high-outcome groups displayed a greater proportion of high-level cognitive activity while working on the task. Thus, they could be distinctively perceived as high- and low-performing groups. These high-performing groups' interactions also reflected more of the supporting conditions associated with PDE than the low-performing groups. An opposite pattern was found in the fourth year university engineering data set, calling for interpretation grounded in the literature on the nature and development of expertise. This study reveals the criticality of using comparable analytical methods across different contexts to enable discrepancies to emerge, thus refining our contextualized understanding of PDE in collaborative science learning.</p> <p>Keywords: Productive disciplinary engagement; Cognitive activity; Learning outcome; Science learning; Senior high school students; University students</p> <hd id="AN0152948400-2">Introduction</hd> <p>Collaborative environments have been widely recommended to support students' science learning. There is evidence that working collaboratively in small groups is positively associated with students' achievement in science in high school (e.g., Bowen [<reflink idref="bib4" id="ref1">4</reflink>]; Kirschner et al. [<reflink idref="bib21" id="ref2">21</reflink>]) and at the university level (e.g., Springer et al. [<reflink idref="bib36" id="ref3">36</reflink>]; Stump et al. [<reflink idref="bib38" id="ref4">38</reflink>]). However, simply offering students the opportunity to work in a group setting is not sufficient to support high-level science learning (e.g., Khosa and Volet [<reflink idref="bib20" id="ref5">20</reflink>]; Sampson and Clark [<reflink idref="bib33" id="ref6">33</reflink>]; Volet et al. [<reflink idref="bib43" id="ref7">43</reflink>]).</p> <p>Several necessary conditions have been identified for collaborative environments to increase learning in science. They range from the context and quality of the learning task to the groups' engagement in the interpersonal coordination of their cognitive processes. In regard to learning tasks and contexts, many researchers have described the advantages of authentic, complex, and challenging science learning activities that engage student groups in disciplinary practices (Brown et al. [<reflink idref="bib6" id="ref8">6</reflink>]; Ford and Forman [<reflink idref="bib14" id="ref9">14</reflink>]). When embedded in school science projects the likelihood of students transferring the skills learned at school to professional practice increases (Bransford et al. [<reflink idref="bib5" id="ref10">5</reflink>]; Johri and Olds [<reflink idref="bib18" id="ref11">18</reflink>]; Stevens et al. [<reflink idref="bib37" id="ref12">37</reflink>]). Such projects are most effective when they are "group-worthy," where the task is complex enough that each student needs to contribute his or her ideas but also to draw from the resources and perspectives of other group members (Horn [<reflink idref="bib17" id="ref13">17</reflink>]; Lotan [<reflink idref="bib26" id="ref14">26</reflink>]).</p> <p>The present study capitalizes on recent conceptualizations of productive disciplinary engagement (PDE; Engle [<reflink idref="bib9" id="ref15">9</reflink>]; Engle and Conant [<reflink idref="bib10" id="ref16">10</reflink>]). It extends to what is currently known about productive engagement in disciplinary thinking and practices in collaborative science learning beyond isolated settings to establish how PDE manifests across disciplinary learning contexts at different levels of education. We use the same methodological approach to investigate the nature of productive collaborative learning in three group-worthy projects completed in three different disciplinary learning contexts.</p> <hd id="AN0152948400-3">Productive Disciplinary Engagement in Science Learning</hd> <p>During the past few decades, many instructional improvement efforts in science, technology, engineering, and mathematics (STEM) have attempted to implement classroom practices that resemble disciplinary practices, such as modeling or argumentation (National Council of Teachers of Mathematics [<reflink idref="bib27" id="ref17">27</reflink>]; National Research Council [<reflink idref="bib28" id="ref18">28</reflink>]). This movement has occurred in North America, South America, Europe, and elsewhere in the world (Engle [<reflink idref="bib9" id="ref19">9</reflink>]; Forman et al. [<reflink idref="bib15" id="ref20">15</reflink>]). Productive engagement in science learning has its own research tradition. A general definition of engagement is "active, goal-directed, flexible, constructive, persistent, focused interactions with social and physical environments" (Furrer and Skinner [<reflink idref="bib16" id="ref21">16</reflink>], p. 149).</p> <p>In the present study, we applied Engle and Conant's ([<reflink idref="bib10" id="ref22">10</reflink>]; Engle [<reflink idref="bib9" id="ref23">9</reflink>]) framework of productive disciplinary engagement (PDE) because it aims to capture the kinds of interaction with people and objects that are likely to result in deep learning of science concepts and practices. PDE was developed to serve as a common framework to help learning scientists make comparisons across case studies of innovative instructional projects (Forman et al. [<reflink idref="bib15" id="ref24">15</reflink>]). For Engle and Conant ([<reflink idref="bib10" id="ref25">10</reflink>]; see also Engle [<reflink idref="bib9" id="ref26">9</reflink>]), engagement is productive to the extent that conceptual or practical progress on a problem is made over time. Disciplinary engagement involves "real work" coordinated between individuals and groups, where "action [is] informed by meaning drawn from a particular group context" (Cook and Brown [<reflink idref="bib7" id="ref27">7</reflink>], p. 387) and to the degree that participants use the concepts and practices of the discipline to achieve their aims (Engle [<reflink idref="bib9" id="ref28">9</reflink>]; Ford and Forman [<reflink idref="bib14" id="ref29">14</reflink>]). In short, PDE is assumed to occur when learners use the language, concepts, and practices of the discipline in authentic tasks to "get somewhere" (e.g., develop a product or improve a process) over time.</p> <hd id="AN0152948400-4">PDE in Designing Science Learning Environments and Understanding the Quality of Learning</hd> <p>The PDE framework was developed around the turn of the century in response to a general challenge posed to the community of learning scientists immersed in development and research on an array of innovative learning environments (see Engle [<reflink idref="bib9" id="ref30">9</reflink>]). It intends to provide general guiding principles for both designing and understanding the quality of learning environments. Fundamentally, PDE represents a state of learner engagement (Engle and Conant [<reflink idref="bib10" id="ref31">10</reflink>]). PDE is characterized by student interactions around issues core to a discipline (e.g., chemistry, biology, veterinary science, and chemical engineering) and manifests by richer use of the practices and discourse of the discipline than in traditional learning environments. In addition, student interactions that result in meaningful disciplinary progress can be seen as expressions of PDE. When learners' interactions are characterized by PDE, learners are more likely to demonstrate a deep understanding of concepts and the incorporation of disciplinary practices (e.g., Cornelius and Herrenkohl [<reflink idref="bib8" id="ref32">8</reflink>]; Scott et al. [<reflink idref="bib34" id="ref33">34</reflink>]; Venturini and Amade-Escot [<reflink idref="bib40" id="ref34">40</reflink>]).</p> <p>In order to support instructional design, Engle ([<reflink idref="bib9" id="ref35">9</reflink>]) described four supportive conditions for PDE as a system of tensions along two poles: authority-accountability and problematizing-resources, defined as follows:</p> <p></p> <ulist> <item> <emph>Authority</emph>: Students have authority to address problems. Specifically, (i) students have agency in identifying, formulating, and solving problems; and (ii) instructors publicly position students as stakeholders and producers of knowledge.</item> <p></p> <item> <emph>Accountability</emph>: Students' work is made accountable to others and to disciplinary norms. Ford ([<reflink idref="bib13" id="ref36">13</reflink>]) elaborated this idea further by claiming that, in addition to accountability to the norms of the discipline, students (and professionals) in science are also accountable to nature.</item> <p></p> <item> <emph>Problematizing</emph>: Students are encouraged to identify and take on disciplinary problems. Engle ([<reflink idref="bib9" id="ref37">9</reflink>]) identified three aspects of problematizing: (i) it engenders genuine uncertainty; (ii) it is in some way responsive to the learner's commitments; and (iii) it embodies "big ideas" or some other central aspect of the discipline.</item> <p></p> <item> <emph>Resources</emph>: Students are provided with sufficient resources to do this work, including both elements such as sufficient background information and time, and resources for promoting authority and accountability—for example, through class presentations or meetings with disciplinary experts.</item> </ulist> <p>Engle ([<reflink idref="bib9" id="ref38">9</reflink>]) examined 23 innovative learning environments and showed that instructional environments that substantially embody the four elements (two poles) foster PDE, while those that have missing elements or even disproportionate emphasis on one of the poles (e.g., too much authority and not enough accountability) do not. Engle and colleagues' conceptualization of PDE has been connected to several innovative science instructional environments, and findings based on PDE have provided a foundation for design-based research projects throughout the learning sciences and science education communities (Forman et al. [<reflink idref="bib15" id="ref39">15</reflink>]). While empirical investigations of PDE have been carried out primarily in activities constructed to develop students' conceptual knowledge directly through argumentation, there is an emerging research on the use of design tasks to promote PDE (Apedoe and Ford [<reflink idref="bib1" id="ref40">1</reflink>]; Koretsky et al. [<reflink idref="bib22" id="ref41">22</reflink>]; Koretsky et al. [<reflink idref="bib24" id="ref42">24</reflink>]). PDE clearly combines "doing" and "thinking" in practice.</p> <p>To date, however, there is still a paucity of empirical studies grounded in Engle and Conant's conceptualization of PDE (Engle [<reflink idref="bib9" id="ref43">9</reflink>]; Engle and Conant [<reflink idref="bib10" id="ref44">10</reflink>]) in STEM collaborative learning contexts, and these studies present limitations. Most studies have investigated single collaborative learning contexts (see, e.g., Koretsky et al. [<reflink idref="bib23" id="ref45">23</reflink>]; Sinatra et al. [<reflink idref="bib35" id="ref46">35</reflink>]) and provided only brief illustrations of the features of PDE (Forman et al. [<reflink idref="bib15" id="ref47">15</reflink>]). It is only recently that some researchers have analyzed collaborative groups' interaction data regarding a subset of the supporting conditions for PDE poles: for example, authority and accountability in mathematics learning (Boaler and Sengupta-Irving [<reflink idref="bib2" id="ref48">2</reflink>]) or problematizing in physics (Phillips et al. [<reflink idref="bib30" id="ref49">30</reflink>]). Furthermore, it is plausible to claim that prior studies have not made explicit how learning environments display the supporting conditions for PDE and, in turn, how this is reflected in students' activities. In other words, the crucial link between the supporting conditions that support design of learning environments and subsequent student groups' PDE in those environments has remained unexplained. To refine our understanding of the PDE framework and, in particular, how PDE manifests during collaborative learning, empirical research needs to be conducted across contexts with the same method of data analysis, and it should explicitly take into account the supporting features of learning environments. The study reported in this article aimed to address this issue through the use of a theoretically driven research design, data from three distinct learning contexts that varied in discipline and educational level in which the studies were implemented, and the adoption of a common analytical approach for all datasets.</p> <hd id="AN0152948400-5">Main Aims</hd> <p>Through the lens of PDE (Engle [<reflink idref="bib9" id="ref50">9</reflink>]), this study characterizes the ways that students working in small groups in different collaborative science learning activities co-construct their conceptual understanding as they make (produce) something together. For this purpose, this study encompassed three different learning contexts (varying in discipline and educational level, as described in the "Method" section) that were designed intentionally to foster PDE, thus substantially embodying Engle's ([<reflink idref="bib9" id="ref51">9</reflink>]) conceptualization of PDE in collaborative learning but differing in the nature of the activities. Using three distinct and varied contexts instead of only one was expected to strengthen the findings of this study. In each context, we selected a high- and a low-outcome group and assessed their level of cognitive activity in terms of students' engagement with the science content as they interacted. Consistent with prior research (Khosa and Volet [<reflink idref="bib20" id="ref52">20</reflink>]), cognitive activity was operationalized as any talk related to the task and science content processing. It could range from gathering and collating information (low level) to knowledge co-construction and scientific meaning making (high level). Examining systematically the extent to which groups engaged in high-level cognitive activity was important, since the conditions for PDE, such as exercising authority, displaying accountability to peers and the discipline, problematizing, and using sufficient resources as a group, all imply deep-level knowledge processing. From the discourse, we identified evidence and features of PDE as it unfolded in real time during their collaborative work.</p> <p>The overall objective of the study was to explore PDE in a systematic way across distinct and varied educational contexts and levels. First, we sought to characterize the extent to which the quality of the small groups' collective learning outcome, in collaborative science learning environments designed to support PDE, is related to the quality of their cognitive activity during their work on the task. We then compared the manifestations of PDE in high- and low-outcome groups, focusing in particular on how these groups took up affordances for PDE, in relation to the four supporting conditions of Engle and Conant ([<reflink idref="bib10" id="ref53">10</reflink>]; Engle [<reflink idref="bib9" id="ref54">9</reflink>]).</p> <p>Two research questions guided this study, as follows:</p> <p></p> <ulist> <item> How do the high- and low-outcome student groups in the three learning contexts differ in the level of their cognitive activity during a collaborative learning task? Based on prior research (Khosa and Volet [<reflink idref="bib20" id="ref55">20</reflink>]; Volet et al. [<reflink idref="bib43" id="ref56">43</reflink>]), it was hypothesized that, within each learning context, the group that produced a high-level outcome would display a greater proportion of high-level cognitive activity than the group that produced a low-level outcome (H1).</item> <p></p> <item> To what extent do the interactions of high- and low-outcome student groups in the three learning contexts reflect the supporting conditions for PDE (authority, accountability, problematizing, and resources) afforded to them by their learning context? In light of the scarce empirical evidence in the PDE literature to date, only the following hypothesis could be generated. It was hypothesized that the student interactions in the higher outcome groups would more frequently reflect Engle's ([<reflink idref="bib9" id="ref57">9</reflink>]) supporting conditions for PDE than their lower outcome counterpart (H2).</item> </ulist> <hd id="AN0152948400-6">Method</hd> <p></p> <hd id="AN0152948400-7">Participants</hd> <p>The study participants were high school students from Finland and university students from Australia and the USA. Table 1 provides information on the background of each sample and each of the collaborative tasks. The students' age range varied from 16 to 18 years old (senior high school general science) to predominantly 19–25-year-old students (second year university veterinary science and final year university engineering). In high school, groups were partly self-selected but the teachers tried to ensure that they were heterogeneous in terms of content knowledge, and that at least one student was skilled enough in English (the virtual environment was in English) in order to make it possible for the group to complete the demanding task. At the university level, students self-selected into groups, either on the basis of personal preference (veterinary students) or individual choice of virtual laboratory (engineering students). Two groups from the larger pool who completed the project were selected for analysis at each research site—one group with a low-quality outcome and one with a high-quality outcome.</p> <p>Table 1 Data of the study</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th><p>Country</p></th><th><p>Level of education Discipline</p></th><th><p>Task phases by same groups</p></th><th rowspan="2"><p>Selection of extreme groups based on independent assessment of outcome quality of the product</p></th><th rowspan="2"><p>Task and context particulars</p></th></tr><tr><th><p>Type of data</p></th><th><p>Group composition</p></th><th><p>Material/tools</p></th></tr></thead><tbody><tr><td rowspan="4"><p>Finland</p><p>Video and transcript</p></td><td><p>High school (16–18 y.o.)</p></td><td rowspan="2"><p>Phase 1: generate hypothesis</p></td><td><p>Quality of PPT presentation</p></td><td rowspan="4"><p>Phase 1: groups had to generate a hypothesis. Phase 2: groups had to analyze results based on an experiment that they conducted, and prepare a presentation based on their study. Context: groups had to carry out a scientific study within a collaborative virtual science learning environment—Virtual Baltic Sea Explorer (ViBSE). They needed to generate hypotheses, create a study plan, conduct the study, analyze results, and give a presentation.</p></td></tr><tr><td><p>Chemistry and biology</p></td><td><p>2 science teachers</p></td></tr><tr><td rowspan="2"><p>Two groups of 3 female students</p></td><td><p>Phase 2: analyze results/prepare a presentation</p></td><td><p>Scoring: inductive, content-based scale 0–5</p></td></tr><tr><td><p>Virtual laboratory</p></td><td><p>Gp A: score of 3/Gp B: score of 5 (extreme scores out of 29 groups)</p></td></tr><tr><td rowspan="5"><p>Australia</p><p>Video and transcripts</p></td><td rowspan="2"><p>University 2nd year undergraduates (mostly 19–25 y.o.)</p></td><td rowspan="2"><p>Phase 1: generate learning objectives</p></td><td><p>Quality of concept map</p></td><td rowspan="5"><p>Phase 1: groups had to generate learning objectives linked to their unique (teacher-allocated) clinical case study. Phase 2: groups had to create a case map with associative and causal linkages using supplied "concept" (symptoms, diagnostics, treatment) cards related to a clinical case. Context: cases treated at university veterinary hospital allocated to groups to reconstruct. Each group's learning objectives underpinned a presentation of their case study.</p></td></tr><tr><td><p>Expert teachers</p></td></tr><tr><td><p>Veterinary science</p></td><td rowspan="2"><p>Phase 2: construct a concept map of a clinical case</p></td><td rowspan="2"><p>Scoring: % age agreement between group maps and expert maps (selected concepts and links between them, associative or causal)</p></td></tr><tr><td rowspan="2"><p>One group of 5 female and 1 male and one of 4 females and 1 male</p></td></tr><tr><td><p>Glass board; set of concept/case cards</p></td><td><p>Gp A: score 56%/Gp B: score 92% (extreme scores out of 11 groups)</p></td></tr><tr><td rowspan="4"><p>USA</p><p>Audio and transcripts</p></td><td><p>University 4th year undergraduates (mostly 21–25 y.o.)</p></td><td><p>Phase 1: exploring resources</p></td><td><p>Quality of memorandum and meeting interactions with instructor</p></td><td rowspan="4"><p>Phase 1: groups had to develop initial experimental plans. Data were selected once students completed initial orientation and project management activities (setting meeting times; examining the assignment). Phase 2: groups had to finalize their experimental plan and articulate it in a design strategy memorandum. Context: groups placed in the role of real-world engineers tasked with optimizing an industrial process.</p></td></tr><tr><td><p>Chemical, biological, or environmental engineering</p></td><td><p>Phase 2: constructing the memorandum</p></td><td><p>The project supervisor</p></td></tr><tr><td rowspan="2"><p>Two groups of 2 males and 1 female</p></td><td rowspan="2"><p>Virtual laboratory</p></td><td><p>Scoring: content-based, scale 0–10</p></td></tr><tr><td><p>Gp A score: 8/Gp B score: 10 (largest difference in grade within cohort of available data out of 22 groups)</p></td></tr></tbody></table> </ephtml> </p> <p>All participation in the research was voluntary, and written permission for video or audio recording the groups' interactions was sought from all students (and custodians if students were under 18 years of age). The participants were fully informed as to why they were participating in the research, what data would be used for research purposes, and were permitted to withdraw their participation during any phase of the research. Data were anonymized and original materials were stored according to the regulations of each country. In all phases of the research, ethical principles were strictly followed in accordance with the national guidelines of each country (Finland, Australia, and the USA).</p> <hd id="AN0152948400-8">Data on Interaction and Collective Outcome</hd> <p>In all learning contexts, small groups of students were recorded as they worked on a collaborative science learning task over an extended period. In all tasks, the groups had to deliver a tangible collective product. Data for this study included transcripts of the groups' interactions during two distinct phases of the overall task and the outcome of each group's collective product (see Table 1). For the high school general science groups, the outcome was the group's joint, final presentation to the class. For the university veterinary science students, the outcome was the jointly constructed map of their clinical case, and for the university engineering students, it was the memorandum jointly written, which formed the basis of a meeting with the instructor to discuss their experimental design for the project. The quality of outcome was assessed separately at each research site by experts in the discipline and independently from the process data (see Table 1).</p> <hd id="AN0152948400-9">Collaborative Science Learning Environments</hd> <p>All three learning environments placed students in groups that positioned them in disciplinary roles. The learning environments were specifically designed to offer opportunities for students to engage in the four supporting conditions of PDE postulated by Engle ([<reflink idref="bib9" id="ref58">9</reflink>]), namely <emph>authority</emph>, <emph>accountability</emph>, <emph>problematizing</emph>, and <emph>resources</emph>. The specific features of each context that were designed to support PDE are summarized in Table 2 and presented next.</p> <p>Table 2 Summary of the PDE design principles and supporting task features in the three contexts</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th /><th><p>High school general science</p></th><th><p>Second year university veterinary science</p></th><th><p>Fourth year university engineering</p></th></tr></thead><tbody><tr><td><p>Authority</p></td><td><p>Authority to conduct field-based scientific inquiry.</p></td><td><p>Authority to formulate and argue on cause and effect relations in regard to a clinical case.</p></td><td><p>Authority to undertake an iterative design project with many possible solution paths.</p></td></tr><tr><td><p>Accountability</p></td><td><p>Held accountable to other students in their group, and to the entire class and the teacher through public presentation.</p></td><td><p>Held accountable to other students in their group, and to the entire class, instructors and clinicians through public presentation and discussion.</p></td><td><p>Held accountable to others in their group, and to the entire class and the instructors/supervisors through public presentation. Accountable to nature through the simulated reactor data.</p></td></tr><tr><td><p>Problematizing</p></td><td><p>Embedded and needed to progress in the experimental research task.</p></td><td><p>Generating and researching learning objectives that pertained to key aspects of the clinical case; reasoning and solving a genuine clinical case.</p></td><td><p>Embedded and needed to address a design task with competing constraints and limited financial resources.</p></td></tr><tr><td><p>Resources</p></td><td><p>Authentic data of marine biologists; various knowledge sources embedded in the software; virtual environment to perform scientific inquiry.</p></td><td><p>Authentic case material from the clinicians who attended that case in the hospital; scientific publications relating to the clinical condition.</p></td><td><p>Prior coursework, introductory lectures, internet resources, computation resources, and virtual environment to perform engineering design.</p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0152948400-10">High School General Science</hd> <p>The Virtual Baltic Sea Explorer (ViBSE) web-based software was designed to provide high school students with adequate and inspiring tools and resources to build new integrated knowledge in two disciplines, biology and chemistry. The virtual learning environment provided a bridge between the school and science worlds by positioning students as researchers and fostering their adoption of the practices, objectives, and methods that guide the authentic research of professional scientists. In being challenged with a complex research task, the student groups had authority to formulate research questions, hypotheses, and research design; carry out their experiments by using authentic data from marine biologists; and draw conclusions based on outcomes. Problematizing was a natural and necessary function throughout the whole research process. Students had the responsibility to consult original knowledge sources and to share their scientific understandings with their groupmates, which fostered reciprocal accountability to each other, to the discipline, and to nature. After experimentation, the groups prepared a joint presentation to the whole class, followed by a discussion, thus further incorporating accountability to others and the discipline.</p> <hd id="AN0152948400-11">Second Year University Veterinary Science</hd> <p>The clinical case-based task was designed to provide students in veterinary science with an opportunity to apply their primary preclinical knowledge, studied so far at a university, to the underlying principles of treatment and management of a real-life clinical case. Through generating and researching learning objectives that addressed group-selected key aspects of their clinical case, students had opportunities to problematize their case within the group naturally and made decisions on the areas of specific interest to the group. After researching their designated aspect, each group member could then position her/himself as the author of the content ideas s/he explored in greater depth. Students' responsibility to consult original sources and share their scientific understandings with peers was expected to foster reciprocal accountability to each other and the discipline. Accountability to the discipline was further incorporated by having each group present their clinical case as a whole to the class, followed by an extended question and answer session with teachers and clinicians.</p> <hd id="AN0152948400-12">Fourth Year University Engineering</hd> <p>The Virtual Chemical Vapor Deposition (VCVD) process development project was designed to provide a bridge between university and industry by appropriating the practices, values, and goals of an industrial work group in a professional context. The groups were challenged with an open-ended design task, to develop a "recipe" of input parameters for an industrial reactor while considering competing constraints. The groups had the authority to develop one of many possible solutions using their own solution path. Concurrently, group members were accountable to their groupmates, to the discipline (through design meetings with the instructor who acted as their industrial supervisor), and to nature (through the output values of virtual experiments). Problematizing was critical as the groups addressed a design task with competing constraints and limited financial resources (students were charged virtual money to perform experiments). However, they also had access to resources that included their prior coursework, introductory lectures, internet resources, and feedback in the design meetings. The first part of this project is studied here, in which the groups collaboratively generated an initial design strategy that they described in a memorandum.</p> <p>In all learning environments, the students were assumed to adopt a role as a practicing professional: i.e., environmental research trainee, veterinary clinician, or process development engineer. The engineering learning context was, however, distinct from the other two learning contexts in that it involved a complex design process. In this context, there were no fixed algorithms or series of steps and the groups navigated through the design process using non-linear and iterative cycles of design ideation and analysis. While the project is structured around weekly milestones and deliverables, the work itself follows a unique path that unfolds differently for each group. Within the resources that are available to the students (e.g., feedback from the instructor, output data from the experiments, information in the technical literature, and knowledge and skills from prior engineering coursework), groups develop strategies and adapt or abandon them in a way that is iterative, open-ended, and temporally emergent (Pickering [<reflink idref="bib31" id="ref59">31</reflink>]). For any fixed point in the project, groups may be at very different stages in such a design approach. Therefore, taking a small sample of data at a fixed time may catch groups at very different places in task completion, and thus impede the comparability of the two groups relative to the other two contexts studied.</p> <hd id="AN0152948400-13">Interaction Data Analysis</hd> <p></p> <hd id="AN0152948400-14">Coding Cognitive Activity</hd> <p>Two distinct meaningful and self-contained collaborative interaction phases were identified and included in the analyses (see Table 1). Identifying the distinct phases was relatively easy for the high school science data and for the university veterinary science data, both of which had instructor-defined project phases. It was more challenging for the university engineering data, where the phases emerged through how the student groups chose to proceed. The two distinct task phases were as follows:</p> <p></p> <ulist> <item> For the high school science task: (i) generating a hypothesis and (ii) analyzing results and preparing a presentation;</item> <p></p> <item> For the university veterinary science task: (i) generating learning objectives and (ii) constructing a clinical case map; and</item> <p></p> <item> For the university engineering task: (i) initial information gathering and problem scoping and (ii) writing the design memorandum.</item> </ulist> <p>Next, a segment (approximately 10–16 min) of each phase was selected for in-depth analyses. Criteria for selection were that both segments were crucial for task performance and completion, and also required students' collaboration (verbal interaction). The decision to use segments of around 10 to 16 min for in-depth analysis was necessary to keep the systematic and in-depth data coding manageable and to ensure the length of the selected segments were similar across phases and groups. The finding that no statistical differences in cognitive activity were observed between phases for each group (see the "Results" section for more detail) supports the choice of 10 to 16 min for in-depth analysis.</p> <p>Across all sites, the small groups' verbal interactions formed the basis of the analyses. One group member's talk, whether it represented one word, or a nod (yes) or shaking head (no), or several sentences of talk, was counted as one interaction turn until another group member spoke. Cognitive activity was coded into three categories: off-task, low-level, and high-level cognitive activity. These categories are based on Volet et al. ([<reflink idref="bib42" id="ref60">42</reflink>]), Volet et al. ([<reflink idref="bib43" id="ref61">43</reflink>]), Khosa and Volet ([<reflink idref="bib20" id="ref62">20</reflink>]), and Koretsky et al. ([<reflink idref="bib22" id="ref63">22</reflink>]). Low-level cognitive activity included organizational tasks or confirming information. High-level cognitive activity included interactions that represented knowledge co-constructing, scientific meaning making, and conceptual linkage. Table 3 presents examples of low- and high-level cognitive activity from each learning context.</p> <p>Table 3 Cognitive activity coding categories and examples across learning contexts</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th><p>Level</p></th><th><p>Low</p></th><th><p>High</p></th></tr></thead><tbody><tr><td><p>Definition (see Khosa and Volet <xref ref-type="bibr" rid="bibr20">2014</xref>)</p></td><td><p>Talking about the content without conceptual justification or explanation, e.g., identifying, collating, or sharing factual information or discussing practical considerations</p></td><td><p>Talking about the content with justification or explanation, that is displaying engagement in the deeper understanding. Using concepts and practices of the discipline, e.g., meaning making with conceptual linkage</p></td></tr><tr><td rowspan="3"><p>High-school general science</p></td><td><p>Anna: "<italic>How many samples do we need?" (the task asks the number of samples)</italic></p></td><td><p>Emma: <italic>"What does happen if pH is higher but temperature is the same..."</italic></p></td></tr><tr><td><p>Emma: "<italic>Do not put any number, let's write only</italic>."</p></td><td rowspan="2"><p>Anna: <italic>"And when it is higher temperature..."</italic> (continues thinking that Emma started and tries to explain)</p></td></tr><tr><td><p>Anna: "<italic>Let's put that we need many samples..."</italic></p></td></tr><tr><td rowspan="6"><p>Second year university veterinary science</p></td><td><p>Renee: <italic>"Okay so blood, gas, and electrolytes."</italic></p></td><td><p>Thea: <italic>"Theoretically weight loss can cause Azotaemia..."</italic></p></td></tr><tr><td><p>Maddox: <italic>"That's normal."</italic></p></td><td rowspan="2"><p>Renee: <italic>"It can? Okay..."</italic> (Goes back to board and continues to draw arrows)</p></td></tr><tr><td rowspan="2"><p>Renee: <italic>"Yeah it does not seem very interesting to me."</italic></p></td></tr><tr><td rowspan="3"><p>Thea: <italic>"By breaking down more protein, therefore you have got more urea in your system..."</italic></p></td></tr><tr><td><p>Thea: <italic>"Did he have toxic neutrophils?"</italic></p></td></tr><tr><td><p>Renee: <italic>"Toxic neutrophils? Where are you reading that?"</italic></p></td></tr><tr><td rowspan="6"><p>Fourth year university engineering</p></td><td><p>Bodhi: <italic>"Yeah other testing..."</italic></p></td><td rowspan="4"><p>Alex: <italic>"Yeah. SCCM a little bit of that, we are working here and we are here. So, we are really close to um some of their ratios so here where you see the 4.3, this is a 40 Å per minute. Um they were working at 350 mTorr which is what we are going to be working at um and a 5:1 ratio and um...</italic>"</p></td></tr><tr><td><p>Alex: <italic>"...for our next set of testing. I agree with it for our first testing..."</italic></p></td></tr><tr><td><p>Alex: <italic>"For our next set of testing, we test the middle, we test the radial we test like some middle point somewhere else."</italic></p></td></tr><tr><td rowspan="3"><p>Marsden: <italic>"Sure."</italic></p></td></tr><tr><td><p>Bodhi: <italic>"... but we are doing 10:1."</italic></p></td></tr><tr><td><p>Alex: <italic>"... yeah we are doing 10:1 but so I mean uh and then the other zero of flow rate of 66 um so if we go to somewhere where we kind of so I guess we should get ..."</italic></p></td></tr></tbody></table> </ephtml> </p> <p>Due to the nature of the tasks and the number of group members participating (ranging from three to six), the number of interaction turns that were analyzed differed in the three learning contexts. For example, the high school science groups spent more time exploring information on the computer screen together and had fewer verbal interactions, whereas veterinary science students were engaged in joint discussion most of the time. Also, since all interactions were included, even if three students simultaneously said "yes," the number of group members could also influence the total number of turns (interactions).</p> <hd id="AN0152948400-15">Inter-Rater Reliability</hd> <p>In all three data sets, the principal coder was a native speaker. The principal coders also acted as inter-coders across data sets to ensure a reliable coding process. After the principal coder had completed the coding, the inter-coder assessed approximately 20% (19.9–25.6%) of the excerpts from both groups (low- and high-outcome groups) and both phases (phases 1 and 2) of the other sites. Inter-rater reliability for cognitive activity was at least substantial (see Landis and Koch [<reflink idref="bib25" id="ref64">25</reflink>], p. 165) in all datasets: high school general science, 87.6% (Cohen's kappa = 0.74); university veterinary science, 93.2% (Cohen's kappa = 0.85); and university engineering, 90.6% (Cohen's kappa = 0.79). There were only minor disagreements and these were resolved by discussion.</p> <hd id="AN0152948400-16">Statistical Analyses</hd> <p>We used statistical analysis to determine if there were differences in the frequency of low- and high-outcome cognitive activity based on group outcome. Statistical significance was determined using non-parametric statistical tests with an alpha level of 0.05. The differences in coding distributions were first evaluated using logistic regression with cognitive activity (high or low) as the dependent variable, group outcome as the independent variable, and phase and site as covariates. Based on the results of that first regression, the cognitive activity at each site was then analyzed individually with group outcome as the independent variable.</p> <hd id="AN0152948400-17">Identification of the Nature of Students' PDE</hd> <p>Exploration of PDE (ResQ2) involved qualitative analyses of the same 10–16 min of data used for the cognitive activity analyses from the three contexts and included both the high- and low-outcome groups.</p> <p>First, transcripts were analyzed in the three contexts independently of one another for evidence of students' engagement that reflected one or more of Engle's ([<reflink idref="bib9" id="ref65">9</reflink>]) four supporting conditions for PDE (authority, accountability, problematizing, and resources). In particular, the high-level cognitive activity episodes were explored for each group from both phases for instances in which PDE was present. Researchers in each context also focused on exploring the segments for interactions in which more than one of Engle's ([<reflink idref="bib9" id="ref66">9</reflink>]) PDE conditions were simultaneously present. Once high-level cognitive-coded interactions had been explored, episodes of low-level cognitive activity were also searched.</p> <p>Next, the research team agreed on two examples from each of the low- and high-outcome groups at each site, in order to provide best examples of data in which the presence of Engle's ([<reflink idref="bib9" id="ref67">9</reflink>]) supportive conditions for PDE was visible in group members' interactions. The aim was that examples represent different aspects of the conditions for PDE (authority, accountability, problematizing, and resources) relative to the group's particular learning context. If a group had minimal high-level cognitive activity and PDE was not evident, and instead mostly low-level cognitive activity (e.g., this was case in the low-outcome high school and the veterinary group's collaboration in the second phase), then examples identified from an episode of low-level cognitive activity were selected to highlight missed opportunities for PDE (for example, as shown in Tables 5 and 6).</p> <p>The length of the high-level cognitive activity episodes, from within which evidence of PDE was explicitly searched for, varied. The minimum requirement for an episode was two turns from different students within the group, but there was no upper limit of the length of the episodes. Cognitive activity episodes in which PDE was evident varied from this minimum amount of turns to an episode with over 100 turns in the veterinary science low-outcome group; however, that particularly long episode was an exception. For the high school groups, the length of high- or low-cognitive episodes was typically from two turns to over ten turns. For the engineering groups, it varied from two turns to over 30 turns. The 12 resulting examples, which are shown in Tables 4, 5, and 6 below, illustrate each group's thinking processes and how that thinking directed the way the group proceeded with the task.</p> <p>Table 4 Level of cognitive activity in different outcome groups across learning contexts</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th><p>Level of education and discipline</p></th><th colspan="2"><p>High school general science</p></th><th colspan="2"><p>Second year university veterinary science</p></th><th colspan="2"><p>Fourth year university engineering</p></th></tr><tr><th><p>Group outcome level</p></th><th><p>Low</p></th><th><p>High</p></th><th><p>Low</p></th><th><p>High</p></th><th><p>Low</p></th><th><p>High</p></th></tr></thead><tbody><tr><td><p>Total cognitive activity, f</p></td><td char="." align="char"><p>303</p></td><td><p>239</p></td><td char="." align="char"><p>605</p></td><td><p>580</p></td><td char="." align="char"><p>278</p></td><td><p>270</p></td></tr><tr><td><p>At high level, f</p></td><td char="." align="char"><p>30</p></td><td><p>64</p></td><td char="." align="char"><p>50</p></td><td><p>196</p></td><td char="." align="char"><p>136</p></td><td><p>69</p></td></tr><tr><td><p>% at high level</p></td><td char="." align="char"><p>9.9%</p></td><td><p>26.8%</p></td><td char="." align="char"><p>8.3%</p></td><td><p>33.8%</p></td><td char="." align="char"><p>48.9%</p></td><td><p>25.6%</p></td></tr><tr><td><p>Across groups</p></td><td colspan="2"><p>16.5%</p></td><td colspan="2"><p>20.7%</p></td><td colspan="2"><p>37.4%</p></td></tr></tbody></table> </ephtml> </p> <p>Table 5 Manifestations of PDE among high school students' interactions in general science</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th /><th><p>Analytical comments</p></th></tr></thead><tbody><tr><td><p>Low-outcome group</p></td><td /></tr><tr><td colspan="2"><p> Extract 1</p></td></tr><tr><td><p> Emma: <italic>Yes, it would have been good to know that if higher temperature and the cool is the same</italic>, so what is then ...</p></td><td rowspan="13"><p>Two different extracts were selected for this group displaying dominantly low-level cognitive activity. Extract 1 illustrates one of the rare episodes where the students' discussion partly features high-level cognitive activity. The group is thinking about the knowledge they lack while trying to figure out what kind of hypothesis to make. This episode displays some connection to the supporting conditions for PDE, namely, how the students are basing their thinking on the <italic>resources</italic> provided by the ViBSE. Further, this discussion shows <italic>evidence of problematizing</italic> and the end a <italic>hint of authority</italic>, but this remains kind of hanging in the air, unelaborated, as the group is prone to seek answers from resources rather than through shared reasoning. Engagement in deeper problem-solving halts, and attempts to use the available resources is not sufficient to achieve deep learning of science concepts and practices.</p></td></tr><tr><td><p> Olivia: <italic>Let's read once again, put it back</italic>. (takes mouse, and the all start to read)</p></td></tr><tr><td><p> Olivia: What is it? ... Here it is said about pH. ... What is this?</p></td></tr><tr><td><p> Emma: To change, I guess.</p></td></tr><tr><td><p> Olivia: Changes between levels depending on whether it is daytime or night</p></td></tr><tr><td><p> Emma: <italic>So do they come up at night?</italic></p></td></tr><tr><td><p> Olivia: No, it is sad just to change here, here is...</p></td></tr><tr><td><p> Anna: Or so</p></td></tr><tr><td><p> Olivia: So (like agrees)</p></td></tr><tr><td><p> Anna: There is variations and ...</p></td></tr><tr><td><p> Olivia: Hmm...</p></td></tr><tr><td><p> Anna: Should we put, do we start so that "We hypothesize that"?</p></td></tr><tr><td><p> Emma: <italic>So what do we hypothesize?</italic></p></td></tr><tr><td><p> Extract 2</p></td><td /></tr><tr><td><p> Anna: First is planning (refers how to proceed in their research process)</p></td><td rowspan="9"><p>Extract 2 shows that the group remains at a low cognitive level without a focus on the content. Although Anna and Emma display an awareness of their planning difficulties, their engagement is not productive. As in Extract 1, there is <italic>no evidence of problematizing</italic> the task <italic>or displaying authority</italic> in the research process. Rather, they take the task "as given," expecting the problem to be ready-made ("It's not clear what is a question in this research"). Also, they <italic>do not show accountability to each other or the discipline</italic>. They seem to proceed mechanically, just performing the task, which is a low-level cognitive activity.</p></td></tr><tr><td><p> Emma: Research plan (elaborates Anna's turn)</p></td></tr><tr><td><p> Anna: It's not clear what is a question in this research (starts to create a research question as a part of planning)</p></td></tr><tr><td><p> Emma: Confusing (shows uncertainty of the research question)</p></td></tr><tr><td><p> Anna: There are so many things here (explains reason for uncertainty)</p></td></tr><tr><td><p> Emma: (starts to list things)</p></td></tr><tr><td><p> Anna: How many samples do we need? (continues planning)</p></td></tr><tr><td><p> Emma: Don't put any number, let's write only</p></td></tr><tr><td><p> Anna: Let's put that we need many samples so that we get needed results of copepods, so many as possible</p></td></tr><tr><td colspan="2"><p>High outcome group</p></td></tr><tr><td colspan="2"><p> Extract 1</p></td></tr><tr><td><p> Ellen: <italic>What do we know about these issues?</italic></p></td><td rowspan="12"><p>Both extracts from this group's interactions feature high-level cognitive activity. In Extract 1, the group displays evidence of taking up the opportunities for PDE offered by the ViBSE learning environment in almost every individual contribution. Extract 1 was the starting point of the group collaborative learning process. Unlike their low-outcome counterpart, this group <italic>problematized</italic> the task at hand by pointing to their lack of prior content knowledge (e.g., "What do we know about these issues?") and did not just check what the material stated. This group also displayed <italic>authority and accountability to each other</italic> by sharing what they were thinking of the phenomenon and concluding they did not know much. Importantly, they also showed <italic>accountability to the discipline</italic>, especially, in attempting to account for why pH is important.</p></td></tr><tr><td><p> Sofia: <italic>So what do we know about ...?</italic></p></td></tr><tr><td><p> Ellen: And about other these things?...</p></td></tr><tr><td><p> Ellen: <italic>I do not know so much of this, I do not know about...</italic></p></td></tr><tr><td><p> Sofia: <italic>I don't know anything</italic>, <italic>really</italic>, so it's bad ...</p></td></tr><tr><td><p> Ellen: <italic>Why pH is important? So pH is, I don't know what's the situation but it's probably in a bad condition</italic></p></td></tr><tr><td><p> Sofia: In plankton, ecosystem (links the meaning to the larger entity), <italic>but what things are included in it</italic></p></td></tr><tr><td><p> Paula: <italic>I don't know anything else that...</italic></p></td></tr><tr><td><p> Sofia: <italic>Why is pH important?</italic></p></td></tr><tr><td><p> Ellen: <italic>Its effect on who can live there, is not it so?</italic> (in Baltic Sea)</p></td></tr><tr><td><p> Sofia: <italic>Probably so that some planktons cannot live there...</italic></p></td></tr><tr><td><p> Paula: <italic>We knew a lot, indeed</italic> (laughs because means opposite)</p></td></tr><tr><td colspan="2"><p> Extract 2</p></td></tr><tr><td><p> Sofia: <italic>So what did happen to the eggs... our hypothesis was wrong because...</italic>?</p></td><td rowspan="9"><p>This extract also features high-level cognitive activity, aimed at assessing the group thinking while generating and testing their hypotheses empirically. They are <italic>problematizing</italic> the phenomenon while creating a hypothesis, conducting an experiment, and drawing conclusions. The group displayed <italic>authorship and accountability</italic> of their ideas by comparing them with the discipline knowledge provided by the software.</p></td></tr><tr><td><p> Paula: ...<italic>they developed</italic></p></td></tr><tr><td><p> Ellen: Yes, it was</p></td></tr><tr><td><p> Paula: ...<italic>it affected positively</italic></p></td></tr><tr><td><p> Ellen: ... <italic>why does it go this way</italic></p></td></tr><tr><td><p> Paula: <italic>We were quite wrong</italic></p></td></tr><tr><td><p> Ellen: <italic>We were completely wrong</italic></p></td></tr><tr><td><p> Paula: It doesn't matter because it has to be learning</p></td></tr><tr><td><p> Ellen: Yes, this is learning</p></td></tr></tbody></table> </ephtml> </p> <p>Table 6 Manifestations of PDE among second year university students' interactions in veterinary science</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th /><th><p>Analytical comments</p></th></tr></thead><tbody><tr><td colspan="2"><p>Low-outcome group</p></td></tr><tr><td colspan="2"><p> Extract 1</p></td></tr><tr><td><p> Ghita: Yeah, I think dog fight can go off to the side (referring to the card on the board)</p></td><td rowspan="7"><p>Both extracts for this group feature low-level cognitive talk. Here, the group is trying to determine which concept cards belong in the case and which might be distractors. Their productive engagement with the task is in the realm of <italic>problematizing</italic>, as the group attempts to define the parameters of the case while not altogether ruling out possibilities that may warrant consideration. The talk is opinion-based and not explicitly supported by disciplinary knowledge.</p></td></tr><tr><td><p> Mark: Yeah, I was thinking that</p></td></tr><tr><td><p> Sheila: <italic>But dog fight could be a cause</italic></p></td></tr><tr><td><p> Jade: It could be a cause</p></td></tr><tr><td><p> Ghita: <italic>But it's not in our case we do not know what the cause is</italic></p></td></tr><tr><td><p> Sheila: <italic>It's possible</italic></p></td></tr><tr><td><p> Ghita: It is</p></td></tr><tr><td colspan="2"><p> Extract 2</p></td></tr><tr><td><p> Mark: And then, each one of these leading to all of those? (Referring to cards on board)</p></td><td rowspan="7"><p>Extract 2 is representative of a long (100+ turns) episode of low-level cognitive talk, with minimal linkage of construction of the case map with the group's clinical case file or background research. Members tend to readily agree, with little evidence of scientific engagement, clinical exploration, or justification of how and why concept map linkages were made. Tentative, <italic>low-level accountability or authority</italic>, often unsourced or unreferenced, was occasionally observed. When one member did <italic>attempt to halt the map-making to problematize</italic>, uptake was typically brief or cursory and met with generic low-level reference to resources, often posed as a question such as "did not it say somewhere...?", i.e., without accountability or authoritative use of resources. Task completion appeared mechanical and divorced from disciplinary engagement.</p></td></tr><tr><td><p> Sheila and Drita: Yep</p></td></tr><tr><td><p> Ghita: Yep</p></td></tr><tr><td><p> Jade: Mmmhmm</p></td></tr><tr><td><p> Mark: Ah what have I got? Like that really (... draws the lines and arrows)</p></td></tr><tr><td><p> Jade: yep</p></td></tr><tr><td><p> Ghita: yeah</p></td></tr><tr><td colspan="2"><p>High-outcome group</p></td></tr><tr><td colspan="2"><p> Extract 1</p></td></tr><tr><td><p> Thea: ... <italic>because retinal detachment relates to why the blood pressure was taken in the first place</italic>. <italic>That was our clinical sign as well as</italic>-</p></td><td rowspan="10"><p>Extract 1 displays evidence of high cognitive activity, during which members offer or request clarification of understanding, and continually challenge one another's interactions, which are steeped in the discourse of the discipline. Elements of <italic>accountability and authority</italic> come into play as resources, and clinical knowledge, background research, and wider discipline knowledge are deployed through problematizing the issues. In contrast to the low-performing group which, even when well into the task maintained comfortable low-level interactions about card placement for many turns, this high-outcome group offered and <italic>demanded accountability, engaged authoritatively and utilized clinical and discipline knowledge</italic> in their map construction from early in the task and throughout the entire process.</p></td></tr><tr><td><p> Renee: Okay so it would have a link here and here?</p></td></tr><tr><td><p> Blanca: Yeah</p></td></tr><tr><td><p> Thea: <italic>Yep. Probably between the retinal detachment and the amlodipine because the amlodipine would have stopped...</italic></p></td></tr><tr><td><p> Renee: Do you want me to start drawing?</p></td></tr><tr><td><p> Thea: Yes</p></td></tr><tr><td><p> Renee: Okay. So one-way arrow?</p></td></tr><tr><td><p> Thea: Two-way</p></td></tr><tr><td><p> Renee: Well it's a cause and effect is not it?</p></td></tr><tr><td><p> Thea: <italic>I'd, I'm not sure because you treat hypertension with amlodipine and then amlodipine modifies your hypertension so I'm not sure which way</italic>... we would put that arrow</p></td></tr><tr><td colspan="2"><p> Extract 2</p></td></tr><tr><td><p> Thea: ...<italic>what I'm saying is we've looked into proteinuria quite a bit and proteinuria is exacerbated by hypertension and yet causes hypertension so, it's a key thing</italic></p></td><td rowspan="6"><p>Extract 2 typifies the way in which this group went about the task. It shows how the group continued to undertake the construction of their map jointly, and also how they engaged in interactions that reflected all four of Engle's (<xref ref-type="bibr" rid="bibr9">2012</xref>) supporting conditions of PDE. For example, the <italic>authoritative</italic> use of resources closely linked to the group clinical case notes and research produced accountability. Like the high-performing high school group, this group built from <italic>problematizing</italic> early on, evolving over the task to increasingly engage in ways that reflected all four of Engle's conditions for PDE at increasingly advanced levels and from all group members. Engaging in a disciplinary talk, during which they also debated one another's thinking, thus enabled the learning affordances of the task to be fully realized, leading to a high-level outcome.</p></td></tr><tr><td><p> Blanca: Yeah</p></td></tr><tr><td><p> Thea: <italic>I haven't looked into azotaemia so much because I thought proteinuria was key in this case but you would expect that azotaemia means that you're retaining more urea in your blood which would lead to lower concentration of your urine... Urea absorption...</italic></p></td></tr><tr><td><p> Renee: <italic>Hang on if you're having more urea in your blood...</italic></p></td></tr><tr><td><p> Thea: Yes</p></td></tr><tr><td><p> Renee: ...<italic>because your kidneys have packed up wouldn't your blood pressure rise too? 'Cos you've got more things in your blood?</italic></p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0152948400-18">Results</hd> <p>Findings from the systematic analyses of the cognitive activity are presented first, since they serve as a basis for the subsequent PDE analyses. The findings and illustrations of the student groups' interactions in light of PDE are presented next, in an attempt to explain the possible differences between the groups from the perspective of disciplinary discourse.</p> <hd id="AN0152948400-19">Cognitive Activity in Three Distinct Learning Contexts</hd> <p>We first determined if there were statistical differences in the frequency of low- and high-level cognitive activity based on group outcome. Logistic regression of the entire data set revealed that high-level outcome groups showed significantly more high-level cognitive activity than low-level outcome groups (chi-square = 46.95; df = 1; <emph>p</emph> < 0.001). The covariate project phase did not significantly correlate with cognitive activity (chi-square = 3.49; df = 1; <emph>p</emph> = 0.066); however, the covariate site was significant, with high-level cognitive activity significantly increasing from the high school level to the 2nd year university level and then to the 4th year university level (chi-square = 87.86; df = 2; <emph>p</emph> < 0.001). In fact, site had a larger effect size than group outcome.</p> <p>Table 4 shows the breakdown by group outcome level within site. Since phase was not significantly different, we removed that variable from analysis and performed separate regressions for each site. The high-outcome groups at the two lower education levels (high school and 2nd year university) spent a significantly higher percentage of their cognitive activity at a high level (26.8 and 33.8%, respectively) than did their low-outcome group counterparts (9.9 and 8.3%, respectively) (HS: chi-square = 29.64; df = 1; <emph>p</emph> < 0.001; V: chi-square = 99.27; df = 1; <emph>p</emph> < 0.001). However, the opposite was observed for the 4th year university site, where the lower outcome group showed more high-level cognitive activity (E: chi-square = 18.56; df = 1; <emph>p</emph> < 0.001<bold>)</bold>.</p> <p>In summary, it was clear that the low-outcome groups in high school general science and second year university veterinary science were also the <emph>low-performing groups</emph> in terms of process data. They worked at the lower (i.e., more superficial) cognitive level more frequently than the high-outcome groups, which supports the first hypotheses (H1). The same did not apply to 4th year engineering students, in which case task outcome and cognitive activity did not match as it did in the other two groups. Next, PDE analyses were aimed to elucidate these qualitative performance differences.</p> <hd id="AN0152948400-20">Productive Disciplinary Group Engagement in the Three Learning Contexts</hd> <p>The key question of this study was to examine how the low- and high-outcome student groups across learning contexts take up affordances for PDE in learning environments designed to support Engle's ([<reflink idref="bib9" id="ref68">9</reflink>]) conditions for PDE. Across all contexts, PDE was reflected in discussions and the differences were characteristically not only quantitative but also qualitative. The PDE of the high school students typically focused on <emph>problematizing</emph> and was quite often paired with <emph>authority</emph> or, to a lesser degree, <emph>accountability</emph>. Similarly, the 4th year engineering student groups' discussions focused on <emph>problematizing</emph>, often accompanied by <emph>authority</emph> or <emph>accountability</emph>. In contrast, second year veterinary science student groups engaged more evenly in all four supporting conditions: <emph>authority</emph>, <emph>accountability</emph>, <emph>problematizing</emph>, and <emph>resources</emph>. Interestingly, from time to time, the university students' talk reflected simultaneously <emph>all</emph> four supporting conditions for PDE within a single episode (though much less so for the low-outcome veterinary science group, as described below), which never occurred with the high school students. Across all contexts, indications of PDE were more discernible when the students were discussing at the high cognitive level than at the low level.</p> <p>Further, there were distinct differences between the low- and high-outcome groups in high school science and veterinary science, supporting the second hypothesis (H2); that is, compared to low-outcome groups, high-outcome groups' discussions typically took place at the high cognitive level and more frequently contained the four supporting conditions of PDE. In both the high school and second year university contexts, the differences between the low- and high-outcome groups' PDE were striking (noting, as earlier mentioned, the way in which the level of cognitive activity also differed considerably between these groups). Differences in PDE are well illuminated in the extracts that follow. As in the case of cognitive activity, the second hypothesis was not supported by the 4th year engineering students, where PDE was more evident in the low-outcome group.</p> <hd id="AN0152948400-21">Examples of Interactions of Low- and High-Outcome Groups in the Three Learning Contexts</hd> <p>Extracts of interactions that best illustrate how low- and high-outcome groups seized opportunities provided by their respective learning environment to engage in PDE were selected from each of the three learning contexts. Two extracts from each outcome level (low, high) are presented in Tables 5, 6, and 7, accompanied by analytical comments on the nature of the group's engagement in PDE. The most visible indicators of interactions that mirror Engle's ([<reflink idref="bib9" id="ref69">9</reflink>]) supporting conditions for PDE (problematizing, accountability, authority, and resources) are shown in italics. A cross-context analysis is presented at the end of the section.</p> <p>Table 7 Manifestations of PDE among fourth year university students' interactions in engineering</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th /><th><p>Analytical comments</p></th></tr></thead><tbody><tr><td colspan="2"><p>Low-outcome group</p></td></tr><tr><td><p> Extract 1</p></td><td /></tr><tr><td><p> Marsden: <italic>So, uh, you'd want an excess of the ammonia though</italic></p></td><td rowspan="5"><p>Both extracts selected for this group feature high-level cognitive activity. In stark contrast to the low-outcome groups in the other two contexts, this low-outcome group displayed sustained engagement in ways that reflected Engle's supporting conditions for PDE for example, <italic>problematizing</italic>, e.g., "Just because the, the dichlorosilane is nasty stuff doesn't, why, that does not mean that ..." and <italic>accountability to science</italic>, e.g., "the ammonia means it's going to speed up the reaction."</p></td></tr><tr><td><p> Alex: <italic>But, okay, but when we have, so, so that was my point. If we have an excess of the ammo-. Well wait. Just because the, the dichlorosilane is nasty stuff, doesn't, why, that doesn't mean that we need to have more ammonia. That's not a reason for it</italic></p></td></tr><tr><td><p> Bodhi: So, the-</p></td></tr><tr><td><p> Marsden: <italic>Yeah, but the ammonia means it's going to speed up the reaction</italic></p></td></tr><tr><td><p> Alex: <italic>Yeah</italic></p></td></tr><tr><td colspan="2"><p> Extract 2</p></td></tr><tr><td><p> Alex: [talking while writing on whiteboard] <italic>Well, I think we ... need to know ... these reaction rates because if we have extra ... of our ammonia, it's going to end up reacting with this ... That's why we need to know. And we need how much</italic></p></td><td rowspan="8"><p>Deep-level engagement in the discourse of the discipline is also evident in Extract 2, which typifies interactions over an episode within which the issues at hand were <italic>problematized</italic> and jointly regulated. Members challenged one another in ways that reflected Engle's four supporting conditions for PDE. For example, Alex debates ideas, during which Alex exhibits disciplinary <italic>accountability</italic>, while also demanding <italic>accountability</italic> from peers. Marsden and Bodhi respond with disciplinary <italic>authority</italic>. The extract also demonstrates wider professional accountability, for example to community and environment: "We do not care about everything else that comes out?"</p></td></tr><tr><td><p> Bodhi: <italic>Well it's going to do it anyway</italic></p></td></tr><tr><td><p> Alex: <italic>It is, but ... we can try to minimize it</italic></p></td></tr><tr><td><p> Bodhi: <italic>Or you just pump the... out of ammonia and 'cause it's cheap and easy</italic></p></td></tr><tr><td><p> Alex: <italic>We don't care about everything else that comes out?</italic></p></td></tr><tr><td><p> Marsden: <italic>Nope</italic></p></td></tr><tr><td><p> Alex: Well</p></td></tr><tr><td><p> Bodhi: <italic>I mean if the overall reaction has no NHCl in it, or not NH. Sorry. HCl. Then, no your overall has none</italic></p></td></tr><tr><td colspan="2"><p>High-outcome group</p></td></tr><tr><td colspan="2"><p> Extract 1</p></td></tr><tr><td><p> Morgan: <italic>It does have ballpark ranges for</italic> ... flow rates. But I don't know how useful it will be.</p></td><td rowspan="4"><p>Extract 1 features the group working on its first test parameter values for the memorandum, and evaluating resources. Morgan realizes that the resource may or may not be useful, and Charlie responded with a disciplinary assumption. This brief interaction focused on resource evaluation was promptly co-determined, suggesting that one another's evaluations were "taken as given." There was <italic>no evidence of problematizing or resources brought in with authority and accountability</italic>.</p></td></tr><tr><td><p> Charlie: <italic>I mean it's a different-</italic></p></td></tr><tr><td><p> Morgan: <italic>Different system</italic></p></td></tr><tr><td><p> Charlie: <italic>Yeah, it's- I mean it's a different- totally different thing. Yeah, I would assume there would be a big difference.</italic></p></td></tr><tr><td colspan="2"><p> Extract 2</p></td></tr><tr><td><p> Charlie: Yeah 'cause I mean like—<italic>so like right here you are gonna have your highest concentration</italic></p></td><td rowspan="12"><p>Here, the group is discussing the test parameter values. They demonstrate a co-constructed understanding that forms the basis from which they <italic>problematize</italic> the issue at hand, progressing by building on contributions more so than questioning one another. Their contributions converge in a way that suggests implicit disciplinary <italic>accountability</italic> and <italic>authority</italic> among members, e.g., Charlie displays <italic>accountability</italic> and <italic>authority</italic> in explaining: "right here you are gonna have your highest concentration," and "... because you don't want the reaction rate..." Morgan listens, agrees: "Yeah, yeah," then seamlessly contributes understanding: "oh ... you need to know if it's gonna be hotter ...," which Morgan's peers confirm, and Morgan: "then you have to find like the concentration gradient ...," and so on. The group efficiently problematize and progress with a tacit agreement that appears underpinned by a bedrock of <italic>accountability</italic> and <italic>authority</italic>, enabling a disciplinary flow that results in a quality outcome.</p></td></tr><tr><td><p> Morgan: Yeah</p></td></tr><tr><td><p> Charlie: <italic>And you could</italic> [pause]. <italic>Like I guess you - you probably want - you probably want your lower temperature here, because you don't want the reaction rate to go that fast right here</italic>.</p></td></tr><tr><td><p> Morgan: Yeah</p></td></tr><tr><td><p> Charlie: <italic>Because if you react faster down here you're gonna have less material up here and you're gonna have way thicker wafers down here</italic>.</p></td></tr><tr><td><p> Morgan: Yeah, yeah- no, I swear that- we had to find like the...</p></td></tr><tr><td><p> Charlie: <italic>So I say T5 is probably gonna be</italic> ...</p></td></tr><tr><td><p> Morgan: <italic>Oh, you need to know if it's gonna be hotter as you go up-</italic></p></td></tr><tr><td><p> Charlie and Foster: <italic>Yeah</italic></p></td></tr><tr><td><p> Morgan: - <italic>then you have to find like the concentration gradient, and then match it to your temperature gradient, but we need to know the kinetics to do that</italic>.</p></td></tr><tr><td><p> Charlie: Yeah.</p></td></tr><tr><td><p> Morgan: <italic>Otherwise, we don't know what temperatures to use</italic></p></td></tr></tbody></table> </ephtml> </p> <hd id="AN0152948400-22">High School Students' Interactions in General Science</hd> <p>Table 5 shows extracts from this learning context. For both groups, extract 1 occurs during the phase in which students had to generate a hypothesis for their project and extract 2 during the phase in which groups had to analyze their results and prepare a class presentation. The low-outcome group's interactions are consistent with their low performance, and the qualitative search for interactions that mirrored the supportive conditions of PDE offered to them revealed the nature of "missed opportunities" for PDE in this group. Overall, the analysis of these two groups' interactions highlight that although the learning environment of ViBSE provided opportunities for all groups to engage in problematizing, using disciplinary resources such as real research data, assuming intellectual authority, and testing how their ideas made sense in relation to those of disciplinary experts, these opportunities were taken up only in the high-outcome group. Importantly, group differences in the quality of their engagement were consistent with differences in their outcome level.</p> <hd id="AN0152948400-23">Second Year University Students' Interactions in Veterinary Science</hd> <p>In this learning context, all extracts are selected from the phase of the overall task during which students constructed their clinical case map after having undertaken background research (Table 6). In the low-outcome group, there was only minimal problematizing during this phase and instead, there was mostly general agreement among members about placing cards and arrows. Although the task afforded opportunities for problematizing and deep disciplinary engagement, most of the time this group "skimmed the surface" of the requirement to produce the map. This level of engagement resulted in the construction of a map largely disconnected from their clinical case and background research regarding direct, definitive linkages. In contrast, the high-outcome group displayed escalating robust engagement in disciplinary talk that reflected all four of Engle's PDE supporting conditions, which led to the construction of an accurate concept map of their clinical case.</p> <hd id="AN0152948400-24">Fourth Year University Students' Interactions in Engineering</hd> <p>Both extracts from this learning context are from the phase in which the groups undertook initial information gathering and problem scoping toward production of a design memorandum to present to their supervisor (Table 6). In combination, the two extracts of the low-outcome engineering group reveal how all three members were deeply engaged in ways that exhibited all four of Engle's supporting conditions for PDE. There was evidence that their high-level cognitive activity was directed at developing a shared understanding of the issue at hand, rather than assuming everyone was "on the same page" about it. Their deep-level engagement appeared remarkably similar to that of the high-outcome veterinary science group and was, therefore, inconsistent with their low-outcome level. In contrast to the low-outcome group's interactions that reflected all of Engle's supporting conditions for PDE in their high-level cognitive talk, the high-outcome group seems to demonstrate implicit agreement of assumed and reciprocal disciplinary authority, and a degree of intellectual trust from which they proceeded.</p> <hd id="AN0152948400-25">Summarizing PDE across Three Learning Contexts</hd> <p>We summarize the PDE results as follows:</p> <p> <emph>First</emph>, both the low-outcome high school science group and the low-outcome second year veterinary science group showed minimal accountability to science in their learning process. While there was evidence of uptake of some of Engle's ([<reflink idref="bib9" id="ref70">9</reflink>]) supporting conditions for PDE (mainly through problematizing within the realm of low-level cognitive activity) within these groups, this was not sufficient to facilitate the development of enriched disciplinary understanding in the absence of other aspects, as illustrated by their low outcome and the nature of their science talk.</p> <p> <emph>Second</emph>, notable in all high-outcome groups across the three contexts, was that group members tended to define parameters and gaps in their disciplinary knowledge. In the high school science high-outcome group, for example, interactions such as "What do we know about these issues?" (Extract 1). In the high-outcome veterinary science group, gaps were expressed using language such as "I'd, I'm not sure because you treat hypertension with amlodipine and then ..." (Extract 1) and, in the engineering group, as "But I don't know how useful it will be" (Extract 1). This practice showed that the most successful groups continually and explicitly evaluated aspects of their disciplinary knowledge.</p> <p> <emph>Third</emph>, at the most advanced level, the high-outcome group in engineering departed from the observed trend. Contributions to PDE appeared to be increasingly collective among group members at this site. While this group was engaged in deep-level processing of the task, their implicit shared understanding may have prevented manifestations of the supporting conditions for PDE to be observed in their verbalizations to the same extent as the low-outcome group.</p> <hd id="AN0152948400-26">Discussion</hd> <p>This study aimed to explore PDE in collaborative science learning across different educational contexts and levels. The three collaborative learning environments in this study were all designed to encompass Engle's four conditions for PDE (authority, accountability, problematizing, and resources). The first aim was to explore the student groups' cognitive activity and, specifically, how the groups' collective learning outcomes are associated with the quality of cognitive activity in different contexts. Based on outcomes of cognitive activity, the second key aim of the study was to establish how the learning environments' supporting features of PDE manifest during group interactions and, particularly, how PDE is associated with low and high cognitive performance in collaborative science learning processes in these three different contexts.</p> <p>The novel contributions of the study are twofold: (i) analyzing both cognitive activity and PDE from the same ongoing collaborative processes using the same theory-based analytical methods on three different sets of data, thus avoiding the danger of the same actions in different datasets being classified differently; and (ii) exploring PDE in relation to the quality of cognitive activity in terms of attempts at deep meaning making and high-level collective achievement. Bringing together three elements of collaborative learning, namely level of cognitive activity, product outcome, and PDE, allowed the identification of patterns in the groups' interaction processes that can help us better analyze the intended influence of the features of learning environments on student learning, as well as differences in productive engagement in science learning.</p> <hd id="AN0152948400-27">High Performance and Engagement in Science: Relations of the Quality of Cognitive Activity, P...</hd> <p>On the basis of theoretical conceptualizations supported by current empirical evidence, it was assumed in the first research question that high-outcome groups would display a greater proportion of high-level cognitive activity (H1) (Khosa and Volet [<reflink idref="bib20" id="ref71">20</reflink>]; Volet et al. [<reflink idref="bib43" id="ref72">43</reflink>]; Volet et al. [<reflink idref="bib44" id="ref73">44</reflink>]). It was expected that this same pattern would be found across all three studied contexts. Hypothesis H1 was confirmed in two contexts: senior high school general science and second year university veterinary science. However, an opposite pattern of results was found with the university engineering student groups, in which case the hypothesis was rejected. The high-outcome group demonstrated less high-level cognitive activity during the phases of the task that were studied. This unexpected outcome is discussed in more detail in the next section.</p> <p>Engle's ([<reflink idref="bib9" id="ref74">9</reflink>]) four supporting conditions of PDE were mirrored in all groups' collaborative interactions, and most typically paired with high-level cognitive activity. Due to the novelty of the second research question (ResQ2), how small groups seize opportunities for PDE, only one broad hypothesis (H2) could be generated. In line with the hypothesis, the relation of PDE and a high-outcome product was found in high school and university second year veterinary science students, but not with the fourth year engineering students. As expected, the qualitative analyses revealed that the interactions of the low-outcome high school science and veterinary science groups reflected Engle's ([<reflink idref="bib9" id="ref75">9</reflink>]) supporting conditions for PDE less frequently and less richly than their high-outcome counterparts. However, they did show missed opportunities for PDE, suggesting that there is opportunity for teachers to interact with these groups in ways that could help support their disciplinary talk. Interestingly, in the high-outcome veterinary science student group, three or even four supporting conditions were often present at the same time. In the engineering context, the low-outcome engineering group frequently demonstrated three supporting conditions for PDE, namely problematizing, authority, and accountability, and sometimes all three simultaneously. Although the high-outcome engineering group also demonstrated these supporting conditions, particularly problematizing most often paired with authority, their disciplinary thinking was not as explicit as that of their low-outcome counterpart.</p> <p>In sum, the comparison between the low- and high-outcome groups' collaborative learning processes provided evidence of the important relationship between group discussions, high-level cognitive activity, and collective outcome that reflect the four supporting conditions of PDE. However, the results for the engineering context differed from the two other contexts for both research questions.</p> <hd id="AN0152948400-28">Disciplinary Expertise in Explaining PDE at Different Professional Levels</hd> <p>There are plausible explanations for the unexpected results in the engineering context. One is contextual. In contrast to high school science and veterinary science task contexts, the engineering learning context is a complex design process, in which there is no fixed algorithm or series of steps for completion. Rather, the groups navigate through the design process using non-linear and iterative cycles of design ideation and analysis. Therefore, data from a sample "slice" in time may capture students in very different stages of thinking and interaction, which might impede the comparability of the two groups. However, the fact that project phase was not significantly different makes this explanation less likely.</p> <p>A more intriguing, conceptually driven explanation revolves around different social practices as the students progress toward disciplinary expertise. The 4th year engineering students were approaching graduation, on the cusp of entering the profession. The analyses of the present study revealed some evidence of "tacit agreement" among members of the engineering high-outcome group that was less evident in the low-outcome group. Specifically, members of the high-outcome group appeared to proceed in a way that built on recognized, mutual intellectual authority and shared understanding as evidenced, for example, by frequently completing one another's sentences. To the extent that each of these students <emph>implicitly</emph> acknowledged that their peers "knew their stuff" and shared a common conception of the project, one could argue that there was less need for extensive high-level cognitive talk. As the students' conceptions of the design task became the same (i.e., a joint enterprise), it is reasonable to assume that there could be a more implicit intellectual authority realized in interactions of tacit agreement as observed. This explanation is supported by the assumption that, by the final year of study, some engineering students have a robust understanding of disciplinary concepts and practices and are capable of "thinking like engineers," especially in the context of an industrially situated task. In contrast, the low-outcome group interactions, which contained more questioning-type discussion as members negotiated their conceptual understanding with one another, are consistent with a group of students less confident in their knowledge, but determined to make progress on the task by learning with and from each other.</p> <p>The distinct patterns of interactions displayed by high- and low-outcome groups are reminiscent of the distinctions found between science experts and novices in studies on the nature of expertise (e.g., Ericsson and Pool [<reflink idref="bib11" id="ref76">11</reflink>]; Feltovich et al. [<reflink idref="bib12" id="ref77">12</reflink>]). For example, research on novices and experts in medicine has revealed that, with higher levels of expertise, some of the reasoning processes of experts are automatic and unconscious and are activated only in cases of mismatches or conflicts in processing (Boshuizen and Schmidt [<reflink idref="bib3" id="ref78">3</reflink>]). In this respect, it can be argued that the high-outcome engineering group showed the compiled conceptual understanding of engineering experts (Redish and Smith [<reflink idref="bib32" id="ref79">32</reflink>]).</p> <p>Additionally, while the data sampling strategy for the four year engineering groups provides equivalent slices of data in time (temporal slices), we suggest the groups might be in quite different "social states" regarding the task at hand. This project was the third project of the term in which the students in each group worked together and they had been in the same program for four years of study. Thus, they brought with them previous conceptions of one another's competencies and a history of collaborative interactions. Once they were "all on the same page," there was no need to renegotiate their approach continually and, in fact, they could use that shared understanding to make their interactions more efficient. In other words, the two engineering groups may have brought different sociotechnical histories, both from within the project and longer term, to the examined interactions. The data from the high-outcome group can be interpreted as stemming from interactions that were not noticeably focused on developing a shared understanding of the foundational scientific principles, but rather on "getting on" with the task of design (Vincenti [<reflink idref="bib41" id="ref80">41</reflink>]). However, they were clearly in PDE and meaningfully making progress. This explanation is supported by observed behaviors of an expert group in this same project who, when compared to student groups, spent much more time focusing on their specific strategies to create, test, and evaluate design options, rather than negotiating the underlying core conceptual knowledge (Nolen et al. [<reflink idref="bib29" id="ref81">29</reflink>]).</p> <hd id="AN0152948400-29">Limitations</hd> <p>While we used the same framework and methodology across three sites in this study, they each had different tasks, students, and intended outcomes. This variation enables exploration of disciplinary engagement and cognitive activity across educational contexts, but also makes the study design unsuitable for claims about progression based on education level. However, when site was considered as a covariate, the data revealed a significantly steady increase in cognitive activity from high school to second year university and then to fourth year university. This trend is consistent with the notion that PDE embodies professional disciplinary behaviors that are more likely to be found in advanced university professional programs than in senior high school science classes. Research designs that can isolate and investigate this developmental progression are needed.</p> <p>Two of the researched tasks focus on engaging in roles that directly align with disciplinary practice (the high school experiment, the engineering design), whereas the veterinary task had a more academic conceptual focus and required the development of a concept map for a veterinary case. Groups engaged in disciplinary practice tasks tended to focus on <emph>problematizing</emph>, often accompanied by <emph>authority</emph> or <emph>accountability</emph>. In contrast, the groups engaged in the more conceptual task more evenly engaged in all four of Engle's supporting conditions. Research is needed to identify the connection between the nature of the task and the ways collaborative groups take up PDE.</p> <hd id="AN0152948400-30">Concluding Remarks</hd> <p>To conclude, consistent and expected patterns of cognitive activity and PDE in relation to product outcomes emerged in the high school science and university veterinary science contexts, whereas a different pattern was found in engineering. The novel and unique feature of this study was the use of the same coding scheme and coders across datasets. This enables controlled identification of discrepancies and correspondences across different learning contexts. Although overgeneralizations must be avoided, such as claims about developmental patterns, the application of the same methods of analysis underlines the effectiveness of this study's strategy in revealing this result. This strategy produced outcomes that offer clear directions for future research, such as further investigation of the role of disciplinary expertise and group members' history, in interpreting a group's social interactions regarding the quality of cognitive activity and PDE. For example, observing groups' learning processes over a longer time period (e.g., follow-up of the same students groups across cultural and educational contexts), in varying learning tasks (e.g., routine\traditional vs. novel problems demanding innovative thinking, disciplinary practice vs. conceptual tasks), and/or comparing high-outcome expert groups (e.g., in different disciplines) with one another would be helpful in identifying whether similar patterns emerge across novice and expert groups.</p> <p>The present study further raises new questions for future research and practice about the application of the PDE framework (Engle [<reflink idref="bib9" id="ref82">9</reflink>]; Forman et al. [<reflink idref="bib15" id="ref83">15</reflink>]). Large differences between the high- and low-outcome groups in relation to cognitive activity and PDE, particularly in senior high school, warrants the question raised by Kelly ([<reflink idref="bib19" id="ref84">19</reflink>]; see also Vauras et al. [<reflink idref="bib39" id="ref85">39</reflink>]) of what it means to incorporate authentic disciplinary practices in classrooms and how classroom teachers can help their students make the difficult transition between school science and the kind of instruction embodied by PDE.</p> <hd id="AN0152948400-31">Funding</hd> <p>Open access funding provided by University of Turku (UTU) including Turku University Central Hospital. This work was supported by the Academy of Finland Grant No. 274117, by the Australian Research Council under the Discovery Award (DP150101142) and Murdoch University, Research and Innovation Office, and by the US National Science Foundation Grant No. EEC 1261930 (any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation).</p> <hd id="AN0152948400-32">Publisher's Note</hd> <p>Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p> <ref id="AN0152948400-33"> <title> References </title> <blist> <bibl id="bib1" idref="ref40" type="bt">1</bibl> <bibtext> Apedoe X, Ford M. The empirical attitude, material practice and design activities. Science & Education. 2010; 19: 165-186. 10.1007/s11191-009-9185-7</bibtext> </blist> <blist> <bibl id="bib2" idref="ref48" type="bt">2</bibl> <bibtext> Boaler J, Sengupta-Irving T. The many colors of algebra: the impact of equity focused teaching upon student learning and engagement. The Journal of Mathematical Behavior. 2016; 41: 179-190. 10.1016/j.jmathb.2015.10.007</bibtext> </blist> <blist> <bibl id="bib3" idref="ref78" type="bt">3</bibl> <bibtext> Boshuizen HPA, Schmidt HGHiggs J, Jones M, Loftus S, Christensen N. The development of clinical reasoning expertise: implications for teaching. Clinical reasoning in the health professions. 20083: Oxford; Butterworth-Heinemann/Elsevier: 113-121</bibtext> </blist> <blist> <bibl id="bib4" idref="ref1" type="bt">4</bibl> <bibtext> Bowen CW. A quantitative literature review of cooperative learning effects on high school and college chemistry achievement. Journal of Chemical Education. 2000; 77: 116-119. 10.1021/ed077p116</bibtext> </blist> <blist> <bibl id="bib5" idref="ref10" type="bt">5</bibl> <bibtext> Bransford JD, Brown AL, Cocking RR. How people learn. 2000: Washington, DC; National Academy Press</bibtext> </blist> <blist> <bibl id="bib6" idref="ref8" type="bt">6</bibl> <bibtext> Brown JS, Collins A, Duguid P. Situated cognition and the culture of learning. Educational Researcher. 1989; 18: 32-42. 10.3102/0013189X018001032</bibtext> </blist> <blist> <bibl id="bib7" idref="ref27" type="bt">7</bibl> <bibtext> Cook SD, Brown JS. Bridging epistemologies: the generative dance between organizational knowledge and organizational knowing. Organization Science. 1999; 10: 381-400. 10.1287/orsc.10.4.381</bibtext> </blist> <blist> <bibl id="bib8" idref="ref32" type="bt">8</bibl> <bibtext> Cornelius LL, Herrenkohl LR. Power in the classroom: how the classroom environment shapes students' relationships with each other and with concepts. Cognition and Instruction. 2004; 22; 4: 467-498. 10.1207/s1532690Xci2204_4</bibtext> </blist> <blist> <bibl id="bib9" idref="ref15" type="bt">9</bibl> <bibtext> Engle RADai Y. The productive disciplinary engagement framework: origins, key concepts and developments. Design research on learning and thinking in educational settings: enhancing intellectual growth and functioning. 2012: New York; Routledge: 161-200</bibtext> </blist> <blist> <bibtext> Engle RA, Conant FR. Guiding principles for fostering productive disciplinary engagement: explaining an emergent argument in a community of learners classroom. Cognition and Instruction. 2002; 20; 4: 399-483. 10.1207/S1532690XCI2004_1</bibtext> </blist> <blist> <bibtext> Ericsson KA, Pool R. Peak: secrets from the new science of expertise. 2016: New York; Eamon Dolan books/Houghton Mifflin & Harcourt</bibtext> </blist> <blist> <bibtext> Feltovich P, Prietula M, Ericsson KAEricsson KA, Charness N, Feltovich PJ, Hoffman RR. Studies of expertise from psychological perspectives. Cambridge Handbook of Expertise and Expert Performance. 2006: New York; Cambridge University Press</bibtext> </blist> <blist> <bibtext> Ford M. Disciplinary authority and accountability in scientific practice and learning. Science Education. 2008; 92: 404-423. 10.1002/sce.20263</bibtext> </blist> <blist> <bibtext> Ford MJ, Forman EA. Redefining disciplinary learning in classroom contexts. Review of Research in Education. 2006; 30: 1-32. 10.3102/0091732X030001001</bibtext> </blist> <blist> <bibtext> Forman EA, Engle RA, Venturini P, Ford MJ. Introduction to special issue: International examinations and extensions of the productive disciplinary engagement framework. International Journal of Educational Research. 2014; 64: 149-155. 10.1016/j.ijer.2013.07.007</bibtext> </blist> <blist> <bibtext> Furrer C, Skinner E. Sense of relatedness as a factor in children's academic engagement and performance. Journal of Educational Psychology. 2003; 95: 148-162. 10.1037/0022-0663.95.1.148</bibtext> </blist> <blist> <bibtext> Horn IS. Learning on the job: a situated account of teacher learning in high school mathematics departments. Cognition and Instruction. 2005; 23: 207-236. 10.1207/s1532690xci2302_2</bibtext> </blist> <blist> <bibtext> Johri A, Olds BM. Situated engineering learning: bridging engineering education research and the learning sciences. Journal of Engineering Education. 2011; 100: 151-185. 10.1002/j.2168-9830.2011.tb00007.x</bibtext> </blist> <blist> <bibtext> Kelly GJ. The social bases of disciplinary knowledge and practice in productive disciplinary engagement. International Journal of Educational Research. 2014; 64: 211-214. 10.1016/j.ijer.2013.07.008</bibtext> </blist> <blist> <bibtext> Khosa DK, Volet S. Productive group engagement in cognitive activity and metacognitive regulation during collaborative learning: can it explain differences in students' conceptual understanding?. Metacognition and Learning. 2014; 9: 287-307. 10.1007/s11409-014-9117-z</bibtext> </blist> <blist> <bibtext> Kirschner F, Paas F, Kirschner PA, Janssen J. Differential effects of problem-solving demands on individual and collaborative learning outcomes. Learning and Instruction. 2011; 21: 587-599. 10.1016/j.learninstruc.2011.01.001</bibtext> </blist> <blist> <bibtext> Koretsky M, Nolen SB, Gilbuena DM, Lehtinen E, Vauras M, Tierney G, Volet SE (2014a) Studying and supporting productive disciplinary engagement in STEM learning environments. Frontiers in education. Madrid, Spain</bibtext> </blist> <blist> <bibtext> Koretsky M, Nolen SB, Gilbuena DM, Lehtinen E, Vauras M, Tierney G, Volet SE (2014b) Studying and supporting productive disciplinary engagement in STEM learning environments. Paper presented at 2014 ASEE Annual Conference, Indianapolis, Indiana. https://peer.asee.org/23070</bibtext> </blist> <blist> <bibtext> Koretsky M, Nolen SB, Tierney G, Wetzstein L (2015) Productive disciplinary engagement in design tasks. Research in engineering education symposium. Dublin, Ireland.</bibtext> </blist> <blist> <bibtext> Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33: 159-174. 10.2307/2529310</bibtext> </blist> <blist> <bibtext> Lotan RA. Group-worthy tasks. Educational Leadership. 2003; 60; 6: 72-75</bibtext> </blist> <blist> <bibtext> National Council of Teachers of Mathematics (2014) Principles to actions: ensuring mathematical success for all. Reston, VA: National Council of Teachers of Mathematics.</bibtext> </blist> <blist> <bibtext> National Research Council. A framework for K-12 science education: practices, crosscutting concepts, and core ideas. 2012: Washington, D.C.; National Academies Press</bibtext> </blist> <blist> <bibtext> Nolen SB, Koretsky MD, Wetzstein L, Scalone G, Goodell A, Chindanon K, Tierney G (2018) Productive disciplinary engagement in STEM design projects. Manuscript submitted for publication.</bibtext> </blist> <blist> <bibtext> Phillips AM, Watkins J, Hammer D. Problematizing as a scientific endeavor. Physical Review Physics Education Research. 2017; 13: 020107. 10.1103/PhysRevPhysEducRes.13.020107</bibtext> </blist> <blist> <bibtext> Pickering A. The mangle of practice: time, agency, and science. 1995: Chicago; University of Chicago Press. 10.7208/chicago/9780226668253.001.0001</bibtext> </blist> <blist> <bibtext> Redish EF, Smith KA. Looking beyond content: Skill development for engineers. Journal of Engineering Education. 2008; 97: 295-307. 10.1002/j.2168-9830.2008.tb00980.x</bibtext> </blist> <blist> <bibtext> Sampson V, Clark D. The impact of collaboration on the outcomes of scientific argumentation. Science Education. 2009; 93: 448-484. 10.1002/sce.20306</bibtext> </blist> <blist> <bibtext> Scott PH, Mortimer EF, Aguiar OG. The tension between authoritative and dialogic discourse: a fundamental characteristic of meaning making interactions in high school science lessons. Science Education. 2006; 90: 605-631. 10.1002/sce.20131</bibtext> </blist> <blist> <bibtext> Sinatra GM, Heddy BC, Lombardi D. The challenges of defining and measuring student engagement in science. Educational Psychologist. 2015; 50: 1-13. 10.1080/00461520.2014.1002924</bibtext> </blist> <blist> <bibtext> Springer L, Stanne ME, Donovan SS. Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: a meta-analysis. Review of Educational Research. 1999; 69: 21-51. 10.3102/00346543069001021</bibtext> </blist> <blist> <bibtext> Stevens R, O'Connor K, Garrison L, Jocuns A, Amos DM. Becoming an engineer: toward a three dimensional view of engineering learning. Journal of Engineering Education. 2008; 97: 355-368. 10.1002/j.2168-9830.2008.tb00984.x</bibtext> </blist> <blist> <bibtext> Stump GS, Hilpert JC, Husman J, Chung W-T, Kim W. Collaborative learning in engineering students: gender and achievement. Journal of Engineering Education. 2011; 100: 475-497. 10.1002/j.2168-9830.2011.tb00023.x</bibtext> </blist> <blist> <bibtext> Vauras M, Volet S, Nolen SGonida E, Lemos M. Supporting motivation in collaborative learning: challenges in the face of an uncertain future. Motivation in education at a time of global change: theory, research, and implications for practice. 2018: New York; Emerald</bibtext> </blist> <blist> <bibtext> Venturini P, Amade-Escot C. Analysis of conditions leading to a productive disciplinary engagement during a physics lesson in a disadvantaged area school. International Journal of Educational Research. 2014; 64: 170-183. 10.1016/j.ijer.2013.07.003</bibtext> </blist> <blist> <bibtext> Vincenti WG. What engineers know and how they know it: analytical studies from aeronautical history. 1990: Baltimore; Johns Hopkins University Press</bibtext> </blist> <blist> <bibtext> Volet S, Summers M, Thurman J. High-level co-regulation in collaborative learning: how does it emerge and how is it sustained?. Learning and Instruction. 2009; 19: 128-143. 10.1016/j.learninstruc.2008.03.001</bibtext> </blist> <blist> <bibtext> Volet S, Vauras M, Khosa D, Iiskala TVolet S, Vauras M. Metacognitive regulation in collaborative learning: conceptual developments and methodological contextualizations. Interpersonal regulation of learning and motivation: methodological advances. 2013: New York; Routledge: 67-101. 10.4324/9780203117736</bibtext> </blist> <blist> <bibtext> Volet S, Vauras M, Salo A-E, Khosa D. Individual contributions in student-led collaborative learning: insights from two analytical approaches to explain the quality of group outcome. Learning and Individual Differences. 2017; 53: 79-92. 10.1016/j.lindif.2016.11.006</bibtext> </blist> </ref> <aug> <p>By Milo D. Koretsky; Marja Vauras; Cheryl Jones; Tuike Iiskala and Simone Volet</p> <p>Reported by Author; Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib21" firstref="ref2"></nolink> <nolink nlid="nl2" bibid="bib36" firstref="ref3"></nolink> <nolink nlid="nl3" bibid="bib38" firstref="ref4"></nolink> <nolink nlid="nl4" bibid="bib20" firstref="ref5"></nolink> <nolink nlid="nl5" bibid="bib33" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib43" firstref="ref7"></nolink> <nolink nlid="nl7" bibid="bib14" firstref="ref9"></nolink> <nolink nlid="nl8" bibid="bib18" firstref="ref11"></nolink> <nolink nlid="nl9" bibid="bib37" firstref="ref12"></nolink> <nolink nlid="nl10" bibid="bib17" firstref="ref13"></nolink> <nolink nlid="nl11" bibid="bib26" firstref="ref14"></nolink> <nolink nlid="nl12" bibid="bib10" firstref="ref16"></nolink> <nolink nlid="nl13" bibid="bib27" firstref="ref17"></nolink> <nolink nlid="nl14" bibid="bib28" firstref="ref18"></nolink> <nolink nlid="nl15" bibid="bib15" firstref="ref20"></nolink> <nolink nlid="nl16" bibid="bib16" firstref="ref21"></nolink> <nolink nlid="nl17" bibid="bib34" firstref="ref33"></nolink> <nolink nlid="nl18" bibid="bib40" firstref="ref34"></nolink> <nolink nlid="nl19" bibid="bib13" firstref="ref36"></nolink> <nolink nlid="nl20" bibid="bib22" firstref="ref41"></nolink> <nolink nlid="nl21" bibid="bib24" firstref="ref42"></nolink> <nolink nlid="nl22" bibid="bib23" firstref="ref45"></nolink> <nolink nlid="nl23" bibid="bib35" firstref="ref46"></nolink> <nolink nlid="nl24" bibid="bib30" firstref="ref49"></nolink> <nolink nlid="nl25" bibid="bib31" firstref="ref59"></nolink> <nolink nlid="nl26" bibid="bib42" firstref="ref60"></nolink> <nolink nlid="nl27" bibid="bib25" firstref="ref64"></nolink> <nolink nlid="nl28" bibid="bib44" firstref="ref73"></nolink> <nolink nlid="nl29" bibid="bib11" firstref="ref76"></nolink> <nolink nlid="nl30" bibid="bib12" firstref="ref77"></nolink> <nolink nlid="nl31" bibid="bib32" firstref="ref79"></nolink> <nolink nlid="nl32" bibid="bib41" firstref="ref80"></nolink> <nolink nlid="nl33" bibid="bib29" firstref="ref81"></nolink> <nolink nlid="nl34" bibid="bib19" firstref="ref84"></nolink> <nolink nlid="nl35" bibid="bib39" firstref="ref85"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1311983
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Productive Disciplinary Engagement in High- and Low-Outcome Student Groups: Observations from Three Collaborative Science Learning Contexts
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Koretsky%2C+Milo+D%2E%22">Koretsky, Milo D.</searchLink><br /><searchLink fieldCode="AR" term="%22Vauras%2C+Marja%22">Vauras, Marja</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-0043-9975">0000-0002-0043-9975</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jones%2C+Cheryl%22">Jones, Cheryl</searchLink><br /><searchLink fieldCode="AR" term="%22Iiskala%2C+Tuike%22">Iiskala, Tuike</searchLink><br /><searchLink fieldCode="AR" term="%22Volet%2C+Simone%22">Volet, Simone</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Research+in+Science+Education%22"><i>Research in Science Education</i></searchLink>. Sep 2021 51:159-182.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 24
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: EEC1261930
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Cooperative+Learning%22">Cooperative Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Education%22">Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Processes%22">Cognitive Processes</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Science%22">Secondary School Science</searchLink><br /><searchLink fieldCode="DE" term="%22College+Science%22">College Science</searchLink><br /><searchLink fieldCode="DE" term="%22Veterinary+Medicine%22">Veterinary Medicine</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Achievement%22">Science Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22High+Achievement%22">High Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Low+Achievement%22">Low Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Expertise%22">Expertise</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s11165-019-9838-8
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0157-244X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study explored how productive disciplinary engagement (PDE) is associated with the level of cognitive activity and collective group outcome in collaborative learning across multiple contexts. Traditionally, PDE has been studied in a single collaborative learning environment, without analysis of how these environments fulfill the supporting conditions for PDE. In addition, research on the quality of a collective learning outcome and product in relation to the extent of the group's PDE during actual collaborative learning processes is scarce. In this study, the learning processes of low- and high-outcome small groups were compared within three collaborative learning contexts: high school general science, second year university veterinary science, and fourth year university engineering. Two meaningful and self-contained phases from each context were selected for analysis. The same theory-based analytical methods were used across contexts. The findings revealed similar patterns in the high school science and second year university veterinary science data sets, where high-outcome groups displayed a greater proportion of high-level cognitive activity while working on the task. Thus, they could be distinctively perceived as high- and low-performing groups. These high-performing groups' interactions also reflected more of the supporting conditions associated with PDE than the low-performing groups. An opposite pattern was found in the fourth year university engineering data set, calling for interpretation grounded in the literature on the nature and development of expertise. This study reveals the criticality of using comparable analytical methods across different contexts to enable discrepancies to emerge, thus refining our contextualized understanding of PDE in collaborative science learning.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2021
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1311983
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1311983
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11165-019-9838-8
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 159
    Subjects:
      – SubjectFull: Cooperative Learning
        Type: general
      – SubjectFull: Science Education
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: Cognitive Processes
        Type: general
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: Secondary School Science
        Type: general
      – SubjectFull: College Science
        Type: general
      – SubjectFull: Veterinary Medicine
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Science Achievement
        Type: general
      – SubjectFull: High Achievement
        Type: general
      – SubjectFull: Low Achievement
        Type: general
      – SubjectFull: Expertise
        Type: general
    Titles:
      – TitleFull: Productive Disciplinary Engagement in High- and Low-Outcome Student Groups: Observations from Three Collaborative Science Learning Contexts
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Koretsky, Milo D.
      – PersonEntity:
          Name:
            NameFull: Vauras, Marja
      – PersonEntity:
          Name:
            NameFull: Jones, Cheryl
      – PersonEntity:
          Name:
            NameFull: Iiskala, Tuike
      – PersonEntity:
          Name:
            NameFull: Volet, Simone
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-print
              Value: 0157-244X
          Numbering:
            – Type: volume
              Value: 51
          Titles:
            – TitleFull: Research in Science Education
              Type: main
ResultId 1