Leadership and the Hidden Politics of Co-Produced Research: A Q-Methodology Study
Saved in:
| Title: | Leadership and the Hidden Politics of Co-Produced Research: A Q-Methodology Study |
|---|---|
| Language: | English |
| Authors: | Durose, Catherine, Perry, Beth, Richardson, Liz, Dean, Rikki |
| Source: | International Journal of Social Research Methodology. 2023 26(1):1-21. |
| Availability: | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Peer Reviewed: | Y |
| Page Count: | 21 |
| Publication Date: | 2023 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Participatory Research, Q Methodology, Research Projects, Politics, Leadership, Power Structure |
| DOI: | 10.1080/13645579.2021.1960738 |
| ISSN: | 1364-5579 1464-5300 |
| Abstract: | There has been encouragement from funders, universities and academics to co-produce research. Co-production of research can be considered a methodology in its own right, or an underpinning set of principles for other methods. Co-production aims to reshape relations between the researched and the researcher. Yet, co-producing research rarely starts with a blank sheet, and is informed by antecedent power as well as prior experiences and expectations. Attention has been paid to practical barriers to co-production, such as time and resources, and there has been critical analysis of the claims made. The 'hidden politics' of co-production as a research approach have also been identified. This paper contributes to debates about such hidden politics of the co-production methodology in research. How leadership in research takes place matters, as it is a way of handling contestation over different aspects of methods, including the purpose and practices of research, and power differentials in co-production. This study was motivated by the experiences of the authors of a co-produced research project on participatory urban governance. |
| Abstractor: | ERIC |
| Entry Date: | 2023 |
| Accession Number: | EJ1374795 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwElkc4s3AQqriLRJtPZRoiBAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDLvfbAsuSVDmlMDrKwIBEICBmxoctkGHkEZgPq49uT0lmBFIjJ6eZX2ub8EqbddlgO1sCQzv_KEaBL4uoRK6dBU1JyC-BJfbVXl5uURoLhlBFlOAqICvUS7BtjZNcWn8neehKV2nwkqaA1xsn1dPxnL3KwT-26GCpmSOGpDzkrl4BVre77X5XbgMrQY-aO8JOyBw2T0tiB_eyId28LwuytF5A-hKGiw0-RtgH7UV Text: Availability: 1 Value: <anid>AN0160848877;9eb01jan.23;2022Dec20.05:54;v2.2.500</anid> <title id="AN0160848877-1">Leadership and the hidden politics of co-produced research: a Q-methodology study </title> <p>Keywords: Co-production; research; leadership; university</p> <hd id="AN0160848877-2">Introduction</hd> <p>There has been encouragement from funders, universities and academics to co-produce research (Durose et al., [<reflink idref="bib15" id="ref1">15</reflink>]). Co-production of research can be considered a methodology in its own right, or an underpinning set of principles for other methods. Co-production aims to reshape relations between the researched and the researcher (Hemström et al., [<reflink idref="bib35" id="ref2">35</reflink>]). Yet, co-producing research rarely starts with a blank sheet, and is informed by antecedent power as well as prior experiences and expectations. Attention has been paid to practical barriers to co-production, such as time and resources, and there has been critical analysis of the claims made (Orr et al., [<reflink idref="bib45" id="ref3">45</reflink>]; Martin, [<reflink idref="bib40" id="ref4">40</reflink>]; Richardson, [<reflink idref="bib50" id="ref5">50</reflink>]). The 'hidden politics' of co-production as a research approach (Flinders et al., [<reflink idref="bib21" id="ref6">21</reflink>]) have also been identified.</p> <p>This paper contributes to debates about such hidden politics of the co-production methodology in research. How leadership in research takes place matters, as it is a way of handling contestation over different aspects of methods, including the purpose and practices of research, and power differentials in co-production. Our study was motivated by our experiences of a co-produced research project on participatory urban governance. The project brought together citizens, activists, and practitioners from the public and voluntary, community and social enterprise sectors as co-researchers to conduct action research (Perry et al., [<reflink idref="bib46" id="ref7">46</reflink>]). Part-way through this process, participants started talking about the 'elephants in the room', referring to unsurfaced issues and concerns about the research, including issues of leadership. What became apparent was that people within the group held distinctly different preferences for what leadership in co-produced research should look like. For some, an initial period of relationship-building had led to frustration at the slow speed of delivery of the research, and they wanted more directive leadership to drive forward the project. For other co-researchers, leadership that facilitated openness and creativity was a welcome alternative to their usual professional practices. The aim of the subsequent Q-methodology study was to help us think through leadership in co-production, particularly in relation to negotiating difference, by setting our experiences in a wider context of the experiences of other co-produced research projects.</p> <p>In the first section of this paper, we set out why we need to pay more attention to leadership in relation to the hidden politics of co-produced research. We elaborate three ways in which these hidden politics play out: divergent purposes, plural practices and power differentials. We then turn to the leadership literature to consider its alignment and limits in engaging with the politics of contested contexts such as co-producing research. In the second section, we set out the design of this study and offer a rationale for the use of Q-methodology as an appropriate way to study co-production as a research methodology. In the third section, we present the four distinct viewpoints on leadership in co-production that emerge from the survey. We elaborate upon the competing perspectives on the purpose, practice of leadership, and how power differentials should be addressed within co-produced research, with contrasting emphases on the purposes of creativity, outcomes, vision or equality. In discussing their divergence, as well as points of commonality, we demonstrate the value of centring questions of politics in debates on co-production and leadership. Our research demonstrates theoretical advance in understanding how leadership in co-production is contested, and practical utility in offering heuristics to help navigate the messy realities of co-producing research.</p> <hd id="AN0160848877-3">Situating co-produced research</hd> <p>In the field of knowledge production, there has been a history of experimentation, from participatory and community-based research (Goodson &amp; Phillimore, [<reflink idref="bib27" id="ref8">27</reflink>]), to citizen science (Haklay, [<reflink idref="bib30" id="ref9">30</reflink>]). Co-production can be understood in the context of this 'participatory turn' (Facer &amp; Enright, [<reflink idref="bib18" id="ref10">18</reflink>]), not as a prescribed or single method, but rather as a set of ideas for how to understand the world and do research (Banks et al., [<reflink idref="bib1" id="ref11">1</reflink>]). The number of co-produced research projects has increased, in part as a result of growing funder stipulations for 'user' engagement. Yet practice has out-paced the theorising of co-production, resulting in a range of normatively orientated studies, and fewer critical reflections on the distinctiveness or effectiveness of such knowledge production processes (cf Hemström et al., [<reflink idref="bib35" id="ref12">35</reflink>]). In some of the debates, normative considerations loom so large they pose a danger of crowding out important concerns of robustness and reliability of scientific methods (Richardson, [<reflink idref="bib50" id="ref13">50</reflink>]).</p> <p>For example, co-produced research has been posed by some scholars as an alternative to a 'traditional' mode of knowledge production that is within disciplinary boundaries, university-centered, conducted in academic settings and led and controlled by academics using typical academic processes such as peer-review (Gibbons et al., [<reflink idref="bib26" id="ref14">26</reflink>]). In contrast, co-production has been argued to operate in a mode that is applied, transdisciplinary and change-oriented (Hart et al., [<reflink idref="bib32" id="ref15">32</reflink>], 6). Advocates pose co-production as a means to address perceived limits of the traditional mode of knowledge production, e.g. that it is overly specialised and in part, detached from the field of study. Co-production has also been presented as a challenge to the academic monopoly on research expertise, by including applied expertise from beyond the academy (Nowotny et al., [<reflink idref="bib43" id="ref16">43</reflink>]). However, what has typically been less clear in such debates is how any potential tensions might be resolved within a piece of research, for example, between experiential ways of knowing, and established research methodologies (c.f. Richardson, [<reflink idref="bib49" id="ref17">49</reflink>]; [<reflink idref="bib50" id="ref18">50</reflink>]).</p> <p>In this context, attention is being usefully paid to what has been called the 'hidden politics' (Flinders et al., [<reflink idref="bib21" id="ref19">21</reflink>]) of co-production. Such politics are 'rarely referred to in the literature', which instead tends to focus on the promises of inclusion (Oliver et al., [<reflink idref="bib44" id="ref20">44</reflink>], p. 1). As such, co-production can present an 'expectations gap' for those involved when its ideals sharply contrast with the messier realities of practice (Flinders et al., [<reflink idref="bib21" id="ref21">21</reflink>]).</p> <hd id="AN0160848877-4">Hidden politics of co-production: purpose, practice and power</hd> <p>The hidden politics of co-production in research include a number of underlying tensions and debates about the purposes of scientific work, its practices, and how power is negotiated.</p> <p>First, conducting research in non-traditional ways is likely to encounter substantive differences in values and incentives, aims and priorities, standards of knowledge and cultures of working, experiences, expectations of working within different kinds of institutional cultures, and timescales (Bovaird, [<reflink idref="bib7" id="ref22">7</reflink>]; Flinders et al., [<reflink idref="bib21" id="ref23">21</reflink>]; Martin, [<reflink idref="bib40" id="ref24">40</reflink>]). Co-production necessarily brings together people with not only different forms of expertise but who likely have different <emph>purposes</emph> for being involved in co-produced research, for instance, linked to achieving more effective policy outcomes, reframing policy problems, delivering social justice or empowering those experiencing hardship or disadvantage (Bevir et al., [<reflink idref="bib5" id="ref25">5</reflink>]; Williams et al., [<reflink idref="bib59" id="ref26">59</reflink>]). Some have argued that the purpose and practice of co-production in research ought to be social justice and the democratisation of the academy (Ersoy, [<reflink idref="bib17" id="ref27">17</reflink>]), for example, through involving lay people in research, or the creation of 'utopian' spaces for creativity and remaking the world through imagination (Bell &amp; Pahl, [<reflink idref="bib3" id="ref28">3</reflink>]). Research funders may also see co-production as a pathway to impact, whilst others centre the importance of 'societal problem solving' as the end goal of co-production, with research outputs a secondary benefit (Polk &amp; Kain, [<reflink idref="bib48" id="ref29">48</reflink>], p. 2).</p> <p>However, for some scholars, these emphases unhelpfully devalue the primacy of scientific methods and the goals of publishing original and significant knowledge. Whilst academics may have multiple motivations for their work, they continue to be assessed according to traditional systems of peer review and institutional cultures, which value academic publications above other forms of output (Durose et al., [<reflink idref="bib15" id="ref30">15</reflink>]). Despite acknowledged issues with peer review (Walker, [<reflink idref="bib57" id="ref31">57</reflink>]), it remains a crucial core platform for quality assurance of scholarly work. Unpublished and unreliable results do not contribute to the body of knowledge in the world. This is not to create a false dichotomy between social science and relevance (Bastow et al., [<reflink idref="bib2" id="ref32">2</reflink>]), but to acknowledge that there may be trade-offs between them, for example, some studies have shown that academic performance is lower in research projects with non-academic involvement (Newig et al., [<reflink idref="bib42" id="ref33">42</reflink>]).</p> <p>Second, co-production is commonly understood as a process that is non-linear, iterative and unfolding. In working collaboratively and seeking to integrate diverse forms of expertise, many accounts highlight the need for flexibility and openness in structures and processes (Garud et al., [<reflink idref="bib23" id="ref34">23</reflink>]), such that research can be 'palpably and directly affected' by wider participation (Fung, [<reflink idref="bib22" id="ref35">22</reflink>], p. 79). Emergence, uncertainty and creativity are seen as hallmarks of co-productive research. Consequently, the design of appropriate <emph>practices</emph> to negotiate uncertainty and flexibility in research processes, and enable the integration of 'experiential expertise' is essential (Collins &amp; Evans, [<reflink idref="bib12" id="ref36">12</reflink>]). However, tensions can be generated between the need for openness, and the pre-determined, well-established and tested requirements of robust methods, particularly deductive approaches, in social scientific research; and on a practical level, the need for academics to fulfil the research design and methods as set out in their promises to funders, and the standards required for publication.</p> <p>Third, co-production in research values multiple forms of expertise, and advocates often have a normative orientation towards the rights of citizens to have a voice in research that affects them (Lister &amp; Beresford, [<reflink idref="bib38" id="ref37">38</reflink>]; Williamson &amp; de Souza, [<reflink idref="bib60" id="ref38">60</reflink>]). This raises questions about how differential power should be negotiated throughout the research process (Bell &amp; Pahl, [<reflink idref="bib3" id="ref39">3</reflink>]). Whilst co-production is sometimes seen to be able to 'dissolve' prior conflicts and tensions (Voorberg et al., [<reflink idref="bib56" id="ref40">56</reflink>]), this perspective masks challenges (Oliver et al., [<reflink idref="bib44" id="ref41">44</reflink>]), for example, to the idea that academics define and legitimate knowledge (Hart et al., [<reflink idref="bib32" id="ref42">32</reflink>]; Pohl et al., [<reflink idref="bib47" id="ref43">47</reflink>]; Walker, [<reflink idref="bib57" id="ref44">57</reflink>]). Co-production opens up research to under-represented voices (Brock &amp; McGee, [<reflink idref="bib8" id="ref45">8</reflink>]; Gaventa, [<reflink idref="bib24" id="ref46">24</reflink>]), and decentres traditional roles in research (Lister et al., [<reflink idref="bib38" id="ref47">38</reflink>]; Hemström et al., [<reflink idref="bib35" id="ref48">35</reflink>]; Williamson &amp; de Souza, [<reflink idref="bib60" id="ref49">60</reflink>]), seeing expertise as distributed across the 'many not the few' (Bennett &amp; Roberts, [<reflink idref="bib4" id="ref50">4</reflink>], 7), without privileging one specific group (Pohl et al., [<reflink idref="bib47" id="ref51">47</reflink>], p.217; Porter, 2010). For advocates of co-produced research, academics should not be assumed to be the sole knowledge producers. However, doing research demands specific skills and sets of expertise, for example, in methodologies, methods, a familiarity with a given field, and so on. Whilst lived experience or experiential expertise may be a complement to scientific expertise, it is not a substitute. Therefore, how can co-researchers contribute in a meaningful way to a research process, without simply defaulting to conventional hierarchies where academics dominate?</p> <p>The question of who is leading in co-produced research is central to how these three sets of debates might be resolved or addressed. Who decides where the emphasis lies on the purpose, who and what shapes what methods are used in practice, how are differences in expertise and background handled? Before introducing the design of our study to address these leadership questions, we first examine the theories and assumptions about how leadership may align with the ideas of co-produced research, and the limits of existing theory in negotiating the politics of leadership in contested contexts, such as the co-production of research.</p> <hd id="AN0160848877-5">Leadership in co-produced research</hd> <p>A recently commissioned study for Economic and Social Research Council (ESRC), the UK's largest public funder of social science research concluded that 'the existing evidence base on research leadership within higher education is incredibly limited' (Flinders &amp; Anderson, [<reflink idref="bib20" id="ref52">20</reflink>], p. 13). However, some scholars have begun to examine certain aspects of how leadership is being transformed within higher education (Van Ameijde et al., [<reflink idref="bib55" id="ref53">55</reflink>]; Youngs, [<reflink idref="bib61" id="ref54">61</reflink>]), including the challenges of undertaking interdisciplinary research (Edelenbos et al., [<reflink idref="bib16" id="ref55">16</reflink>]), and how leadership can support research impact (Jeong &amp; Choi, [<reflink idref="bib37" id="ref56">37</reflink>]). There has been relatively less focus to date on research leadership in the context of changing modes of knowledge production (Jasanoff, [<reflink idref="bib36" id="ref57">36</reflink>]), and emerging new 'modes' that challenge traditional relationships between science and society (Gibbons et al., [<reflink idref="bib26" id="ref58">26</reflink>]; Maasen &amp; Lieven, [<reflink idref="bib39" id="ref59">39</reflink>]). Some studies have centred on the contribution of particular leadership types or styles to co-production, such as relational leadership (Bussu &amp; Galanti, [<reflink idref="bib11" id="ref60">11</reflink>]; Schlappa &amp; Imani, [<reflink idref="bib51" id="ref61">51</reflink>]), others the modes of leadership that may be appropriate in different governance conditions (Tortzen, [<reflink idref="bib54" id="ref62">54</reflink>]).</p> <p>Looking to the broader leadership literature, a pre-occupation with those who have formal authority within a given organisation or context may be noted. However, there is increasing recognition that it is insufficient to seek to understand leadership solely through attention to those in such positions (Hartley, [<reflink idref="bib33" id="ref63">33</reflink>]). Instead, more distributed conceptualisations that recognise the value of leadership that involves and mobilises actors from different backgrounds and positions (Bolden, [<reflink idref="bib6" id="ref64">6</reflink>]; Gronn, [<reflink idref="bib29" id="ref65">29</reflink>]); acknowledge different sources of authority, power and legitimacy (Hartley, [<reflink idref="bib33" id="ref66">33</reflink>]); and examine the processes and practices of leadership 'which shape the attention and resources of others' (Hartley, [<reflink idref="bib33" id="ref67">33</reflink>], p. 203) are gaining prominence. For example, theories of 'systems leadership' (Ghate, [<reflink idref="bib25" id="ref68">25</reflink>]), emphasise mobilising collaboration across traditional sectoral or organisational boundaries. Similarly, theories of 'facilitative' (Bussu &amp; Bartels, [<reflink idref="bib10" id="ref69">10</reflink>]) or 'adaptive' leadership (Heifetz, [<reflink idref="bib34" id="ref70">34</reflink>]) advocate wider mobilisation to help navigate unpredictable and uncertain contexts, and to produce innovation.</p> <p>Such theories of facilitative and adaptive leadership may, at first glance, seem a natural fit with co-production, given the emphasis in both on empowering diverse networks of actors working collaboratively, and in recognising claims to authority based on different forms of expertise, such as applied or experiential knowledge. However, such alignment has neither been examined empirically, nor has engaged substantively with the politics that such leadership may involve.</p> <p>Challenging established conventions on research leadership remains 'counterintuitive' within the academy (Bolden [<reflink idref="bib6" id="ref71">6</reflink>], p. 254). The leadership authority of academic researchers, even within co-produced research, is reinforced in multiple ways. For example, funding conventions can mitigate against co-production, due to a reluctance to provide the longer-term or more distributed funding required to build different forms of collaboration (Durose et al., [<reflink idref="bib15" id="ref72">15</reflink>]). Also, standard ethical conventions of research may serve to 'protect institutional power at the expense of community empowerment' (Durham Community Research Team, [<reflink idref="bib13" id="ref73">13</reflink>], p. 9), and are ill-suited to the ethical complexities of co-produced research (Thomas-Hughes, [<reflink idref="bib53" id="ref74">53</reflink>]). Other commentators have highlighted the broader risk that the distinctive ethical and political stance of co-production may be 'diluted' (Williams et al., [<reflink idref="bib59" id="ref75">59</reflink>]) through its 'capture' by the neoliberal university (Bell &amp; Pahl, [<reflink idref="bib3" id="ref76">3</reflink>]), which may serve to reinforce academic authority within co-produced research.</p> <p>Existing leadership theories – like the existing theorising of co-production – is limited in terms of engaging with the politics involved in mobilising those without formal authority to become leaders. As Hartley has observed, leadership theory has – until recently, at least – 'neglected the existence and treatment of both formal and informal politics', which has 'impoverished leadership in whatever sector or sphere' (2018, p. 207). This absence of politics has been based on a misplaced assumption of shared goals and aspirations concerning leadership (Hartley, [<reflink idref="bib33" id="ref77">33</reflink>]), which is unlikely within co-production's plurality of interests, goals, aspirations and values. As Gordon ([<reflink idref="bib28" id="ref78">28</reflink>], pp. 282–283) notes, the literature on distributed leadership has often adopted 'a normative, apolitical approach to power', neglecting the political skills of leadership, particularly in contexts of contestation (Hartley, [<reflink idref="bib33" id="ref79">33</reflink>]).</p> <p>In this article, we seek to interrogate the preferences for forms of leadership of those involved in the co-production of research, and what this means for understanding the power, purpose and practice of leadership in this context. In particular, we are interested in understanding not only different perspectives on how leadership can negotiate the inherent contestation within the co-production of research but what are the points of commonality and divergence between the viewpoints on leadership. What for example, are the trade-offs made between being directive and inclusive, innovative and accountable, open to what emerges and sharing power? With these questions in mind, we now turn to the research design of our study.</p> <hd id="AN0160848877-6">Methods</hd> <p>The remainder of this paper focuses on the results of a Q-methodology study that aimed to redress the dearth of empirical studies on leadership in co-produced research, and interrogated the alignment between the leadership preferences of respondents with experience of co-produced research. The methodology under discussion in this paper is that of co-produced research. We used a Q-survey as our specific method for primary research about leadership in co-produced research. However, Q-methodology is also a methodology in its own right, which involves technique (sorting), method (factor analysis), and associated ontology and epistemology. In this section, we discuss the choice of Q as our data collection and analysis method.</p> <p>Motivated by the discussion on 'elephants', noted in the Introduction, we initially undertook 17 qualitative interviews with those involved in our co-produced research project to understand their views on research leadership (see Appendix 2). Analysis of these interviews revealed little consensus around what research leadership should look like, with participants differing on the leadership role of academics, and on the value of a more distributed approach. Rather than seek to settle these debates, we wanted to gather more data from a wider population, to further explore competing interpretations of the problem at hand, including points of contention and agreement. Therefore, we then conducted the Q-methodology study with 32 respondents involved in a range of research projects on urban governance that self-identified as co-producing research, drawn from three funding programmes – two in the UK and one in Sweden.</p> <p>Q-methodology is particularly well suited to the challenges of exploring competing opinions, as it is designed to clarify alternative perspectives on complex and contested topics (Watts &amp; Stenner, [<reflink idref="bib58" id="ref80">58</reflink>]). Q reveals and describes divergent views in a group as well as consensus. It involves a process called 'Q-sorting' – where participants rank order, using a pre-set grid (see Appendix 1), a large set of items (usually statements) about the topic under investigation (see Appendix 2). These Q-sorts are commonly conducted with 25 to 40 participants (Watts &amp; Stenner, [<reflink idref="bib58" id="ref81">58</reflink>]), then analysed using principal component analysis (PCA) or factor analysis to find a set of shared viewpoints (Brown, [<reflink idref="bib9" id="ref82">9</reflink>]).</p> <p>Our study consisted of a set of 42 statements that each provided a different ending to the sentence 'Good leadership in co-production ... '. Respondents ranked these statements, based on the extent of their agreement with them, and the PCA of these Q-sorts produced a set of four shared viewpoints. We give a detailed account of how we developed and undertook the research, applying a well-established five-step process for conducting Q-methodology studies (McKeown &amp; Thomas, [<reflink idref="bib41" id="ref83">41</reflink>]), in Appendix 2. In this section, we focus on three key reasons why we selected the method as a means of understanding leadership within co-produced research.</p> <p>First, Q-methodology surveys employ structured Q-samples provide a means to systematically interrogate the structuring theoretical propositions in a transparent and replicable form (Brown, [<reflink idref="bib9" id="ref84">9</reflink>]). A Q-methodology survey was a way to explore notions of research leadership by subjecting our theoretical presuppositions to examination by others involved in co-producing research. Through our interviews within the original co-produced research project, along with our review of relevant literature, we developed an incipient typology of four ideal types of leadership in co-production, which we termed, 'directive', 'distributed', 'shared', and 'adaptive'. These ideal types may be positioned along two axes, which run as continuums: one running between leadership aligned with formal authority, and leadership not aligned with formal authority; the other, from leadership aligned with particular individuals, and leadership not aligned with particular individuals. 'Directive' leadership was understood as leadership held by individuals in formal positions of authority; 'distributed' leadership as held by individuals informally, and not primarily based on any positions of authority, 'shared' leadership as held between individuals imbued with formal authority; 'adaptive' leadership as held between individuals informally and not primarily based on any positions of authority. We used these four ideal types, along with the distinction between purpose, power and practice within leadership, outlined earlier, to structure our Q-sample of 42 statements (see Appendix 2). Our findings demonstrate that our respondents' judgements did depart from and nuance our initial expectations in important ways.</p> <p>Second, Q-sorting is an intensive forced-choice process that induces reflection in the respondents as they iteratively sort, prioritise and comment on the statements in order to arrive at their final rank order. This process of reflection was important in relation to the topic of leadership, which we already argued is a 'hidden' element of co-production, which may be primarily characterised by implicit assumptions. Moreover, the large number of statements allowed respondents to render a detailed and nuanced account of their perspective, while also producing data that can be subjected to systematic, transparent and replicable quantitative analysis.</p> <p>Third, conducting an online Q-methodology study enabled us to extend beyond the original research project, with a scientifically robust method that allowed us to be more confident that the viewpoints we found were not determined by the specific features of one individual case of a co-productive research project. Q-methodology does not rely on large-N person samples to produce statistically meaningful results, with most Q-studies involving between 25 and 40 people (Watts &amp; Stenner, [<reflink idref="bib58" id="ref85">58</reflink>]). Its rigour is partly based on the quality of the 'Q-sample', which represents and summarises the diversity of debate on the topic under consideration. The Q-sample, known as the 'concourse', was drawn from a review of relevant literature, and illustrated through statements typifying the debates collected from the initial qualitative interviews. The full set of statements in our structured Q-sample is shown in Table 1 in Appendix 2. Our purpose was to characterise the range of diversity of preferences on the questions of leadership in co-produced research.</p> <p>Table 1. Summary of similarities and differences between viewpoints on leadership in co-produced research.</p> <p> <ephtml> &lt;table&gt;&lt;thead&gt;&lt;tr&gt;&lt;td&gt;Viewpoint&lt;/td&gt;&lt;td&gt;1: Creative Leadership&lt;/td&gt;&lt;td&gt;2: Outcomes-focused Leadership&lt;/td&gt;&lt;td&gt;3: Visionary Leadership&lt;/td&gt;&lt;td&gt;4 Egalitarian Leadership&lt;/td&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Purpose&lt;/td&gt;&lt;td&gt;Creativity&lt;/td&gt;&lt;td&gt;Outcomes&lt;/td&gt;&lt;td&gt;Vision&lt;/td&gt;&lt;td&gt;Equality&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Practice&lt;/td&gt;&lt;td&gt;Buildinggroup resilience&lt;/td&gt;&lt;td&gt;Identifying and incorporating all relevant expertise&lt;/td&gt;&lt;td&gt;Enabling individuals to take responsibility for what they feel passionate about&lt;/td&gt;&lt;td&gt;Maintaining group cohesion and consensus&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Power&lt;/td&gt;&lt;td&gt;Redistributing power&lt;/td&gt;&lt;td&gt;Working with power&lt;/td&gt;&lt;td&gt;Working with power&lt;/td&gt;&lt;td&gt;Redistributing power&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Formality&lt;/td&gt;&lt;td&gt;Flexible and relational&lt;/td&gt;&lt;td&gt;Clear and formal&lt;/td&gt;&lt;td&gt;Flexible and relational&lt;/td&gt;&lt;td&gt;Clear and formal&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Authority&lt;/td&gt;&lt;td&gt;Emergent&lt;/td&gt;&lt;td&gt;Leaders by expertise&lt;/td&gt;&lt;td&gt;Leaders by discretion&lt;/td&gt;&lt;td&gt;Group by consensus&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>In the next section, we outline the four shared viewpoints on good leadership that resulted from the PCA of the respondents' Q-sorts. We arrived at these by interpreting the 'PC arrays' (see Appendix 3) – composite Q-sorts created from the weighted average statement scores of all those Q-sorts with a statistically significant loading onto the PC (and without a similarly large loading on another PC). Each PC array thus represented the shared features of those with similar viewpoints in an aggregated position. Our interpretations focus on the full set of statements as 'gestalt', elaborating the relationships of the parts to the whole, whilst paying particular attention to 'characterising statements', namely those at the extremes of the distribution grid (most agree/most disagree), and 'distinguishing statements', those with a statistically unique placement for a single viewpoint, as is standard practice within Q-methodology (Brown, [<reflink idref="bib9" id="ref86">9</reflink>]; Watts &amp; Stenner, [<reflink idref="bib58" id="ref87">58</reflink>]). The free-text comments of exemplar respondents – those with a statistically significant loading on a single viewpoint – were provided to explain why they chose their most agree/disagree statements were also drawn upon to enrich these interpretations.</p> <hd id="AN0160848877-7">Four viewpoints on good leadership in co-production of research</hd> <p>This section sets out the four viewpoints on what constitutes good leadership in co-production of research as identified through our analysis.</p> <hd id="AN0160848877-8">Viewpoint One: Creative Leadership</hd> <p> <emph>Creative Leadership</emph> was 'marked by the presence of creativity, the ability of a group to move' (s41, <bold>+4</bold>, 0, +2, +2)[<reflink idref="bib1" id="ref88">1</reflink>] and was premised on the 'underlying relationships' (s34, <bold>+4</bold>, +4, +1, +1) between those involved in co-production. For this viewpoint, such relationships were a pre-condition for creativity, allowed for unexpected outcomes, and also enabled the co-production process to adapt to changing circumstances, respond to group dynamics and preferences, and address inequalities in power within the group.</p> <p>Flexibility was key for <emph>Creative Leadership</emph>, as evident from the characterising statement, 'good leadership in co-production is not about one particular style that suits all purposes' (s36, <bold>+4</bold>, +3, −1, 1). As one exemplar argued, 'flexibility is important – even in the same process, different stages need different [...] styles' (RES11[<reflink idref="bib2" id="ref89">2</reflink>]).</p> <p>This interpretation was reinforced by the distinguishing statements for <emph>Creative Leadership</emph>. It was the only viewpoint that reacted negatively to the statement that 'good leadership in co-production means knowing where you are, knowing what your role is, knowing what is expected of you and you getting on and doing it' (s01, <bold>−2</bold>, +1, +3, 0)[<reflink idref="bib3" id="ref90">3</reflink>]; which one exemplar remarked was 'too inflexible and undemocratic' (RES26). It was distinguished by its relative neutrality about the statement that 'good leadership in co-production needs a clear process for how decisions will be made' (s22, <bold>−1</bold>, +4, −3, +3). As one exemplar commented, 'Co-production is nearly always messy there are no clear process-oriented ways of doing it' (RES01).</p> <p>Challenging power inequalities was an important theme. That leadership in co-production 'can mean telling someone what to do' (s37, <bold>−4</bold>, −1, −2, −2) was strongly rejected, since this risked 'undesirable hierarchies' (RES07). Indeed, <emph>Creative Leadership</emph> was notable for its focus on 'addressing real but invisible hierarchies and how that shapes decision-making or what people feel' (s38, <bold>+3</bold>, 0, 0 + 2). A distinguishing view was that leadership in co-production is complicated by antecedent social position, 'feeling that you can be a leader is about gender, class, experience' (s25, <bold>+2</bold>, −2, −3, −1). In <emph>Creative Leadership</emph>, 'you do not "give" people power, you stop preventing them from exercising power' (RES23).</p> <hd id="AN0160848877-9">Viewpoint Two: Outcomes-focused Leadership</hd> <p> <emph>Outcomes-focused Leadership</emph> defined the purpose of leadership in co-production as 'ensuring activity towards an outcome' (s15, −2, <bold>+4</bold>, +1, −1). Without this focus, as one exemplar explained, 'the exercise becomes meaningless process and everyone ends up disappointed' (RES19). <emph>Outcomes-focused Leadership</emph> also valued relationships (s34, +4, <bold>+4</bold>, +1, +1), but took a more instrumental view than <emph>Creative Leadership</emph>, emphasising that relationships would help to take account of the 'real strengths each party is bringing' (RES19). For this viewpoint, leadership was about getting things done; rejecting notions of group decision-making and collective voice. Decisions were to be taken by whoever had the most appropriate skills and capacities. Relationships of trust, clear structures and transparent processes supported this priority. Lower priority was placed on addressing inequalities in power.</p> <p>Lack of clarity about structures and processes, for example, 'fudging moment-to-moment' (s2, −2, <bold>−4</bold>, 3, −3), was most strongly rejected in <emph>Outcomes-focused Leadership</emph>. As one exemplar commented, 'On rare occasions maybe ambiguity is useful, but making it a big part of a leadership model does not seem a positive trait' (RES32). Instead, <emph>Outcomes-focused Leadership</emph> relied upon 'a clear process for how decisions will be made' (s22, −1, <bold>+4</bold>, −3, +3).</p> <p> <emph>Outcomes-focused Leadership</emph> was also distinctive in its rejection of group decision-making. For example, disagreeing that good leadership in co-production is about 'getting things done as a group' (s10, 0, <bold>−3</bold>, +1, +1) or 'all feed[ing] into something and com[ing] out with a collective voice' (s17, −1, <bold>−3</bold>, +1, +2). Its negative position on 'the group taking ownership of the process and facilitating that so that decision-making is shared' (s11, +1, <bold>−3</bold>, +2, +4) was similarly distinctive. One exemplar explained, 'It is rare for multiple minds genuinely to take joint ownership of an activity, goal, or process' (RES32).</p> <p> <emph>Outcomes-focused Leadership</emph> was more comfortable than the other viewpoints with hierarchies, with much less emphasis on addressing power relations. For example, emphatically rejecting the idea of leadership as 'the very difficult task of inviting someone into a space and then trying to give them power' (s29, −1, <bold>−4</bold>, +2, +2). It was distinguished in its neutrality that good leadership in co-production 'sometimes means someone just saying, actually, this is the way we are doing it' (s20, −3, <bold>0</bold>, −2, −3).</p> <hd id="AN0160848877-10">Viewpoint Three: Visionary Leadership</hd> <p> <emph>Visionary Leadership</emph> emphasised 'being visible and articulating a vision, but also being prepared to listen to people and to modify that vision' (s28, 0, 3, <bold>+4</bold>, +4) and to have 'empathy and awareness', 'holding people to the sense of purpose' (s16, +1, +1, <bold>+4</bold>, 0). Whilst clarity on roles was deemed important, fixed processes were eschewed in favour of leader's discretion to act, improvise and not be overly constrained by structure. Power dynamics were treated pragmatically.</p> <p> <emph>Visionary Leadership</emph> was understood to be importantly empathetic. As one exemplar reflected, 'my ability to empathise and engage with others has been the sole determining factor in helping me be successful when leading co-production activities' (RES29). Such 'soft' skills were seen as crucial in catalysing people to act creatively and to 'start thinking for themselves' (RES29). As another exemplar suggested leadership in co-production was 'to facilitate and guide, but not to impose my view of the world' (RES9). Indeed, another statement positively characterising this viewpoint was, 'good leadership in co-production should promote the individual ability of people to act with a degree of autonomy and creativity' (s33, +3, +2, <bold>+4</bold>, +1).</p> <p> <emph>Visionary Leadership</emph> was characterised by a pragmatic acknowledgement of unequal power. It valued clear roles for participants and space for leaders to lead, as reflected in the distinguishing statement 'good leadership in co-production means knowing where you are, knowing what your role is, knowing what is expected of you and you getting on and doing it' (s01, −2, +1, <bold>+3</bold>, 0). However, <emph>Visionary Leadership</emph> was also strongly negatively characterised by the statement 'good leadership in co-production needs a clear process for how decisions will be made' (s22, −1, +4, <bold>−3</bold>, +3). One exemplar elucidated that a 'loose structure' is needed, so that as a leader you can 'go totally off-piste but still pull everything back together' (RES29).</p> <p>However, <emph>Visionary Leadership</emph> did not uncritically accept existing power relations. It was concerned with 'giving everyone the opportunity to speak rather than it just being left for the kind of loudest voices to be the ones that are going to speak' (s39, +3, 0, <bold>+3</bold>, +4). But this perspective was not the same as advocating sharing power. An exemplar offered useful nuance, 'I don't agree co-production shares power' (RES09), 'being present, "staying with the trouble" (Haraway, [<reflink idref="bib31" id="ref91">31</reflink>]), is essential as is being willing to adapt and re- orientate in order to reflect community concerns not just those of the academy/ funders' (RES09).</p> <hd id="AN0160848877-11">Viewpoint Four: Egalitarian Leadership</hd> <p> <emph>Egalitarian Leadership</emph> in co-production of research was presented as creating a shared, inclusive process for a 'collective purpose or identity' (RES08). This viewpoint was characterised by the statements: 'Good leadership in co-production means the group taking ownership of the process and facilitating that so that decision-making is shared' (s11, +1, −3, +2, <bold>+4</bold>) and 'that we all feed into something and come out with a collective voice' (s17, −1, −3, +1, <bold>+2</bold>). <emph>Egalitarian Leadership</emph> facilitated this collective purpose primarily through creating transparent structures for decision-making, to constrain antecedent power of well-resourced group members and ensure that decision-making is genuinely shared by all.</p> <p>Clear structures that empower and make co-production a shared process, lay at the heart of <emph>Egalitarian Leadership</emph>. As one exemplar reflected, 'It is the most challenging and yet necessary activity to create structures that enable everyone in the group to [...] engage productively in decision-making' (RES27). Empowering structures were coupled with actively including all members of the group. A 'key competence of process leaders' (RES24) was avoiding the 'loudest voices' (s39, +3, 0. +3, <bold>+4</bold>) to dominate. Another exemplar reinforced this, saying: 'good leadership is about empowering, not leaving some behind' (RES12).</p> <p> <emph>Egalitarian Leadership</emph> also constrained the over-powerful. Describing how 'good leadership in co-production needs structure in order to empower people' (s08, −1, +2, −1, <bold>+2</bold>), another exemplar reflected: 'Structure protects the weak and moderates the strong ... and thereby shares the load' (RES21). Transparency was seen to bring power differentials into the open. So 'good leadership in co-production is about identifying and addressing real but invisible hierarchies and how that shapes decision-making or what people feel' (s38, +3, 0, 0, <bold>+2</bold>) because 'sometimes power imbalances and various kinds of privilege are not overt' (RES08). Structure and transparency constrained the exercise of arbitrary power, because, as one exemplar explained: 'Without process, co-production can be hi-jacked by those with hidden agendas, embedded privileges, or implicit feelings of their own right to manipulate the process' (RES21).</p> <hd id="AN0160848877-12">Comparison across the viewpoints</hd> <p>Our analysis found differences and similarities between the four viewpoints of leadership in the co-production of research. Table 1 presents the viewpoints, breaking them down into the lines of enquiry introduced earlier of purpose, practice, power, formality and authority.</p> <p>Each viewpoint had a unique emphasis regarding the <emph>purpose</emph> of leadership in co-production of research, addressing the question of what leadership is for. The purpose of C<emph>reative Leadership</emph> was to allow creativity to flourish (s41, +4). <emph>Outcome-focused Leadership</emph> was focused upon delivering outcomes (s15, +4). The purpose of <emph>Visionary Leadership</emph> was to articulate a mobilising vision (s28, +4). <emph>Egalitarian Leadership's</emph> overriding purpose was ensuring equal participation in determining group decisions (s11, +4).</p> <p>Each viewpoint was also distinctive on the <emph>practices</emph> of leadership: on how leadership in the co-production of research should be enacted. Both <emph>Creative Leadership</emph> and <emph>Outcomes-focused Leadership</emph> emphasised the value of relationships. For the former, this emphasis was oriented towards building group resilience so co-production would not be derailed by differences. For the latter, relationships were a way to discover participants' expertise, in order to harness it in pursuit of outcomes. In contrast, <emph>Egalitarian Leadership</emph> was focused less on relationships than in realising coherence and consensus through clear process. <emph>Visionary Leadership</emph> provided another departure, in its emphasis on enabling individuals to act on their passions, in order to realise a vision.</p> <p>There was agreement across viewpoints that leadership in the co-production of research should acknowledge <emph>power</emph> dynamics between participants. But, there was divergence in how far the leadership of co-production should seek to transform power relations; each viewpoint had a distinctive interpretation about whether antecedent power should be accommodated or redistributed, whether leadership should be primarily relational or subject to formalised structures, and who gets to take decisions and by what process. These differences were illustrated by different rankings of the statement: 'leadership is about identifying and addressing real but invisible hierarchies' (s38; +3, 0, 0, +2). <emph>Outcomes-focused</emph> and <emph>Visionary Leadership</emph> recognised that sensitivity to power dynamics is important, but were not actively concerned with transforming them. In contrast, <emph>Creative</emph> and <emph>Egalitarian Leadership</emph> actively sought to redistribute power within the group through either relationships or clear and transparent structures respectively.</p> <p>The viewpoints were differently divided on the importance of <emph>formality</emph>, as evidenced by the statement, 'good leadership needs structure in order to empower people' (s08; −1, +2, −1, +2). Here <emph>Outcomes-focused</emph> and <emph>Egalitarian Leadership</emph> were aligned in seeing leadership exercised through formal structures, dividing them from <emph>Creative</emph> and <emph>Visionary Leadership</emph>, which both preferred a more relational and emergent leadership approach.</p> <p>There were complex differences between the viewpoints on where authority lies and how it is exercised. <emph>Outcomes-focused</emph> and <emph>Visionary Leadership</emph> were comfortable with the idea of leaders who make decisions, even resorting to 'undemocratic' means (s27, −3, +3, +3, −3). But these viewpoints differed on the ground by which legitimacy to take decisions is claimed, between appropriate individuals based on their substantive expertise for <emph>Outcomes-focused Leadership</emph>, compared to flexibility allowing for the leader's discretion in <emph>Visionary Leadership</emph>. For <emph>Creative Leadership</emph>, who decides and how decisions cannot be pre-specified and depended on specific circumstances and group dynamics. For <emph>Egalitarian Leadership</emph>, decisions were taken by the group through a clear and consensus-oriented structure.</p> <hd id="AN0160848877-13">Discussion</hd> <p>There has been limited engagement to date in the questions of leadership implied by the hidden politics of co-production in research. The wider literature on leadership has been similarly 'impoverished' in its engagement with issues of politics and contestation. Our study has sought to interrogate these lacunas through a Q-methodology study with respondents with experience of co-production in research. The study asked respondents what constituted 'good' leadership in the co-production of research. Our research identified four distinct viewpoints, and in this section, we will discuss the implications of our study for thinking about the politics of leadership in co-produced research.</p> <p>Three of the four viewpoints aligned with the core normative concerns of advocates of co-produced research. For example, the emphasis in <emph>Creative Leadership</emph> on retaining flexibility to manage complexity and group dynamics, aligned with the emphasis in the theory and practice of co-production on emergence. The focus on <emph>Egalitarian Leadership</emph>, using structure to ensure equity and inclusion and to constrain the power of the dominant, was in line with an emphasis in co-production on opening up research to under-represented voices. <emph>Visionary Leadership</emph> emphasised the role of co-production in crossing boundaries between different actors or sets of expertise in research, allowing participants to pursue their own intellectual curiosities within a wider collaborative endeavour. In contrast to a focus on process, <emph>Outcomes-focused Leadership</emph> emphasised the role of leadership in co-production as a means of generating outcomes, for example, delivering the research and impact programme designed by the academics. This position was not seen as antithetical to co-production approaches in this viewpoint. The important differences between the viewpoints reinforce the contested nature of leadership and of co-produced research itself, supporting the value in centring questions of politics.</p> <p>The viewpoints also had differing implications for the assumed authority of academics within the research process. <emph>Creative Leadership</emph> sought synergies between participants, but its emphasis on emergence may risk a potential default to academics dominating the process. Such emergence may also challenge the rigour, potentially undermining both science and relevance. <emph>Outcomes-focused Leadership</emph> may reduce trade-offs between academic and societal outcomes (Newig et al., [<reflink idref="bib42" id="ref92">42</reflink>]), potentially supporting scientific standards, but also possibly diluting the distinctiveness of co-produced research. <emph>Visionary Leadership</emph> has the potential to empower diverse participants, but its pragmatism regarding power differentials again opens the risk of academic dominance. <emph>Egalitarian Leadership</emph> perhaps most explicitly seeks to guard against this risk, but in doing so may restrict the ability to enforce scientific standards. Our research suggests is that no single viewpoint on leadership is able to easily navigate the tension between espoused social distribution of expertise and the antecedent power of academics, with varying implications for the robustness, relevance and inclusiveness of co-produced research.</p> <p>However, as the preceding section acknowledged, whilst the viewpoints are distinct, there are also important points of alignment or overlap. For example, the re-distributive approach to negotiating power differentials shared by <emph>Creative</emph> and <emph>Egalitarian Leadership</emph> viewpoints, and a more negotiated approach on working with power from <emph>Outcomes-focused</emph> and <emph>Visionary Leadership</emph> viewpoints. Similarly, on a flexible and relational approach to working shared by <emph>Creative</emph> and <emph>Visionary Leadership</emph>, and a preference for clear and formal structures shared by <emph>Outcomes-focused</emph> and <emph>Egalitarian Leadership</emph>. These points of connection offer a way to think about how these different viewpoints on leadership within co-production may be bridged, for example, at different points in the co-production process, or as the dynamics of the group or demands of the endeavour evolve. For instance, <emph>Visionary Leadership</emph> mobilising and enabling participants before shifting into <emph>Outcomes-focused Leadership</emph> focusing on delivery, or <emph>Egalitarian Leadership</emph> providing a grounding to allow <emph>Creative Leadership</emph> to flourish. The viewpoints were all sensitive to issues of equality, diversity and inclusion, but approached them differently. For example, <emph>Egalitarian Leadership</emph> reflected an emphasis on clear and formal structure as a means to redistribute power and embed a collective and shared endeavour. In contrast, <emph>Outcomes-focused Leadership</emph> had a less redistributive approach, but shared a preference for clear and formal decision-making structures in order to allow different forms of expertise to come to the fore.</p> <p>Overall, the viewpoints contribute to the field by focusing attention to leadership skills or practices involved in the co-production of research, an area of noted neglect in both co-production and leadership literatures. Whilst some scholars, notably Jean Hartley, have developed a focus on political astuteness within leadership research over recent years, this is less developed in the context of co-production (Perry et al., [<reflink idref="bib46" id="ref93">46</reflink>]). They may also act as heuristics to enable those engaging in co-production to surface and discuss some of the messy realities of practice and points of contestation, for example, how different preferences for leadership may be met in different ways or points of the co-production process (Durose et al., [<reflink idref="bib14" id="ref94">14</reflink>]), and the different mixes of skills and practices required to lead (Perry et al., [<reflink idref="bib46" id="ref95">46</reflink>]).</p> <hd id="AN0160848877-14">Conclusion</hd> <p>The focus in this article on the leadership of co-produced research offers a contribution that challenges the misplaced assumptions of shared goals and assumed consensus, which remain influential within literatures on both leadership and co-production that retain a strongly normative orientation. Our contribution is to centre the inherent contestation within co-production and so bring questions of politics, and leadership to the fore within co-production of research.</p> <p>We drew upon the tensions we experienced in our own efforts to co-produce research to develop a Q-methodology study on the question of leadership in co-production. Our use of Q-methodology enabled us to surface competing interpretations of leadership in co-production, including points of contention and agreement, in a way that both retained its empirical grounding but also offered systematic and replicable analysis. The viewpoints evidenced differences concerning the purpose of leadership in co-production of research, the practices it required, how to navigate power differentials, and formality and authority within decision-making. The differences in perspective we have identified, are likely to be found within the same co-production effort, and have tangible consequences for how the challenge of leadership should be considered.</p> <p>The significance and contribution of this article lies in devoting critical attention to uncovering and interrogating how viewpoints on leadership in co-production of research differ, as well as align. In doing so, we have opened up new avenues for research on co-production in other domains. These include the value of further theorising and interrogation of the implications of the different collaborative traditions that inform co-production, and their implications for practice. Also, the political leadership skills that co-production demands, how such skills may be enabled or constrained within different institutional and governance contexts, and how and when in co-production, the evolution or configuration of different leadership practices may occur. Whilst our Q-methodology approach allowed us to analyse the diversity of attitudes, it did not account for their prevalence nor how they align with particular groups, conditions or points in the process of co-production which, again, further research may usefully address.</p> <p>By centring the politics of co-production, we have been able to offer a step-forward by surfacing distinct perspectives on leadership in the co-production of research and offering a heuristic for practice. Opening up such debate offers a way to help navigate the messy realities of practice in co-production, as well advancing the theorising on how to respond to the contestation inherent in co-production. The consequence of our work is not to argue for a new model or template for leadership in the co-production of research. Instead, the findings point to the importance of elucidating these differences in perspectives on leadership, in the interests of surfacing hidden politics and provoking discussion on how differences can be negotiated within a co-production process.</p> <hd id="AN0160848877-15">Acknowledgments</hd> <p>The authors would like to thank the members of the Action Research Collective, and wider participants of the study. The authors acknowledge the contributions of Max Lempriere (University of Birmingham), Susanne Martikke (University of Manchester/ Greater Manchester Centre for Voluntary Organisation) and Robert Pate to this research. The authors also thank Petra Guasti (Charles University), Peter John (Kings College London), Jonathan Rinne (Friedrich Schiller University Jena), and colleagues at the Institute of Local Government University of Birmingham for their comments on earlier versions of this paper. The authors would further like to thank the anonymous reviewers for their thorough and considered comments.</p> <hd id="AN0160848877-16">Disclosure statement</hd> <p>No potential conflict of interest was reported by the author(s).</p> <hd id="AN0160848877-17">Appendix 1. A pre-set Q-sort grid</hd> <p>Graph: Figure 1. A pre-set Q-sort grid</p> <hd id="AN0160848877-18">Appendix 2. A five-step process for conducting a Q-methodology study</hd> <p>This methodological appendix provides technical detail about how we constructed our Q-methodology survey, carried out the collection of the Q-sorts, and analysed the results. We followed a five-step process, as laid out by McKeown and Thomas ([<reflink idref="bib41" id="ref96">41</reflink>]). This approach is a well-established practice within Q-methodology, with other foundational texts, such as Brown ([<reflink idref="bib9" id="ref97">9</reflink>]) and Watts and Stenner ([<reflink idref="bib58" id="ref98">58</reflink>]), offering very similar guidelines.</p> <hd1 id="AN0160848877-19"> <emph>Step 1: Developing the Q-sample</emph> </hd1> <p>The first stage of Q-methodology study is to develop a 'Q-sample' of statements for the participants to rank. The Q-sample must be constructed to reflect the diversity of debate on the topic under consideration – here, leadership preferences in co-produced research. A Q-sample represents and summarises these debates, which are known in Q-methodology as the 'concourse'. Therefore, the first stage in creating the Q-sample is to map the concourse.</p> <p>To map the concourse, we drew on two sources: a review of relevant literature and a series of semi-structured interviews, conducted with 17 individuals from within the initial co-production project, focusing on their experiences of and preferences for leadership. Of these 17, 4 were academics, 1 worked in a public sector organisation, 12 were from community, voluntary or social enterprise sector organisations; and of the 13 non-academics; 5 non-academics also offered consultancy, training, and research services. An initial concourse of 224 statements was generated from these sources. The next stage was to reduce this long-list to a smaller Q-sample of statements that was both manageable for participants and preserved the diversity of the concourse.</p> <p>To achieve this, we employed a theoretically informed sampling grid, producing a structured Q-sample (Fisher, [<reflink idref="bib19" id="ref99">19</reflink>]; Brown, [<reflink idref="bib9" id="ref100">9</reflink>]). A sampling grid provides a framework for selecting the Q-sample, ensuring that statements have an underlying order and relationship with each other. Our sampling grid was based on two dimensions. The first was a typology of four ideal types of leadership along two continuums: one running between leadership aligned with formal authority, and leadership not aligned with formal authority; the other, from leadership aligned with particular individuals, and leadership not aligned with particular individuals. These ideal types - 'adaptive', 'distributed' 'shared' and 'directive' – represented our initial theoretical propositions based on our incipient analysis of the literature review and our qualitative data. The second dimension of our grid was based on key features of these different ideal leadership types – purpose, practices and power – specifically relevant for our study, given the leadership challenges in co-production identified. We also selected a fourth feature – dysfunction – to allow for greater critical engagement in the question at hand. The 224 statements were then assigned across the sampling grid, with duplicate statements iteratively removed to produce a Q-sample of 42 statements, as shown in Table 2.</p> <p>Table 2. Structured Q-sample Grid.</p> <p> <ephtml> &lt;table&gt;&lt;thead&gt;&lt;tr&gt;&lt;td&gt;Statement: "Good leadership in co-production..."&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td /&gt;&lt;td&gt;Purpose&lt;/td&gt;&lt;td&gt;Power&lt;/td&gt;&lt;td&gt;Practices&lt;/td&gt;&lt;td&gt;Dysfunctions&lt;/td&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Directive Leadership&lt;/td&gt;&lt;td&gt;S01 means knowing where you are, knowing what your role is, knowing what is expected of you and you getting on and doing it. S09 is having a strong leader. That is not the enemy of participation, it is how you ensure people stay connected and engaged.&lt;/td&gt;&lt;td&gt;S37 can mean telling someone what to do, that can have a plus side of speed, efficiency, coherence and very clear accountability. S20 sometimes means someone just saying, Actually, this is the way we are doing it.&lt;/td&gt;&lt;td&gt;S31 is being commended for success but also being held responsible when things go wrong. S26 means someone being able to take the bull by the horns, but at the same time, putting your arms around people and nurturing them, being empathetic. S27 is about recognising that if things are not going well, you have to be able to step in and step up, even if that means being un-democratic for a while and making decisions.&lt;/td&gt;&lt;td&gt;S35 is strong leadership, even when it means some people tend to keep ideas to themselves. S04 may sometimes leave the people who are at the bottom of the hierarchy feeling a lack of control or a lack of agency about what they are doing. But that is the price of leadership.&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Shared Leadership&lt;/td&gt;&lt;td&gt;S10 is about getting things done as a group. S17 means that we all feed into something and come out with a collective voice.&lt;/td&gt;&lt;td&gt;S08 needs structure in order to empower people S22 needs a clear process for how decisions will be made. S39 is giving everyone the opportunity to speak rather than it just being left for the kind of loudest voices to be the ones that are going to speak.&lt;/td&gt;&lt;td&gt;S11 means the group taking ownership of the process and facilitating that so that decision-making is shared. S16 does not imply greater knowledge or anything else, it implies empathy and awareness and also holding people to the sense of purpose. S28 means being visible and articulating a vision, but also being prepared to listen to people and to modify that vision.&lt;/td&gt;&lt;td&gt;S21 is sharing power even at the expense of some clarity, some expediency. S42 is willing to sacrifice some responsibility for equality. S19 shares power but that sometimes means a sort of suffocation and an inability to act. S12 is not just sitting around talking about your feelings.&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Adaptive Leadership&lt;/td&gt;&lt;td&gt;S34 is about the underlying relationships, which are essential. S07 is not necessarily about agreeing with it, but about being on that journey together. S13 depends on the situation what kind of leadership is most appropriate.&lt;/td&gt;&lt;td&gt;S38 is about identifying and addressing real but invisible hierarchies and how that shapes decision making or what people feel. S25 is complicated, feeling that you can be a leader is about gender, class, experience, whether you think you have a right to be heard? S33 should promote the individual ability of people to act with a degree of autonomy and creativity.&lt;/td&gt;&lt;td&gt;S03 is about trusting in the process, and just kind of seeing what happens. S41 is marked by the presence of creativity, the ability of a group to move. S18 is about having fun, relating to people as people, not being so formal. S30 is not about being on a white horse, it is about enabling everybody else to fulfil a function or a role effectively. S36 is not about one particular style that suits all purposes.&lt;/td&gt;&lt;td&gt;S02 means fudging moment-to-moment. S05 is very loose, which makes some people feel uncomfortable.&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Distributed Leadership&lt;/td&gt;&lt;td&gt;S15 is about ensuring activity towards an outcome. S24 is about bringing together a range of different capacities. That's got to be better than if one single brain tries to do everything.&lt;/td&gt;&lt;td&gt;S14 is people being comfortable enough to take the lead when it is appropriate, like if somebody has an insight or expertise in an area, it makes sense for them to lead. S23 sits with the person best qualified to lead on that particular thing.&lt;/td&gt;&lt;td&gt;S40 is about people feeling that they can say, I have this idea and I want to take it forward. S32 is about saying, Come on guys, we have got to do this! Making everyone feel good, pumping everyone up.&lt;/td&gt;&lt;td&gt;S29 involves the very difficult task of inviting someone into a space and then trying to give them power. S06 wants to be innovative but falls back into the old patterns.&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <hd1 id="AN0160848877-20"> <emph>Step 2: Recruiting the person sample</emph> </hd1> <p>Q-method does not rely on large-N person samples to produce statistically meaningful results, with most Q-studies involving between 25 and 40 people (Watts &amp; Stenner, [<reflink idref="bib58" id="ref101">58</reflink>]). A sample of 32 international key informants with prior experience of research projects involving a university partner and self-identifying as using co-production were recruited for this study. Personalised invitations were sent to 120 key informants who met these criteria and were involved in funded research supported by any of three relevant programmes, two in the UK and one in Sweden. These programmes were selected due to scale, international scope and portfolios of projects focusing on co-produced and/or engaged research. This process produced a sample of 19 individuals with experience of co-production as academic researchers, and 21 with a range of experience beyond academia.[<reflink idref="bib4" id="ref102">4</reflink>]</p> <hd1 id="AN0160848877-21"> <emph>Step 3: Q-sort</emph> </hd1> <p>The participants conducted the Q-sort online using the specialist programme HTMLQ,[<reflink idref="bib5" id="ref103">5</reflink>] hosted on a domain that we created specifically for the purposes of this project. The software first presents the statements to the participants one-by-one in a random order, with an option to sort the statements into three categories: agree, neutral and disagree. Respondents are then presented with the statements in these categories for a second time, so that they can refine their choices by ranking them beginning with the extremes of the ranking grid – namely, in our study to choose their three most agree and three most disagree statements, iteratively working towards the neutral point (the middle of the grid presented in Figure 1). The software then presents the fully completed grid to the participant, asking them if they wish to make any changes (which they can do by dragging and dropping statements, much like in the digital version of the card game solitaire) before confirming their finalised Q-sort. Finally, participants were given the option to provide free-text responses clarifying their selection of their three 'most agree' and 'most disagree' statements. On average, respondents took 24.5 minutes to complete their sort, and contributed 204 words of free-text response.</p> <hd1 id="AN0160848877-22"> <emph>Step 4: Analysis</emph> </hd1> <p>We used principal component analysis (PCA) to identify statistically significantly different shared viewpoints across the Q-sorts. This analysis was conducted with the specialised software PQ Method (Schmolk and Atkinson [<reflink idref="bib52" id="ref104">52</reflink>]), which first generated a correlation matrix between the 32 Q-sorts, based on relative differences in statement rankings. Then, the PCA extracted the common variance from this correlation matrix as principal components. The next stage is to identify how many of the extracted principal components should be retained as substantively meaningful. We ran the four standard statistical tests for determining this, but, as is common (see Watts &amp; Stenner, [<reflink idref="bib58" id="ref105">58</reflink>]), the results between tests varied, suggesting retaining between two and eight principal components (PCs).[<reflink idref="bib6" id="ref106">6</reflink>] Therefore, we ran multiple solutions, extracting different numbers of PCs, varimax rotating them, and interpreting the resulting PC Arrays to judge their substantive meanings. We began with two PCs and added a new PC until doing so added nothing to the substantive interpretation. We stopped this process after analysing the six PC solutions, because we judged that in the five and six PC solutions, the additional PCs were not substantively meaningful and did not provide any advantage over the four PC solutions. As such, this process resulted in a varimax-rotated four PC solution.</p> <p>In Q, the researchers' interpretation of the most substantively meaningful solution is acknowledged to have primacy (McKeown &amp; Thomas, [<reflink idref="bib41" id="ref107">41</reflink>]; Watts &amp; Stenner, [<reflink idref="bib58" id="ref108">58</reflink>]). However, there were also some statistical factors that indicated a four PC solution provided the optimal trade-off between parsimony and comprehensiveness, measured in terms of explanatory variance and coverage of statistically significant Q-sort loadings. A varimax solution attempts to maximise Q-sorts loading on a single PC. The four PC solutions comprehensively covered the Q-sorts (every respondent had at least one significant loading), whilst also having only five confounded Q-sorts (that is, Q-sorts with more than one significant PC loading), the lowest number of the comprehensive solution. The four PC solutions captured 57% of the explanatory variance within the individual Q-sorts. Adding an extra PC increased the explanatory variance to 62%, but increased the number of confounded Q-sorts to 9 and diluted the clarity of the substantive interpretations of the PCs.</p> <hd1 id="AN0160848877-23"> <emph>Step 5: Interpretation</emph> </hd1> <p>The final step is to interpret the substantive meaning of the PCs, using the PC arrays created by PQMethod. PC arrays are composite Q-sorts created from the weighted average statement scores of all those Q-sorts with a statistically significant loading onto the PC (and without a similarly large loading on another PC). We include the statement-by-statement scores for the PC arrays and the participants' PC loadings in the tables below. As aforementioned in the article, our interpretation of the arrays followed the standard Q-methodology practice of focusing on the full set of statements as 'gestalt', elaborating the relationships of the parts to the whole, though paying particular attention to 'characterising statements' (those at the extremes of the distribution grid), and 'distinguishing' statements (those with a statistically unique placement for a single viewpoint). The process of interpreting the PC arrays was one of intensive discussion amongst the four authors. This included a full-day workshop to discuss and agree a set of an initial set of interpretations, followed by an iterative process of drafting the interpretations, then sharing, commenting and redrafting. Throughout this process, we employed the free-text comments of exemplar participants (those respondents with a statistically significant loading on a single viewpoint) as a reference point to check the validity of our interpretations.</p> <hd id="AN0160848877-24">Appendix 3. Principal Component Arrays</hd> <p>Table 3: PC Arrays.</p> <p> <ephtml> &lt;table&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td /&gt;&lt;td&gt;Creative Leadership&lt;/td&gt;&lt;td&gt;Outcomes-focused Leadership&lt;/td&gt;&lt;td&gt;Visionary Leadership&lt;/td&gt;&lt;td&gt;Egalitarian Leadership&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Statement&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Q&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Z&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Q&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Z&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Q&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Z&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Q&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&lt;italic&gt;Z&lt;/italic&gt;&lt;/bold&gt;-score&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S01&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.75*&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.45&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.38*&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.04&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S02&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.58*&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.91&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.63&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.29&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S03&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.75&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.05&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S04&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.52&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.48&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.95&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;2.09*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S05&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.26*&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;1.06&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.92&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;1.20&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S06&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;1.03&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.48&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.90&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.70&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S07&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.47&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.15&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.19&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S08&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.36&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.51&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S09&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.45&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.67&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.66&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.65&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S10&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.15*&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.16*&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.58&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.62&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S11&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.70&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.10*&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.60*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S12&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.13&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.45&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.32&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S13&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.63&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.14&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S14&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0.03&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0.17&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0.06&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0.48&lt;/italic&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S15&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.83&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.71*&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.27&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.66*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S16&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.81&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.50*&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S17&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.41*&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.40*&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.55&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.70&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S18&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.35&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.54&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.66*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S19&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;3&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.48&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;2&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.91&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;4&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.69&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;3&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.21&lt;/italic&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S20&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.38&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.21*&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.72*&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.58&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S21&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.15&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.63&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.69&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S22&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.24*&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.86*&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.12*&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.11*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S23&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.95&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.56*&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.30&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.10*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S24&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.65&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.13*&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.12&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S25&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;1.09*&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.83&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.28&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S26&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.26&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.46&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.14&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.32&lt;/italic&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S27&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.51&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.21&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.34&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.32&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S28&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.01*&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;2.14*&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.24&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S29&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.22*&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.65*&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.68&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.75&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S30&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.21&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.68&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.30&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.11&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S31&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.12&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;0&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.22&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.39&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;0.42&lt;/italic&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S32&lt;/td&gt;&lt;td&gt;&amp;#8722;3&lt;/td&gt;&lt;td&gt;&amp;#8722;1.22*&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.50&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.10&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.67&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S33&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.15&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.39&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.57&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S34&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.58&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.77&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.27&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.66&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S35&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;4&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.79&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;3&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.38&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;4&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;1.81&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;4&lt;/italic&gt;&lt;/td&gt;&lt;td&gt;&lt;italic&gt;&amp;#8722;2.00&lt;/italic&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S36&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.58&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.54&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.21*&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.52*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S37&lt;/td&gt;&lt;td&gt;&amp;#8722;4&lt;/td&gt;&lt;td&gt;&amp;#8722;1.76*&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.42&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.65&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;1.07&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S38&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.53*&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.23&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.10&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.97*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S39&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.28&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.19*&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.37&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.58&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S40&lt;/td&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;1.15&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.47&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S41&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;1.54*&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;0.09&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.65&lt;/td&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;0.69&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;S42&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;&amp;#8722;0.06&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.71&lt;/td&gt;&lt;td&gt;&amp;#8722;1&lt;/td&gt;&lt;td&gt;&amp;#8722;0.36&lt;/td&gt;&lt;td&gt;&amp;#8722;2&lt;/td&gt;&lt;td&gt;&amp;#8722;0.66&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>1 <emph>Q</emph>-scores indicate placement in the composite Q-sort, i.e. the three statements with scores of 4 would be in the most agree column and the other three with −4 in the most disagree column, thus constitute 'characterising' statements.</p> <ulist> <item>2 <emph>Z</emph>-scores show the weighted average score for exemplar Q-sorts for the respective PC. <emph>Q</emph>-scores are derived from ranking the <emph>Z</emph>-scores.</item> <item>3 * indicates a 'distinguishing' statement that is uniquely placed for the respective PC, i.e a statistically significant difference at the 5% level.</item> <item>4 Italics indicates a consensus statement, where there is no statistically significant difference between any of the four PCs.</item> </ulist> <p>Table 4. Respondents' PC Loadings.</p> <p> <ephtml> &lt;table&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Respondent&lt;/td&gt;&lt;td&gt;PC1&lt;/td&gt;&lt;td&gt;PC2&lt;/td&gt;&lt;td&gt;PC3&lt;/td&gt;&lt;td&gt;PC4&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;01&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.51&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;td&gt;0.27&lt;/td&gt;&lt;td&gt;&amp;#8722;0.06&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;02&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.52&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;0.06&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;td&gt;0.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;03&lt;/td&gt;&lt;td&gt;0.42&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;td&gt;0.51&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;04&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;td&gt;0.06&lt;/td&gt;&lt;td&gt;&amp;#8722;0.02&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.67&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;05&lt;/td&gt;&lt;td&gt;0.28&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.49&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;0.35&lt;/td&gt;&lt;td&gt;0.16&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;06&lt;/td&gt;&lt;td&gt;&amp;#8722;0.11&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.48&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.39&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;07&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.82&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;0.13&lt;/td&gt;&lt;td&gt;0.17&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;08&lt;/td&gt;&lt;td&gt;0.30&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;td&gt;0.13&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.73&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;09&lt;/td&gt;&lt;td&gt;0.37&lt;/td&gt;&lt;td&gt;0.16&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.49&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;10&lt;/td&gt;&lt;td&gt;0.15&lt;/td&gt;&lt;td&gt;&amp;#8722;0.38&lt;/td&gt;&lt;td&gt;0.16&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.58&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;11&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.57&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;0.06&lt;/td&gt;&lt;td&gt;0.34&lt;/td&gt;&lt;td&gt;0.32&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;12&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;td&gt;0.05&lt;/td&gt;&lt;td&gt;0.25&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.72&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;13&lt;/td&gt;&lt;td&gt;&amp;#8722;0.08&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;td&gt;0.07&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.46&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;14&lt;/td&gt;&lt;td&gt;0.42&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;0.07&lt;/td&gt;&lt;td&gt;0.52&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;15&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.75&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;td&gt;0.02&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;16&lt;/td&gt;&lt;td&gt;&amp;#8722;0.42&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;td&gt;0.26&lt;/td&gt;&lt;td&gt;0.47&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;17&lt;/td&gt;&lt;td&gt;0.35&lt;/td&gt;&lt;td&gt;&amp;#8722;0.03&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.57&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;0.08&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;td&gt;0.34&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.64&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;19&lt;/td&gt;&lt;td&gt;0.15&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.70&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;td&gt;0.31&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;20&lt;/td&gt;&lt;td&gt;0.11&lt;/td&gt;&lt;td&gt;0.10&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.73&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;21&lt;/td&gt;&lt;td&gt;0.44&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;td&gt;0.05&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.69&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;22&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.77&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.38&lt;/td&gt;&lt;td&gt;&amp;#8722;0.02&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;23&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.60&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;0.02&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;td&gt;0.46&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;24&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;0.21&lt;/td&gt;&lt;td&gt;0.39&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.54&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;0.45&lt;/td&gt;&lt;td&gt;0.08&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;0.50&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;26&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.60&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;td&gt;&amp;#8722;0.14&lt;/td&gt;&lt;td&gt;0.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;27&lt;/td&gt;&lt;td&gt;0.20&lt;/td&gt;&lt;td&gt;0.25&lt;/td&gt;&lt;td&gt;0.05&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.66&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;28&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.58&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;td&gt;0.25&lt;/td&gt;&lt;td&gt;0.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;29&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;td&gt;0.00&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.75&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.11&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;30&lt;/td&gt;&lt;td&gt;0.49&lt;/td&gt;&lt;td&gt;0.36&lt;/td&gt;&lt;td&gt;0.09&lt;/td&gt;&lt;td&gt;0.55&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;31&lt;/td&gt;&lt;td&gt;0.30&lt;/td&gt;&lt;td&gt;0.23&lt;/td&gt;&lt;td&gt;0.30&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.44&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;32&lt;/td&gt;&lt;td&gt;&amp;#8722;0.05&lt;/td&gt;&lt;td&gt;&lt;bold&gt;0.62&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;0.02&lt;/td&gt;&lt;td&gt;&amp;#8722;0.02&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <ulist> <item>5 Any PC loading greater than or equal to.40 is statistically significant at the 1% level</item> <item>6 Bold indicates exemplar participants whose Q-sorts were used to create the PC arrays for the respective PC. Exemplars are selected if they have a significant loading on one PC and no similarly large significant loading on a second PC.</item> </ulist> <ref id="AN0160848877-25"> <title> Notes </title> <blist> <bibl id="bib1" idref="ref11" type="bt">1</bibl> <bibtext> The quoted scores demonstrate a particular statement's position in the respective PC array, for example, s41, +4 means that statement 41 is positioned in the most-agree column in the PC array for the viewpoint under discussion, hence is positively characterizing. See Appendix 2 for full detail.</bibtext> </blist> <blist> <bibl id="bib2" idref="ref32" type="bt">2</bibl> <bibtext> An identifier for the quoted exemplar respondent of a particular viewpoint.</bibtext> </blist> <blist> <bibl id="bib3" idref="ref28" type="bt">3</bibl> <bibtext> The quoted scores demonstrate a particular statement's position in the respective PC array. For example, (s01, −2, +1, +3, 0) means that statement 1 is scored by viewpoint one as −2; by viewpoint two as +1, and so on. Where the score is given in bold, it is to indicate the viewpoint under discussion, see Appendix 2 for further detail.</bibtext> </blist> <blist> <bibl id="bib4" idref="ref50" type="bt">4</bibl> <bibtext> Participants were able to select more than one role, hence why the number is greater than 32.</bibtext> </blist> <blist> <bibl id="bib5" idref="ref25" type="bt">5</bibl> <bibtext> HTMLQ is provided for free on GitHub by aproxima: https://github.com/aproxima/htmlq</bibtext> </blist> <blist> <bibl id="bib6" idref="ref64" type="bt">6</bibl> <bibtext> 1. Kaiser–Guttman criterion suggested retaining eight PCs. 2. Humphrey's Rule suggested retaining three PCs. 3. The Scree Plot suggested retaining two PCs. 4. There were six unrotated PCs with two or more significantly loading Q sorts (at the 1% level).</bibtext> </blist> </ref> <ref id="AN0160848877-26"> <title> References </title> <blist> <bibtext> Banks, S., Hart, A., Pahl, K., &amp; Ward, P. (Eds.). (2019). Co-producing research. Policy Press.</bibtext> </blist> <blist> <bibtext> Bastow, S., Dunleavy, P., &amp; Tinkler, J. (2014). The impact of the social sciences. Sage.</bibtext> </blist> <blist> <bibtext> Bell, D. M., &amp; Pahl, K. (2018). Co-production: Towards a utopian approach. International Journal of Social Research Methodology, 21 (1), 105 – 117. https://doi.org/10.1080/13645579.2017.1348581</bibtext> </blist> <blist> <bibtext> Bennett, F., &amp; Roberts, M. (2004). From input to influence. Joseph Rowntree Foundation.</bibtext> </blist> <blist> <bibtext> Bevir, M., Needham, C., &amp; Waring, J. (2019). Inside co-production: Ruling, resistance, and practice. Social Policy &amp; Administration, 53 (2), 197 – 202. https://doi.org/10.1111/spol.12483</bibtext> </blist> <blist> <bibtext> Bolden, R. (2011). Distributed Leadership in Organizations: A review of theory and research. International Journal of Management Reviews, 13 (3), 251 – 269. https://doi.org/10.1111/j.1468-2370.2011.00306.x</bibtext> </blist> <blist> <bibl id="bib7" idref="ref22" type="bt">7</bibl> <bibtext> Bovaird, T. (2007). Beyond Engagement and Participation: User and Community Coproduction of Public Services. Public Administration Review, 67 (5), 846 – 860. https://doi.org/10.1111/j.1540-6210.2007.00773.x</bibtext> </blist> <blist> <bibl id="bib8" idref="ref45" type="bt">8</bibl> <bibtext> Brock, K., &amp; McGee, R. (eds). (2002). Knowing poverty. Earthscan Publications Ltd.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref82" type="bt">9</bibl> <bibtext> Brown, S. (1980). Political subjectivity. Yale University Press.</bibtext> </blist> <blist> <bibtext> Bussu, S., &amp; Bartels, K. (2014). Facilitative leadership and the challenge of renewing local democracy in Italy. International Journal of Urban and Regional Research, 38 (6), 2256 – 2273. https://doi.org/10.1111/1468-2427.12070</bibtext> </blist> <blist> <bibtext> Bussu, S., &amp; Galanti, M. T. (2018). Facilitating coproduction: The role of leadership in coproduction initiatives in the UK. Policy and Society, 37 (3), 347 – 367. https://doi.org/10.1080/14494035.2018.1414355</bibtext> </blist> <blist> <bibtext> Collins, H. M., &amp; Evans, R. J. (2002). The third wave of science studies. Social Studies of Science, 32 (2), 235 – 296. https://doi.org/10.1177/0306312702032002003</bibtext> </blist> <blist> <bibtext> Durham Community Research Team. (2012). Community-based participatory research. Centre for Social Justice and Community Action.</bibtext> </blist> <blist> <bibtext> Durose, C., Perry, B., &amp; Richardson, L. (2021). Leading transdisciplinary knowledge. In K. Hemström, K. Simon, H. Palmer, B. Perry, &amp; M. Polk (Eds.), Transdisciplinary knowledge co-production (pp. 34 – 37). Practical Action.</bibtext> </blist> <blist> <bibtext> Durose, C., Richardson, L., &amp; Perry, B. (2018). Craft metrics to value co-production. Nature, 562 (7725), 32. https://doi.org/10.1038/d41586-018-06860-w</bibtext> </blist> <blist> <bibtext> Edelenbos, J., Bressers, N. E. W., &amp; Vandenbussche, L. (2017). Evolution of interdisciplinary collaboration: What are stimulating conditions? Science and Public Policy, 44 (4), 451 – 463. https://doi.org/10.1093/scipol/scw035</bibtext> </blist> <blist> <bibtext> Ersoy, A. (Ed.). (2017). The impact of co-production. Policy Press.</bibtext> </blist> <blist> <bibtext> Facer, K., &amp; Enright, B. (2016). Creating living knowledge. University of Bristol/AHRC Connected Communities.</bibtext> </blist> <blist> <bibtext> Fisher, R.A. (1960). The design of experiments. Hafner</bibtext> </blist> <blist> <bibtext> Flinders, M., &amp; Anderson, A. (2019). Fit for the future? ESRC.</bibtext> </blist> <blist> <bibtext> Flinders, M., Wood, M., &amp; Cunningham, M. (2016). The politics of co-production: Risks, limits and pollution. Evidence &amp; Policy: A Journal of Research, Debate and Practice, 12 (2), 261 – 279. https://doi.org/10.1332/174426415X14412037949967</bibtext> </blist> <blist> <bibtext> Fung, A. (2001). Accountable Autonomy: Toward Empowered Deliberation in Chicago Schools and Policing. Politics and Society, 29 (1), 73 – 103. https://doi.org/10.1177/0032329201029001004</bibtext> </blist> <blist> <bibtext> Garud, R., Jain, S., &amp; Tuertscher, P. (2008). Incomplete by design and designing for incompleteness. Organization Studies, 29 (3), 351 – 371. https://doi.org/10.1177/0170840607088018</bibtext> </blist> <blist> <bibtext> Gaventa, J. (2005). Claiming Citizenship. Zed Books.</bibtext> </blist> <blist> <bibtext> Ghate, D., Lewis, J., &amp; Welbourn, D. (2013). Systems Leadership : Exceptional leadership for exceptional times - synthesis report. Virtual Staff College</bibtext> </blist> <blist> <bibtext> Gibbons, M., Limoges, C., Nowotony, H., Schwartzman, S., Scott, P., &amp; Trow, M. (1994). The new production of knowledge. Sage.</bibtext> </blist> <blist> <bibtext> Goodson, L., &amp; Phillimore, J. (2012). Community research for participation. The Policy Press.</bibtext> </blist> <blist> <bibtext> Gordon, R. D. (2010). Dispersed Leadership: Exploring the Impact of Antecedent Forms of Power Using a Communicative Framework. Management Communication Quarterly, 24 (2), 260 – 287. https://doi.org/10.1177/0893318909360213</bibtext> </blist> <blist> <bibtext> Gronn, P. (2000). Distributed properties: A new architecture for leadership. Educational Management and Administration, 28 (3), 317 – 338. https://doi.org/10.1177/0263211X000283006</bibtext> </blist> <blist> <bibtext> Haklay, M. (2013). Citizen science and volunteered geographic information. In D. Z. Sui, S. Elwood, &amp; M. F. Goodchild (Eds.), Crowdsourcing geographic knowledge (pp. 105 – 122). Springer.</bibtext> </blist> <blist> <bibtext> Haraway, D.J. (2016). Staying with the trouble. Duke University Press</bibtext> </blist> <blist> <bibtext> Hart, A., Davies, C., Aumann, K., Wenger, E., Aranda, K., Heaver, B., &amp; Wolff, D. (2013). Mobilising knowledge in community−university partnerships: What does a community of practice approach contribute? Contemporary Social Science, 8 (3), 278 – 291. https://doi.org/10.1080/21582041.2013.767470</bibtext> </blist> <blist> <bibtext> Hartley, J. (2018). Ten propositions about public leadership. International Journal of Public Leadership. 14 (4), 202 – 217. 1 0.1 108/IJPL-09-2018–0048</bibtext> </blist> <blist> <bibtext> Heifetz, R. (1994). Leadership without easy answers. Harvard University Press.</bibtext> </blist> <blist> <bibtext> Hemström, K., Simon, K., Palmer, H., Perry, B., &amp; Polk, M. (2021). Transdisciplinary knowledge co-production. Practical Action.</bibtext> </blist> <blist> <bibtext> Jasanoff, S. (Ed.). (2006). States of Knowledge. Routledge.</bibtext> </blist> <blist> <bibtext> Jeong, S., &amp; Choi, J. Y. (2015). Collaborative research for academic knowledge creation: How team characteristics, motivation, and processes influence research impact. Science and Public Policy, 42 (4), 460 – 473. https://doi.org/10.1093/scipol/scu067</bibtext> </blist> <blist> <bibtext> Lister, R. and Beresford, P., with Green, D. &amp; Woodward, K. (2000). "Where are 'the poor' in the future of poverty research?". In Bradshaw, J. and Sainsbury, R. (Eds.) Researching Poverty (pp. 284 – 310). Ashgate</bibtext> </blist> <blist> <bibtext> Maasen, S., &amp; Lieven, O. (2006). Transdisciplinarity: A new mode of governing science? Science and Public Policy, 33 (6), 399 – 410. https://doi.org/10.3152/147154306781778803</bibtext> </blist> <blist> <bibtext> Martin, S. (2010). Co-production of social research: Strategies for engaged scholarship. Public Money and Management, 30 (4), 211 – 218. https://doi.org/10.1080/09540962.2010.492180</bibtext> </blist> <blist> <bibtext> McKeown, B., &amp; Thomas, D. (2013). Q Methodology (2nd ed.). Sage.</bibtext> </blist> <blist> <bibtext> Newig, J., Jahn, S., Lang, D. J., Kahlea, J., &amp; Bergmann, M. (2019). Linking modes of research to their scientific and societal outcomes. Evidence from 81 sustainability-oriented research projects. Environmental Science &amp; Policy, 101, 147 – 155. https://doi.org/10.1016/j.envsci.2019.08.008</bibtext> </blist> <blist> <bibtext> Nowotny, H., Scott, P. B., &amp; Gibbons, M. T. (2001). Re-thinking science. Wiley.</bibtext> </blist> <blist> <bibtext> Oliver, K., Kothari, A., &amp; Mays, N. (2019). The dark side of coproduction. Health Research Policy and Systems, 17, 33. https://doi.org/10.1186/s12961-019-0432-3</bibtext> </blist> <blist> <bibtext> Orr, K. M., Bennett, M., &amp; Cunliffe, A. L. (2009). Reflexivity in the co-production of academic-practitioner research. Qualitative Research in Organizations and Management: An International Journal, 4 (1), 85 – 102. https://doi.org/10.1108/17465640910951462</bibtext> </blist> <blist> <bibtext> Perry, B., Durose, C., &amp; Richardson, L., with the Action Research Collective. (2019). How can we govern cities differently? The promise and practices of co-production. Greater Manchester, Creative Concern.</bibtext> </blist> <blist> <bibtext> Pohl, C., Rist, S., Zimmerman, A., Fry, P., Gurung, G. S., Schneider, F., Speranza, C. I., Kiteme, B., Boillat, S., Serrano, E., Hadorn, G. H., &amp; Wiesmann, U. (2010). Researchers' roles in knowledge co-production: Experience from sustainability research in Kenya, Switzerland, Bolivia and Nepal. Science and Public Policy, 37 (4), 267 – 281. https://doi.org/10.3152/030234210X496628</bibtext> </blist> <blist> <bibtext> Polk, M., &amp; Kain, J. (2015). Co-producing knowledge for sustainable urban futures. In I. M. Polk (Ed.), Co-producing knowledge for sustainable cities (pp. 1 – 22). Routledge.</bibtext> </blist> <blist> <bibtext> Richardson, L. (2013). Putting the Research Boot on the Policymakers' Foot: Can Participatory Approaches Change the Relationship between Policymakers and Evaluation? Social Policy and Administration, 47 (4), 483 – 500. https://doi.org/10.1111/spol.12031</bibtext> </blist> <blist> <bibtext> Richardson, L. (2014). Engaging the public in policy research: Are community researchers the answer? Politics and Governance, 2 (1), 31 – 43. https://doi.org/10.17645/pag.v2i1.19</bibtext> </blist> <blist> <bibtext> Schlappa, H., &amp; Imani, Y. (2018). Who is in the lead? In T. Brandsen, B. Verschuere, &amp; T. Steen (Eds.), Co-production and Co-creation (pp. 99 – 108). Taylor &amp; Francis.</bibtext> </blist> <blist> <bibtext> Schmolck, P. &amp; Anderson, J. (2014). PQMethod. http : //schmolck.userweb.mwn.de/qmethod/</bibtext> </blist> <blist> <bibtext> Thomas-Hughes, H. (2018). Ethical 'mess' in co-produced research: Reflections from a U.K.-based case study. International Journal of Social Research Methodology, 21 (2), 231 – 242. https://doi.org/10.1080/13645579.2017.1364065</bibtext> </blist> <blist> <bibtext> Tortzen, A. (2017) Leading co-production: Three leadership styles and how they affect the quality and public value of co-production processes. Paper presented at Public Service Innovation Conference, Lillehammer, Norway.</bibtext> </blist> <blist> <bibtext> van Ameijde, J. D. J., Nelson, P., Billsberry, J., &amp; van Meurs, N. (2009). Improving leadership in Higher Education institutions: A distributed perspective. Higher Education, 58 (6), 763 – 779. https://doi.org/10.1007/s10734-009-9224-y</bibtext> </blist> <blist> <bibtext> Voorberg, W. H., Bekkers, V. J. J. M., &amp; Tummers, L. G. (2015). A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey. Public Management Review, 17 (9), 1333 – 1357. https://doi.org/10.1080/14719037.2014.930505</bibtext> </blist> <blist> <bibtext> Walker, D. (2010). Debate: Do academics know better or merely different? Public Money and Management, 30 (4), 204 – 206. https://doi.org/10.1080/09540962.2010.492174</bibtext> </blist> <blist> <bibtext> Watts, S., &amp; Stenner, P. (2012). Doing Q methodological research. SAGE.</bibtext> </blist> <blist> <bibtext> Williams, O., Sarre, S., Constantina Papoulias, S., Knowles, S., Robert, G., Beresford, P., Rose, D., Carr, S., Kaur, M., &amp; Palmer, V. (2020). Lost in the shadows: Reflections on the dark side of co-production. Health Research Policy and Systems, 18 (1),1-10. https://doi.org/10.1186/s12961-020-00558-0</bibtext> </blist> <blist> <bibtext> Williamson, A., &amp; de Souza, R. (2010). Researching with communities. Muddy Creek Press.</bibtext> </blist> <blist> <bibtext> Youngs, H. (2017). A critical exploration of collaborative and distributed leadership in higher education: Developing an alternative ontology through leadership-as-practice. Journal of Higher Education Policy and Management, 39 (2), 140 – 141. https://doi.org/10.1080/1360080X.2017.1276662</bibtext> </blist> </ref> <aug> <p>By Catherine Durose; Beth Perry; Liz Richardson and Rikki Dean</p> <p>Reported by Author; Author; Author; Author</p> <p></p> <p>Catherine Durose is Director of Research and Reader in Policy Sciences at the University of Birmingham's Institute of Local Government Studies. Her research interests centre on urban governance, public policy and participation. Her work has been published in journals including Urban Studies , Governance , Public Administration Review , and Political Studies.</p> <p>Beth Perry is Director of the Urban Institute and a Professor of Urban Knowledge and Governance at the University of Sheffield. Her work focuses on co-production, urban governance and sustainable urban transitions. She has co-authored and co-edited six books on these topics and her work has appeared in interdisciplinary journals including International Journal of Urban and Regional Research, Regional Studies, Politics and Governance and Local Environment.</p> <p>Liz Richardson is a Professor of Public Administration at the University of Manchester. Her research interests include urban governance; public policy; citizen participation; and participatory research methods. Her work has appeared in a range of journals such as Governance , Evidence and Policy , the British Journal of Politics and International Relations , Social Policy and Administration , and Environment and Planning.</p> <p>Rikki Dean is a Postdoctoral Fellow in the Democratic Innovations Research Unit, Goethe University Frankfurt. His research interests encompass democratic systems theory, political process preferences and participatory governance. He has published in journals across these fields, including Democratic Theory , Governance , Political Studies and Social Policy &amp; Administration.</p> </aug> <nolink nlid="nl1" bibid="bib15" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib35" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib45" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib40" firstref="ref4"></nolink> <nolink nlid="nl5" bibid="bib50" firstref="ref5"></nolink> <nolink nlid="nl6" bibid="bib21" firstref="ref6"></nolink> <nolink nlid="nl7" bibid="bib46" firstref="ref7"></nolink> <nolink nlid="nl8" bibid="bib27" firstref="ref8"></nolink> <nolink nlid="nl9" bibid="bib30" firstref="ref9"></nolink> <nolink nlid="nl10" bibid="bib18" firstref="ref10"></nolink> <nolink nlid="nl11" bibid="bib26" firstref="ref14"></nolink> <nolink nlid="nl12" bibid="bib32" firstref="ref15"></nolink> <nolink nlid="nl13" bibid="bib43" firstref="ref16"></nolink> <nolink nlid="nl14" bibid="bib49" firstref="ref17"></nolink> <nolink nlid="nl15" bibid="bib44" firstref="ref20"></nolink> <nolink nlid="nl16" bibid="bib59" firstref="ref26"></nolink> <nolink nlid="nl17" bibid="bib17" firstref="ref27"></nolink> <nolink nlid="nl18" bibid="bib48" firstref="ref29"></nolink> <nolink nlid="nl19" bibid="bib57" firstref="ref31"></nolink> <nolink nlid="nl20" bibid="bib42" firstref="ref33"></nolink> <nolink nlid="nl21" bibid="bib23" firstref="ref34"></nolink> <nolink nlid="nl22" bibid="bib22" firstref="ref35"></nolink> <nolink nlid="nl23" bibid="bib12" firstref="ref36"></nolink> <nolink nlid="nl24" bibid="bib38" firstref="ref37"></nolink> <nolink nlid="nl25" bibid="bib60" firstref="ref38"></nolink> <nolink nlid="nl26" bibid="bib56" firstref="ref40"></nolink> <nolink nlid="nl27" bibid="bib47" firstref="ref43"></nolink> <nolink nlid="nl28" bibid="bib24" firstref="ref46"></nolink> <nolink nlid="nl29" bibid="bib20" firstref="ref52"></nolink> <nolink nlid="nl30" bibid="bib55" firstref="ref53"></nolink> <nolink nlid="nl31" bibid="bib61" firstref="ref54"></nolink> <nolink nlid="nl32" bibid="bib16" firstref="ref55"></nolink> <nolink nlid="nl33" bibid="bib37" firstref="ref56"></nolink> <nolink nlid="nl34" bibid="bib36" firstref="ref57"></nolink> <nolink nlid="nl35" bibid="bib39" firstref="ref59"></nolink> <nolink nlid="nl36" bibid="bib11" firstref="ref60"></nolink> <nolink nlid="nl37" bibid="bib51" firstref="ref61"></nolink> <nolink nlid="nl38" bibid="bib54" firstref="ref62"></nolink> <nolink nlid="nl39" bibid="bib33" firstref="ref63"></nolink> <nolink nlid="nl40" bibid="bib29" firstref="ref65"></nolink> <nolink nlid="nl41" bibid="bib25" firstref="ref68"></nolink> <nolink nlid="nl42" bibid="bib10" firstref="ref69"></nolink> <nolink nlid="nl43" bibid="bib34" firstref="ref70"></nolink> <nolink nlid="nl44" bibid="bib13" firstref="ref73"></nolink> <nolink nlid="nl45" bibid="bib53" firstref="ref74"></nolink> <nolink nlid="nl46" bibid="bib28" firstref="ref78"></nolink> <nolink nlid="nl47" bibid="bib58" firstref="ref80"></nolink> <nolink nlid="nl48" bibid="bib41" firstref="ref83"></nolink> <nolink nlid="nl49" bibid="bib31" firstref="ref91"></nolink> <nolink nlid="nl50" bibid="bib14" firstref="ref94"></nolink> <nolink nlid="nl51" bibid="bib19" firstref="ref99"></nolink> <nolink nlid="nl52" bibid="bib52" firstref="ref104"></nolink> |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1374795 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Leadership and the Hidden Politics of Co-Produced Research: A Q-Methodology Study – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Durose%2C+Catherine%22">Durose, Catherine</searchLink><br /><searchLink fieldCode="AR" term="%22Perry%2C+Beth%22">Perry, Beth</searchLink><br /><searchLink fieldCode="AR" term="%22Richardson%2C+Liz%22">Richardson, Liz</searchLink><br /><searchLink fieldCode="AR" term="%22Dean%2C+Rikki%22">Dean, Rikki</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Social+Research+Methodology%22"><i>International Journal of Social Research Methodology</i></searchLink>. 2023 26(1):1-21. – Name: Avail Label: Availability Group: Avail Data: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 21 – Name: DatePubCY Label: Publication Date Group: Date Data: 2023 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Participatory+Research%22">Participatory Research</searchLink><br /><searchLink fieldCode="DE" term="%22Q+Methodology%22">Q Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Projects%22">Research Projects</searchLink><br /><searchLink fieldCode="DE" term="%22Politics%22">Politics</searchLink><br /><searchLink fieldCode="DE" term="%22Leadership%22">Leadership</searchLink><br /><searchLink fieldCode="DE" term="%22Power+Structure%22">Power Structure</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1080/13645579.2021.1960738 – Name: ISSN Label: ISSN Group: ISSN Data: 1364-5579<br />1464-5300 – Name: Abstract Label: Abstract Group: Ab Data: There has been encouragement from funders, universities and academics to co-produce research. Co-production of research can be considered a methodology in its own right, or an underpinning set of principles for other methods. Co-production aims to reshape relations between the researched and the researcher. Yet, co-producing research rarely starts with a blank sheet, and is informed by antecedent power as well as prior experiences and expectations. Attention has been paid to practical barriers to co-production, such as time and resources, and there has been critical analysis of the claims made. The 'hidden politics' of co-production as a research approach have also been identified. This paper contributes to debates about such hidden politics of the co-production methodology in research. How leadership in research takes place matters, as it is a way of handling contestation over different aspects of methods, including the purpose and practices of research, and power differentials in co-production. This study was motivated by the experiences of the authors of a co-produced research project on participatory urban governance. – Name: AbstractInfo Label: Abstractor Group: Ab Data: ERIC – Name: DateEntry Label: Entry Date Group: Date Data: 2023 – Name: AN Label: Accession Number Group: ID Data: EJ1374795 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1374795 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/13645579.2021.1960738 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 21 StartPage: 1 Subjects: – SubjectFull: Participatory Research Type: general – SubjectFull: Q Methodology Type: general – SubjectFull: Research Projects Type: general – SubjectFull: Politics Type: general – SubjectFull: Leadership Type: general – SubjectFull: Power Structure Type: general Titles: – TitleFull: Leadership and the Hidden Politics of Co-Produced Research: A Q-Methodology Study Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Durose, Catherine – PersonEntity: Name: NameFull: Perry, Beth – PersonEntity: Name: NameFull: Richardson, Liz – PersonEntity: Name: NameFull: Dean, Rikki IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2023 Identifiers: – Type: issn-print Value: 1364-5579 – Type: issn-electronic Value: 1464-5300 Numbering: – Type: volume Value: 26 – Type: issue Value: 1 Titles: – TitleFull: International Journal of Social Research Methodology Type: main |
| ResultId | 1 |