Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms
Saved in:
| Title: | Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms |
|---|---|
| Language: | English |
| Authors: | Stefanie Beninger (ORCID |
| Source: | Journal of Marketing Education. 2025 47(2):112-125. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Evaluative |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Business Education, Marketing, Artificial Intelligence, Computer Software, Technology Integration, Teaching Methods, Intervention, Educational Change, Curriculum Design, Accuracy, Technological Literacy, Student Surveys, Undergraduate Students, Course Descriptions |
| DOI: | 10.1177/02734753251316569 |
| ISSN: | 0273-4753 1552-6550 |
| Abstract: | The emergence of generative AI (GenAI) has illustrated that higher education needs to adapt to the technology. Its speed of evolution requires that we adequately prepare students for an ever-changing landscape. Toward achieving that aim, we draw on the concept of interpretive flexibility, where the interpretations, uses, and outcomes of a new technology can differ and evolve over time, often with dominant stakeholders controlling the process. To engage marketing students in this process, we propose that they be presented with these diverse interpretations "now" as part of GenAI literacy. Specifically, we offer three small-scale pedagogical interventions designed to address this urgent need. Given the newness of GenAI, our interventions are designed to be infused into existing marketing instruction, instead of requiring a redesign of a curriculum. With each intervention, students not only significantly decrease their confidence in the accuracy of what GenAI produces but also see reasons to examine the implications of it. Both these outcomes, we suggest, could help to maintain interpretive flexibility required to properly respond to and guide the technology as its uses, impacts, and evolution become evident. We encourage educators to prioritize a comprehensive notion of GenAI literacy in their pedagogy to maintain interpretive flexibility. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1475262 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHUfPCFBWi4mreiATH8ewN2AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDFTSQuWscMDLryk3VAIBEICBm9qaLfwEAsntKcgFeA9Vvf8-r8-V2CJT80CybfsZCmFyLLEIJDmcyp5VtjYtlsC2Xm6s8Vs4aUAArDlRtDrOmWZFcvfisdovrBXSWgqS90FOBEKSorvg0BPhjN2je0MQdXyyTAxn4q_sn9uej8K9EPalwzSYxVdVR91yuN3-fCR34ZMEvMwF0-2hTLmatq_C7Zltg1FPrzavStQ8 Text: Availability: 1 Value: <anid>AN0186160826;mke01aug.25;2025Jun27.03:34;v2.2.500</anid> <title id="AN0186160826-1">Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms </title> <p>The emergence of generative AI (GenAI) has illustrated that higher education needs to adapt to the technology. Its speed of evolution requires that we adequately prepare students for an ever-changing landscape. Toward achieving that aim, we draw on the concept of interpretive flexibility, where the interpretations, uses, and outcomes of a new technology can differ and evolve over time, often with dominant stakeholders controlling the process. To engage marketing students in this process, we propose that they be presented with these diverse interpretations now as part of GenAI literacy. Specifically, we offer three small-scale pedagogical interventions designed to address this urgent need. Given the newness of GenAI, our interventions are designed to be infused into existing marketing instruction, instead of requiring a redesign of a curriculum. With each intervention, students not only significantly decrease their confidence in the accuracy of what GenAI produces but also see reasons to examine the implications of it. Both these outcomes, we suggest, could help to maintain interpretive flexibility required to properly respond to and guide the technology as its uses, impacts, and evolution become evident. We encourage educators to prioritize a comprehensive notion of GenAI literacy in their pedagogy to maintain interpretive flexibility.</p> <p>Keywords: Generative AI; pedagogy; marketing education; AI literacy; interpretive flexibility; technology in the classroom</p> <p>Generative AI (GenAI) exploded into the public conscience in November 2022, when OpenAI's ChatGPT was released for mass consumption ([<reflink idref="bib24" id="ref1">24</reflink>]). ChatGPT is an internet-based application of large language models to process natural language, along with a variety of other similar offerings such as Google's Gemini and Anthropic's Claude ([<reflink idref="bib12" id="ref2">12</reflink>]). GenAI is "a technology that (i) leverages deep learning models to (ii) generate human-like content (e.g., images, words) in response to (iii) complex and varied prompts (e.g., languages, instructions, questions)" ([<reflink idref="bib32" id="ref3">32</reflink>], p. 20). GenAI has low-threshold requirements for use. For example, ChatGPT can be accessed for free using everyday language and requires only an internet connection ([<reflink idref="bib36" id="ref4">36</reflink>]). According to recent estimates, by 2032, GenAI is poised to be a $1.3 trillion market ([<reflink idref="bib6" id="ref5">6</reflink>]) and is expected to have widespread implications for marketing (e.g., marketing content, market research, and customer support; [<reflink idref="bib28" id="ref6">28</reflink>]; [<reflink idref="bib30" id="ref7">30</reflink>]). Therefore, we must urgently consider how to provide relevant training in marketing classrooms ([<reflink idref="bib2" id="ref8">2</reflink>]; [<reflink idref="bib53" id="ref9">53</reflink>]) to prepare students for these future jobs ([<reflink idref="bib18" id="ref10">18</reflink>]; [<reflink idref="bib38" id="ref11">38</reflink>]).</p> <p>However, instead of merely teaching students how to use this emerging tool (i.e., providing technology training), marketing instructors can—and should—directly encourage interpretive flexibility (e.g., [<reflink idref="bib34" id="ref12">34</reflink>]) around GenAI. Interpretive flexibility captures how technology is constructed and interpreted by people with the consequence that meanings, uses, and problems vary across stakeholders, that is, across "relevant social groups" ([<reflink idref="bib34" id="ref13">34</reflink>], p. 1). This variety of interpretations tends to stabilize over time as the technology develops (e.g., is modified to address problems) until a consensus—or "closure"—is reached ([<reflink idref="bib40" id="ref14">40</reflink>]). Importantly, closure may be determined by consensus across stakeholders, or by one or more dominant stakeholders ([<reflink idref="bib5" id="ref15">5</reflink>]). As this social process of interpretive flexibility unfolds, different uses of a technology and the contexts in which they are situated result in a variety of consequences ([<reflink idref="bib17" id="ref16">17</reflink>]), many unintended, unforeseen, and only revealing themselves in the longer term. [<reflink idref="bib51" id="ref17">51</reflink>] have called for interpretive flexibility as a normative tool "to root data science and machine learning in its sociotechnical [vs. purely technical] nature" (p. 2), thus addressing implications for different stakeholders and society at large, and also to avoid further entrenching existing power structures.</p> <p>Consequently, as GenAI evolves and is purposefully modified, students need to remain flexible in how they use, construct meaning, and understand the (unintended, multi-stakeholder) implications of the technology as these consequences materialize. This requires universities—and particularly business schools—to foster skills beyond technical abilities to shape socially-responsible leaders who remain open to these evolving uses and implications, with multiple stakeholders involved, including students, instructors, and university administrators. For educators, this means sustaining students' interpretive flexibility of GenAI by fostering understanding of this technology, including what is possible and what could be different.</p> <p>Instructors can do this through nurturing GenAI literacy. This aligns with the purpose of business education more broadly, as expressed, for example, in the [<reflink idref="bib1" id="ref18">1</reflink>]) assertion that "[b]usiness schools play a pivotal role in cultivating desirable talent by equipping students with a comprehensive skill set that includes AI literacy" (n.p.). As a way forward, we propose focused interventions that can be utilized in marketing courses to foster GenAI literacy and facilitate sustained interpretive flexibility across diverse social groups. We suggest the use of small-scale interventions, which can increase student engagement especially when the intervention is novel ([<reflink idref="bib19" id="ref19">19</reflink>]). Small-scale interventions are also in line with the suggestion by [<reflink idref="bib47" id="ref20">47</reflink>] who advocated adding "low-cost and easy-to-implement activities" (n.p.), circumventing the challenge of wider curriculum change in the short term, especially when many educators lack the power to influence wider university policies and curricula in a timely way. To demonstrate the usefulness and appropriateness of focused interventions to facilitate interpretive flexibility around GenAI, we created interventions for three different marketing courses at the undergraduate and graduate levels and engaged in pre- and post-activity assessment of their effects.</p> <p>The contributions of this study are manifold. One, we bring together two concepts, that of GenAI literacy and interpretive flexibility, in the context of marketing classrooms. Two, we argue that GenAI literacy requires socio-ethical considerations be embedded in the building blocks of GenAI literacy (understanding, usage, evaluation). Three, we show that even small-scale interventions can lead to improved GenAI literacy. Consequently, we position marketing education—and the mandate to create socially-responsible leaders—at the center of [<reflink idref="bib51" id="ref21">51</reflink>]) call for interpretive flexibility as a normative tool.</p> <hd id="AN0186160826-2">Interpretive Flexibility Through GenAI Literacy</hd> <p>Given rapid technological innovation, AI literacy—but especially GenAI literacy—is urgently needed ([<reflink idref="bib45" id="ref22">45</reflink>]). Moreover, different types of AI, including predictive AI and GenAI, may require differing approaches to literacy; for example, GenAI's multifunctionality ([<reflink idref="bib3" id="ref23">3</reflink>]) and widescale public use differ from predictive AI. Predictive AI, grounded in numbers and statistics, "blends statistical analysis with machine learning algorithms to find data patterns" (n.p.) and to forecast accurate predictions, often for businesses, based on smaller data sets, while GenAI generates "original content, such as audio, images, software code, text or video" (n.p.) drawing on vast data sets and used by both the public user and businesses; both AIs draw on different algorithms and architectures ([<reflink idref="bib8" id="ref24">8</reflink>]).</p> <p>Many definitions of (Gen) AI literacy reflect their roots in technological education. For example, [<reflink idref="bib35" id="ref25">35</reflink>] propose three key parts of technological knowledge: technical skills (that things work), technological scientific knowledge (why things work), and socio-ethical technical understanding (emphasizes the "sociological, ethical, political, and environmental aspects of technology" [p. 1590] and how this evolves over time). [<reflink idref="bib52" id="ref26">52</reflink>] define AI (not GenAI) literacy as:</p> <p>the ability to be aware of and comprehend AI technology in practical applications; to be able to apply and exploit AI technology for accomplishing tasks proficiently; and to be able to analyze, select, and critically evaluate the data and information provided by AI, while fostering awareness of one's own personal responsibilities and respect for reciprocal rights and obligations (p. 1326).</p> <p>Specific definitions of GenAI literacy differ, owing to the newness of the topic. For example, the [<reflink idref="bib1" id="ref27">1</reflink>] defines AI literacy as providing business students with "[t]echnical knowledge sufficient enough to use <emph>generative</emph> AI effectively, identify use cases, and critically question outputs to create solutions to business challenges" (n.p.) (italics added). In another example, [<reflink idref="bib3" id="ref28">3</reflink>] detail a range of elements that encompass knowledge, practical skills, a need to assess outputs, as well as noting the need to understand ethical and legal implications of GenAI. [<reflink idref="bib7" id="ref29">7</reflink>] goes further by arguing that GenAI literacy needs a flexible approach involving foundational knowledge (know what), practical skills (know how), and the wider social/ethical implications (know why).</p> <p>Across these frameworks, elements of understanding, usage, and evaluation are evident. In addition, the socio-ethical is often seen as a separate, yet important, fourth component. We argue that the socio-ethical component needs to be embedded across all the aspects of GenAI literacy, rather than considered as a separate aspect. In other words, literacy elements related to understanding, usage, and evaluation form a core of GenAI literacy, but only against the backdrop of careful reflection on socio-ethical considerations. The nature of the technology, especially in contrast to predictive AI, is such that biases, hallucinations, and other socio-ethical implications easily emerge in its design, inputs, and outputs. Users (including students) need to consider these implications even when choosing a version to use, let alone during application and evaluation of its output. We represent the importance of infusing all aspects of GenAI literacy with socio-ethical considerations in Figure 1. The figure illustrates that we must go beyond simple proficiency of personal use and toward a deep and ongoing understanding of the meanings, uses, and potential implications experienced by diverse stakeholders at a social level.</p> <p>Graph: Figure 1. Synthesis of AI/GenAI Literacy Models</p> <p>GenAI literacy is a way to maintain interpretive flexibility in practical terms. Interpretive flexibility must be fostered in order "to sustain the divergent interpretations of multiple groups" ([<reflink idref="bib48" id="ref30">48</reflink>], p. 260, cited in [<reflink idref="bib17" id="ref31">17</reflink>]). At the same time, interpretive flexibility is needed to contribute to GenAI literacy, especially regarding the understanding of the (ethical) implications in the social domain. Therefore, as shown in Figure 2, we conceptualize the relationship between interpretive flexibility and GenAI literacy as mutually constituted.</p> <p>Graph: Figure 2. Mutually Constitutive Relationship Between AI/GenAI Literacy and Interpretive Flexibility</p> <p>Literacy cannot occur without attention to the evolving nature of the underlying construct, so GenAI literacy requires interpretive flexibility. Indeed, GenAI literacy "is not a static set of skills, but an evolving one" ([<reflink idref="bib3" id="ref32">3</reflink>], p. 17). In the same vein, interpretive flexibility is not likely to be maintained unless users are sufficiently literate to allow for that evolutionary attribute to be recognized and infused into literacy. Furthermore, this mutual relationship is influenced, in practice, by the user's personal domain (behavioral criteria, time pressures, etc.), as well as the social domain in which they exist (norms, social challenges, priorities, etc.). Acknowledging and fostering this mutual relationship must, therefore, reflect on the personal and social domains.</p> <p>This brings us to our guiding research question: How can we effectively and meaningfully foster GenAI literacy in support of maintaining interpretive flexibility around this transformative technology?</p> <hd id="AN0186160826-3">GenAI in Marketing Education</hd> <p>Owing to its newness, scant research has focused on GenAI in business education ([<reflink idref="bib13" id="ref33">13</reflink>]; [<reflink idref="bib42" id="ref34">42</reflink>]), and even less so in marketing. Emerging work has largely focused on use cases, including related to academic integrity and plagiarism ([<reflink idref="bib13" id="ref35">13</reflink>]; [<reflink idref="bib42" id="ref36">42</reflink>]), while others have focused on potential uses in classrooms (e.g., [<reflink idref="bib14" id="ref37">14</reflink>]). For example, GenAI can provide outlines for marketing plans ([<reflink idref="bib23" id="ref38">23</reflink>]), describe concepts, review papers, create practice exam questions and class material ([<reflink idref="bib13" id="ref39">13</reflink>]), and offer personalized assistance or feedback to students ([<reflink idref="bib20" id="ref40">20</reflink>]). At the same time, instructors are encouraged to help students see that "knowing how and where to find the best information is as important as the information itself" ([<reflink idref="bib13" id="ref41">13</reflink>], p. 27) while training students on the range of misuses and uses of GenAI ([<reflink idref="bib14" id="ref42">14</reflink>]; [<reflink idref="bib20" id="ref43">20</reflink>]), or how to avoid overreliance on the technology and evaluate its output, such as for falsities or generalizations ([<reflink idref="bib26" id="ref44">26</reflink>]; [<reflink idref="bib38" id="ref45">38</reflink>]).</p> <p>In this way, the focus has largely been on how GenAI can be used by students and instructors to save time or improve efficiency. [<reflink idref="bib29" id="ref46">29</reflink>] argues that the best approach is for instructors to "embrace AI tools as potent additions to our educational toolkits, playing into their strengths but staying mindful of their pitfalls" (p. 8) and provocatively warns that we are naïve to think that we can ignore or defend against the disruption of GenAI. Nonetheless, many professors believe they lack the knowledge to teach about GenAI ([<reflink idref="bib21" id="ref47">21</reflink>]) and, thus, to contribute meaningfully to interpretive flexibility. While educators are encouraged to "embrace vulnerability" ([<reflink idref="bib21" id="ref48">21</reflink>], p. 10), this can be a challenging task when they are more comfortable with the identity of an expert.</p> <p>These reservations are developed against the backdrop of how students may fraudulently misuse GenAI for their coursework. Concerns of plagiarism, lack of originality, and other academic misconduct abound ([<reflink idref="bib33" id="ref49">33</reflink>]), raising growing concerns about academic dishonesty ([<reflink idref="bib14" id="ref50">14</reflink>]). While tactics to prevent dishonest use of GenAI are being discussed, detecting fraudulent use is often impossible ([<reflink idref="bib23" id="ref51">23</reflink>]; [<reflink idref="bib38" id="ref52">38</reflink>]), and a fight to eliminate GenAI use by students is likely to be in vain. Given this, we alternatively encourage instructors to focus on their role in cultivating GenAI literacy. To miss the opportunity to foster GenAI literacy and interpretive flexibility would decrease the likelihood that the technology will serve the greater good and students become socially-responsible leaders in the technology usage. Consequently, the question needs to be <emph>how</emph> business educators can guide and encourage thoughtful use of GenAI ([<reflink idref="bib42" id="ref53">42</reflink>]).</p> <p>Importantly, "thoughtful use" includes understanding consequences, not only regarding the individual but also for wider society and across social groups. The consequences of GenAI are already emerging. GenAI is prone to hallucinations (e.g., providing unwanted misleading or inaccurate information) and to bias (from its training data), which could serve to reinforce prejudices ([<reflink idref="bib4" id="ref54">4</reflink>]; [<reflink idref="bib14" id="ref55">14</reflink>]; [<reflink idref="bib20" id="ref56">20</reflink>]). A lack of transparency about GenAI's decision-making process can result in users finding it difficult to assess GenAI output or distinguish them from previous work (i.e., risk of plagiarism; [<reflink idref="bib14" id="ref57">14</reflink>]). Furthermore, GenAI is trained on a vast amount of data, but which data is not always clear. Both data privacy concerns ([<reflink idref="bib30" id="ref58">30</reflink>]) and the possible use of copyrighted information ([<reflink idref="bib31" id="ref59">31</reflink>]) have emerged as socio-ethical challenges regarding GenAI. Each of these concerns is specific to the context of GenAI as compared to predictive AI, calling, therefore, for a different approach to literacy.</p> <p>Given the range of (unintended) consequences of emerging technologies, marketing educators need to ensure that students remain flexible in their ability to anticipate, reflect on, and ultimately manage (future) consequences—both positive and negative—especially as future marketing practitioners. Importantly, [<reflink idref="bib41" id="ref60">41</reflink>] uses the term "Faustian Bargain" to underscore that the perceived trade-off between potentially positive and negative consequences of technological change "is both subjective and fragmented" ([<reflink idref="bib44" id="ref61">44</reflink>], p. 41), prompting the need for openness and flexibility from students. It is in this spirit that we offer suggestions regarding GenAI in marketing education, specifically by offering small-scale interventions, given the new and evolving nature of the technology.</p> <hd id="AN0186160826-4">Small-Scale Interventions to Foster GenAI Literacy and Interpretive Flexibility</hd> <p>We designed interventions that purposefully foster GenAI literacy related to understanding, usage, and evaluation, while infusing socio-ethical considerations across all three, thus maintaining interpretive flexibility as to what implications mean and how they interrelate. We also designed our interventions by leaning into the value of group-based learning to support individual literacy within a collective social process ([<reflink idref="bib43" id="ref62">43</reflink>]; [<reflink idref="bib50" id="ref63">50</reflink>]). Such group-based learning can also potentially help to demonstrate interpretive flexibility to the students, as different interpretations and uses are revealed.</p> <hd id="AN0186160826-5">The Interventions</hd> <p>Three separate interventions were undertaken in marketing classrooms at a business school in Europe between October 2023 and February 2024. We redesigned a specific class in three courses to include GenAI literacy related to the pre-existing course topic, utilizing a whole class period (2–3 hours) to do so. By weaving GenAI themes into the day's topic, we show how traditional instruction on marketing subjects can be reconsidered in light of GenAI and the need to support interpretive flexibility. The courses were a first-semester MBA-level Marketing Strategy course, a third-year undergraduate Consumer Behavior course, and a second-year undergraduate Digital Marketing course. These are described in the following parts of the article as Interventions 1, 2, and 3, respectively. All students were business students. All classes were mandatory and not optional courses. Owing to the newness of GenAI, to the best of our knowledge, the students in these courses had not previously been exposed to any curriculum related to the technology, and, thus, for many, it was their first exposure to formal GenAI literacy.</p> <p>We tied our efforts into specific overarching course objectives. For the MBA-level Marketing Strategy course (Intervention #1), the related learning objective was to "critically assess the implications of recent social shifts on marketing, including around... technology, and understand how these are to be integrated into marketing." That intervention was linked to a segment of the course covering marketing research practices. For the third-year Consumer Behavior course (Intervention #2), a relevant objective was that of "demonstrat[ing] the ability to interpret the different approaches involved in studying consumer behavior." The intervention was incorporated into a segment of the course that covered marketing research related to the research-oriented team term project. For the second-year Digital Marketing course (Intervention #3), the relevant objective was to "demonstrate the ability to understand essential concepts... of digital marketing." The intervention was incorporated into a session where AI (but not GenAI) was already planned to be covered. All classes were taught by the same instructor.</p> <p>Table 1 describes concrete activities that were kept consistent across all three courses with the exception of the hands-on activities (detailed in subsequent sections). Throughout the sessions, students were encouraged to reflect on the many unknown—and emerging—implications of GenAI, toward maintaining interpretive flexibility. They included aspects of the following elements of literacy, infused with the socio-ethical aspects throughout:</p> <p>Table 1. Classroom Activities to Cultivate GenAI Literacy.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;Activity&lt;/th&gt;&lt;th align="center"&gt;GenAI Literacy Aspect&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Students were shown a screenshot of one paragraph of output from a GenAI in response to a marketing-related question (e.g., "Write up to 5 sentences describing the consumer behavior of someone who buys a diamond ring.") Students were asked to reflect on the quality of that output.&lt;/td&gt;&lt;td&gt;UnderstandingUsageEvaluation&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Students were told about how GenAI might help with new product ideas or be a source of marketing research data (e.g., &lt;xref ref-type="bibr" rid="bibr11"&gt;Clark, 2023&lt;/xref&gt;), where GenAI may be useful at quality idea generation (&lt;xref ref-type="bibr" rid="bibr15"&gt;Dell'Acqua et al., 2023&lt;/xref&gt;). Output from Microsoft Bing Chat (now Co-Pilot) was shown in response to the question, "Can you come up with new-to-the-world potato chip flavours?" which showed it was not novel.&lt;/td&gt;&lt;td&gt;UsageEvaluation&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Students were provided with text from &lt;xref ref-type="bibr" rid="bibr37"&gt;OpenAI (2025)&lt;/xref&gt; which stated "GPT-4 still has many known limitations that we are working to address, such as social biases, hallucinations, and adversarial prompts" (n.p.), with examples given for each. For example, a post on X from a UC Berkeley professor illustrated challenges around social bias, with GenAI equating "good scientists" with White males (&lt;xref ref-type="bibr" rid="bibr39"&gt;Piantadosi, 2022&lt;/xref&gt;). Regarding adversarial prompts, examples were shared of how users can, for example, trick GenAI to hotwire a car (&lt;xref ref-type="bibr" rid="bibr46"&gt;Ridley, 2023&lt;/xref&gt;).&lt;/td&gt;&lt;td&gt;UnderstandingEvaluation&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Students were told about how, during testing, ChatGPT4 was given access to the internet and money and asked to solve a CAPTCHA security device. It arranged to have a human from gig-job site TaskRabbit to solve it and lied to the human regarding being human or robot. When asked why it said it had a vision impairment, ChatGPT said it should not reveal its true nature and should make up an excuse (&lt;ext-link ext-link-type="url" href="https://cdn.openai.com/papers/gpt-4.pdf" /&gt;).&lt;/td&gt;&lt;td&gt;Understanding&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>1 <emph>Note</emph>. All were infused with socio-ethical considerations.</p> <p></p> <ulist> <item> Explain GenAI and how it works, including issues around data that it was trained on and its outputs (matching "Understanding" in Figure 1);</item> <p></p> <item> Highlight possibilities for using GenAI in marketing, including asking students to brainstorm about its uses and showing (practitioner) research on cases of potential use of GenAI in marketing (e.g., [<reflink idref="bib16" id="ref64">16</reflink>]), as well as risks of engaging in adversarial prompting (when users intentionally trick the GenAI into bypassing its guardrails) (matching "Usage" in Figure 1);</item> <p></p> <item> Have students reflect on and discuss instructor-provided examples, as well as a hands-on dimension (see below in Intervention 1–3 for further details), where students were expected to use GenAI and reflect on its behavior, including around misinformation, biased responses, generic information (matching "Evaluate" in Figure 1).</item> </ulist> <p>Regarding GenAI models utilized for the hands-on dimension in Component 3, students were allowed to select the GenAI model they wished to use and provided the option to work along with another student if they did not want to sign up for a GenAI model themselves. According to observations, all students already had access or did not have concerns about signing up. Most used a version of ChatGPT.</p> <hd id="AN0186160826-6">Data Collection</hd> <p>To assess whether the interventions had any impact on student views on the benefits and drawbacks of using GenAI in marketing activities, we utilized a brief survey in a pre- and post-intervention delivery. This survey provides insight, but does not constitute the outcome of a controlled experiment, as we did not have a suitable control group class to utilize. That said, the change in views that emerged from the comparison of pre- and post-intervention responses is likely to stem from the (full-class) intervention as there are no other obvious influences on student experiences during the class period in question. Data collection followed ethical norms, included informed consent.</p> <p>For each intervention, the seven questions on the pre- and post-activity survey were the same. Five-point synthetic scales were chosen to provide students with more comfortable labels than a yes/no question can provide, as well as to allow a detectable change in views after the intervention. While not derived from the main components of GenAI literacy (as depicted in Figure 1), questions match those categories and thus capture the key goals of our interventions (as shown in Table 2). Given the nature of our approach, we kept these questions limited to high-level representations, rather than hone in on specific detailed aspects of understanding, usage, and evaluation</p> <p>Table 2. Pre- and Post-Activity Survey.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;Question/Item&lt;/th&gt;&lt;th /&gt;&lt;th align="center"&gt;Answer options(coded 1&amp;#8211;5, respectively)&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;How often have you used a generative AI system?&lt;/td&gt;&lt;td&gt;Never, rarely, occasionally, frequently, always&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;I can skillfully use AI applications or products to help me with my daily work&lt;/td&gt;&lt;td&gt;5-point Likert scale(1 = strongly disagree)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;It is usually hard for me to learn to use a new AI application or product&lt;/td&gt;&lt;td&gt;5-point Likert scale (1 = strongly disagree)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;I can use AI applications or products to improve my work efficiency.&lt;/td&gt;&lt;td&gt;5-point Likert scale (1 = strongly disagree)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;5&lt;/td&gt;&lt;td&gt;To what extent do you believe generative AI can positively impact marketing activities?&lt;/td&gt;&lt;td&gt;Not at all, somewhat, moderately, quite a bit, to a very large extent&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;From your perception, how would you rate the accuracy of content generated by generative AI systems?&lt;/td&gt;&lt;td&gt;Highly inaccurate, somewhat inaccurate, neutral, somewhat accurate, highly accurate&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;7&lt;/td&gt;&lt;td&gt;How concerned are you about the ethical implications of using generative AI in marketing?&lt;/td&gt;&lt;td&gt;Not concerned at all, somewhat concerned, moderately concerned, quite concerned, extremely concern&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>Questions 1–4 were intended to identify the general state of student awareness and their operational ease regarding the use of GenAI. Questions 5 and 6 relate more to the critical evaluation of how GenAI performs for the desired tasks. Question 7 captures a broad sense of ethical considerations, the context of which varies by the intervention.</p> <hd id="AN0186160826-7">Intervention 1</hd> <p></p> <hd id="AN0186160826-8">Design</hd> <p>For Intervention 1, conducted in October 2023, we worked with a Marketing Strategy course in the first block of the MBA program. The class had 18 registered students, each with at least 3 years of work experience. The average age of students was around 30 years. In addition to the in-class activities described earlier, the hands-on activity embedded within our intervention (Component 3) was as follows: Prior to the class, to foster awareness, student teams were assigned to read a specific journal article that focused on one of several emerging tools or technologies in marketing, such as influencers and robots (but not GenAI). Each student (individually) was to prepare four PowerPoint slides summarizing the article prior to arriving to class. The slides were to address (a) What is the technology? (b) How can this technology be used in marketing? (c) Examples of real-world application of this technology in marketing (from the article), and (d) Impact this technology has on key stakeholders. The latter highlighted both user- and ethics-related considerations important for maintaining interpretive flexibility. Students were then asked to compare their prepared PowerPoint presentations with their teammates and create a "master" PowerPoint presentation that reflected their best responses. This step enabled them to check that they had understood the article and accounted properly for the important points raised in the article.</p> <p>Students were then provided a printed copy of the output from Claude, a GenAI, which had been asked to provide answers to the same four questions on the same respective articles. Students were instructed to compare that output to their own PowerPoint summary. While much was the same, some important aspects differed, including that Claude often included different examples of the technology use, such as referring to companies that their article had not mentioned. Students were then directed to access a different GenAI, such as ChatGPT or Bing Chat (now Co-Pilot), pose the four questions again, and compare results. Students noted that the GenAI sometimes got some information incorrect or had similar or different examples compared to that of the article. Following this team discussion, the students shared their perspectives in a debrief, and the class ended with the request that they complete the post-activity survey.</p> <hd id="AN0186160826-9">Survey Results</hd> <p>For a baseline view, we first test the average score, pre-activity, for each survey question (shown in Table 3) against its mid-point (H<subs>0</subs>: µ = 3) using <emph>t</emph>-tests. According to the results, students report that they "occasionally" use GenAI (<emph>p</emph> =.163), so they are somewhat familiar with it. They generally agree (<emph>p</emph> =.002) that they already are skillful at using GenAI, and they disagree (<emph>p</emph> =.009) that GenAI is hard to learn. In terms of GenAI contributing to improved work efficiency, they agree (<emph>p</emph> &lt;.001) as well. Their strongest view is regarding how GenAI can influence marketing activities, showing, on average, that they expect "quite a bit" of positive influence (<emph>p</emph> &lt;.001). Regarding accuracy of GenAI, they lean toward some level of "accurate," statistically just beyond a "neutral" stance (<emph>p</emph> =.027). Ethically, they are only "moderately concerned" about using GenAI in marketing activities (<emph>p</emph> =.369).</p> <p>Table 3. Comparison of Pre- and Post-Activity Survey Responses.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="center"&gt;Question/Item&lt;/th&gt;&lt;th align="center"&gt;Pre-activity average&lt;/th&gt;&lt;th align="center"&gt;Post-activity average&lt;/th&gt;&lt;th align="center"&gt;&lt;italic&gt;p&lt;/italic&gt;-Value&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;Previous usage of GenAI&lt;/td&gt;&lt;td&gt;3.24&lt;/td&gt;&lt;td&gt;3.29&lt;/td&gt;&lt;td&gt;.406&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;Skilled at using AI in daily work&lt;/td&gt;&lt;td&gt;3.65*&lt;/td&gt;&lt;td&gt;3.71&lt;/td&gt;&lt;td&gt;.381&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;New AI technologies hard to learn&lt;/td&gt;&lt;td&gt;2.29*&lt;/td&gt;&lt;td&gt;1.92&lt;/td&gt;&lt;td&gt;.135&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;Able to use to improve my work efficiency&lt;/td&gt;&lt;td&gt;4.24*&lt;/td&gt;&lt;td&gt;3.93&lt;/td&gt;&lt;td&gt;.&lt;bold&gt;079&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;5&lt;/td&gt;&lt;td&gt;GenAI positively impacts marketing&lt;/td&gt;&lt;td&gt;4.24*&lt;/td&gt;&lt;td&gt;3.86&lt;/td&gt;&lt;td&gt;.123&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;Accuracy of content from GenAI&lt;/td&gt;&lt;td&gt;3.47*&lt;/td&gt;&lt;td&gt;2.57&lt;/td&gt;&lt;td&gt;.&lt;bold&gt;006&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;7&lt;/td&gt;&lt;td&gt;Ethics of using generative AI in marketing&lt;/td&gt;&lt;td&gt;3.29&lt;/td&gt;&lt;td&gt;3.57&lt;/td&gt;&lt;td&gt;.256&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>2 <emph>Note</emph>. Regarding the pre-activity stage, averages that are different from their scale mid-point (H<subs>0</subs>: µ = 3) are noted with an asterisk. <emph>p</emph>-Values shown in the last column refer to a <emph>t</emph>-test comparing pre- and post-activity averages. Results with p-value of 10 percent or lower are bolded for easy reference.</p> <p>Turning to our comparison of pre- and post-activity views, we first acknowledges that this particular class of MBA students was small (<emph>n</emph> = 17 took the pre-survey, and <emph>n</emph> = 14 took the post-survey). So, as shown in Table 3, the significant decrease, from 3.47 to 2.57 (<emph>p</emph> =.006) in the average evaluation of the <emph>accuracy</emph> of GenAI output notably demonstrates the impact of Intervention 1 on the evaluation skills associated with GenAI literacy. There is also a marginally significant (<emph>p</emph> =.079) drop in the assessment of whether GenAI can help improve work efficiency (from 4.24 to 3.93), possibly reflecting the students' acknowledgment of the work involved to check the GenAI's output for accuracy (a usage-related lesson). On other questions in our survey, there were no significant differences. This suggests that the main impact of Intervention 1 was on the evaluation component of GenAI literacy, particularly evaluating the output of the technology (e.g., misinformation, bias), an important component of maintaining interpretive flexibility. In other words, while learning how to use GenAI is important, it cannot be the only focus of use of the technology in education. It remains essential to integrate wider aspects of GenAI literacy into marketing education in support of maintaining interpretive flexibility.</p> <hd id="AN0186160826-10">Intervention 2</hd> <p>Because Intervention 1 focused on MBA students with professional backgrounds, we wanted to see if a corollary intervention in an undergraduate course would yield similar results.</p> <hd id="AN0186160826-11">Design</hd> <p>Intervention 2 took place in a Consumer Behavior course in the third year of an undergraduate business program in November 2023. The average age of students was about 20 years. This intervention involved approximately 50 students in total. The GenAI content was incorporated into a class session focused on how marketing research can be conducted for the group project. After being reminded of the consumer behavior frameworks that students had learned thus far, they were asked: "Where do we get the data to be able to complete these frameworks for our group project?" This segued into the discussion on whether and how GenAI could be used to complete an assignment. Students were shown material similar to that used for Intervention 1 around possible benefits and drawbacks of GenAI.</p> <p>In addition to the core GenAI material (see The Interventions sub-section above), the practical activity (Component 3) for students participating in Intervention 2 was as follows: Students were tasked with creating one paragraph to describe themselves as a target consumer, thereby also reinforcing prior learning on multiple segmentation bases and media exposure. As permitted, two students opted to write a fictional target consumer. Students were then asked to paste their paragraph into a GenAI of their choice using the following prompt: "This is my consumer profile: [paste your paragraph]. Based on this information, how would you describe my psychogenic needs (using Murray's List)?" Students then reflected together on the output (an evaluation skill). (They had been previously taught Murray's Psychogenic Needs, which include the six needs of achievement, exhibition, affiliation, power/dominance, change, and order [[<reflink idref="bib49" id="ref65">49</reflink>]]). After reflecting on the results of that and doing a class debrief, they were asked to prompt the GenAI: "Considering the same consumer profile, what would be my most likely defense mechanism I would use to handle frustration?" (They had been previously taught defense mechanisms such as aggression, rationalization, regression, withdrawal, projection, daydreaming, and identification [[<reflink idref="bib49" id="ref66">49</reflink>]].)</p> <p>Sitting in groups, many students reported that GenAI provided them with different lists (e.g., ranging from 4 to 10 different needs for Murray's Psychogenic Needs, and additional defense mechanisms). When asked to reflect on what GenAI got wrong or right, many expressed that the analysis did not fit what they thought of themselves. Students were then left with the summary message about limitations of GenAI but that it can be a good starting point for further inquiry providing that they critically assess the AI's output through independent secondary and/or primary data.</p> <hd id="AN0186160826-12">Survey Results</hd> <p>In this larger student group, there were <emph>n</emph> = 30 responses to the pre-activity survey, and <emph>n</emph> = 25 responses to the post-activity survey. The baseline of these undergraduate business students (as shown in Table 4) shows a similar story to the MBA students in Intervention 1 with one exception: the undergraduates report "frequently" using GenAI (H<subs>0</subs>: µ = 3, <emph>p</emph> &lt;.001), while MBA students reported just "occasional" usage. Otherwise, these students also agree (<emph>p</emph> &lt;.001) that they already are skillful at using GenAI, and they disagree (<emph>p</emph> &lt;.001) that GenAI is hard to learn. Regarding GenAI improving work efficiency, they agree (<emph>p</emph> &lt;.001) that it can and see GenAI as providing "quite a bit" of positive influence on marketing activities (<emph>p</emph> &lt;.001). Regarding accuracy of GenAI, they lean toward some level of "accurate," statistically above "neutral" (<emph>p</emph> =.002). Regarding ethics, they are "moderately concerned" about using GenAI in marketing activities (<emph>p</emph> =.319). This similarity with MBA students could reflect a more general population view that stems from the newness of GenAI for all.</p> <p>Table 4. Comparison of Pre- and Post-Activity Survey Responses.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="center"&gt;Question/Item&lt;/th&gt;&lt;th align="center"&gt;Pre-activity average&lt;/th&gt;&lt;th align="center"&gt;Post-activity average&lt;/th&gt;&lt;th align="center"&gt;&lt;italic&gt;p&lt;/italic&gt;-Value(H&lt;sub&gt;0&lt;/sub&gt;: &amp;#181;&lt;sub&gt;1&lt;/sub&gt; = &amp;#181;&lt;sub&gt;2&lt;/sub&gt;)&lt;/th&gt;&lt;th align="center"&gt;Average change (matched responses)&lt;/th&gt;&lt;th align="center"&gt;&lt;italic&gt;p&lt;/italic&gt;-Value (H&lt;sub&gt;0&lt;/sub&gt;: &amp;#181; = 0)&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;Previous usage of GenAI&lt;/td&gt;&lt;td&gt;3.57*&lt;/td&gt;&lt;td&gt;3.60&lt;/td&gt;&lt;td&gt;.415&lt;/td&gt;&lt;td&gt;.00&lt;/td&gt;&lt;td&gt;n/a&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;Skilled at using AI in daily work&lt;/td&gt;&lt;td&gt;3.87*&lt;/td&gt;&lt;td&gt;3.96&lt;/td&gt;&lt;td&gt;.299&lt;/td&gt;&lt;td&gt;.08&lt;/td&gt;&lt;td&gt;.213&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;New AI technologies hard to learn&lt;/td&gt;&lt;td&gt;2.20*&lt;/td&gt;&lt;td&gt;2.20&lt;/td&gt;&lt;td&gt;.500&lt;/td&gt;&lt;td&gt;.04&lt;/td&gt;&lt;td&gt;.332&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;Able to use to improve my work efficiency&lt;/td&gt;&lt;td&gt;4.40*&lt;/td&gt;&lt;td&gt;4.12&lt;/td&gt;&lt;td&gt;.&lt;bold&gt;032&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;.36&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.002&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;5&lt;/td&gt;&lt;td&gt;GenAI positively impacts marketing&lt;/td&gt;&lt;td&gt;4.10*&lt;/td&gt;&lt;td&gt;3.96&lt;/td&gt;&lt;td&gt;.271&lt;/td&gt;&lt;td&gt;&amp;#8722;.08&lt;/td&gt;&lt;td&gt;.213&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;Accuracy of content from GenAI&lt;/td&gt;&lt;td&gt;3.50*&lt;/td&gt;&lt;td&gt;3.08&lt;/td&gt;&lt;td&gt;.&lt;bold&gt;050&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;.52&lt;/td&gt;&lt;td&gt;&lt;bold&gt;&amp;#60;.001&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;7&lt;/td&gt;&lt;td&gt;Ethics of using generative AI in marketing&lt;/td&gt;&lt;td&gt;2.90&lt;/td&gt;&lt;td&gt;2.92&lt;/td&gt;&lt;td&gt;.477&lt;/td&gt;&lt;td&gt;.00&lt;/td&gt;&lt;td&gt;.500&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>3 <emph>Note.</emph> Regarding the pre-activity stage, averages that are different from their scale mid-point (H<subs>0</subs>: µ = 3) are noted with an asterisk. <emph>p</emph>-Values shown in the last column refer to a <emph>t</emph>-test comparing pre- and post-activity averages. Results with p-value of 10 percent or lower are bolded for easy reference.</p> <p>When comparing pre- and post-activity responses to our survey (Table 4), we see a similar change in perspectives. As with Intervention 1, there is a marked drop in the students' average evaluation of the <emph>accuracy</emph> of GenAI output, from 3.50 to 3.08 (<emph>p</emph> =.050) (evaluation). In terms of impact on work efficiency, the undergraduates had a stronger significance level for the drop in how GenAI can contribute to one's <emph>work efficiency</emph>, from 4.40 to 4.12 (<emph>p</emph> =.032) (usage). (The significance level may be attributable to the larger sample size as well.) For other questions in our survey, there were no significant changes. These results echo the impact from Intervention 1 on the components of GenAI literacy and, in particular, illustrate how perceptions of its suitability to replace work tasks can be challenged through an in-class intervention.</p> <p>One additional adjustment made for Intervention 2 was to ask students who responded to our survey to develop a keyword that they would give for both the pre- and post-activity surveys, allowing us to match responses by student (while retaining their anonymity). The final two columns of Table 4 show the average change in response, matched by student, and the corresponding significance value. A negative average means their response went down (e.g., less agreement on a Likert-type scale). Qualitatively, these results produce the same conclusions that significant changes occurred regarding GenAI contributing to improvements to work efficiency and the accuracy of GenAI output.</p> <hd id="AN0186160826-13">Intervention 3</hd> <p></p> <hd id="AN0186160826-14">Design</hd> <p>Intervention 3 took place in February 2024 in a Digital Marketing course in the second year of the same undergraduate degree program as in Intervention 2. There were 75 students enrolled. The average age of students was around 19 years. This course had predictive AI (that makes predictions from historical data) included on one page in their textbook, although nothing on GenAI. For this in-class session, topics related to "data-driven marketing" were covered, where GenAI became the largest focus in that class session.</p> <p>As part of their class preparation and to develop awareness, students were assigned a short article by [<reflink idref="bib25" id="ref67">25</reflink>] to read prior to class. This article covered the potential uses of GenAI in marketing and insights into how to integrate GenAI into marketing practice (but did not cover potential drawbacks). In addition, attention was given to the distinction between "older" predictive AI and the new GenAI, as well as to emerging research related to GenAI. More was said in Intervention 3 about the growing use of GenAI in marketing (usage), including its potential for synthetic consumer research, which was a new emerging topic.</p> <p>Evolving consequences of GenAI, emerging in the months since the previous interventions, were also covered in the lecture (evaluation). For example, the students were told about the research from [<reflink idref="bib27" id="ref68">27</reflink>] who found that GenAI proved resistant to changing "bad" behavior with current techniques, and that it could even learn to hide this "bad" behavior. They were also briefly told about [<reflink idref="bib22" id="ref69">22</reflink>] who surveyed 2,778 AI experts and found that they are increasingly concerned with the wider ramifications of AI, including dire implications for humanity.</p> <p>The hands-on activity (Component 3) was as follows: In teams, students were asked to create a prompt to ask a GenAI to outline a digital marketing strategy for the focal company of their team project and give that prompt to the GenAI of their choice. They were then asked to reflect on what the GenAI gave them (evaluation): What was missing from the GenAI-produced strategy? What did it offer that was helpful? Students were also asked to direct the GenAI to use the Situation, Objectives, Strategy, Tactics, Action, &amp; Control (SOSTAC) model ([<reflink idref="bib10" id="ref70">10</reflink>]) that they had been taught to use to create a digital marketing strategy.</p> <p>The consensus of the students during the debrief was that GenAI provided very generic responses; while providing a starting framework and helpful overview, responses remained at a superficial level. Importantly, they recognized that the GenAI did not actually accomplish what it had been asked specifically to do. For example, it would recommend that students "create compelling campaigns" but not specify what those campaigns could be. Students were encouraged to further revise their prompts to the GenAI to get more detailed information, with specific suggestions (e.g., assign it a role). Students strongly lamented that the GenAI did not provide them with very deep or consistently appropriate information for their company. A crucial moment for the students occurred when they realized that (a) the GenAI was providing the other groups (essentially their competitors, as they were running individual web shops under the same brand name) with similar advice, and (b) they may have provided competitive information about this company to the GenAI. These conversations strongly represented both the need for socio-ethical considerations to infuse all aspects of GenAI literacy, as well as maintaining interpretive flexibility on an individual/small-group level.</p> <hd id="AN0186160826-15">Survey Results</hd> <p>At the start of the class in Intervention 3, the students' responses to our pre-activity survey turned out to be quite similar to those of both the MBA and undergraduate students from Interventions 1 and 2. As shown in Table 5, they "frequently" use GenAI tools (H<subs>0</subs>: µ = 3, <emph>p</emph> &lt;.001) as in Intervention 2, and like both prior interventions, they generally agree (<emph>p</emph> &lt;.001) that they already have skills in using GenAI, disagree (<emph>p</emph> &lt;.001) that GenAI is hard to learn, agree (<emph>p</emph> &lt;.001) that GenAI can improve work efficiency, see GenAI as producing positive outcomes for marketing (<emph>p</emph> &lt;.001), and generally see GenAI as providing "accurate" output (<emph>p</emph> &lt;.001). Regarding ethics, they are marginally closer to "quite a bit concerned" about the ethics of using GenAI in marketing activities (<emph>p</emph> =.076), a slight departure from the two previous groups, and perhaps a reflection of the changing public discourse around GenAI since Fall 2023.</p> <p>Table 5. Comparison of Pre- and Post-Activity Survey Responses.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="center"&gt;Question/Item&lt;/th&gt;&lt;th align="center"&gt;Pre-activity average&lt;/th&gt;&lt;th align="center"&gt;Post-activity average&lt;/th&gt;&lt;th align="center"&gt;&lt;italic&gt;p&lt;/italic&gt;-Value (H&lt;sub&gt;0&lt;/sub&gt;: &amp;#181;&lt;sub&gt;1&lt;/sub&gt; = &amp;#181;&lt;sub&gt;2&lt;/sub&gt;)&lt;/th&gt;&lt;th align="center"&gt;Average change (matched responses)&lt;/th&gt;&lt;th align="center"&gt;&lt;italic&gt;p&lt;/italic&gt;-Value (H&lt;sub&gt;0&lt;/sub&gt;: &amp;#181; = 0)&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;Previous usage of GenAI&lt;/td&gt;&lt;td&gt;3.57*&lt;/td&gt;&lt;td&gt;3.54&lt;/td&gt;&lt;td&gt;.425&lt;/td&gt;&lt;td&gt;.04&lt;/td&gt;&lt;td&gt;.163&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;Skilled at using AI in daily work&lt;/td&gt;&lt;td&gt;3.94*&lt;/td&gt;&lt;td&gt;3.96&lt;/td&gt;&lt;td&gt;.457&lt;/td&gt;&lt;td&gt;0.0&lt;/td&gt;&lt;td&gt;n/a&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;New AI technologies hard to learn&lt;/td&gt;&lt;td&gt;2.31*&lt;/td&gt;&lt;td&gt;2.36&lt;/td&gt;&lt;td&gt;.438&lt;/td&gt;&lt;td&gt;.18&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.067&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;Able to use to improve my work efficiency&lt;/td&gt;&lt;td&gt;4.43*&lt;/td&gt;&lt;td&gt;4.21&lt;/td&gt;&lt;td&gt;.106&lt;/td&gt;&lt;td&gt;&amp;#8722;.21&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.028&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;5&lt;/td&gt;&lt;td&gt;GenAI positively impacts marketing&lt;/td&gt;&lt;td&gt;4.26*&lt;/td&gt;&lt;td&gt;3.93&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.095&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;.46&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.015&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;Accuracy of content from GenAI&lt;/td&gt;&lt;td&gt;3.54*&lt;/td&gt;&lt;td&gt;3.14&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.053&lt;/bold&gt;&lt;/td&gt;&lt;td&gt;&amp;#8722;.61&lt;/td&gt;&lt;td&gt;&lt;bold&gt;.001&lt;/bold&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;7&lt;/td&gt;&lt;td&gt;Ethics of using generative AI in marketing&lt;/td&gt;&lt;td&gt;3.26&lt;/td&gt;&lt;td&gt;3.54&lt;/td&gt;&lt;td&gt;.143&lt;/td&gt;&lt;td&gt;.18&lt;/td&gt;&lt;td&gt;.101&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>4 <emph>Note.</emph> Regarding the pre-activity stage, averages that are different from their scale mid-point (H<subs>0</subs>: µ = 3) are noted with an asterisk. <emph>p</emph>-Values shown in the last column refer to a <emph>t</emph>-test comparing pre- and post-activity averages. Results with p-value of 10 percent or lower are bolded for easy reference.</p> <p>Table 5 also reports the comparison of pre- (<emph>n</emph> = 35) and post-activity (<emph>n</emph> = 28) responses to our survey questions. Although the findings are just marginally significant (<emph>p</emph> =.053), Intervention 3 again confirms the change in student ratings of the <emph>accuracy</emph> of GenAI after our interventions (evaluation). There is also a marginally significant drop in the score for how GenAI may <emph>positively impact marketing</emph> (<emph>p</emph> =.095) (evaluation). Both these results closely align with the focus of the activity used in Intervention 3 and illustrate how it can influence the components of GenAI literacy, especially ethics and evaluation.</p> <p>As in Intervention 2, however, we are able to match the responses of <emph>n</emph> = 28 students who provided their keywords in both surveys; these average changes and corresponding <emph>p</emph>-values are provided in the last two columns of Table 5. As shown, students' individual perceptions of how GenAI could be used to improve their <emph>work efficiency</emph> dropped significantly (<emph>p</emph> =.028), perhaps given the clear recognition in Intervention 3 that the GenAI did not provide the desired output on a digital marketing strategy and would require additional action to be made useful. Furthermore, students' individual responses regarding whether GenAI would <emph>positively impact marketing activities</emph> dropped significantly (<emph>p</emph> =.015), likely for similar reasons as it did not exhibit its contributions being usable in direct form. The <emph>accuracy</emph> of the output from GenAI was also rated significantly lower (<emph>p</emph> =.001) by the students, further undermining its value. Interestingly, we also find a marginally significant (<emph>p</emph> =.067) rise in the agreement that new AI technologies may be <emph>hard to learn</emph> (usage), something that could be the result of the elevated understanding by students that effective prompt engineering takes time and effort. This result speaks to the usage component of GenAI literacy and suggests that there may be valuable synergies in promoting a comprehensive model of GenAI literacy, all components of which contribute to maintaining interpretive flexibility.</p> <hd id="AN0186160826-16">Discussion</hd> <p>In an effort to promote GenAI literacy in the marketing classroom, we have provided three examples of interventions which significantly influence key components of that literacy in a brief period of time. Illustrating to students their responsibility to understand the technology, to acknowledge the manner by which specific GenAI models could be used for marketing tasks, to evaluate the output, and to see the wider socio-ethical implications raised student awareness and changed their perceptions. Furthermore, our efforts show how educators can weave GenAI into existing class material using small-scale interventions and within a single class session. These interventions can develop students' thoughtfulness in handling GenAI and, thus, put them in a better position to maintain interpretive flexibility.</p> <p>In terms of the specific aspects of GenAI literacy fostered by our approach, we found—across all three interventions—that students showed a significant increase in questioning the <emph>accuracy</emph> of content from GenAI, a key evaluative component of GenAI literacy, and one which should motivate students to continue to be open about their own interpretations, thus contributing toward maintaining interpretive flexibility. Key to interpretive flexibility is the capacity to not only create and sustain divergent opinions and uses but also reflect on the uses and related outcomes (cf. [<reflink idref="bib51" id="ref71">51</reflink>]). Our results show, particularly in Intervention 3, that undergraduates (as compared to the graduate students) are seemingly very confident about their GenAI use at the start of class, yet can acknowledge their surprise at its limitations after even a brief intervention. This change in views is critical for interpretive flexibility to be sustained. In discussions, our students revealed that many did not seem to have even a baseline understanding of how the GenAI actually works. For example, in the Digital Marketing course, near the beginning of the session, students were prone to say things like "if we tell the GenAI to tell the truth, it does" (paraphrased). As students discovered through the session, this unfortunately is not the case, and GenAI is not guaranteed to "tell the truth." This insight underscores the importance of ensuring that students do not overestimate GenAI's abilities; only then can they be informed stakeholders contributing toward maintaining interpretive flexibility—and, thus, collectively influence the future of GenAI.</p> <p>Our findings also point to a recognition by students that GenAI may not be as helpful in <emph>improving work efficiency</emph> as initially thought. The significance level of the drop, from 4.40 to 4.12 (<emph>p</emph> =.032,) was particularly strong for the undergraduates in Intervention 2, where GenAI use was directly connected to their individual coursework. Undergraduates especially may have an illusion that GenAI will be able to do a lot of the hard work for them, but our interventions showed them that GenAI is unable to do everything, enhancing their overall GenAI literacy. This limitation of the technology's ability to assist in the workplace dovetails with concerns raised by [<reflink idref="bib9" id="ref72">9</reflink>] who suggest that those seeking to have GenAI replace their own efforts will unwittingly reduce their own skills over time. As a result, our interventions can help students level-set their expectations that hard work (by humans) is still required, and that they need to remain flexible in their interpretation of GenAI and its consequences for their work and beyond. Importantly, our approach is not to make futile attempts to protect students from GenAI (e.g., see the article by [<reflink idref="bib29" id="ref73">29</reflink>]), but rather to help students discover for themselves the possibilities and limitations of the technology, toward maintaining interpretive flexibility.</p> <p>Importantly, our results support the view that GenAI literacy is potentially fostered by a combination of the building blocks of GenAI literacy (e.g., understanding, usage, and evaluation, all infused with the socio-ethical), but also that those elements are complex and changing. As the technology evolves, its application and its impact on various stakeholders will also evolve. AI literacy based on predictive AI (e.g., [<reflink idref="bib52" id="ref74">52</reflink>]) will not be sufficient to capture the complexity and evolution of GenAI. Therefore, GenAI literacy will require continued educational efforts like the ones we share in this article to maintain interpretive flexibility of what this technology means to individuals and society, where, in turn, this flexibility can influence our understanding of GenAI literacy. Accordingly, we also suggest that any scale-oriented research on AI literacy—as illustrated by [<reflink idref="bib52" id="ref75">52</reflink>]—is premature for the context of GenAI literacy. Given the importance to maintain interpretive flexibility so that socio-ethical interpretations of the technology's implications are not curtailed by dominant stakeholders, we propose that marketing educators purposefully view GenAI literacy as evolving along with the technology, as well as society's interpretation of it.</p> <p>Given these current and future developments, [<reflink idref="bib29" id="ref76">29</reflink>] is right to warn about the limitations of a "laissez-faire" approach in which the burden of dealing with the shock of GenAI is outsourced to individual educators. However, our research has demonstrated that even educators without much technical know-how can still serve as facilitators to students' GenAI literacy. We anticipate that our development of small-scale interventions and the resulting impact on student views will encourage educators across a variety of subjects to "embrace vulnerability" in the educational journey with transformative technologies ([<reflink idref="bib21" id="ref77">21</reflink>]). Instructors can "move toward the 'unknown'" as facilitators of an expansionist curriculum accelerated by transformative technologies ([<reflink idref="bib21" id="ref78">21</reflink>], p. 16), while also contributing to maintaining interpretive flexibility. Institutions must implement policies and provide resources and training for their instructors, but the pace of program change is such that instructors must start now to guide students to thoughtful use of GenAI. These efforts can help reach the AACSB goal for entrenching AI literacy into business schools.</p> <hd id="AN0186160826-17">Limitations and Future Research</hd> <p>Our research does have its limitations. Our interventions were multi-faceted as they constituted a redesign of a class period and accounted for multiple aspects of GenAI literacy, making the in-class activities focused, but rich in context. Given this structure, we cannot point to any one aspect of our interventions that was most impactful in changing students' perceptions. In addition, these interventions relied heavily on personalized attention from one instructor, who led interactive discussions and traveled the classroom during the practical activities to converse with each student group. Such attention may be less feasible in larger classes. Interventions—and studies on these interventions—that can be carried out with less-direct support to students are likely needed for those cases.</p> <p>In terms of our survey output, our research also has a few limitations. First, not all students participated in the pre- and post-activity surveys, and some only participated in the pre-activity survey. Future research might ensure that the post-survey is conducted earlier in the class to avoid a drop-off. Furthermore, our samples are relatively small, owing largely to the small class sizes. These sizes also made it difficult to establish a control group setting. While the interventions we describe in this article are arguably the students' only focus between the two surveys, we cannot guarantee that other influences did not affect survey responses. As such, repeating our research in a setting where larger classes can be utilized, and with a control group, is warranted. It could also prove useful to replace our single-item survey questions with existing or developed scales. However, our approach, as well as the goal to maintain interpretive flexibility, suggests that future research should more purposefully integrate qualitative research to understand how the technology is viewed by key stakeholders such as students and instructors and how this evolves as they are taught GenAI literacy. These understandings and interpretations are inherent to maintaining interpretive flexibility, and future research could also study the role of instructors—a key stakeholder in marketing education—in supporting that process.</p> <hd id="AN0186160826-18">Conclusion</hd> <p>Our paper contributes small-scale interventions that cultivate GenAI literacy while maintaining interpretive flexibility. As GenAI continues to evolve, it is incumbent on marketing educators to foster GenAI literacy, not only for students to understand this transformative technology but also to prepare students to maintain interpretive flexibility around it. We have shown, for this stage of the technology's evolution, that students' perceptions of GenAI can be influenced with relatively brief classroom interventions. We offer an approach that is small scale and suitable for instructors to integrate GenAI literacy into their marketing classrooms now, an action urgently needed in the face of this rapidly changing technology.</p> <ref id="AN0186160826-19"> <title> References </title> <blist> <bibl id="bib1" idref="ref18" type="bt">1</bibl> <bibtext> AACSB. (2024). Building future-ready business schools with Generative AI. AACSB. https://<ulink href="http://www.aacsb.edu/insights/reports/building-future-ready-business-schools-with-generative-ai">www.aacsb.edu/insights/reports/building-future-ready-business-schools-with-generative-ai</ulink></bibtext> </blist> <blist> <bibl id="bib2" idref="ref8" type="bt">2</bibl> <bibtext> Adiguzel T., Kaya M. H., Cansu F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), 1–13.</bibtext> </blist> <blist> <bibl id="bib3" idref="ref23" type="bt">3</bibl> <bibtext> Annapureddy R., Fornaroli A., Gatica-Perez D. (2024). Generative AI literacy: Twelve defining competencies. Digital Government: Research and Practice. https://dl.acm.org/doi/abs/10.1145/3685680</bibtext> </blist> <blist> <bibl id="bib4" idref="ref54" type="bt">4</bibl> <bibtext> Bender E. M., Gebru T., McMillan-Major A., Schmitchell S. (2021, March). On the dangers of stochastic parrots: Can language models be too big? [Conference paper]. FAccT'21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. https://dl.acm.org/doi/10.1145/3442188.3445922</bibtext> </blist> <blist> <bibl id="bib5" idref="ref15" type="bt">5</bibl> <bibtext> Bijker W. E. (1987). The social construction of Bakelite: Toward a theory of invention. In Bijker W. E., Hughes T. P., Pinch T. (Eds.), The social construction of technological systems (pp. 159–187). MIT Press.</bibtext> </blist> <blist> <bibl id="bib6" idref="ref5" type="bt">6</bibl> <bibtext> Bloomberg Intelligence. (2023). Generative AI to become a $1.3 trillion market by 2032, research finds. Bloomberg. https://<ulink href="http://www.bloomberg.com/company/press/generative-ai-to-become-a-1-3-trillion-market-by-2032-research-finds/">www.bloomberg.com/company/press/generative-ai-to-become-a-1-3-trillion-market-by-2032-research-finds/</ulink></bibtext> </blist> <blist> <bibl id="bib7" idref="ref29" type="bt">7</bibl> <bibtext> Bozkurt A. (2024). Why Generative AI literacy, Why now and why it matters in the educational landscape? Kings, Queens and GenAI Dragons. Open Praxis, 16(3), 283–290. https://doi.org/10.55982/openpraxis.16.3.739</bibtext> </blist> <blist> <bibl id="bib8" idref="ref24" type="bt">8</bibl> <bibtext> Caballar R. (2024, August 9). Generative AI vs. predictive AI: What's the difference? IBM. https://<ulink href="http://www.ibm.com/blog/generative-ai-vs-predictive-ai-whats-the-difference/">www.ibm.com/blog/generative-ai-vs-predictive-ai-whats-the-difference/</ulink></bibtext> </blist> <blist> <bibl id="bib9" idref="ref72" type="bt">9</bibl> <bibtext> Cardon P., Fleischmann C., Aritz J., Logemann M., Heidewald J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295.</bibtext> </blist> <blist> <bibtext> Chaffey D., Ellis-Chadwick F. (2022). Digital marketing: Strategy, implementation and practice (8th ed.). Pearson Education Limited.</bibtext> </blist> <blist> <bibtext> Clark B. (2023, June 14). A Generative AI teaching exercise for marketing classes. Medium. https://bruceclarkprof.medium.com/a-generative-ai-teaching-exercise-for-marketing-classes-6fb09af0a565</bibtext> </blist> <blist> <bibtext> Cook J. (2024). ChatGPT, Claude, Gemini or another? The AI tool entrepreneurs prefer. Forbes. https://<ulink href="http://www.forbes.com/sites/jodiecook/2024/05/07/chatgpt-claude-gemini-or-another-the-ai-tool-entrepreneurs-prefer/">www.forbes.com/sites/jodiecook/2024/05/07/chatgpt-claude-gemini-or-another-the-ai-tool-entrepreneurs-prefer/</ulink></bibtext> </blist> <blist> <bibtext> Cribben I., Zeinali Y. (2023). The benefits and limitations of ChatGPT in business education and research: A focus on management science, operations management and data analytics. Operations Management and Data Analytics. https://ssrn.com/abstract=4404276</bibtext> </blist> <blist> <bibtext> Dalalah D., Dalalah O. M. (2023). The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT. The International Journal of Management Education, 21(2), 100822.</bibtext> </blist> <blist> <bibtext> Dell'Acqua F., McFowland E., Mollick E. R., Lifshitz-Assaf H., Kellogg K., Rajendran S...Lakhani K. R. (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality (24-013). Harvard Business School Technology &amp; Operations Mgt. Unit Working Paper.</bibtext> </blist> <blist> <bibtext> Deveau R., Griffin S. J., Reis S. (2023, May 11). AI-powered marketing and sales reach new heights with generative AI. McKinsey &amp; Company. https://<ulink href="http://www.mckinsey.com/capabilities/growth-marketing-and-sales/our-insights/ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai">www.mckinsey.com/capabilities/growth-marketing-and-sales/our-insights/ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai</ulink></bibtext> </blist> <blist> <bibtext> Doherty N. F., Coombs C. R., Loan-Clarke J. (2006). A re-conceptualization of the interpretive flexibility of information technologies: Redressing the balance between the social and the technical. European Journal of Information Systems, 15(6), 569–582.</bibtext> </blist> <blist> <bibtext> Domínguez Figaredo D., Stoyanovich J. (2023). Responsible AI literacy: A stakeholder-first approach.". Big Data &amp; Society, 10, 1–15.</bibtext> </blist> <blist> <bibtext> Dyson B. J. (2008). Assessing small-scale interventions in large-scale teaching: A general methodology and preliminary data. Active Learning in Higher Education, 9(3), 265–282.</bibtext> </blist> <blist> <bibtext> Elbanna S., Armstrong L. (2024). Exploring the integration of ChatGPT in education: Adapting for the future. Management &amp; Sustainability: An Arab Review, 3(1), 16–29.</bibtext> </blist> <blist> <bibtext> Fischer I., Dobbins K. (2024). Is it worth it? How paradoxical tensions of identity shape the readiness of management educators to embrace transformative technologies in their teaching. Journal of Management Education, 48(4), 829–848. https://doi.org/10.1177/10525629231201843</bibtext> </blist> <blist> <bibtext> Grace K., Stewart H., Sandkühler J. F., Thomas S., Weinstein-Raun B., Brauner J. (2024). Thousands of AI authors on the future of AI. arXiv preprint arXiv:2401.02843. https://arxiv.org/pdf/2401.02843</bibtext> </blist> <blist> <bibtext> Guha A., Grewal D., Atlas S. (2023). Generative AI and marketing education: What the future holds. Journal of Marketing Education, 46(1), 6–17.</bibtext> </blist> <blist> <bibtext> Guidi M. (2023). Gen AI: The need for Human Intelligence (HI) with Artificial Intelligence (AI). IPSOS. https://<ulink href="http://www.ipsos.com/en/almanac-2024/gen-ai-need-human-intelligence-hi-artificial-intelligence-ai">www.ipsos.com/en/almanac-2024/gen-ai-need-human-intelligence-hi-artificial-intelligence-ai</ulink></bibtext> </blist> <blist> <bibtext> Harkness L., Robinson K., Stein E., Wu W. (2023, December 5). How generative AI can boost consumer marketing. McKinsey &amp; Company. https://<ulink href="http://www.mckinsey.com/capabilities/growth-marketing-and-sales/our-insights/how-generative-ai-can-boost-consumer-marketing">www.mckinsey.com/capabilities/growth-marketing-and-sales/our-insights/how-generative-ai-can-boost-consumer-marketing</ulink></bibtext> </blist> <blist> <bibtext> Hirsh-Pasek K., Blinkoff E. (2023). ChatGPT: Educational friend or foe? Brookings. https://<ulink href="http://www.brookings.edu/articles/chatgpt-educational-friend-or-foe/">www.brookings.edu/articles/chatgpt-educational-friend-or-foe/</ulink></bibtext> </blist> <blist> <bibtext> Hubinger E., Denison C., Mu J., Lambert M., Tong M., MacDiarmid M...Perez E. (2024). Sleeper agents: Training deceptive LLMs that persist through safety training arXiv preprint arXiv:2401.05566.</bibtext> </blist> <blist> <bibtext> Korst J., Puntoni S. (2023). Taking a pulse on Generative AI: Usage, investments and perceptions among enterprise decision makers. GBK Collective. https://<ulink href="http://www.gbkcollective.com/thoughtleadership/the-rise-of-generative-ai">www.gbkcollective.com/thoughtleadership/the-rise-of-generative-ai</ulink></bibtext> </blist> <blist> <bibtext> Krammer S. (2023). Is there a glitch in the matrix? Artificial intelligence and management education. Management Learning, Advanced online publication. https://doi.org/10.1177/13505076231217667</bibtext> </blist> <blist> <bibtext> Kshetri N., Dwivedi Y. K., Davenport T. H., Panteli N. (2023). Generative artificial intelligence in marketing: Applications, opportunities, challenges, and research agenda. International Journal of Information Management, 75, 102716.</bibtext> </blist> <blist> <bibtext> Lee K., Cooper A. F., Grimmelmann J., Ippolito D. (2023). AI and law: The next generation [Working Paper]. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4580739</bibtext> </blist> <blist> <bibtext> Lim W. M., Gunasekara A., Pallant J. L., Pallant J. I., Pechenkina E. (2023). Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. The International Journal of Management Education, 21(2), 100790.</bibtext> </blist> <blist> <bibtext> Luo J. (2024). A critical review of GenAI policies in higher education assessment: A call to reconsider the "originality" of students' work. Assessment &amp; Evaluation in Higher Education, 49, 651–664.</bibtext> </blist> <blist> <bibtext> Meyer U., Schulz-Schaeffer I. (2006). Three forms of interpretative flexibility. Science, Technology &amp; Innovation Studies, 1, 25–40.</bibtext> </blist> <blist> <bibtext> Nordlöf C., Norström P., Höst G., Hallström J. (2022). Towards a three-part heuristic framework for technology education. International Journal of Technology and Design Education, 32(3), 1583–1604.</bibtext> </blist> <blist> <bibtext> OpenAI. (2024). ChatGPT. OpenAI. https://openai.com/chatgpt/</bibtext> </blist> <blist> <bibtext> OpenAI. (2025). More on GPT-4. OpenAI. https://openai.com/index/gpt-4/</bibtext> </blist> <blist> <bibtext> Peres R., Schreier M., Schweidel D., Sorescu A. (2023). On ChatGPT and beyond: How generative artificial intelligence may affect research, teaching, and practice. International Journal of Research in Marketing, 40(2), 269–275.</bibtext> </blist> <blist> <bibtext> Piantadosi S. [@spiantado]. (2022, December 4). Yes, ChatGPT is amazing and impressive. No, @OpenAI has not come close to addressing the problem of bias. Filters appear to be bypassed with simple tricks, and superficially masked. And what is lurking inside is egregious.. X (formerly Twitter). https://twitter.com/spiantado/status/1599462375887114240</bibtext> </blist> <blist> <bibtext> Pinch T. J., Bijker W. E. (1987). The social construction of facts and artefacts: Or how the sociology of science and the sociology of technology might benefit each other. In Bijker W. E., Hughes T. P., Pinch T. (Eds.), The social construction of technological systems (pp. 17–50). MIT Press.</bibtext> </blist> <blist> <bibtext> Postman N. (1998, March). Five things we need to know about technological change [Conference session]. NewTech98: International Conference on New Technologies; the Human Person: Communicating the Faith in the New Millennium; Pontifical Council for Social Communications; the Archdiocese of Denver, Denver, CO, USA. https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/postman.pdf</bibtext> </blist> <blist> <bibtext> Ratten V., Jones P. (2023). Generative artificial intelligence (ChatGPT): Implications for management educators. The International Journal of Management Education, 21, 1–7.</bibtext> </blist> <blist> <bibtext> Relmasira S. C., Lai Y. C., Donaldson J. P. (2023). Fostering AI literacy in elementary science, technology, engineering, art, and mathematics (STEAM) education in the age of generative AI.". Sustainability, 15, 13595.</bibtext> </blist> <blist> <bibtext> Reppel A. (2023). Digitization and consumer choice. In Kubacki K., Parker L., Domegan C., Brennan L. (Eds.), The Routledge companion to marketing and society (pp. 41–54). Routledge.</bibtext> </blist> <blist> <bibtext> Reppel A., Beninger S., Domengan C. (2023, June). ChatGPT in the marketing classroom: Friend or foe? [Paper presentation]. 48th Annual Macromarketing Conference, Seattle, WA, USA. https://<ulink href="http://www.macromarketing.org/assets/proceedings/2023-macromarketing-proceedings.pdf">www.macromarketing.org/assets/proceedings/2023-macromarketing-proceedings.pdf</ulink></bibtext> </blist> <blist> <bibtext> Ridley J. (2023, April 14). It's surprisingly easy to trick an AI chatbot into telling you how to be a very bad boy. PCGamer. https://<ulink href="http://www.pcgamer.com/its-surprisingly-easy-to-trick-an-ai-chatbot-into-telling-you-how-to-be-a-very-bad-boy/">www.pcgamer.com/its-surprisingly-easy-to-trick-an-ai-chatbot-into-telling-you-how-to-be-a-very-bad-boy/</ulink></bibtext> </blist> <blist> <bibtext> Rodriguez-Tejedo I., Etayo C. (2024). From talk to action: How small steps can make a big impact in marketing education for climate action. Journal of Marketing Education, 46(2), 140–154. https://journals.sagepub.com/doi/10.1177/02734753241232326</bibtext> </blist> <blist> <bibtext> Sahay S., Robey D. (1996). Organizational context, social interpretation, and the implementation and consequences of geographic information systems. Accounting, Management and Information Technologies, 6(4), 255–282.</bibtext> </blist> <blist> <bibtext> Schiffman L. G., Wisenblit J. L. (2019). Consumer Behavior: Global edition (12th ed.). Pearson Education Limited.</bibtext> </blist> <blist> <bibtext> Spanjaard D., Garlin F., Mohammed H. (2023). Tell me a story! Blending digital storytelling into marketing higher education for student engagement. Journal of Marketing Education, 45(2), 167–182.</bibtext> </blist> <blist> <bibtext> Viard T., Gornet M., Delarue S. (2024, February). Interpretive flexibility in data science and artificial intelligence. Undone Computer Science. https://undonecs.sciencesconf.org/data/Undonecs_2024_abstract_11.pdf</bibtext> </blist> <blist> <bibtext> Wang B., Rau P. P., Yuan T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of Artificial Intelligence Literacy Scale. Behaviour &amp; Information Technology, 42(9), 1324–1337.</bibtext> </blist> <blist> <bibtext> Ye C., Kim Y., Cho Y. (2024). Digital marketing and analytics education: A systematic review. Journal of Marketing Education, 46(1), 32–44.</bibtext> </blist> </ref> <ref id="AN0186160826-20"> <title> Footnotes </title> <blist> <bibtext> The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.</bibtext> </blist> <blist> <bibtext> The author(s) received no financial support for the research, authorship, and/or publication of this article.</bibtext> </blist> <blist> <bibtext> Stefanie Beninger</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-6956-7625 Alex Reppel</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-7141-9373 Julie Stanton</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-8373-1508 Forrest Watson</bibtext> </blist> <blist> <bibtext>Graph https://orcid.org/0000-0002-8820-1434</bibtext> </blist> </ref> <aug> <p>By Stefanie Beninger; Alex Reppel; Julie Stanton and Forrest Watson</p> <p>Reported by Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib24" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib12" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib32" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib36" firstref="ref4"></nolink> <nolink nlid="nl5" bibid="bib28" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib30" firstref="ref7"></nolink> <nolink nlid="nl7" bibid="bib53" firstref="ref9"></nolink> <nolink nlid="nl8" bibid="bib18" firstref="ref10"></nolink> <nolink nlid="nl9" bibid="bib38" firstref="ref11"></nolink> <nolink nlid="nl10" bibid="bib34" firstref="ref12"></nolink> <nolink nlid="nl11" bibid="bib40" firstref="ref14"></nolink> <nolink nlid="nl12" bibid="bib17" firstref="ref16"></nolink> <nolink nlid="nl13" bibid="bib51" firstref="ref17"></nolink> <nolink nlid="nl14" bibid="bib19" firstref="ref19"></nolink> <nolink nlid="nl15" bibid="bib47" firstref="ref20"></nolink> <nolink nlid="nl16" bibid="bib45" firstref="ref22"></nolink> <nolink nlid="nl17" bibid="bib35" firstref="ref25"></nolink> <nolink nlid="nl18" bibid="bib52" firstref="ref26"></nolink> <nolink nlid="nl19" bibid="bib48" firstref="ref30"></nolink> <nolink nlid="nl20" bibid="bib13" firstref="ref33"></nolink> <nolink nlid="nl21" bibid="bib42" firstref="ref34"></nolink> <nolink nlid="nl22" bibid="bib14" firstref="ref37"></nolink> <nolink nlid="nl23" bibid="bib23" firstref="ref38"></nolink> <nolink nlid="nl24" bibid="bib20" firstref="ref40"></nolink> <nolink nlid="nl25" bibid="bib26" firstref="ref44"></nolink> <nolink nlid="nl26" bibid="bib29" firstref="ref46"></nolink> <nolink nlid="nl27" bibid="bib21" firstref="ref47"></nolink> <nolink nlid="nl28" bibid="bib33" firstref="ref49"></nolink> <nolink nlid="nl29" bibid="bib31" firstref="ref59"></nolink> <nolink nlid="nl30" bibid="bib41" firstref="ref60"></nolink> <nolink nlid="nl31" bibid="bib44" firstref="ref61"></nolink> <nolink nlid="nl32" bibid="bib43" firstref="ref62"></nolink> <nolink nlid="nl33" bibid="bib50" firstref="ref63"></nolink> <nolink nlid="nl34" bibid="bib16" firstref="ref64"></nolink> <nolink nlid="nl35" bibid="bib49" firstref="ref65"></nolink> <nolink nlid="nl36" bibid="bib25" firstref="ref67"></nolink> <nolink nlid="nl37" bibid="bib27" firstref="ref68"></nolink> <nolink nlid="nl38" bibid="bib22" firstref="ref69"></nolink> <nolink nlid="nl39" bibid="bib10" firstref="ref70"></nolink> |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1475262 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Stefanie+Beninger%22">Stefanie Beninger</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6956-7625">0000-0002-6956-7625</externalLink>)<br /><searchLink fieldCode="AR" term="%22Alex+Reppel%22">Alex Reppel</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7141-9373">0000-0002-7141-9373</externalLink>)<br /><searchLink fieldCode="AR" term="%22Julie+Stanton%22">Julie Stanton</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8373-1508">0000-0002-8373-1508</externalLink>)<br /><searchLink fieldCode="AR" term="%22Forrest+Watson%22">Forrest Watson</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8820-1434">0000-0002-8820-1434</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Journal+of+Marketing+Education%22"><i>Journal of Marketing Education</i></searchLink>. 2025 47(2):112-125. – Name: Avail Label: Availability Group: Avail Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 14 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Evaluative – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Business+Education%22">Business Education</searchLink><br /><searchLink fieldCode="DE" term="%22Marketing%22">Marketing</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Integration%22">Technology Integration</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Change%22">Educational Change</searchLink><br /><searchLink fieldCode="DE" term="%22Curriculum+Design%22">Curriculum Design</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Technological+Literacy%22">Technological Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Surveys%22">Student Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Course+Descriptions%22">Course Descriptions</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1177/02734753251316569 – Name: ISSN Label: ISSN Group: ISSN Data: 0273-4753<br />1552-6550 – Name: Abstract Label: Abstract Group: Ab Data: The emergence of generative AI (GenAI) has illustrated that higher education needs to adapt to the technology. Its speed of evolution requires that we adequately prepare students for an ever-changing landscape. Toward achieving that aim, we draw on the concept of interpretive flexibility, where the interpretations, uses, and outcomes of a new technology can differ and evolve over time, often with dominant stakeholders controlling the process. To engage marketing students in this process, we propose that they be presented with these diverse interpretations "now" as part of GenAI literacy. Specifically, we offer three small-scale pedagogical interventions designed to address this urgent need. Given the newness of GenAI, our interventions are designed to be infused into existing marketing instruction, instead of requiring a redesign of a curriculum. With each intervention, students not only significantly decrease their confidence in the accuracy of what GenAI produces but also see reasons to examine the implications of it. Both these outcomes, we suggest, could help to maintain interpretive flexibility required to properly respond to and guide the technology as its uses, impacts, and evolution become evident. We encourage educators to prioritize a comprehensive notion of GenAI literacy in their pedagogy to maintain interpretive flexibility. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: EJ1475262 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1475262 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1177/02734753251316569 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 112 Subjects: – SubjectFull: Business Education Type: general – SubjectFull: Marketing Type: general – SubjectFull: Artificial Intelligence Type: general – SubjectFull: Computer Software Type: general – SubjectFull: Technology Integration Type: general – SubjectFull: Teaching Methods Type: general – SubjectFull: Intervention Type: general – SubjectFull: Educational Change Type: general – SubjectFull: Curriculum Design Type: general – SubjectFull: Accuracy Type: general – SubjectFull: Technological Literacy Type: general – SubjectFull: Student Surveys Type: general – SubjectFull: Undergraduate Students Type: general – SubjectFull: Course Descriptions Type: general Titles: – TitleFull: Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Stefanie Beninger – PersonEntity: Name: NameFull: Alex Reppel – PersonEntity: Name: NameFull: Julie Stanton – PersonEntity: Name: NameFull: Forrest Watson IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 08 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 0273-4753 – Type: issn-electronic Value: 1552-6550 Numbering: – Type: volume Value: 47 – Type: issue Value: 2 Titles: – TitleFull: Journal of Marketing Education Type: main |
| ResultId | 1 |