Use of Event-Related Potentials to Assess Visual–Auditory Multisensory Information in the Decision-Making Processes Related to Fast-Consuming Behavior.
Saved in:
| Title: | Use of Event-Related Potentials to Assess Visual–Auditory Multisensory Information in the Decision-Making Processes Related to Fast-Consuming Behavior. |
|---|---|
| Authors: | Rui, Zhepeng1 (AUTHOR), Gu, Zhenyu1 (AUTHOR) zygu@sjtu.edu.cn |
| Source: | International Journal of Human-Computer Interaction. Nov2024, Vol. 40 Issue 22, p7019-7042. 24p. |
| Subjects: | Memory testing, Sensory memory, Evoked potentials (Electrophysiology), Sounds, Sales promotion |
| Abstract: | People are accustomed to using mobile phones to purchase products online. Previous studies identified brain activities associated with online buying decisions but did not assess mismatch negativity (MMN), P300 (P3a and P3b), and slow waves. We applied visual animation and sound effects to test visual–auditory multisensory concepts in product promotion strategies. Event-related potential (ERP) responses from 53 participants were analyzed to help design sound effects based on MMN, P300, and slow waves. We designed five short visual–auditory animation videos: visual animation sound effect (VASE), VA sound beep (VASB), visual standard sound beep (VSSB), visual animation–no sound (VANS), and visual standard–no sound (VSNS). These five apps were used to test how matched and unmatched multisensory user experience (UX) influences online shopping decisions. We also used Arrow's impossibility theorem to design the purchasing experiment. VASE evoked MMN (cluster p = 0.0184) compared with VSSB. VASE evoked the strongest P300 (P3a and P3b) responses (cluster p = 1 × 10−5), and VASB evoked more negative slow wave amplitudes (cluster p = 1.7 × 10−4) compared with VASE. Participants buy products unconsciously via most VASE and VANS mobile apps compared with via VASB and VSNS. Our findings suggest that sensory memory from multisensory UX can promote product consumption in mobile phone shopping interfaces. This study's testing of memory and attention from MMN, P300, and slow waves makes a novel contribution to the marketing discipline. The implications can motivate researchers to apply ERP to analyze the multisensory concept in future interdisciplinary research. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | People are accustomed to using mobile phones to purchase products online. Previous studies identified brain activities associated with online buying decisions but did not assess mismatch negativity (MMN), P300 (P3a and P3b), and slow waves. We applied visual animation and sound effects to test visual–auditory multisensory concepts in product promotion strategies. Event-related potential (ERP) responses from 53 participants were analyzed to help design sound effects based on MMN, P300, and slow waves. We designed five short visual–auditory animation videos: visual animation sound effect (VASE), VA sound beep (VASB), visual standard sound beep (VSSB), visual animation–no sound (VANS), and visual standard–no sound (VSNS). These five apps were used to test how matched and unmatched multisensory user experience (UX) influences online shopping decisions. We also used Arrow's impossibility theorem to design the purchasing experiment. VASE evoked MMN (cluster p = 0.0184) compared with VSSB. VASE evoked the strongest P300 (P3a and P3b) responses (cluster p = 1 × 10−5), and VASB evoked more negative slow wave amplitudes (cluster p = 1.7 × 10−4) compared with VASE. Participants buy products unconsciously via most VASE and VANS mobile apps compared with via VASB and VSNS. Our findings suggest that sensory memory from multisensory UX can promote product consumption in mobile phone shopping interfaces. This study's testing of memory and attention from MMN, P300, and slow waves makes a novel contribution to the marketing discipline. The implications can motivate researchers to apply ERP to analyze the multisensory concept in future interdisciplinary research. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 10447318 |
| DOI: | 10.1080/10447318.2023.2260983 |
