Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

The ‘hookability’ of multimodal impact captions A mixed-methods exploratory study

Sasamoto, Ryoko orcid logoORCID: 0000-0002-1644-6897, Doherty, Stephen orcid logoORCID: 0000-0003-0887-1049 and O'Hagan, Minako orcid logoORCID: 0000-0003-0870-0725 (2021) The ‘hookability’ of multimodal impact captions A mixed-methods exploratory study. Translation, Cognition & Behavior, 4 (2). pp. 253-280. ISSN 2542-5277

Abstract
The use of captions has grown in recent years in both traditional and new media, particularly in terms of the diversity of style, content, and function. Impact captions have emerged as a popular form of captions for hearing viewers and contain rich multimodal information which is employed to capture viewer attention and enhance engagement, particularly in situations where there is competition for viewer attention. Drawing upon relevance theory, we argue how impact captions could effectively attract and hold visual attention owing to their balance between processing effort and contextual effects. This exploratory study employs a dual-task paradigm and uses authentic materials and viewing situations to further examine the ability of multimodal impact captions to attract and retain overt visual attention amongst a small sample of TV viewers. Our results provide novel insight into the apparent highly individualised efficacy of impact captions, where we identify several variables of interest in participants’ viewing behaviours. We conclude with a discussion of the study’s contributions, limitations, and an outline for future work.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:Impact; captions; subtitles; audiovisual translation; relevance theory; multimodal
Subjects:Humanities > Linguistics
Humanities > Translating and interpreting
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Applied Language and Intercultural Studies
Research Initiatives and Centres > Centre for Translation and Textual Studies (CTTS)
Publisher:John Benjamins Publishing
Official URL:https://doi.org/10.1075/tcb.00055.sas
Copyright Information:© 2021 John Benjamins Publishing
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:26630
Deposited On:21 Jan 2022 16:00 by Ryoko Sasamoto . Last Modified 21 Jan 2022 16:00
Documents

Full text available as:

[thumbnail of Sasamoto et al 2021.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
749kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record