The impact of translator training, experience and extrinsic information on translation evaluation: An eye-tracking study
DOI:
https://doi.org/10.24197/f16fex28Keywords:
Perceived translation quality, translation training, eye-tracking, cognitive effort, extrinsic informationAbstract
In this paper, we describe the results of an eye-tracking study where we have observed the impact of translator training and experience as well as extrinsic information on the translation evaluation process. We presented three different groups of participants (novice, trained and experienced) with English source texts and Spanish translations and asked them to evaluate the translations. We recorded the cognitive effort spent on different information provided through eye-tracking technology. We seek to observe differences in evaluating behaviour and reliance on extrinsic information in these groups of participants with differing levels of expertise and relate measurement knowledge and quality uncertainty. Overall, our results indicate that translator’s training and experience tends to add value to the evaluation process by making the assessors less reliant on extrinsic information, even if it initially raises their measurement uncertainty, which is then overcome by greater effort spent on the intrinsic information.
Downloads
References
Akerlof, George A. (1978). The market for “lemons”: Quality uncertainty and the market mechanism. The Quarterly Journal of Economics 48 (3), 488-500. https://doi.org/10.2307/1879431.
Beeby, Allison, Ensinger, Doris, and Presas, Marisa (2000). Acquiring translation competence: Hypotheses and methodological problems of a research project. In Allison Beeby, Doris Ensingerand Marisa Presas (Eds.), Investigating Translation (pp. 99-106). John Benjamins.
Bermúdez-Bausela, Montserrat and De Wille, Tabea (2023). Estudio del esfuerzo cognitivo en el procesamiento de características léxicas en estudiantes y expertos utilizando una metodología de seguimiento de jos. Hikma 22 (1), 219-248. https://doi.org/10.21071/hikma.v 22i1.15063
Carl, Michael and Kay, Martin (2011) Gazing and typing activities during translation: A comparative study of translation units of professional and student translators. Meta 56 (4), 952-975. https://doi.org/10.7202/1011262ar
Chesterman, Andrew (2001). Proposal for a Hieronymic oath. The Translator 7 (2), 139-154. https://doi.org/10.1080/13556509.2001.10 799097
Chesterman, Andrew (2016). Memes of Translation: The Spread of Ideas in Translation Theory. John Benjamins.
De Wille, Tabea (2017). A Mixed Methods Investigation on Perceived Quality in Crowdsourced Localisation [Unpublished doctoral dissertation]. University of Limerick. (Supervised by Chris Exton and Reinhard Schäler).
De Wille, Tabea and Bermúdez-Bausela, Montserrat (2018). Quality perceptions and professional status in translation. Clina: Revista Interdisciplinaria de Traducción, Interpretación y Comunicación Intercultural, 4 (2), 103-122. https://doi.org/10.14201/clina2018421 03122
De Wille, Tabea and Bermúdez-Bausela, Montserrat (2020). Quality perceptions and professional status: The impact of extrinsic information on translation editing. Revista de Lenguas para Fines Específicos, 26 (1), 84-107. https://doi.org/10.20420/RLFE.2 020.315
Doherty, Stephen, O’Brien, Sharon, and Carl, Michael (2010). Eye tracking as an MT evaluation technique. Machine Translation, 24, 1-13. https://doi.org/10.1007/s10590-010-9070-9
Dragsted, Barbara (2010). Coordination of reading and writing processes: An eye on uncharted territory. In Gregory Shreve and Erik Angelone (Eds.), Translation and Cognition (pp. 41-62). John Benjamins.
Dragsted, Barbara and Carl, Michael (2013). Towards a classification of translation styles based on eye-tracking and keylogging data. Journal of Writing Research, 5 (1), 133-158. https://doi.org/10.17239/jowr-2013.05.01.6
Dreyfus, Stuart E. (2004). The five-stage model of adult skill acquisition. Bulletin of Science, Technology and Society, 24 (3), 177-181. https://doi.org/10.1177/0270467604264992
Golder, Peter N., Mitra, Debanjan, and Moorman, Christine (2012). What is quality? An integrative framework of processes and states. Journal of Marketing, 76, 1-23.
Göpferich, Susanne and Jääskeläinen, Riitta (2009). Process research into the development of translation competence: Where are we, and where do we need to go? Across Languages and Cultures, 10(2), 169-191. https://doi.org/10.1556/Acr.10.2009.2.1
Hvelplund, Kristian T. (2017). Eye tracking in translation process research. In John W. Schwieter and Aline Ferreira (Eds.), The Handbook of Translation and Cognition (pp. 248-264). John Wiley & Sons. https://doi.org/10.1002/9781119241485.ch14
Jakobsen, Arnt Lykke and Hvelplund, Kristian T. (2008). Eye movement behaviour across four different types of reading task. Copenhagen Studies in Language, 36, 103-124.
Just, Marcel A. and Carpenter, Patricia A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87 (4), 329-354. https://psycnet.apa.org/doi/10.1037/0033-295X.87.4.329
Kelly, Dorothy A. (2002). Un modelo de competencia traductora: bases para el diseño curricular. Puentes, 1, 9-20.
Kelly, Dorothy A. (2007). Translator competence contextualized, translator training in the framework of higher education reform: In search of alignment in curricular design. In Dorothy Kenny and Kyongjoo Ryou (Eds.), Across Boundaries: International Perspectives on Translation Studies (pp. 128-142). Cambridge Scholars Publishing.
O’Brien, Sharon (2009). Eye tracking in translation process research: methodological challenges and solutions. In Inger M. Mees, Fabio Alves, and Susanne Göpferich, Susanne (Eds.), Methodology, Technology and Innovation in Translation Process Research (pp. 251-266). Samfundslitteratur.
PACTE (2000). Acquiring translation competence: Hypotheses and methodological problems in a research project. In Allison Beeby, Doris Ensingerand MarisaPresas (Eds.), Investigating Translation (pp. 99-106). John Benjamins.
PACTE (2003). Building a translation competence model. In Fabio Alves (Ed.), Triangulating Translation: Perspectives in Process Oriented Research (pp. 43-66). John Benjamins. https://doi.org/10.1075/ btl.45.06pac
Paloposki, Outi (2016). Translating and translators before the professional project. JoSTrans. The Journal of Specialised Translation, 25, 15-32. https://doi.org/10.26034/cm.jostrans.2016.297
Pavlović, Natasa and Hvelplund Jensen, Kristian T. (2009). Eye tracking translation directionality. Translation Research Projects, 2, 93-109.
Schaeffer, Moritz, Nitzke, Jean, Tardel, Anke, Oster, Katharina, Gutermuth, Silke, and Hansen-Schirra, Silvia (2019). Eye-tracking revision processes of translation students and professional translators. Perspectives, 27 (4), 589-603. https://doi.org/10.1080/0907676X.20 19.1597138
Schäffner, Christina and Shuttleworth, Mark (2013). Metaphor in translation: Possibilities for process research. Target, 25 (1), 93-106. https://doi.org/10.1075/target.25.1.08shu
Sharmin, Selina, Špakov, Oleg, Räihä, Kari-Jouko, and Jakobsen, Arnt Lykke (2008). Where on the screen do translation students look while translating, and for how long? In Susanne Göpferich,, Arnt Lykke Jakobsen, and Inger M. Mees (Eds.), Looking at Eyes. Eye-Tracking Studies of Reading and Translation Processing (pp. 31-51). Samfundslitteratur.
Walker, Callum (2021). An Eye-Tracking Study of Equivalent Effect in Translation: The Reader Experience of Literary Style. Palgrave Macmillan. https://doi.org/10.1007/978-3-030-55769-0
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
The articles published at Hermēneus. Revista de Traducción e Interpretación will have a Creative Commons Attribution 4.0 International License (CC BY 4.0).
The journal allows the authors to retain publishing rights. Authors may reprint their articles in other media without having to request authorization, provided they indicate that the article was originally published in Hermēneus. Revista de Traducción e Interpretación.
