Eye Tracking Function and Content Words in Persian Subtitles

Document Type : مقالات علمی پژوهشی

Authors
S. Zahedi 1
M. Khoshsaligheh 2
1 Ph.D. Candidate in Translation Studies- Department of English Language- Ferdowsi University –Mashhad –Iran.
2 Associate Professor of Translation Studies- Department of English Language- Ferdowsi University –Mashhad –Iran.
Abstract
Introduction

Eye-tracking research on language, media and translation has gained ground over the last three decades. Due to their multi-semiotic nature, subtitles have been the subject of a number of eye-tracking studies. Many influential factors such as stylistic features, translation method, lexical frequency, etc. have been analyzed. However, there is still an exponential need for further research on this area, especially in the context of Persian language.


Research Objectives

This research aims to compare the attention given to function and content words in Persian subtitles by analyzing four eye-tracking data.


Research Questions

Is there any significant difference between attention allocation to function and content words in Persian subtitles in terms of four eye data (fixation duration, fixation number, first fixation duration and skipping)?


Research Hypothesis

H: Fixation duration, fixation number and first fixation duration are significantly larger for content words compared to function words, while the number of skipped function words is significantly higher compared to content words.


Method

Forty random participants (23 females and 17 males) participated in the study randomly. They had normal or corrected-to-normal vision. A written consent was obtained from the participants prior to the experiment. A scene of Elle was chosen as stimuli for the experiment. The subtitles were made by Subtitle Edit Software. SMI eye tracking device with a sampling rate of 60 Hz was used to collect the eye data after performing a three-point calibration. The areas of interest were determined and BeGaze software was used to extract the data. Finally, the eye data were examined in SPSS software.


Conclusion

The results of the test showed that there was a significant difference in attention allocation to lexical and functional words. The fixation duration, fixation number and first fixation duration were significantly larger for the content words compared to the function words, while the number of the skipped function words was significantly higher compared to the content words.

Keywords

Subjects

• بامشادی، پارسا و قطره، فریبا. (1396). چندمعنایی پسوند «-ی» فارسی: کندوکاوی در چهارچوب ساختواژه ساختی. جستارهای زبانی. د. 8. ش 7 (پیاپی 42). صص 265-285.
• آزادفلاح، نفیسه؛ شریفی، مسعود و حیدری، محمود. (1396). اثر طول کلمه و نوع حروف چاپی (فونت) بر حرکات چشم (تثبیت، جهش، واپسگرد) در حین خواندن متن آشنا و ناآشنا. روانشناسی معاصر. س 11. ش 2. صص 67-80.
References
• Aaronson, D., & Scarborogh, H.S. (1976). “Performance theories for sentence coding: some qualitative evidence. Journal of Experimental Psychology: Human Perception and Performance, 2, Pp. 56-70.
• Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Grammar of spoken and written English. London: Longman.
• Booij, G. (2005). The Grammar of Words. New York: Oxford University Press.
• Bradley, D.C. (1978). Computational distinction of vocabulary type. Unpublished doctoral dissertation. Massachesetts Institute of Technology.
• Carpenter, P., & Just, M. A. (1983). “What your eyes do while your mind is reading”. In K. Rayner (Ed.), Eye Movements in Reading: Perceptual and Language Processes (Pp. 275–307). New York, NY: Academic Press.
• D’Ydewalle, G., & De Bruycker. W. (2007). “Eye Movements of Children and Adults While Reading Television Subtitles”. Journal of European Psychologist. 12, Pp.196–205.
• D’Ydewalle, G., & Gielen. I. (1992). “Attention allocation with overlapping sound, image, and text”. In K. Rayner (Ed.), Eye Movements and Visual Cognition: Scene Perception and Reading (Pp. 415–427). New York.
• D’Ydewalle, G., Rensbergen, J. V., & Pollet, J. (1987). “Reading a message when the same message is available auditorily in another language: The case of subtitling”. In J. K. O’Reagan & A. Lévy-Schoen (Eds.), Eye Movements: From Physiology to Cognition (Pp. 313–321). Amsterdam/ New York.
• D'Ydewalle, G., Praet , C.., Verfaillie, K., & van Rensbergen, J. (1991). “Watching Subtitled Television: Automatic Reading Behaviour”. Journal of Communication Research. 18, Pp. 650–666.
• Díaz Cintas, J., & Remael, A. (2007). Audiovisual Translation: Subtitling. Manchester: St. Jerome Publishing.
• Duchowski, T.A. (2017). Eye Tracking Methodology. Cham: Springer.
• Fisher, D.F., & Shebilske, W.L. (1985). “There is more that meets the eye than the eye–mind assumption”. In R. Groner, G.W. McConkie & C. Menz (Eds.), Eye Movements and Human Information Processing (Pp. 149-158). Amsterdam/New York: Elsevier Publishing Co.
• Ghia, E. (2012). “The impact of translation strategies on subtitle reading”. In E. Perego (Ed.), Eye-tracking in Audiovisual Translation (Pp. 157-182). Rome: Arcane.
• Gough, P. B. (1983). “Context, form and interaction”. In K. Rayner (Ed.), Eye Movements in Reading (Pp. 225-253). New York: Academic Press.
• Hatta, T., Kawakam, A., & Deguchi, T. (1999). “Visual field effects on processing of Japanese content and function words: possibility of orthographic effects”. Asia Pacific Journal of Speech, Language and Hearing, 4:1, Pp. 1-12
• Henderson, J.M., & Ferreira, F. (1993). “Eye movement control during reading: Fixation measures reflect foveal but not parafoveal processing difficulty”. Canadian Journal of Experimental Psycholoy, 47, Pp. 201-221.
• Hogaboam, T.W., & McConki, G.W. (1981). “The rocky road from eye fixations to comprehension”. Technical Report 207, Center for the Study of reading, University of Illinois at Urbana-Champaign.
• Holmes, V.M., & O’Regan, J.K. (1981). “Eye fixation patterns during the reading of relative-clause sentences”. Journal of Verbal Learning and Verbal Behavior, 20, Pp. 417-430.
• Hvelplund, K. T. (2017). “Eye Tracking in Translation Process Research”. In J. W. Schwieter, & A. Ferreira (Eds.), The Handbook of Translation and Cognition (Pp. 248-264). Wiley-Blackwell.
• Ivarsson, J., & Carroll, M. (1998). Subtitling. Simrishamn: TransEdit HB.
• Just, M.A., & Carpenter, P.A. (1980). “A theory of reading: From eye fixations to comprehension”. Psychological Review, (87), Pp. 329-354.
• Krejtz, I., Szarkowska, A. & Krejtz, K. (2013). “The effects of shot changes on eye movements in subtitling”. Journal of Eye Movement Research, 6(5):3, Pp. 1-12.
• Krejtz, I., Szarkowska, A. & Krejtz, K. (2013). “The effects of shot changes on eye movements in subtitling”. Journal of Eye Movement Research, 6(5):3, Pp. 1-12.
• Krejtz, I., Szarkowska, A., & Łogińska, M. (2016). “Reading Function and Content Words in Subtitled Videos”. The Journal of Deaf Studies and Deaf Education, 21(2), Pp. 222–232.
• Kruger, J., Doherty, S., & Soto Sanfiel, T. (2017). “Original Language Subtitles: Their Effects on the Native and Foreign Viewer”. Media Education Research Journal. 50, Pp. 23-32.
• Kruger, J., Szarkowska, Ag. & Krejtz, I. (2015). “Subtitles on the Moving Image: An Overview of Eye Tracking Studies”. Refractory: A journal of Entertainment Media. 25.
• Levi, D. M., Klein, S. A., & Aitsebaomo, A. P. (1985). “Vernier acuity, crowding andcortical magnification”. Vision Research, 25(7), Pp. 963-977.
• Moran, S. (2012). “The effect of linguistic variation on subtitle reading”. In E. Perego (Ed.), Eye-tracking in Audiovisual Translation (Pp. 183-222). Rome: Arcane.
• O’Regan, J.K. (1975). Structural and Contextual Constraints on Eye Movements in Reading. Unpublished doctoral thesis, University of Cambridge.
• O’Regan, J.K. (1979). “Saccade size control in reading: Evidence for the linguistic control hypothesis. Perception & and Psychology, 25, Pp. 501-509.
• Pavlović, N. & Jensen, K. T. H. & (2009). Eye Tracking Translation Directionality. In A. Pym and Perekrestenko (Eds.), Translation Research Projects 2 (Pp. 93-110). Tarragona:
• Intercultural Studies Group.
• Pernice, K., & Nielsen, J. (2009). How to Conduct Eye Tracking Studies? Nielsen Norman Group.
• Pollatsek, A., Reichle, E.D., & Rayner, K. (2006). “Tests of the E–Z Reader Model: Exploring the Interface between Cognition and Eye–Movement Control”. Cognitive Psychology, 52, Pp. 1-52.
• Rayner, K. (1998). “Eye movements in reading and information processing: Twenty years of research”. Psychological Bulletin Journal, 124, Pp. 372–422.
• Rayner, K., & McConkie, G. W. (1976). “What guides a reader’s eye movements?” Vision Research, 16, Pp. 829–837.
• Rayner, K., and Duffy. S.A. (1988). “On-line comprehension processes and eye movements in reading”. In M. Daneman, G.E. MacKinnon, & T.G. Waller (Eds), Reading Research: Advances in Theory and Practice (Pp. 13-66). New York.
• Rayner, K., Pollatsek, A., Ashby, J., & Clifton, Ch., Jr. (2012). Psychology of reading (2nd ed.). New York, NY: Psychology Press.
• Roy-Charland, A., Saint-Aubin, J., Klein, M. R., Maclean, G.H., Lalande, A., & Belanger, A. (2012). “Eye movements when reading: The importance of the word to the left of fixation”. Visual Cognition, 20 (3), Pp. 328-355.
• Schmauder, A.R., Morris, R. K., & Poynor, D. V. (2000). “Lexical processing and text integration of function and content words: Evidence from priming and eye fixations”. Memory & Cognition, 28 (7), Pp. 1098-1108.
• Schotter, E.R., & Rayner, K. (2012). “Eye movements in reading: Implication for reading subtitles”. In E. Perego (Ed.), Eye tracking in Audiovisual Translation (Pp. 83-104). Rome: Arcane.
• Segalowitz, S. J., & Lane, K. C. (2000). “Lexical access of function versus content words”. Brain and Language Journal, 75, Pp. 376–389.
• Slowiaczek, M.L. (1983). “What does the mind do while the eyes are gazing?” In K. Rayner (Ed.), Eye movements in Reading: Perceptual and Language Processes (Pp. 345–356). New York, NY: Academic Press.
• Smith, F. (2004). Understanding Reading. Hillsdale, NJ: Lawrence Erlbaum.
• Szarkowska, A., Krejtz, I., Krejtz, K., & Duchowski, A. (2013). “Harnessing the potential of eye-tracking for media accessibility”. In S. Grucza, M. Płużyńska, J. Zając, S. Grucza, M. Płużyńska, & J. Zając (Eds.), Translation Studies and Eye-Tracking Analysis. (Pp. 153–184). Peter Lang Verlag.
• Taylor, C. (2012). “Multimodal texts”. In E. Perego (Ed.), Eye-tracking in Audiovisual Translation (Pp. 13-36). Rome: Arcane.
• Teixeira, C. (2014). “Data collection methods for researching the interaction between translators and translation tools – An ecological approach”. In J. Schwieter & A. Ferreira (Eds.), The Development of Translation Competence: Theories and Methodologies from Psycholinguistics and Cognitive Science (Pp. 269-286). Cambridge Scholar.
• Tuinman, J., & Gray, G. (1972). “The effect of reducing the redundancy of written messages by deletion of function words”. Journal of Psychology. 82, Pp. 299-306.
Language Related Research
Volume 10, Issue 4 - Serial Number 52
September and October 2019
Pages 313-338