A Comparative Study of McGurk Effect in Persian and Kermanshahi Kurdish Subjects

Authors
M. Asiaee 1
N. Hosseini Kivanani 2
M. Nourbakhsh 3
1 M.A. in linguistics at the University Zahra, Tehran, Iran
2 M.A. in linguistics at the University Al-Zahra, Tehran, Iran
3 Assistant Professor of Linguistics, University of Al-Zahra, Tehran, Iran
Abstract
McGurk effect is a perceptual phenomenon in which subjects use information from both auditory and visual modalities to come into a unified percept. In the classic example of McGurk, when auditory /bɑ/ is dubbed over the lip movements of /ɡɑ/ , subjects report perceiving /da/. Although this illusion is not considered a universal one, it is experienced by the majority of subjects. The effect had been the subject of multiple studies in different languages. The present study is the first survey which examines this effect in Persian and Kermanshahi Kurdish language. Our main question is to examine whether the effect is significant in Persian and Kermanshahi Kurdish language. We also investigated the effect of gender on the occurrence of this phenomenon. It investigated McGurk in Persian and Kermanshahi Kurdish subjects. 121 (11*11) audiovisual stimuli were presented to 120 subjects (60 Persian speakers and 60 Kermanshahi Kurdish speakers). The Results demonstrate a reduced McGurk effect in both Persian and Kermanshahi Kurdish subjects; however, the probability of its occurrence is significant in Kermanshahi Kurdish. The phenomenon is highly significant when an auditory labial CV is dubbed with a visual velar CV for Persian subjects; however, for Kermanshahi Kurdish subjects the effect was robust when an auditory velar CV is dubbed with a visual palatal CV. The effect of gender (both presenter and subjects) on the occurrence of this effect is also studied in this research. Results show significant effect of gender on audio-visual perception of consonants. However, if the percept happens, female presenters significantly affect the audio-visual perception of the subjects.

Keywords

  • آسیایی، مارال و ماندانا نوربخش (1391). «درک شنیداری- دیداری همخوان‌های زبان فارسی». مجموعه‌مقالات هشتمین همایش زبان‌شناسی ایران.به کوشش محمد دبیر‌مقدم. تهران: دانشگاه علامه طباطبایی.

  • مقدم­کیا، رضا (1385). «مقایسه مشخصه­های زبرزنجیری در زبان فارسی و ژاپنی». پژوهش زبان­های خارجی. ش 33. صص 167-183.

    • Allen, P. (2000). “Acoustics and psychoacoustics”. In Roeser, R. J., Valente, M., Hosford-Dunn, H., editors. Audiology Diagnosis. 1st edition. New York: Thieme Medical Publisher Inc. Pp. 80-153.

    •  Binnie, C. A.; A. A. Montgomery & P. L. Jackson. (1974). “Auditory and visual contributions to the perception of consonants”. Journal of Speech and Hearing Research. No.17. Pp. 619- 630.

    • Bovo, R.; A. Ciorba; S. Prosser & A. Martini. (2009). “The McGurk phenomenon in Italian listeners”. Acta Otorhinolaryngologica Italica. No. 29. Pp. 203-208.

    • Chen, T. H. & D. W. Massaro. (2004). “Mandarin speech perception by ear and eye follows a universal principle”. Perception & Psychophysics. 66/5. Pp. 820-836.

    • Chen, Y. & V. Hazan .(2009). “Developmental factor and the non native speaker effect in auditory-visual speech perception”. Journal of the Acoustical Society of America. 126/2. Pp. 858-865.

    •  Conrad, R. (1977). “Lip reading by deaf and hearing children”. British Journal of Educational  Psychology. 47/1. Pp. 60-65.

    • De Gelder, B. & J. Vroomen. (1992). “Auditory and visual speech perception in alphabetic and non-alphabetic Chinese/Dutch Bilinguals”. In: R. J. Harris (ed). Cognitive Processing in Bilinguals. Amsterdam: Elsevier. Pp. 413-426.

    •  Dodd, B. (1977). “The role of vision in the perception of speech”. Perception. 6/1. Pp. 31-40.

    • Fowler, C.A. & D.J. Dekle. (1991). “Listening with the eye and hand: Cross modal contributions to speech perception”. Journal of Experimental Psychology: Human Perception and Performance. 17/3. Pp. 816- 828.

    • Green, K. P.; P. K. Kuhl; A. N. Meltzoff & E. B. Estevens. (1991). “Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect”. Perception & Psychophysics, 50/6. Pp. 524-536.

    • Hayashi, Y. & K. Sekiyama.(1998). “Native-foreign language effect in the McGurk Effect: A test between Chinese and Japanese”. In Auditory- Visual Speech Processing (AVSP’ 98). Terrigal– Sydney: Austraila. In http://www.isca-speech.org/archive.

    • Hayward, K. (2000). Experimetal Phonetics. Harlow: Pearson education.

    • Hazan, V. & E. Li.(2008). “The effect of auditory and visual degradation on audiovisual perception of native and non-native speakers”. In: Proc. Interspeech. Pp. 1191-1194.

    • Hoffman, D. M. (1989). “Self and culture revisited: Culture acquisition among Iranians in the United States”. Ethos. 17 (1). Pp. 32-49.

    • Johnson, F. M.; L. H. Hicks; T. Goldberg & M. S. Myslobodsky. (1988). “Sex differences in lipreading”. Bulletin of the Psychonomic Society. 26/2. Pp. 106-108.

    • MacDonald, J. & H. McGurk. (1978). “Visual influences on speech perception processes”. Perception & Psychophysics. 24/3. Pp. 253- 257.

    • MacDonald, J.; S. Andersen & T. Bachmann. (2000). “Hearing by eye: how much spatial degradation can be tolerated?”. Perception. 29/10. Pp. 1155-1168.

    • McGurk. , H. & J. MacDonald. (1976). “Hearing lips and seeing voices”. Nature. No. 264. Pp. 746-748.

    • Massaro, D. W. (1984). “Children's perception of visual and auditory speech”. Child Development. 55/5. Pp. 1777-1788.

    • Massaro, D. W. .(1989). “Testing between the TRACE model and fuzzy logical model of speech perception”. Cognitive psychology. 21/3. Pp. 398-421.

    • Massaro, D. W. ; M. M. Cohen, A. Gesi & R. Heredia. (1993). “Bimodal speech perception: An examination across languages”. Journal of Phonetics. No.21. Pp. 445- 478.

    • Pelson, R. O. & W. F. Prather .(1974). “Effects of visual message related cues, age and hearing impairment on speech reading performance”. Journal of Speech and Hearing Research. Vol. 17. Pp. 518-525.

    • Sams, M.; P. Manninen; V. Surakka; P. Helin & R. Kättö .(1998). “McGurk effect in finnish syllables, isolated words, and words in sentences: Effects of word meaning and sentence context”. Speech Communication. Vol. 26. Pp. 75- 87.

    • Sekiyama, K. & Y. Tohkura. (1991). “McGurk Effect in non-english listeners: Few visual effects for Japanese subjects hearing Japanese syllables for high auditory intelligibility”. The Journal of the Acoustical Society of America.Vol.90. Pp. 1797- 1805.

    • Sekiyama, K. & Y. Tohkura.(1993). “Inter-Language differences in the influence of visual cues in speech perception”. Journal of Phonetics. 21/4. Pp. 427- 444.

    • Sekiyama, K. & Y. Tohkura& M. Umeda. (1996). “A few factors which affect the degree of incorporating lip- read information into speech perception”. Appears in Spoken Language, ICSLP 96. Proceedings., Fourth International Conferenceon. Vol. 3. Pp. 1481-1484.

    • Sekiyama, K. (1994). “Differences in auditory-visual speech perception between Japanese and Americans: Mcgurk effect as a function of incompatibility”. Journal of Acoustical Society of Japan (e). 15/3. Pp. 143-158.

    • Sekiyama, K. .(1997). “Cultural and Linguistic factors in audiovisual speech processing: the mcgurk effect in chinese subjects”. Perception & Psychophysics. 59/1. Pp. 73- 80.

    • Sekiyama, K.; D. Burnham; H. Tam & D. Erdener . (2003). “Auditory-visual speech perception development in Japanese and English speakers”. In AVSP. Pp. 43-47.

    • Werker, J. F., Frost P. E., McGurk H. LaLangue et Les Lèvres . (1992). “Cross-language influences on bimodal speech perception”. Canadian Journal of Psychology. 46/4. Pp. 551-568.




 


 

Language Related Research
Volume 7, Issue 3
July and August 2016
Pages 1-18