مطالعه‌ی عوامل حمایت‌کننده‌ی روایی محتوی در آزمون چهار‌گزینه‌ای درک‌مطلب EPT از دیدگاه مولفه‌محور

نوع مقاله : مقالات علمی پژوهشی

نویسندگان
1 دانشجوی دکتری آموزش زبان انگلیسی، دانشگاه آزاد اسلامی، ملایر، ایران
2 استادیار گروه آموزش زبان انگیسی، دانشگاه آزاد اسلامی، ملایر، ایران
چکیده
دراین پژوهش، به بررسی عوامل حمایت‌کننده‌ی روایی قسمتی از بخش درک‌مطلب آزمون استاندارد ای‌پی‌تی که هر ماه در ایران برگزار می‌شود می‌پردازیم، وبا اختصاص هر یک از سوالات آن، به یکی از مولفه‌های موثرشناخته‌شده در درک‌مطلب، سعی بر تحلیل آن می‌کنیم. توانایی ما در خواندن در زبان دوم، در ابتدا، به میزان آشنایی ما با دانش متنی که همان کلمات و دستور‌زبان هدف است بستگی‌دارد؛ و سپس تحت تاثیر دانش غیر‌متنی ماست؛ که اگر ارزیابی این توانایی با «دانش غیر‌متنی» ما، بیش از میزان هنجار آن آمیخته گردد؛ نتیجه‌ی حاصله اعتبار استاندارد سوال را تامین نخواهدکرد. ازآنجایی که آزمون‌های سرنوشت‌سازی[i] مانند EPT برای آزمون‌دهندگان با تجربیات و دیگر توانایی‌های شناختی متفاوت فردی طراحی می‌شوند، متوازن‌ساختن این مداخله ما را به نتایج مطلوب‌تری خواهد‌رساند. 85 سوال از 22 متن علمی‌توضیحی به‌طور تصادفی انتخاب شدند، و 150 آزمون‌ورخانم فارغ‌التحصیل رشته‌های نظری علوم‌انسانی، تجربی، و ریاضی از شهرستان ملایر در آزمون شرکت‌کردند. داده‌ها با استفاده از تحلیل آماری همبستگی پیرسون، نسبت خصیصه‌ی متفاوت-خصیصه‌ی یکسان، تحلیل آماری اکتشافی، و مدل تعدیل جزئی بررسی گردیدند. نتایج حاصله نشان‌داد که دانش غیر‌متنی در آزمون، تاثیر معنی‌دار و بیش از حد انتظاری نشان‌می‌دهد.معلمان، مدرسان، و موسسه‌های مجری طراحی آزمونهای استاندارد در زبان دوم، از نتایج تحقیق حاضر استفاده خواهند‌کرد.


[i] High-stake tests



کلیدواژه‌ها

موضوعات


Abdelaal, N. M., & Sase, A. S., (2014). Relationship between prior knowledge and reading comprehension. Advances in Language and Literary Studies, 5(6), 125-131.
Adams, M. J., & Collins, A. (1977). A schema-theoretic view of reading comprehension (Report No. 032).Center for the Study of Reading Technical Report.
Amirian, M. R., Heshmatifar, Z., Zareian, Gh. & Davoudi, M. ((2018. Qualitative analysis of the factors affecting participation in English language preparation courses of the Ministry of Science, Research and Technology (MSRT): A data-driven approach. Linguistic Research in Foreign Languages, 8 (1), 27-56.
August, D., & Shanahan, T. (2010).Developing literacy in second-language learners: Report of the national literacy panel on language-minority children and youth. Journal of Literacy Research, 42(3), 341-348.
Alderson, J. C. (2000). Assessing reading. Cambridge: Cambridge University Press.
------------, Clapham C., & Wall, D. (2005). Language test construction and evaluation. Cambridge: Cambridge University Press.
Bachman, L. F. (1990). Fundamental considerations in language testing. New York: Oxford University Press.
Black, P., & William, D. (1998). Assessment and Classroom Learning: Assessment in Education. Assessment in Education, 5, 7-74.
Brame, C., & Biel, R. (2015). Test-enhanced learning: The potential for testing to promote greater learning in undergraduate science courses. CBE Life Sciences Education,14 (2), 1-12.
Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals. New York: Longman University Press.
Carr, J. F., & Harris, D. E. (2001). Succeeding with standards linking curriculum, assessment, and action planning. Alexandria Virginia: Association for Supervision and Curriculum Development.
Caldwell J. S. (2008). Comprehension assessment: A classroom guide. New York: Guilford Publication Press.
Chehrzad, M.H., & Ajideh, P. (2013). Effects of different response types on Iranian EFL test-takers' performance. Iranian Journal of Applied Language Studies, 5 (2), 29-50.
Coady, J. (1979). A psycholinguistic model for the ESL reader. In R. MacKay, B. Barkman, & R. R. Jordan (Eds.), Reading in a second language: Hypothesis, organization and practice (pp. 5-12).Newbury House.
Council of Europe. (2011). Manual for language test development and examining: ALTE. Strasburg. Language Policy Division.
Davis, A. (1968). Language testing symposium: A psycholinguistic approach. London: Oxford University Press.
Estaji, M. (2020). Does field of study matter in academic performance: Differential item functioning analysis of a high-stakes test using one-parameter and two-parameter item response theory models. Iranian Journal of English for Academic Purposes, 9(3), 14-31.
Farhadi, H., & Hessami, G. R. (2005). Construct validity of L2 reading comprehension skills. International Journal of Applied Linguistics.8(2), 29-53.
Fletcher, J. M. (2006). Measuring reading comprehension. Scientific Studies of Reading, 10, 323-330.
Garson, G. D. (2016). Partial least squares: Regression and structural equation models. Asheboro, NC: Statistical Associates Publishers.
Grabe, W. (1991). Current developments in second language reading research. TESOL Quarterly, 25, 375-406.
------------ (2009). Reading in a second language: Moving from theory to practice. Cambridge: Cambridge University Press.
Hair, J. F., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM). Sage publications.
Hedge, T., (2003). Teaching & learning in the language classroom. UK: OUP.
Hemmati, S. J., Baghaei, P., Bemani, M. (2016). Cognitive diagnostic modeling of L2 reading comprehension ability: providing feedback on the reading performance of Iranian candidates for the university entrance examination. International Journal of Language Testing, 6(2), 92-100.
Hoover, W. A., & Tunmer, W. E. (1993). The components of reading. In G. G. Thompson, W. E. Tunmer, & T. Nicholson (Eds.), Reading acquisition processes (pp. 1-19). Multilingual Matters.
Jabbari, S., Khademi, M. (2013). Creating a diagnostic test for reading comprehension of elementary school students. Curriculum Research, 3 (2), 33-51.
Jafarpour, A. J. (1996). Introduction to Language Testing. Shiraz: Shiraz University Press.
Kaplan, R. M., & Saccuzzo, D. P. (2001). Psychological testing: Principles, applications, and issues (5th Ed.). Belmont, CA: Wadsworth.
Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York: Cambridge University Press.
Laufer, B. (1992). Reading in a foreign language: How does L2 lexical knowledge interact with the reader’s general academic ability?. Journal of Research in Reading, 15(1), 95-103.
Linn, R. L., & Gronlund, N. E. (2000). Measurement and assessment in teaching (8th Ed.). Columbus, OH: Merrill, Prentice Hall.
Lunzer, E., Waite, M., & Dolan, T. (1979). Comprehension and comprehension test. In E. Lunzer & K. Gardner (Eds.), The effective use of reading (pp. 37-71). Heinemann Educational Books Ltd.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement (pp. 13-103). Macmillan.
Munby, J. (1978). Communicative syllabus design. Cambridge: Cambridge University Press.
Nunan, D. (1991). Language teaching methodology. London: Prentice-Hall.
Palomba, C. & Banta, T.W. (1999) Assessment essentials: Planning, implementing, and improving assessment in higher education. San Francisco: Jossey-Bass Publishers.
Paris, S. G., & Hamilton, E. E. (2009). The development of children’s reading comprehension. In S. E. Israel & G. G. Duffy (Eds.), Handbook of research on reading comprehension (pp.32-53). Routledge.
Pasquarella, A., Gottardo, A., & Grant, A.(2012). Comparing factors related to reading comprehension in adolescents who speak English as first (L1) or second (L2) languages. Scientific Studies of Reading, 1(6), 1-29.
Perfetti, C. (1985). Reading ability. New York: Oxford University Press.
--------------, Landi, N., & Oakhill, J. (2005). The acquisition of reading comprehension skills. In M. J. Snowling & C. Hulme (Eds.), The science of reading: a handbook (pp. 227-247). Blackwell.
-------------- (2007). Reading ability: Lexical quality to comprehension. Scientific Studies of Reading, 8, 293-304.
Quellette, G. P., (2006). What’s meaning got to do with it: The role of vocabulary in word reading and reading comprehension. Journal of Educational Psychology. 98(3), 554-566.
RAND Reading Study Group. (2002). Reading for understanding: Towards an R&D program in reading comprehension. OERI.
Ranjbaran, F. & Alavi, S. M. (2017). Developing a reading comprehension test for cognitive diagnostic assessment: A RUM analysis .Studies In Educational Evaluation, 55, 167-179.
Rogde, K., Hagen, A. M., Melby-Lervag, M., & Lervag, A. (2019). The effect of linguistic comprehension instruction on generalized language and reading comprehension skills: A systematic review. Campbell Systematic Reviews, 15(4), 1-37.
Roohani, A., Dayeri, K., & Farhang Ju, M. (2017). Role of background knowledge in Iranian EFL learners' reading comprehension test performance. International Journal of Language Testing, 7(1), 28-39.
Rumelhart, D. (2004). Toward an interactive model of reading. In R. B. Rudell & N. J. Unrau (Eds.), Theoretical models and processes of reading. (pp. 1149-1179). International Reading Association.
Sahraei, R., & Mamaghani, H. (2012). Evaluation of the validity and reliability of the English language test of the Ministry of Science, Research and Technology. Educational Measurement Quarterly, 3 (10), 1-20.
Schoonen, R., Hulstijn, J., & Bossers, B. (1998). Meracognitive and language-specific knowledge in native and foreign language reading comprehension: An empirical study among Dutch students in grades 6, 8 and 10. Language Learning, 48(1), 71-106.
Shirvan, M., Ghonsooly, B., & Fatemi, A. (2016). The Effectiveness of strategy-based instruction in teaching English as a second or foreign Language: A meta-analysis of experimental studies. US-China Foreign Language, 14(3), 163-181.
Shahmirzadi, N., Siyyari, M., Marashi, H., & Geramipour, M. (2020). Test fairness analysis in reading comprehension PhD nationwide admission test items under CDA. Journal of Foreign Language Research,10(1), 152-165.
Sheybani, E., & Zeraatpishe, M. (2018). On the dimensionality of reading comprehension tests composed of text comprehension items and cloze test items. International Journal of Language Testing, 8(1), 12-26.
Sinclair, J. (1991). Corpus, concordance, collocation. Oxford: Oxford University Press.
Skehan, P. (1998). A cognitive approach to language learning. Oxford: Oxford University Press.
Stovich, K. E. (2000). Progress in understanding reading: Scientific foundations and new frontiers. New York: Guilford Press.
Urquhart, A. H., & Weir, C. J. (1998). Reading in a second language: Process, product, and practice. New York: Longman.
Vandergrift, L., & Goh, C. C. M. (2012). Teaching and learning second language listening: Metacognition in action. New York: Routledge.
Van der Walt, J. L., & Steyn, H. S. (2008). The validation of language tests. Stellenbosch Papers in Linguistics, 38, 191-204.
Van Dijk, T. A. (1977). Text and context: Explorations in the semantics of text. London: Longman.
Weir, C. J. (2005). Language test validation: An evidence-based approach. Oxford: Palgrave.
Zandi, H., Keivanpanah, S., & Alavi, S. M.(2014).The effect of test specifications review on improving the quality of a test. Iranian Journal of Language Teaching Research, 2(1), 1-14.
Zarei, A. A. & Shakoori Nia, S. (2014). The effect of vocabulary, syntax, and discourse-oriented activities on short and long-term L2 reading comprehension. International Journal of Language and Linguistics, 1(1), 30-39.
Zhang, D. (2012). Vocabulary and grammar knowledge in second language reading comprehension: A structural equation modelling study. The Modern Language Journal, 96(4), 558-575.