Formal versus Informal Diagnostic Formative Assessment and EFL Learners’ Speaking Fluency and Accuracy

مقالات آماده انتشار

نوع مقاله : مقاله تحقیق

نویسندگان
Mohammad Mahdi Hajmalek 1
Mona Bakhshizadeh 2
1 Assistant Professor in TEFL, English Language Department, Khatam University
2 Khatam University
چکیده
Diagnostic Formative Assessment (DFA) has already established its applicability and necessity in second language teaching practice and research as a legitimate supplement to summative assessment. However, examples of practical implementations of DFA informing SLA research and an investigation of the detailed processes involved, especially when it comes to productive skills such as speaking in tertiary educational settings are rather scarce. Therefore, focusing on the formality dimension, as a rather neglected component in DFA, the present quasi-experimental study set out to compare the effects of formal and informal DFA on Iranian EFL learners’ oral fluency and accuracy at university level. For this purpose, a homogeneous group of 52 male and female L2 learners were assigned to two experimental conditions and after a speaking pre-test developed and scored based on IELTS speaking tasks, went through four months of formal and informal DFA based on four reiterative stages of Observation, Initial Assessment, Hypothesis Checking, and Decision Making. Upon the post-test, the results of ANCOVAs showed that both treatments equally contributed to learners’ development of oral fluency and accuracy, indicating that traditional skepticisms towards informal DFA must be revisited and they can serve as appropriate supplements to more formal approaches whenever necessitated by the instruction. EFL practitioners are recommended to take these rather broad, flexible, and convenient informal DFA practices into consideration and decide on their exact choices based on the particularities of the context, situation, and individual learners, which leads to an expansion in their pedagogical options.

کلیدواژه‌ها

موضوعات

Abdulaal, M. A. A. D., Alenazi, M. H., Tajuddin, A. J. A., & Hamidi, B. (2022). Dynamic vs. diagnostic assessment: Impacts on EFL learners’ speaking fluency and accuracy, learning anxiety, and cognitive load. Language Testing in Asia, 12(32), 1–24. https://doi.org/10.1186/s40468-022-00179-0
Ahmadi, A., & Sadeghi, E. (2016). Assessing English language learners’ oral performance: A comparison of monologue, interview, and group oral test. Language Assessment Quarterly, 13(4), 341–358. https://doi.org/10.1080/15434303.2016.1236797
Alderson, J. C., Brunfaut, T., & Harding, L. (2015). Towards a theory of diagnosis in second and foreign language assessment: Insights from professional practice across diverse fields. Applied Linguistics, 36(2), 236–260. https://doi.org/10.1093/applin/amt046
Aryadoust, V., Zakaria, A., Lim, M. H. & Chen, C. (2020). An extensive knowledge mapping review of measurement and validity in language assessment and SLA research. Frontiers in Psychology, 11: 1941, 1–29. https://doi.org/10.3389/fpsyg.2020.01941
Asamoah, D., Shahrill, M., & Abdul Latif, S. (2022). A review of formative assessment techniques in higher education during COVID-19. The Qualitative Report, 27(2), 475–487. https://doi.org/10.46743/2160-3715/2022.5145
Azmoode Sis Abad, M., Kiany, G. R., & Abassian, G. R. (2024). Diagnostic assessment of interactional competence in paired speaking tests: Investigating rating accuracy of Iranian EFL learners. Language and Translation, 14(1), 19–33. https://doi.org/10.30495/ttlt.2024.709364
Bachman, L., & Palmer, A. (2022). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
Brown, H. D. (2010). Language assessment: Principles and classroom practices. Pearson Longman.
Can Daşkın, N., & Hatipoğlu, Ç. (2019). Reference to a past learning event as a practice of informal formative assessment in L2 classroom interaction. Language Testing, 36(4), 527–551. https://doi.org/10.1177/0265532219857066
Cumming, A. (2015). Design in four diagnostic language assessments. Language Testing, 32(3), 407–416. https://doi.org/10.1177/0265532214559115
Dai, H. (2024). The construction of a learning-oriented speaking assessment model in college English based on the online diagnostic assessment. Journal of Contemporary Educational Research, 8(2), 26–33. https://doi.org/10.26689/jcer.v8i2.6143
Derakhshan, A., & Shakki, F. (2016). The effect of dynamic assessment on elementary EFL learners’ listening comprehension through mediational strategies. International Journal of English Language & Translation Studies, 4(2), 29–45.
Doe, C. (2015). Student interpretations of diagnostic feedback. Language Assessment Quarterly, 12(1), 110–135. https://doi.org/10.1080/15434303.2014.1002925
Ebadijalal, M., & Yousofi, N. (2021). The impact of mobile-assisted peer feedback on EFL learners’ speaking performance and anxiety: Does language make a difference? The Language Learning Journal, 51(1), 112–130. https://doi.org/10.1080/09571736.2021.1957990
Evans, A. (2009). No Child Left Behind and the quest for educational equity: The role of teachers’ collective sense of efficacy. Leadership and Policy in Schools, 8(1), 64–91. https://doi.org/10.1080/15700760802416081
Fan, J. & Yan, X. (2020) Assessing speaking proficiency: A narrative review of speaking assessment research within the argument-based validation framework. Frontiers in Psychology, 11:330, 1–14. https://doi.org/10.3389/fpsyg.2020.00330
Fan, T., Song, J. & Guan, Z. (2021). Integrating diagnostic assessment into curriculum: A theoretical framework and teaching practices. Language Testing in Asia 11(2), 1–23. https://doi.org/10.1186/s40468-020-00117-y
Farhady, H., & Selçuk, M. (2022). Classroom-based diagnostic assessment practices of EFL instructors. Iranian Journal of Language Teaching Research, 10(2), 77–94. https://doi.org/10.30466/ijltr.2022.121184
Gan, Z., & Leung, C. (2020). Illustrating formative assessment in task-based language teaching. ELT Journal, 74(1), 10–19. https://doi.org/10.1093/elt/ccz048
Harding, L., Alderson, J. C., & Brunfaut, T. (2015). Diagnostic assessment of reading and listening in a second or foreign language: Elaborating on diagnostic principles. Language Testing, 32(3), 317–336. https://doi.org/10.1177/0265532214564505
Hill, K., & McNamara, T. (2012). Developing a comprehensive, empirically based research framework for classroom-based assessment. Language Testing, 29(3), 395–420. https://doi.org/10.1177/0265532211428317
Ismail, S.M., Rahul, D. R., Patra, I., & Rezvani, E. (2022). Formative vs. summative assessment: Impacts on academic motivation, attitude toward learning, test anxiety, and self-regulation skill. Language Testing in Asia, 12(40), 1–23. https://doi.org/10.1186/s40468-022-00191-4
Jang, E. E., & Sinclair, J. (2022). Diagnostic assessment in language classrooms. In G. Fulcher & L. Harding (Eds.), The Routledge handbook of language testing (2nd ed., pp. 187–205). Routledge.
Jin, K. Y., & Eckes, T. (2024). Measuring the impact of peer interaction in group oral assessments with an extended many‐facet Rasch model. Journal of Educational Measurement, 61(1), 47–68. https://doi.org/10.1111/jedm.12375
Kazemi, N., & Tavassoli, K. (2020). The comparative effect of dynamic vs. diagnostic assessment on EFL learners’ speaking ability. Research in English Language pedagogy, 8(2), 223–241. https://doi.org/10.30486/relp.2019.1878561.1155
Kemp, S., & Scaife, J. (2012). Misunderstood and neglected? Diagnostic and formative assessment practices of lecturers. Journal of Education for Teaching, 38(2), 181–192. https://doi.org/10.1080/02607476.2012.656443
Lee, Y. W. (2015). Diagnosing diagnostic language assessment. Language Testing, 32(3), 299–316. https://doi.org/10.1177/0265532214565387
Leung, C. (2024). Classroom-based assessment issues for language teacher education. In A. J., Kunnan (Ed.), The concise companion to language assessment (pp. 303–311). Wiley Blackwell.
Lipnevich, A. A. & Panadero, E. (2021). A review of feedback models and theories: Descriptions, definitions, and conclusions. Frontiers in Education, 6:720195, 1–29. https://doi.org/10.3389/feduc.2021.720195
Martin, S., & Alvarez Valdivia, I. M. (2017). Students’ feedback beliefs and anxiety in online foreign language oral tasks. International Journal of Educational Technology in Higher Education, 14: 18, 1–15. https://doi.org/10.1186/s41239-017-0056-z
Mathur, M., & Mahapatra, S. (2022). Impact of ePortfolio assessment as an instructional strategy on students’ academic speaking skills: An experimental study. Computer-Assisted Language Learning Electronic Journal (CALL-EJ), 23(3), 1–23.
May, L., Nakatsuhara, F., Lam, D., & Galaczi, E. (2020). Developing tools for learning oriented assessment of interactional competence: Bridging theory and practice. Language Testing, 37(2), 165–188. https://doi.org/10.1177/0265532219879044
McKay, P. (2006). Assessing young language learners. Cambridge University Press.
Milawati, M., Saukah, A., Suharmanto, S. & Suryati, N. (2021). Characterizing Indonesian EFL teachers' questioning as informal formative assessment strategy. Pegem Journal of Education and Instruction, 11(3), 112–124. Retrieved from https://www.pegegog.net/index.php/pegegog/article/view/1356
Nakatsuhara, F., Khabbazbashi, N., & Inoue, C. (2022). Assessing speaking. In G. Fulcher & L. Harding (Eds.), The Routledge handbook of language testing (2nd ed., pp. 209–222). Routledge. https://doi.org/10.4324/9781003220756-17
O’Keeffe, L., Rosa, A., Vannini, I., & White, B. (2020). Promote informal formative assessment practices in higher education: The potential of video analysis as a training tool. Form@ re-Open Journal per la formazione in rete, 20(1), 43–61. https://doi.org/10.13128/form-8241
Pallant, J. (2020). SPSS survival manual: A step by step guide to data analysis using IBM SPSS (7th ed.). Routledge. https://doi.org/10.4324/9781003117452
Ruiz-Primo, M. A. (2011). Informal formative assessment: The role of instructional dialogues in assessing students’ learning. Studies in Educational Evaluation, 37(1), 15–24. https://doi.org/10.1016/j.stueduc.2011.04.003
Scaife, J., & Wellington, J. (2010). Varying perspectives and practices in formative and diagnostic assessment: A case study. Journal of Education for Teaching, 36(2), 137–151. https://doi.org/10.1080/02607471003651656
Schildkamp, K., van der Kleij, F. M., Heitink, M. C., Kippers, W. B., & Veldkamp, B. P. (2020). Formative assessment: A systematic review of critical teacher prerequisites for classroom practice. International Journal of Educational Research, 103, 101602. https://doi.org/10.1016/j.ijer.2020.101602
Shakki, F., Derakhshan, A., & Ziabari, R. S. (2016). The interplay between language skills and dynamic assessment. International Journal of Linguistics, 8(2), 141–157.
Spinelli, C. G. (2008). Introduction: The benefits, uses, and practical application of informal assessment procedures. Reading & Writing Quarterly, 24(1), 1–6. https://doi.org/10.1080/10573560701753005
Sun, H., & Kang, Y. (2022). A Review of cognitive diagnosis assessment in language from 2000 to 2021: A visualized analysis with CiteSpace II. Journal of Humanities and Social Sciences Studies, 4(3), 182–191. https://doi.org/10.32996/jhsss.2022.4.3.17
Turner, C. E., & Purpura, J. E. (2016). Learning-oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 255–274). De Gruyter Mouton. https://doi.org/10.1515/9781614513827-018
Van der Kleij, F. M., Vermeulen, J. A., Schildkamp, K., & Eggen, T. J. H. M. (2015). Integrating data-based decision making, assessment for learning and diagnostic testing in formative assessment. Assessment in Education: Principles, Policy & Practice, 22(3), 324–343. https://doi.org/10.1080/0969594X.2014.999024
Wiliam, D. (2011). Embedded formative assessment. Solution Tree Press.
جستارهای زبانی

مقالات آماده انتشار، پذیرفته شده
انتشار آنلاین از 22 تیر 1404