Test fairness and its components from the perspective of Persian language teachers to non-Persian speakers

Document Type : مقالات علمی پژوهشی

Authors
1 Assistant Professor of Farsi Language Education, Faculty of Humanities, Tarbiat Modares University
2 Doctoral student teaching Persian language to foreigners at Allameh Tabatabai Universityteaching Persian language to foreigners at Allameh Tabatabai University
Abstract
One of the challenges and important dimensions of assessment and evaluation in language teaching is test fairness, a broad concept that includes several factors and components. In the standards of educational and psychological assessment, test fairness means that there is no bias and advocacy and the same treatment with all subjects regardless of their race, religion, gender and age. The purpose of this study was to investigate the perception and attitude of Persian language instructors to non-Persian speakers about the definition of the concept of test fairness, essential components for a fair test and the general concept of test fairness. This research has been done by field and combined methods (quantitative and qualitative). 58 Persian language instructors for non-Persian speakers were selected by available sampling and participated as a statistical sample from the Persian language instructor’s community. Homayouni standard questionnaire (2015) was used to collect data, and SPSS version 23 were used for analysis of descriptive statistics and inferential statistics. In the qualitative part of the research, 9 semi-structured interviews were conducted with the instructors and the opinions of the instructors were extracted based on the content analysis of Krippendorff (2004). The analysis of descriptive statistics findings showed that experienced instructors have a better and deeper understanding of the general concept of test fairness, the definition of the concept of test fairness and the components necessary to conduct

Keywords

Subjects


Ahearn, S. (2009). IELTS and trade in education and immigration. TESOL in context, 19(1), 39-51.
Bachman L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly; 2, 1–
34.
Banerjee H. (2018). Test Fairness in Second Language Assessment. Columbia University Working Papers in TESOL & Applied Linguistics,16 (1), 54-59.
Birjandi, P., & Mosallanejad, P. (2010). Exploring new reading strategies. Tehran: Sepahan Publication;
2010. Persian.
Chick, A., & Besser.(2011). S. International language test taking among young learners: A Hong Kong case
study. Language Assessment Quarterly; 8, 73-91.
Colquitt J. A., & Shaw J. (2005). How should organizational justice be measured. In: Greenberg J.& Colquitt
J. A (Eds.), Handbook of organizational justice. Lawrence Erlbaum Associates Publishers. 2005; Vol. 1, p.
113–152.
Cropanzano R, Marion F, and Kirk J. F. )2015(. How do we know when we are treated fairly? Justice rules and
fairness judgments. In: M. R. Buckley, A. R. Wheeler, & J. R. B. Halbesleben (Eds.), Research in personnel
and human resources management. Cambridge, UK: Emerald Group Publishing Limited. P.279-350.
Davies, A. )2010(. Test fairness: A response. Language Testing, 27, 171–176.
Doosti M, & Ahmadi Safa M. (2021). Fairness in Oral Language Assessment: Training Raters and Considering
Examinees’ Expectations. International Journal of Language Testing, 11(2), 64-90.
Drasgow, F. (2015). Technology and testing: Improving educational and psychological measurement. Routledge.
Gross C, (2008). A Measure of Fairness: An Investigative Framework to Explore Perceptions of Fairness and
Justice in a Real-Life Social Conflict. Human Ecology Review, 15 (2): 130-140.
Hailikari T. Postareff L, Tuononen T, Raisanen M, & Lindblom-Ylanne S. (2014). Student’s and Teachers’
Perceptions of Fairness in Assessment. Advances and innovations in university assessment and feedback.
. 99-113.
Hawkey, Roger. (2005). "An impact study of a high-stakes test (IELTS): Lessons for test validation and linguistic
diversity.in: Taylor & C.J. Weir (Eds.), Multilingualism and Assessment. Cambridge: UCLES/Cambridge
University Press. 2005. p 215-228.
Homayouni S. (2015). A comparative study of the inferences of teachers and master students of Iranian English
language teaching in relation to fair judgment in academic achievement tests. Master Thesis. Iran, Khatam
University.
Kane M. (2010). Validity and fairness. Language Testing. 2010; 27(2):177-182. doi:10.1177/0265532209349467
Kane, Michael T. 2016. Explicating validity. Assessment in Education: Principles, Policy &
Practice.2016; 23(2), 198-211
Karami, H. (2013). The quest for fairness in language testing. Educational Research and Evaluation, 19 (2-3): 158-169.
Krippendorff, K. Reliability in content analysis: Some common misconceptions and recommendations. Human
communication research. 2004; 30(3), 411-433.
Kunnan, A. J. (2000). Fairness and justice for all. In: Kunnan A. J. (Ed.), Fairness and validation in language
assessment. Cambridge, UK: Cambridge University Press. 2000. p. 1–14.
Kunnan, A. J. (2010). Test fairness and Toulmin’s argument structure. Language Testing. 2010; 27 (2), 183-189.
Kunnan, A. J. Test fairness. In: Milanovic, M. & Weir C., (Eds.), European language testing in a global context:
Proceedings of the ALTE Barcelona Conference. Cambridge, UK: Cambridge University Press; 2004. p. 27–
48.
Kunnan, Antony John. Towards a model of test evaluation: Using the test fairness and test context frameworks.
In: Zsuzsa C. L, Multilingualism and assessment: Achieving transparency, assuring quality, sustaining
diversity. Proceedings of the ALTE Berlin Conference; 2008. p. 229-251.
Lingard B. Sellar, S. & Savage G. C. Re-articulating social justice as equity in schooling policy: The effects of
testing and data infrastructures. British Journal of Sociology of Education. 2014; 35 (5), 710-730.
McNamara T. and Ryan, K. Fairness versus justice in language testing: The place of English literacy in the
Australian citizenship test. Language Assessment Quarterly. 2011; 8(2):161-178.
Mehmandoost Z, Alavi, S. M, Keyvanpanah Sh. Evaluation of assessment literacy and evaluation of English
language university teachers in Iran. Linguistic Research in Foreign Languages. 2018; 8(2): 663-645. Persian.
Nisbet i. Fairness takes centre stage. Assessment in Education: Principles, Policy & Practice. 2019; 26(1), 111-117.
qonsuli B. (2010) Design and validity of Persian language adequacy test. Research in Contemporary World
Literature. 15 (57). 130-115. Persian.
Ramsden, P. Learning to Teach in Higher Education (2nd eds). London: Routledge; 2003.
Sambell K., McDowell L, and Brown S. But is it Fair?: An Exploratory Study of Student Perceptions of the
Consequential Validity of Assessment. Studies in Educational Evaluation. 1997; 23: 349–371.
Shohamy E. The power of tests: a critical perspective on the uses of language tests. Harlow: Longman,2000.
Stone E. A, & Cook L. Fair Testing and the Role of Accessibility. In: Elliott Stephen N, Ryan J, Kettler Peter A. Beddow, and Alexander Kurz. Handbook of accessible instruction and testing practices. New York, NY: Springer.
2018; p. 59-73.
Tierney, Robin D. (2014). Fairness as a multifaceted quality in classroom assessment. Studies in Educational Evaluation.
. 43: 55-69.
Wallace, M., & Qin, Coral. Language Classroom Assessment Fairness: Perceptions from Students. LEARN
Journal: Language Education and Acquisition Research Network. 2021; 14(1), 492-521.
Weir, C.J.(2005). Language testing and validation: An evidence- based approach. Basingstoke: Palgrave
Macmillan.
Willingham W. A systemic view of test fairness. In: Messick S. J. Assessment in higher education: Issues of access,
quality, student development and public policy. Mahwah, NJ: Lawrence Erlbaum.Routledge, 2013. p. 213–
242.
Xi, X. How do we go about investigating test fairness? Language Testing.2010; 27, 147–170.
Yan J. Powerful tests, powerless test designers? Challenges facing the College English Test. Shanghai: Shanghai
Foreign Language Education Press.2008.

Articles in Press, Accepted Manuscript
Available Online from 13 July 2025