An Investigation into the Validity of the Iranian Ph.D. Admission English Proficiency Test: An Assessment Use Argument Approach

Authors
M. Hamavandy 1
G. R. Kiany 2
R. Ghafar Samar 2
R. Akbari 3
1 Ph.D. Candidate of TEFL, English Department, Tarbiat Modares University, Tehran, Iran
2 Associate Professor of TEFL, English Department, Tarbiat Modares University, Tehran, Iran
3 Assistant Professor of TEFL, English Department, Tarbiat Modares University, Tehran, Iran
Abstract
Assessment of the English proficiency of applicants of entry into postgraduate studies, undeniably, is of utmost importance. Nationally speaking, the current status of the English test administered by the National Organization of Educational Testing (NOET) in Iran has been a topic of heated contention in recent years. This study purports to investigate the validity of the Iranian English proficiency test for Ph.D. admission purposes adopting the assessment use argument as the main framework for its validation research. To this end, the required data were collected from the relevant stakeholders of the test, namely applicants of the test, experts in educational assessment and language testing, and test readiness instructors. Structured interviews and focus groups were conducted and the acquired data were analyzed using the qualitative content analysis approach. Most prominent themes that emerged from the data in addition to a number of relevant representative quotes constituted the major findings of this study. The results revealed that the test is in need of major revisions in some parts, and further modifications are deemed as necessary. In the final section, summary of the results along with suggestions for optimization of the test are put forth. Keywords: Iranian Ph.D. admission English proficiency test, test validation, assessment use argument

Keywords

  • کیانی، غلام‌رضا؛ مهدوی، بابک و رضا غفارثمر. (1392).  «مقایسه میزان منصفانه ‌بودن انواع آزمون‌های زبان انگلیسی در دوره دبیرستان». جستارهای زبانی. د 4. ش 1. صص 181- 202.

  • کیانی، غلامرضا. (1388).  «استانداردسازی آزمون زبان انگلیسی داوطلبان مقطع دکترا».  طرح کاربردی. دانشگاه تربیت مدرس تهران.



  • Bachman, L. F. & I. Choi (2012). Review of pearson test of English academic: Building an assessment use argument. Language Testing, 29(4), Pp. 603–619.

  • Bachman, L. F. & A. S. Palmer (2010). Language Assessment in Practice. Oxford University Press: Oxford

  • Carlson, N. R.; D. Heth; H. Miller; J. Donahoe & G. N. Martin (2009). Psychology: The Science of Behavior. Pearson.

  • Cronbach, L. J. & P. E. Meehl (1955). “Construct validity in psychological tests”. Psychological Bulletin. 52(4). P. 281

  • Kane, M. (2004). “Certification Testing as an Illustration of Argument-Based Validation”. Measurement: Interdisciplinary Research and Perspectives. 2(3). Pp. 135- 170.

  • Kane, M. T. (2013). “Validating the interpretations and uses of test scores”.Journal of Educational Measurement. 50(1). Pp. 1-73.

  • Messick, S. (1989). “Meaning and values in test validation: The science and ethics of assessment”. Educational Researcher. 18(2). Pp. 5-11.

  • Saif, S. (2006). “Aiming for positive washback: A case study of international teaching assistants”. Language Testing. 23(1). Pp. 1-34.

  • Spanjers, D. M. (2007). Cognitive Engagement as a Predictor of Achievement. ProQuest.

  • Toulmin, S. E. (1957،2003). The Uses of Argument. Cambridge University Press.

  • Wang, H. (2010). Investigating the Justifiability of an Additional Test Use:  An Application of Assessment Use Argument to English as a Foreign Language. Unpublished PhD dissertation. UCLA.


 


 

Language Related Research
Volume 7, Issue 1
March and April 2016
Pages 237-251