ISSN: 2226-6348
Open access
Oral performance among test-takers in proficiency English tests has shown to be prone to variability due to its rater-mediated nature. Test-takers could better lead their assessment preparation if they understood more about how to optimise their strengths, which can be identified as test-taker characteristics. The purpose of this study is to determine whether topic familiarity and extraversion can be linked to oral assessment facets using the Conceptual-psychometric framework of rater-mediated assessment (Eckes, 2015). To understand how these factors affect test performance and task engagement, it focuses on the relationship between test takers’ topic familiarity and extraversion traits. By reviewing existing literature, this review proposed a conceptual framework that explains the concepts inherent in ESL oral assessment to investigate test-taker individual differences in topic familiarity and extraversion. This review seeks to contribute to a deeper understanding of how these factors interact and may influence the results of ESL oral assessments by carefully examining the relationships between individual differences such as topic familiarity and extraversion and oral assessment. Furthermore, it displays the significance of involving affective and cognitive dimensions of test-taker behaviour when developing assessment instruments that are dependable and valid for English as a Second Language (ESL) learners. Future research directions and the implications of these findings for ESL assessment practices are also addressed.
Kassim, N. L., & Zubairi, A. M. (2006). Interaction Between Test-taker Characteristics, Task Facets and L2 Oral Proficiency Test Performance. Educational Awakening: Journal of the Educational Sciences, 3(2), 139–159.
Bukhari, N. I., Aziz, T. M. F., Hakim, M. L., Ismail, L., & Abdul Razak, A. (2023). Exploring the Link Between Extraversion Tendencies and ESL Proficiency. BITARA International Journal of Civilizational Studies and Human Sciences, 6, 19–27. http://www.bitarajournal.com
Aljuaid, N. S. (2022). The Relationship between Personality Traits, Motivation Levels, and Speaking Performance among EFL Learners. 3L: Language, Linguistics, Literature, 28(3), 181–200. https://doi.org/10.17576/3L-2022-2803-12
Almziad, A., Samad, A. A., Razali, A. B., & Ismail, L. (2020). Using information gap activities to improve the speaking skills of Saudi Arabian introverted and extroverted learners. PalArch’s Journal Od Archaeology of Egypt/ Egyptology, 17(6), 357–368.
Aryadoust, V., Ng, L. Y., & Sayama, H. (2021). A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research. Language Testing, 38(1), 6–40. https://doi.org/10.1177/0265532220927487
Assiri, M. S. (2019). Experiential versus attitudinal topic types and task performance in EFL monologues. Indonesian Journal of Applied Linguistics, 9(2). https://doi.org/10.17509/ijal.v9i2.20238
Badrasawi, K. J. I., Kassim, N. L. A., Zubairi, A. M., Johar, E. M., & Sidik, S. S. (2021). English Language Speaking Anxiety, Self-Confidence and Perceived Ability among Science and Technology Undergraduate Students: A Rasch Analysis. Pertanika Journal of Social Sciences and Humanities, 29(3), 309–334. https://doi.org/10.47836/pjssh.29.s3.16
Banerjee, H. L. (2019). Investigating the Construct of Topical Knowledge in Second Language Assessment: A Scenario-Based Assessment Approach. Language Assessment Quarterly, 16(2), 133–160. https://doi.org/10.1080/15434303.2019.1628237
Bei., X. (2010). The effects of topic familiarity and strategic planning in topic-based task performance at different proficiency levels. Chinese University of Hong Kong, China.
Berry, V. (1993). The Assessment of Spoken Language Under Varying Interactional Conditions. In N. Bird (Ed.), Annual International Language in Education Conference (pp. 491–507).
Berry, V. E. (2004). A study of the interaction between individual personality differences and oral performance test facets. Doctoral Thesis, PhD(June).
Bidin, S. J., Don, Z., Abdul Raof, A. H., Zubairi, A. M., & Mahat, N. I. (2019). A Correlational Study Between MUET and IELTS. Majlis Peperiksaan Malaysia.
Bijani, H., Khabiri, M., & Branch, C. T. (2017). Direct and Semi-Direct Validation: Test Takers’ Perceptions, Evaluations and Anxiety towards Speaking Module of an English Proficiency Test. 7(1), 25–41. http://ttlt.stb.iau.ir/article_529069.htmlhttp:/ttlt.azad.ac.ir/article_529572.html
Bonk, W. J., & Ockey, G. J. (2003). A many-facet Rasch analysis of the second language group oral discussion task. Language Testing, 20(1), 89–110. https://doi.org/10.1191/0265532203lt245oa
Bonk, W. J., & Van Moere, A. (2004). L2 group oral testing: The influence of shyness/outgoingness, match ofinterlocutors’ proficiency level, and gender on individual scores. In Annual meeting of the Language Testing Research Colloquium, Temecula, CA.
Brown, A. (2003). Interviewer variation and the co-construction of speaking proficiency. Language Testing, 20(1), 1–25. https://doi.org/10.1191/0265532203lt242oa
Chonghui, L. (2019). Boosting English Standards. The Star Online. https://www.thestar.com.my/news/education/2019/06/09/boosting-english-standards
Council of Europe. (2001). the Common European Framework of Reference for Languages?: Learning, Teaching, Assessment. Council of Europe. https://doi.org/10.1017/S0267190514000221
Davis, L. (2009). The influence of interlocutor proficiency in a paired oral assessment. Language Testing, 26(3), 367–396. https://doi.org/10.1177/0265532209104667
Jong, N., & Vercellotti, M. Lou. (2016). Similar prompts may not be similar in the performance they elicit: Examining fluency, complexity, accuracy, and lexis in narratives from five picture prompts. Language Teaching Research. https://doi.org/10.1177/1362168815606161
Eckes, T. (2015). Introduction to Many-Facet Rasch Measurement: Analyzing and evaluating rater-mediated assessments (R. Grotjahn & G. Sigott (eds.); Second Edi). Peter Lang GmbH.
Figueras, N. (2019). Developing and using tasks for the assessment of speaking. Apples – Journal of Applied Language Studies, 13(1), 133–149. https://doi.org/10.17011/apples/urn.201903011693
Fischer, J. (2020). The underlying action-oriented and task-based approach of the CEFR and its implementation in language testing and assessment at university. Language Learning in Higher Education, 10(2), 301–316. https://doi.org/10.1515/cercles-2020-2021
Gan, Z., Oon, E. P. T., & Davison, C. (2017). ESL students’ oral performance in English language school-based assessment: results of an empirical study. Language Testing in Asia, 7(1). https://doi.org/10.1186/s40468-017-0051-2
Geranpayeh, A., & Ahmad Zufrie, A. R. (2018). The Alignment Of Malaysian University English Test To The CEFR. 6th British Council New Directions in English Language Assessment Conference: Standards in Learning Systems, October, 21.
Harun, H., Bosro, M. Z. M., Palpanadan, S. T., Ibrahim, M. Y., Sohaimi, N. A. M., & Jannaton, N. A. A. L. (2021). Malaysian public university students’ challenging skills to pass Malaysian University English Test (MUET). AIP Conference Proceedings, 2347, 020031. https://doi.org/10.1063/5.0052716
Huang, H. T. D., Hung, S. T. A., & Hong, H. T. V. (2016). Test-Taker Characteristics and Integrated Speaking Test Performance: A Path-Analytic Study. Language Assessment Quarterly, 13(4), 283–301. https://doi.org/10.1080/15434303.2016.1236111
Huang, H. T. D., Hung, S. T. A., & Plakans, L. (2018). Topical knowledge in L2 speaking assessment: Comparing independent and integrated speaking test tasks. Language Testing, 35(1), 27–49. https://doi.org/10.1177/0265532216677106
Huang, L. fen, Kubelec, S., Keng, N., & Hsu, L. (2018). Evaluating CEFR rater performance through the analysis of spoken learner corpora. Language Testing in Asia, 8(1), 0–17. https://doi.org/https://doi.org/10.1186/s40468-018-0069-0
Khabbazbashi, N. (2013). An investigation into the effects of topic and background knowledge of topic on second language speaking performance assessment in language proficiency interviews. 2013(January), 395.
Khabbazbashi, N. (2017). Topic and background knowledge effects on performance in speaking assessment. Language Testing, 34(1), 23–48. https://doi.org/10.1177/0265532215595666
Mahmud, N. (2018). Investigating the washback effect of the MUET as a university entry est on students in Malaysia (Issue December). University of York.
Mahmud, N., Lateh, N. H. M., Mahmud, N., Hassan, A. A., Mohamed, A. F., & Tarmizi, S. A. A. (2021). Washback impact of the MUET: The before and after effect of a high-stake university english test in Malaysia. International Journal of Learning, Teaching and Educational Research, 20(8), 1–17. https://doi.org/10.26803/IJLTER.20.8.1
Malaysian Examinations Council. (2019). Malaysian University English Test (MUET). In Batu Caves: Percetakan Warni. https://www.mpm.edu.my/images/dokumen/calon-peperiksaan/muet/regulation/Test_Specification_Regulation.pdf
Messick, S. (1989). Validity in educational measurement. In Educational Measurement.
Sohaimi, N. A., Harun, H., Palpanadan, S. T., Bosro, M. Z. M., Ibrahim, M. Y., & Abdul Latif Jannaton, N. A. (2021). Students’ feedback on learning skills to enhance MUET results. AIP Conference Proceedings, 2347(1), 020046. https://doi.org/10.1063/5.0052712
Nakatsuhara, F. (2011). Effects of test-taker characteristics and the number of participants in group oral tests. Language Testing, 28(4), 483–508. https://doi.org/10.1177/0265532211398110
O’Grady, S. (2019). The impact of pre-task planning on speaking test performance for English-medium university admission. Language Testing, 36(4), 505–526. https://doi.org/10.1177/0265532219826604
O’Sullivan, B. (2000). Exploring gender and oral proficiency interview performance. System, 28(3). https://doi.org/10.1016/S0346-251X(00)00018-X
Ockey, G. (2011). Self-consciousness and assertiveness as explanatory variables of L2 oral ability: A latent variable approach. Language Learning, 61(3), 968–989. https://doi.org/10.1111/j.1467-9922.2010.00625.x
Préfontaine, Y., & Kormos, J. (2015). The relationship between task difficulty and second language fluency in French: A mixed methods approach. Modern Language Journal, 99(1), 96–112. https://doi.org/10.1111/modl.12186
Purpura, J. E. (2004). Validating questionnaires to examine personal factors in L2 test performance. In M. Milanovich & C. Weir (Eds.), European language testing in a global context (pp. 93–114). Cambridge University Press.
Qiu, X. (2020). Functions of oral monologic tasks: Effects of topic familiarity on L2 speaking performance. Language Teaching Research, 24(6), 745–764. https://doi.org/10.1177/1362168819829021
Rethinasamy, S., & Chuah, K. M. (2011). The Malaysian university English test (MUET) and its use for placement purposes: A predictive validity study. Electronic Journal of Foreign Language Teaching, 8(2), 234–245. https://doi.org/10.2139/ssrn.2146007
Skehan, P., & Foster, P. (1999). The influence of task structure and processing conditions in narrative retellings. Language Learning, 49, 93–120.
Skehan, P., Xiaoyue, B., Qian, L., & Wang, Z. (2012). The task is not enough: Processing approaches to task-based performance. Language Teaching Research, 16(2), 170–187. https://doi.org/10.1177/1362168811428414
Taguchi, N. (2007). Task difficulty in oral speech act production. Applied Linguistics, 28(1), 113–135. https://doi.org/10.1093/applin/aml051
Tavakoli, P. (2009). Investigating task difficulty: Learners’ and teachers’ perceptions. International Journal of Applied Linguistics, 19(1), 1–25. https://doi.org/10.1111/j.1473-4192.2009.00216.x
Taylor, L. (2011). Examining speaking: Research and practice in assessing second language speaking. Cambridge University Press.
Weir, C. J. (2005). Language Testing and Validation. In Language Testing and Validation. https://doi.org/10.1057/9780230514577
Weir, C., O’Sullivan, B., & Horai, T. (2006). Exploring difficulty in speaking tasks: An intra-task perspective. In International English Language Testing System (IELTS) Research Reports 2006: Volume 6. IELTS Australia and British Council. https://search.informit.org/doi/pdf/10.3316/informit.078778646705266
Zafar, S., Khan, Z. A., & Meenakshi, K. (2017). Extraversion-introversion tendencies and their relationship with ESL proficiency: A study of Chinese students in Vellore, India. Pertanika Journal of Social Sciences and Humanities, 25(2), 687–703.
Zalbidea, J., & Sanz, C. (2020). Does learner cognition count on modality? Working memory and L2 morphosyntactic achievement across oral and written tasks. Applied Psycholinguistics, 1171–1196. https://doi.org/10.1017/S0142716420000442
(Bukhari et al., 2024)
Bukhari, N. I. A., Ismail, L., Kassim, N. L. A., Noordin, N., & Razali, A. B. (2024). Topic Familiarity and Extraversion in ESL Oral Assessment: A Conceptual Review. International Journal of Academic Research in Progressive Education and Development, 13(3), 2876–2887.
Copyright: © 2024 The Author(s)
Published by HRMARS (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode