Optimizing Oral Proficiency Assessment in Chinese as a Second Language: Challenges and Improvement Strategies of the OPI Test

Na Liu, Jeferd Saong

Abstract


The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously, analyzed separately, and then compared or integrated to achieve a comprehensive understanding of the research problem. Quantitative data primarily consists of Oral Proficiency Interview (OPI) test scores, which supplied the admission, pre-test, and posttest scores. Semi-structured interviews with five teachers were conducted to identify challenges in administering the OPI. The findings revealed that technical and cultural differences, examiner subjectivity, and environmental factors influenced students’ OPI performance. Key results emphasized the importance of understanding students’ backgrounds for adaptive questioning while maintaining standardized assessment practices. To enhance OPI effectiveness, the study recommends further examiner training, continuous professional development, and the integration of technology, such as AI, into the assessment framework. Overall, the CLS program should adopt more effective teaching and learning strategies to improve language proficiency outcomes and literacy.


Keywords


oral proficiency interview, language scholarship, second language literacy, OPI challenges, assessment, AI

Full Text:

PDF

References


Achirri, K. (2021). Life is splendid here in the U.S.: Intercultural learning in contemporary Chinese students’ academic adjustment. The Qualitative Report. https://doi.org/10.46743/2160-3715%2F2021.3501

American Council on the Teaching of Foreign Languages [ACTFL]. (2018). 2017 Annual Report. www.actfl.org/sites/default/files/reports/annualreport2017/index.html

ACTFL. (2020). ACTFL assessments. https://www.actfl.org

ACTFL. (2021). Oral Proficiency Interview (OPI). https://www.languagetesting.com

Akbari, N. (2020). Second language assessment in Persian. https://doi.org/10.4324/9780429446221-25

Bijani, H. (2019). Evaluating the effectiveness of the training program on direct and semi-direct oral proficiency assessment: A case of multifaceted Rasch analysis. Cogent Education, 6(1). https://doi.org/10.1080/2331186X.2019.1670592

Bucher, T. (2019). The impact of the social dimension on assessing oral proficiency. In E. White & T. Delaney (Eds.), Handbook of Research on Assessment Literacy and Teacher-Made Testing in the Language Classroom (pp. 141-156). IGI Global. https://doi.org/10.4018/978-1-5225-6986-2.CH008

Candel-Mora, M. A. (2019). Intercultural communication competence in specialized languages and contexts: Research prospects and possibilities. Advanced Linguistics, 4, 4-9. https://doi.org/10.20535/2617-5339.2019.4.181340

Carr, S., & Sun, S. (2021). Ensuring accuracy and quality for oral examinations in translation. Assessment & Evaluation in Higher Education, 47, 830 - 842. https://doi.org/10.1080/02602938.2021.1972929

Ellis, R., Skehan, P., Li, S., Shintani, N., & Lambert, C. (2019). Task-Based language teaching. https://doi.org/10.1017/9781108643689

Gardner, J., O’Leary, M., & Yuan, L. (2021). Artificial intelligence in educational assessment: 'Breakthrough? or Buncombe and Ballyhoo?'. J. Comput. Assist. Learn., 37, 1207-1216. https://doi.org/10.1111/jcal.12577

Jackson, J., & Schwieter, J. W. (2019). Study abroad and immersion. In J. W. Schwieter & A. Benati (Eds.), The Cambridge Handbook of Language Learning (pp. 727 - 750). https://doi.org/10.1017/9781108333603.031

Karuppaiah, S., & Raof, A. H. A. (2020). The impact of rater training on rater reliability in an English Oral Test. Asian Journal of Assessment in Teaching and Learning, 10(2), 94-105. https://doi.org/10.37134/ajatel.vol10.2.10.2020

Kawaguchi, K., Sakoda, A., Kojima, K., & Goto, A. (2020). Current trends and prospects of studies on Japanese OPI in Korea. The Japanese Language Association of Korea, 66, 5-26. https://doi.org/10.14817/jlak.2020.66.5

Khasawneh, M., & Khasawneh, Y. (2023). Achieving assessment equity and fairness: Identifying and eliminating bias in assessment tools and practices. Preprints. https://doi.org/10.20944/preprints202306.0730.v1

Kinney, C. L., Raddatz, M. M., Robinson, L. R., Garrison, C. J., & Sabharwal, S. (2021). Interrater reliability in the American Board of Physical Medicine and Rehabilitation Part II Certification Examination. American Journal of Physical Medicine & Rehabilitation, 101, 468 - 472. https://doi.org/10.1097/PHM.0000000000001859

Ma, W., & Winke, P.M. (2019). Self‐assessment: How reliable is it in assessing oral proficiency over time? Foreign Language Annals, 52(1), 66-86. https://doi.org/10.1111/FLAN.12379

McConnell, K.D. (2022). The devil is in the details: A response to Eubanks. Journal of Assessment and Institutional Effectiveness, 12, 48 - 60. https://doi.org/10.5325/jasseinsteffe.12.1-2.0048

Ortega, P., Izquierdo, K., Iṅigo, R., Gonzaliez, J., Gregorich, S., Karliner, L., Cordon, C., Diamon, L., & Figueroa, J. (2023). Development and effectiveness of a rater training curriculum for evaluating student medical Spanish Oral Proficiency using the physician oral language observation matrix. Global Business Languages, 23, 14–39. https://doi.org/10.4079/gbl.v23.3

Peng, Y., Yan, W., & Cheng, L. (2020). Hanyu Shuiping Kaoshi (HSK): A multi-level, multi-purpose proficiency test. Language Testing, 38, 326 - 337. https://doi.org/10.1177/0265532220957298

Rossi, O., & Brunfaut, T. (2020). Raters of subjectively‐scored tests. The TESOL Encyclopedia of English Language Teaching, 1-7. https://doi.org/10.1002/9781118784235.eelt0985

Silva, C. D., Alexandre, B. H., Ferronato, R. F., Pontes, F. G., & Lima, O. D. (2024). Vygotsky E A Aprendizagem Sociointeracionista: O Papel Da Linguagem E Do Contexto Cultural Na Educação. IOSR Journal of Business and Management, 26(11), 8-18. https://doi.org/10.9790/487x-2611090818

Siraranghom, W. (2024). Developing a comprehensive preparation module for the Oral Proficiency Interview (OPI). NKRAFA Journal of Humanities and Social Sciences, 12, 117–129. https://so04.tci-thaijo.org/index.php/KANNICHA/article/view/274563

Wang, Z., & Zhang, J. (2023). Mediation and learner reciprocity. Language and Sociocultural Theory, 10(1), 82-105. https://doi.org/10.1558/lst.22181

Winke, P., &Brunfaut, T. (Eds.). (2020). The Routledge handbook of second language acquisition and language testing (1st ed.). https://doi.org/10.4324/9781351034784

Yang, H. (2023). Investigating stakeholders’ needs to enhance raters’ feedback on an English Oral Proficiency Interview Test. Multimedia-Assisted Language Learning, 26(4). https://doi.org/10.15702/mall.2023.26.4.98




DOI: https://doi.org/10.7575/aiac.ijels.v.13n.2p.605

Refbacks

  • There are currently no refbacks.


Bookmark and Share


License URL: https://creativecommons.org/licenses/by/4.0/

2013-2025 (CC-BY) Australian International Academic Centre PTY.LTD.

International Journal of Education and Literacy Studies  

You may require to add the 'aiac.org.au' domain to your e-mail 'safe list’ If you do not receive e-mail in your 'inbox'. Otherwise, you may check your 'Spam mail' or 'junk mail' folders.