An Analytical Reverse Engineering of IELTS Listening Tasks for a Construct Model

Masood Khalili Sabet, Hamid Reza Babaee Bormanaki

Abstract


The study reported here was concerned with the issue of reverse engineering of language test items as it relates to the identification of the language constructs underlying listening tasks of LELTS test. In this regard, the IELTS examination papers, from IELTS 1 to IELTS 10 were compiled as a corpus for the analysis. Tasks were analyzed using a taxonomic frame work adopted from Moore, Morton and price (2012), that was originally adapted from Weir and Urquhart (1998), with a focus on two dimensions of difference: level of engagement, referring to the level of text with which a listener required to engage in order to respond to a task (local vs. global); type of engagement referring to the way (or ways)  listeners expected to engage with a text in order to process the material to respond to a task (literal vs. interpretative). Overall, the analysis found evidences of bottom up processing underlying most IELTS listening tasks. The majority of tasks were identified to have a ‘local-literal’ configuration on their orientation, demanding primarily a basic understanding of relatively small textual units of the material. The results of the study were used to suggest the practical implications for the four groups of the people involved in the IELTS educational contexts: participants; teachers; material preparation experts, and curriculum designers.


Keywords


IELTS listening test, Reverse engineering, Taxonomic Framework, Level of Engagement, Type of Engagement, Bottom up Processing

Full Text:

PDF

References


Alderson, JC. (2000). Assessing reading, Cambridge: Cambridge University Press.

Badger, R & Yan, X. (2012). The use of tactics and strategies by Chinese students in the listening component of IELTS. In L. Taylor & C. Weir (Eds.), Studies in language testing, IELTS collected papers 2 (pp.454-486), Cambridge, UK: Cambridge University Press.34.

Breeze, R. & Miller, P. (2012). Predictive validity of the IELTS listening test as an indicator of student coping ability in English-medium undergraduate courses in Spain. In L. Taylor & C. Weir (Eds.), Studies in language testing, IELTS collected papers 2, (pp. 487-518). Cambridge, UK: Cambridge University Press 34.

Carroll, J. B. (1987a). ‘New perspectives in the analysis of abilities’ in R. R. Ronning, J. A. Glover, J. C. Conoley, and J. C. Witt (eds.): The Influence of Cognitive Psychology on Testing. (pp.267-84). Hillsdale, NJ: Lawrence Erlbaum Associates.

Cronbach, L. J. and P. E. Meehl. (1955). ‘Construct validity in psychological tests.’ Psychological Bulletin 52(4), 281-302.

Field, J. (2012). The cognitive validity of the lecture-based question in the IELTS listening paper. In L. Taylor & C. Weir (Eds.), Studies in language testing, IELTS collected papers 2,(pp.391-453). Cambridge, UK: Cambridge University Press. 34.

Fulture, G. (2010). Practical language testing, London: Hodder education.

Fulcher, G. and Davidson, F. (2007). Language Testing and Assessment: An Advanced Resource Book. London and New York: Routledge.

Fulcher, G. and Davidson, F. (2009). Test architecture, test retrofit. Language Testing, 26(1) 123–144.

IELTS. (2007). The IELTS handbook, UCLES/British Council, IDP Education Australia: Cambridge.

Kerlinger, F. and Lee, H. B. (2000). Foundations of Behavioral Research. Fort Worth, TX: Harcourt College Publishers.

Moore, T. Morton, J. Price, S. (2012). Construct validity in the IELTS Academic Reading test: A comparison of reading requirements in IELTS test items and in university study. IELTS Research Reports, (Vol.11). Swinburne University. IELTS Australia and British Council.

Moore, T. and Morton, J. (2007). .Authenticity in the IELTS Academic Module Writing Test: A comparative study of Task 2 items and university assignments. In L. Taylor and P. Falvey (Eds.), IELTS collected papers: Research in speaking and writing assessment (pp. 197-248). Cambridge: Cambridge University Press.

Nakatshuhara, F. (2012). The relationship between test takers’ listening proficiency and their performance on the IELTS Speaking test. In L. Taylor & C. Weir (Eds.), Studies in language testing, IELTS collected papers 2. (pp. 519-573). Cambridge, UK: Cambridge University Press. 34.

Weir, C. (2005). Language Testing and Validation. London: Palgrave Macmillan.

Weir, C.J. and Urquhart, AH. (1998). Reading in a second language: Process, product and practice, New York: Longman.




DOI: http://dx.doi.org/10.7575/aiac.ijalel.v.6n.7p.49

Refbacks

  • There are currently no refbacks.




Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2012-2019 (CC-BY) Australian International Academic Centre PTY.LTD

International Journal of Applied Linguistics and English Literature

To make sure that you can receive messages from us, please add the journal emails into your e-mail 'safe list'. If you do not receive e-mail in your 'inbox', check your 'bulk mail' or 'junk mail' folders.