Email this article Malpractice in online versus onsite computer-based language tests: Reflections from the COVID lockdown experience
Abstract
Computer-based tests provide a fast, efficient and cost effective means of assessing students, especially if they can be administered online (Chalhoub-Deville 2002; Suvorov, Hegelheimer 2013). Traditionally, they are administered in controlled conditions, where supervision and invigilation (or proctoring) can be conducted in much the same way as it is with paper-based tests. Around the world, the COVID emergency (2020-21) led to the sudden closure of educational institutions and a shift online of all teaching and testing. In this paper, we will examine the effects of such a change in the context of two specific university courses where a set of bespoke Moodle-hosted computer-based (CB) tests were adapted from a controlled and supervised onsite context to a much freer online context using a general business communication platform (Microsoft Team). We compare the results of over 4,500 tests (Lexis and Use of English, Translation, Reading, Listening and Writing Tasks: the first four marked automatically, the last manually) taken in both onsite and online contexts to identify differences in results between both testing environments. The aim is to provide some hard data to ascertain how far online distance-invigilated tests taken under only the most basic supervision can be adequate substitutes for more traditional formats especially in view of both their positive aspects (e.g. greater accessibility and inclusivity for students) and their negative ones (e.g. the greater opportunity for malpractice).
References
Association of Language Testers in Europe (ALTE). 2011. “Manual for Language Test Development and Examining”. © Council of Europe 2011. Available online at:
https://www.alte.org/resources/Documents/ManualLanguageTest-Alte2011_EN.pdf
Berkey, Dennis / Halfond, Jay. (2015) Cheating, Student Authentication and Proctoring in Online Programs. New England Journal of Higher Education, http://www.nebhe.org/thejournal/cheating-student-authentication-and-proctoring-in-online-programs/
Bouchrika, Imed. 2023. “50 Current Student Stress Statistics: 2023 Data, Analysis & Predictions” Research.com, 17/03/2023: https://research.com/education/student-stress-statistics.
Chalhoub-Deville, Micheline. 2002. “Technology in Standardized Language Assessment.” In Kaplan, Robert B. (ed.) Handbook of Applied Linguistics. Oxford: Oxford University Press, pp. 471-484
Dias, Mark S. / Boehmer, Susan / Johnston-Walsh, Lucy / Levi, Benjamin, H. 2015. “Defining ‘reasonable medical certainty’ in court: What does it mean to medical experts in child abuse cases?” Child Abuse & Neglect, Volume 50, December 2015, pp. 218-227
D’Souza, Kelwyn A. / Siegfeldt, Denise V. (2017), A Conceptual Framework for Detecting Cheating in Online and Take‐Home Exams. Decision Sciences Journal of Innovative Education, 15: 370-391. doi:10.1111/dsji.12140
Groves, Robert M. / Fowler, Floyd J. Jr. / Couper, Mick P. / Lepkowski, James M. / Singer, Eleanor / Tourangeau, Roger. 2009. Survey Methodology (2nd Edition). Hoboken (NJ): Wiley.
Johnson, Roger / Molfetas, Marios. 2018. “Online Proctoring: A key feature of secure high stakes tests in the future?” Presentation given at “ALTE 52nd Conference Day”, 23 November 2018, Salamanca, Spain. PowerPoint presentation, available online at:
https://www.alte.org/resources/Documents/ALTE%20Presentation%20Nov%2018%20Salamanca%20-%20final%20(RJ%20and%20MM).pptx
Karim, Michael & Kaminsky, Samuel / Behrend, Tara. (2014). Cheating, Reactions, and Performance in Remotely Proctored Testing: An Exploratory Experimental Study. Journal of Business and Psychology, 29. 1-18. 10.1007/s10869-014-9343-z.
Ketab, Salam Shakir / Clarke, Nathan / Haskell-Dowland, Paul. (2015). E-Invigilation of E-Assessments. Conference: Proceedings of INTED2015 Conference 2nd-4th March 2015, Madrid, Spain
Kotz, Samuel / Read, Campbell B. / Balakrishnan, Narayanaswamy / Vidakovic, Brani (eds.) (2006), Encyclopedia of Statistical Sciences, Hoboken (NJ): Wiley.
Levitt, Steven D. / Dubner, Stephen J. 2005. Freakonomics: A Rogue Economist Explores the Hidden Side of Everything. New York (NY): William Morrow.
Suvorov, Ruslan / Hegelheimer, Volker (2013). Computer-assisted language testing. In A. J. Kunnan (Ed.), Companion to Language Assessment. Malden, (MA): Wiley-Blackwell, pp. 593-613
Usher, Ellen, L. / Golding, Jonathan M. /Han, Jaeyun / Griffiths, Caiti S. / McGavran, Mary Beth / Brown, Christia Spears / Sheehan, Elizabeth A. 2021. “Psychology Students’ Motivation and Learning in Response to the Shift to Remote Instruction During COVID-19.” Scholarship of Teaching and Learning in Psychology. Available online at https://doi.org/10.1037/stl0000256doi: 10.1037/stl000025
Full Text: PDF
Refbacks
- There are currently no refbacks.
