Malpractice in online versus onsite computer-based language tests: Reflections from the COVID lockdown experience


Abstract


Computer-based tests provide a fast, efficient and cost effective means of assessing students, especially if they can be administered online (Chalhoub-Deville 2002; Suvorov, Hegelheimer 2013). Traditionally, they are administered in controlled conditions, where supervision and invigilation (or proctoring) can be conducted in much the same way as it is with paper-based tests. Around the world, the COVID emergency (2020-21) led to the sudden closure of educational institutions and a shift online of all teaching and testing. In this paper, we will examine the effects of such a change in the context of two specific university courses where a set of bespoke Moodle-hosted computer-based (CB) tests were adapted from a controlled and supervised onsite context to a much freer online context using a general business communication platform (Microsoft Team). We compare the results of over 4,500 tests (Lexis and Use of English, Translation, Reading, Listening and Writing Tasks: the first four marked automatically, the last manually) taken in both onsite and online contexts to identify differences in results between both testing environments. The aim is to provide some hard data to ascertain how far online distance-invigilated tests taken under only the most basic supervision can be adequate substitutes for more traditional formats especially in view of both their positive aspects (e.g. greater accessibility and inclusivity for students) and their negative ones (e.g. the greater opportunity for malpractice).


DOI Code: 10.1285/i22390359v59p39

Keywords: Onsite / Online testing, distance invigilation / proctoring, malpractice / cheating

References


Association of Language Testers in Europe (ALTE). 2011. “Manual for Language Test Development and Examining”. © Council of Europe 2011. Available online at:

https://www.alte.org/resources/Documents/ManualLanguageTest-Alte2011_EN.pdf

Berkey, Dennis / Halfond, Jay. (2015) Cheating, Student Authentication and Proctoring in Online Programs. New England Journal of Higher Education, http://www.nebhe.org/thejournal/cheating-student-authentication-and-proctoring-in-online-programs/

Bouchrika, Imed. 2023. “50 Current Student Stress Statistics: 2023 Data, Analysis & Predictions” Research.com, 17/03/2023: https://research.com/education/student-stress-statistics.

Chalhoub-Deville, Micheline. 2002. “Technology in Standardized Language Assessment.” In Kaplan, Robert B. (ed.) Handbook of Applied Linguistics. Oxford: Oxford University Press, pp. 471-484

Dias, Mark S. / Boehmer, Susan / Johnston-Walsh, Lucy / Levi, Benjamin, H. 2015. “Defining ‘reasonable medical certainty’ in court: What does it mean to medical experts in child abuse cases?” Child Abuse & Neglect, Volume 50, December 2015, pp. 218-227

D’Souza, Kelwyn A. / Siegfeldt, Denise V. (2017), A Conceptual Framework for Detecting Cheating in Online and Take‐Home Exams. Decision Sciences Journal of Innovative Education, 15: 370-391. doi:10.1111/dsji.12140

Groves, Robert M. / Fowler, Floyd J. Jr. / Couper, Mick P. / Lepkowski, James M. / Singer, Eleanor / Tourangeau, Roger. 2009. Survey Methodology (2nd Edition). Hoboken (NJ): Wiley.

Johnson, Roger / Molfetas, Marios. 2018. “Online Proctoring: A key feature of secure high stakes tests in the future?” Presentation given at “ALTE 52nd Conference Day”, 23 November 2018, Salamanca, Spain. PowerPoint presentation, available online at:

https://www.alte.org/resources/Documents/ALTE%20Presentation%20Nov%2018%20Salamanca%20-%20final%20(RJ%20and%20MM).pptx

Karim, Michael & Kaminsky, Samuel / Behrend, Tara. (2014). Cheating, Reactions, and Performance in Remotely Proctored Testing: An Exploratory Experimental Study. Journal of Business and Psychology, 29. 1-18. 10.1007/s10869-014-9343-z.

Ketab, Salam Shakir / Clarke, Nathan / Haskell-Dowland, Paul. (2015). E-Invigilation of E-Assessments. Conference: Proceedings of INTED2015 Conference 2nd-4th March 2015, Madrid, Spain

Kotz, Samuel / Read, Campbell B. / Balakrishnan, Narayanaswamy / Vidakovic, Brani (eds.) (2006), Encyclopedia of Statistical Sciences, Hoboken (NJ): Wiley.

Levitt, Steven D. / Dubner, ‎Stephen J. 2005. Freakonomics: A Rogue Economist Explores the Hidden Side of Everything. New York (NY): William Morrow.

Suvorov, Ruslan / Hegelheimer, Volker (2013). Computer-assisted language testing. In A. J. Kunnan (Ed.), Companion to Language Assessment. Malden, (MA): Wiley-Blackwell, pp. 593-613

Usher, Ellen, L. / Golding, Jonathan M. /Han, Jaeyun / Griffiths, Caiti S. / McGavran, Mary Beth / Brown, Christia Spears / Sheehan, Elizabeth A. 2021. “Psychology Students’ Motivation and Learning in Response to the Shift to Remote Instruction During COVID-19.” Scholarship of Teaching and Learning in Psychology. Available online at https://doi.org/10.1037/stl0000256doi: 10.1037/stl000025


Full Text: PDF

Refbacks

  • There are currently no refbacks.
کاغذ a4

Creative Commons License
This work is licensed under a Creative Commons Attribuzione - Non commerciale - Non opere derivate 3.0 Italia License.