Profiling informal experience with English. An instrument for data collection


Abstract


Within the thriving area of research on informal access to English, the present paper focuses on the methodology and design of valid, reliable and effective instruments for data collection. Studies on informal language learning have addressed different target populations, with a preference for teenagers and young adults, and have mainly used questionnaires and users’ reports to gather large amounts of information. Methodological reflections on questionnaire design, however, are not always in the foreground – while this is crucial for the comparability and replicability of findings.

Moving from these premises, the current study describes a new instrument to investigate the experiencing and learning of English outside the classroom through multiple media. It includes a newly-developed questionnaire (the Informal English Contact and Learning questionnaire, IECoL) and a receptive vocabulary test adapted from Nation (1990). The tool was designed as part of an ongoing large-scale national (PRIN) project on the informalisation of English language learning among university students in Italy. Both components are described in detail, focusing on the rationale, the innovative aspects, the development and piloting phases, and the final structure and layout. Cronbach’s Alpha coefficient was calculated and shows the reliability and internal consistency of the instrument as a whole. We conclude by outlining the innovativeness of the instrument and by underlining the paramount importance of data collection methods and tools in a field where users’ reports and recall are the main sources of information about respondents’ behaviour and private worlds.


DOI Code: 10.1285/i22390359v59p303

Keywords: Informal English learning; Questionnaires; Data collection; Test validation; Media input.

References


Aiello J. 2018, Negotiating Englishes and English-speaking identities, Routledge, London.

Arnbjörnsdóttir B. and Ingvarsdóttir H. (eds.) 2018, Language Development Across the Life Span: The Impact of English on Education and Work in Iceland, Springer International Publishing, Cham.

Arndt H. 2023, Construction and validation of a questionnaire to study engagement in informal second language learning, in “Studies in Second Language Acquisition”, pp. 1–25.

Azzolini D., Campregher S. and Madia J.E. (2022), Formal instruction vs informal exposure. What matters more for teenagers’ acquisition of English as a second language?, in “Research Papers in Education” 37 [2], pp. 153-181.

Benson P. 2011, Language learning and teaching beyond the classroom: An introduction to the field, in Benson P. and Reinders H. (eds.), Beyond the Language Classroom, Palgrave Macmillan, Basingstoke, pp. 7-16.

Benson P. 2021, Language Learning Environments, Multilingual Matters, Bristol.

Berns M., de Bot K. and Hasebrink U. 2007, In the Presence of English: Media and European Youth, Springer, New York.

Caruana S. 2021, An Overview of Audiovisual Input as a Means for Foreign Language Acquisition in Different Contexts, in “Language & Speech” 64 [4], pp. 1018-1036.

Casiraghi L. 2016, ‘A Key’, ‘a Plunge’, ‘an Anchor’: A Study of the Role of English in the Experience of Erasmus Students, Unpublished postgraduate thesis, Università degli Studi di Pavia.

Collentine J. and Freed B. F. 2004, Learning context and its effects on Second Language Acquisition, in “Studies in Second Language Acquisition” 26 [2], pp. 153-171.

Cravidi G. 2016, Accessing English Input Outside University: A Qualitative and Quantitative Investigation, Unpublished postgraduate thesis, Università degli Studi di Pavia.

De Riso C. 2023, Out-of-the-classroom English input and informal Second Language Acquisition: A longitudinal study of Italian university students, Unpublished doctoral thesis, University of Pavia.

De Wilde V., Brysbaert M. and Eyckmans J. 2020, Learning English through out-of-school exposure. Which levels of language proficiency are attained and which types of input are important?, in “Bilingualism: Language and Cognition” 23, pp. 171-185.

Dörnyei, Z. and Dewaele J.-M. 2023, Questionnaires in Second Language Research: Construction, Administration, and Processing, Routledge, London.

Dressman M. and Sadler R.W. (eds.) 2020, The Handbook of Informal Language Learning, Wiley-Blackwell, Hoboken.

Ellis N. C. 2003, Constructions, Chunking and Connectionism, in Doughty C. and Long M. (eds.), The Handbook of Second Language Acquisition, Blackwell Publishing, Malden, pp. 63-103.

Ferguson G. 2015, Introduction: Attitudes to English, in Linn A., Bermel N. and Ferguson G. (eds.), Attitudes towards English in Europe, Mouton de Gruyter, Berlin, pp. 3-24.

Freed B. F., Dewey D. P., Segalowitz N. and Halter R. 2004, The language contact profile, in “Studies in Second Language Acquisition” 26 [2], pp. 349-356.

Gass S. M. 1997, Input, Interaction, and the Second Language Learner, Lawrence Erlbaum Associates, Mahwah.

Gass S. M. and Mackey A. 2020, Input, Interaction, and Output in L2 Acquisition, in VanPatten B. and Williams J. (eds.), Theories in SLA. An Introduction, Routledge, London, pp. 192-222.

Ghia E. and Pavesi M. 2021, Choosing between dubbing and subtitling in a changing landscape, Lingue e Linguaggi 46, pp. 161-177.

González Fernandez B. and Schmitt N. 2015, How much collocation knowledge do L2 learners have?: the effects of frequency and amount of exposure, in “ITL - International Journal of Applied Linguistics” 166 [1], pp. 94-126.

Iwaniec J. 2019, Questionnaires: Implications for effective implementation, in McKinley J., Rose H. (eds.), The Routledge handbook of research methods in applied linguistics, Routledge, London, pp. 324-335.

Krashen S. 1985, The Input Hypothesis: Issues and Implications, Longman, London.

Kukulska-Hulme A. 2009, Will mobile learning change language learning?, in “ReCALL” 21 [2], pp. 157-165.

Kuppens A. 2010, Incidental foreign language acquisition from media exposure, in “Learning, Media and Technology” 35 [1], pp. 65-85.

Kusyk M. 2020, Informal English learning in France, in Dressman M. and Sadler R. W. (eds.), The Handbook of Informal Language Learning, Wiley-Blackwell, Hoboken, pp. 333-348.

Kusyk M. and Sockett G. 2012, From informal resource usage to incidental language acquisition: Language uptake from online television viewing in English, in “Asp. La revue du GERAS” 62, pp. 45-65.

Laufer B., Elder C., Hill K. and Congdon P. 2004, Size and Strength: Do We Need Both to Measure Vocabulary Knowledge?, in “Language Testing” 21, pp. 202-226.

Lee J. S. and Dressman M. 2018, When IDLE Hands Make an English Workshop: Informal Digital Learning of English and Language Proficiency, in “TESOL Quarterly” 52 [2], pp. 435-445.

Leppänen S., Pitkänen-Huhta A., Nikula T., Kytölä S., Törmäkangas T., Nissinen K., Kääntä L., Räisänen T., Laitinen M., Pahta P., Koskela H., Lähdesmäki S. and Jousmäki H. 2011, National survey on the English language in Finland: Uses, meanings and attitudes, in “Studies in Variation, Contacts and Change in English” 5.

Lindgren E. and Muñoz C. 2013, The influence of exposure, parents, and lin- guistic distance on young European learners’ foreign language comprehension, in “International Journal of Multilingualism” 10 [1], pp. 105-129.

Long M. 1996, The Role of the Linguistic Environment in Second Language Acquisition, in Ritchie W. C. and Bhatia T. K. (eds.), The Handbook of Second Language Acquisition, Academic Press, San Diego, pp. 413-468.

Ludke K. M. 2020, Songs and music, in Dressman M. and Sadler R. W. (eds), The Handbook of Informal Language Learning, Wiley-Blackwell, Hoboken, pp. 203-213.

Lütge C. (ed.) 2022, Foreign Language Learning in the Digital Age, Routledge, Oxon.

Martinez R. and Schmitt N. 2012, A Phrasal Expressions List in “Applied Linguistics” 33, pp. 299-320.

McCarthy T. M. 2009, Music and song beyond the classroom: Strategies to aid the language learning process, in “Cam TESOL Conference on English Language Teaching: Selected Papers” 5, pp. 252-261.

Meara P. 1992, EFL Vocabulary Tests, Swansea University, Swansea.

Muñoz C. 2020, Boys like games and girls like movies. Age and gender differences in out-of-school contact with English, in “RESLA” 33, pp. 172-202.

Muñoz C. and Cadierno T. 2021, How do differences in exposure affect English language learning? A comparison of teenagers in two learning environments, in “Studies in Second Language Learning and Teaching” 11 [2], pp. 185-212.

Nation I.S.P. 1990, Teaching and Learning Vocabulary, Newbury House, New York.

Nation I. S. P. 2021, Critical Commentary. Thoughts on word families, in “Studies in Second Language Acquisition” 43, pp. 1-4.

Ortega L. 2019, SLA and the Study of Equitable Multilingualism, in “The Modern Language Journal” 103 [1], pp. 23-38.

Pavesi M. and Ghia E. 2020, Informal Contact with English. A case study of Italian postgraduate students, ETS, Pisa.

Puimège E. and Peters E. 2019, Learners’ English Vocabulary Knowledge Prior to Formal Instruction: The Role of Learner-Related and Word-Related Variables, in “Language Learning” 69 [4], pp. 943-977.

Reinhardt J. 2022, The History of Language Learning and Teaching Beyond the Classroom, in Reinders H., Lai C. and Sundqvist P. (eds.), The Routledge Handbook of Language Learning and Teaching Beyond the Classroom, Routledge, Oxon, pp. 9-23.

Schmitt N., Nation P. and Kremmel B. 2020, Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation, in “Language Teaching” 53 [1], pp. 109-120.

Sockett G. 2014, The Online Informal Learning of English, Palgrave Macmillan, London.

Sundqvist P. and Sylvén L.K. 2014, Language-related computer use: Focus on young L2 English learners in Sweden, in “Re-CALL” 26 [1], pp. 3-20.

Sundqvist P. and Sylvén L.K. 2016, Extramural English in Teaching and Learning: from Theory and Research to Practice, Palgrave Macmillan, London.

Swain M. 1995, Three functions of output in second language learning, in Cook G. and Seidlhofer B. (eds.), Principle and Practice in Applied Linguistics: Studies in Honour of H. G. Widdowson, Oxford University Press, Oxford, pp. 125-144.

Swain M. 2005, The output hypothesis: theory and research, in Hinkel E. (ed.), Handbook of Research in Second Language Teaching and Learning, Lawrence Erlbaum Associates, Mahwah, pp. 471-483.

Sylvén L. K. and Sundqvist P. 2012, Gaming as extramural English L2 learning and L2 proficiency among your learners, in “ReCALL” 24 [3], pp. 302-321.

Toffoli D. and Sockett G. 2010, How non-specialist students of English practice informal learning using Web 2.0 tools, in “Asp. La revue du GERAS” 58, pp. 125-144.

Toffoli D. and Sockett G. 2014, English language music: Does it help with learning?, in “Researching and Teaching Languages for Specific Purposes” 33 [2], pp. 192-209.

VanPatten B. and Williams J. (eds.) 2020, Theories in SLA. An Introduction, Routledge, London.

Verspoor M.H., de Bot K., and van Rein E. 2011, English as a foreign language. The role of out-of-school language input, in De Houwer A. and Wilton A. (eds.), English in Europe Today. Sociocultural and Educational Perspectives, John Benjamins, Amsterdam, pp. 147-166.

Webb S., Sasao Y. and Ballance O. 2017, The updated Vocabulary Levels Test: Developing and validating two new forms of the VLT, in “ITL - International Journal of Applied Linguistics” 168 [1], pp. 34-70.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribuzione - Non commerciale - Non opere derivate 3.0 Italia License.