Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Probing the internal validity of the LLAMA language aptitude tests
Linnéuniversitetet, Institutionen för svenska språket (SV).ORCID iD: 0000-0002-9857-5878
Stellenbosch University, South Africa;Stockholm University, Sweden.
2020 (English)In: Language learning, ISSN 0023-8333, E-ISSN 1467-9922, Vol. 70, no 1, p. 11-47Article in journal (Refereed) Published
Abstract [en]

Over the past decade, the LLAMA language aptitude test battery has come to play an increasingly important role as an instrument in research on individual differences in language development. However, a potentially serious problem that has been pointed out by several scholars is that the LLAMA has not yet been carefully validated. We addressed this issue by examining the internal validity of this test battery. We collected LLAMA data from 350 participants and assessed these data using classical item analysis, Rasch analysis, and principal component analysis within a framework of best practices in educational and psychological test validation. The results show that only one out of the four subtests (LLAMA B) produced scores that fit a latent trait model with sufficient accuracy. This suggests that researchers using the LLAMA battery must treat their results with appropriate carefulness and also that there is potential for refining the LLAMA further.

Place, publisher, year, edition, pages
Hoboken, NJ: John Wiley & Sons , 2020. Vol. 70, no 1, p. 11-47
Keywords [en]
language aptitude, language learning, validation, LLAMA, item analysis, Rasch measurement
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
URN: urn:nbn:se:hj:diva-54816DOI: 10.1111/lang.12368ISI: 000480446300001Scopus ID: 2-s2.0-85069887675OAI: oai:DiVA.org:hj-54816DiVA, id: diva2:1600688
Available from: 2019-07-30 Created: 2021-10-05 Last updated: 2021-10-05Bibliographically approved
In thesis
1. Validity considerations in the study of language learning aptitude
Open this publication in new window or tab >>Validity considerations in the study of language learning aptitude
2021 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Language learning aptitude is a hypothesized psychological construct that has been used to explain differences in how fast and how well people can acquire a second language (L2). It is generally assumed that language learning aptitude is a multidimensional phenomenon, meaning that it consists of sub-constructs that are not necessarily interrelated. Research on language aptitude and its relationship with language learning outcomes has been undertaken for at least 70 years but much still remains unknown about the nature of this construct. Key to understanding the effects of a hypothesized latent trait like language aptitude is to ensure that it can be meaningfully quantified, and also that whatever real world observations that the trait is supposed to be linked to (in this case, L2 acquisition) can be measured with sufficient accuracy. The present thesis set out to explore issues in the measurement of both language learning aptitude and its predicted outcome (L2 acquisition), specifically applied to a context in which the L2 is Swedish. The validity of an increasingly popular test of language aptitude, the LLAMA, was examined in detail and a test of Swedish receptive vocabulary for L2 learners (the SweLT) was developed with the aim of efficiently serving various research purposes, including the study of language aptitude effects. In addition, theoretical and methodological issues in the assessment of individual differences in second language acquisition were outlined. The results from the empirical studies suggest that the LLAMA suffers from imprecision but that it may still be useful in research if due care is given to the interpretation of the obtained test scores. For quick assessment of general proficiency in Swedish, the SweLT seems to be a promising candidate but further refinement of this test is called for. Finally, some possible implications of aptitude research are discussed, including future use of aptitude tests as practical tools for individual adaptation of educational programs for adult L2 learners of Swedish. The findings of this thesis make it clear that the LLAMA would not be suitable for this purpose. 

Place, publisher, year, edition, pages
Växjö: Linnaeus University Press, 2021. p. 80
Keywords
language aptitude, language testing, individual differences, Swedish vocabulary, test validation
National Category
General Language Studies and Linguistics
Research subject
Humanities, Linguistics
Identifiers
urn:nbn:se:hj:diva-54815 (URN)9789189460089 (ISBN)9789189460072 (ISBN)
Public defence
2021-10-22, Weber, Institutionen för svenska språket, Växjö, 13:00 (English)
Opponent
Supervisors
Available from: 2021-10-05 Created: 2021-10-05 Last updated: 2022-11-01Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Bokander, LarsBylund, Emanuel

Search in DiVA

By author/editor
Bokander, LarsBylund, Emanuel
In the same journal
Language learning
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 179 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf