| 1 |
Age, Task Characteristics, and Acoustic Indicators of Engagement: Investigations into the Validity of a Technology-Enhanced Speaking Test for Young Language Learners
|
|
|
|
Abstract:
Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for YLLs. Thus, the purpose of the current study was to explore relationships among examinee age, task characteristics, engagement, and performance in the context of gathering evidence to back a test validity argument. Following a mixed-methods approach, the investigations involved over 400 YLLs in 11 countries who responded to TOEFL Primary® Speaking test tasks (Educational Testing Service, 2013). Results from many-facet Rasch measurement revealed that, in terms of evaluation claims, tasks and raters functioned well across examinee age groups. Generalizability theory was then applied to confirm that examinees accounted for most of the score variance and that current test form configurations maximize score dependability. Fischer’s (1973, 1995) linear logistic test model results helped explain that vocabulary support, novelty, and video animation increased task difficulty, while topical choice did not. Lastly, acoustic measures of harmonicity and shimmer from the spoken responses served as indicators of engagement in a structural model showing that topical choice and novelty promoted engagement; these findings were triangulated by retrospective verbal reports from eight YLLs. Results point to the importance of including engagement in theoretical models of language performance. Also, a taxonomy of task characteristics that may support engagement is proposed to help drive a research agenda and inform test development.
|
|
Keyword:
Educational tests and measurements; English language--Study and teaching; Linguistics; Test of English as a Foreign Language
|
|
URL: https://doi.org/10.7916/d8-ad10-bc50
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Language Testing : regards croisés entre anglophonie et francophonie
|
|
|
|
In: Éducation dans les pays anglophones et francophones : héritages, contextes et représentations ; https://hal.archives-ouvertes.fr/hal-03086895 ; Éducation dans les pays anglophones et francophones : héritages, contextes et représentations, Imelda Elliott, HLLI, Université du Littoral Côte d'Opale, Nov 2020, Boulogne-sur-Mer, France ; https://view.genial.ly/5fa6c362316b3b0cf52d8f3a/horizontal-infographic-timeline-journee-detudes (2020)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
ЛИНГВО-ПРАГМАТИЧЕСКИЕ ОСОБЕННОСТИ ВЫРАЖЕНИЯ РЕЧЕВОГО АКТА «ПРИГЛАШЕНИЕ» У ДОШКОЛЬНИКОВ ... : Linguistic and pragmatic peculiarities of preschoolers invitations ...
|
|
Кожухова, И.В.. - : ФГБОУ ВО "Воронежский государственный технический университет", 2020
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Einleitung: Instrumente zur Erfassung institutioneller (schrift-)sprachlicher Bildung
|
|
|
|
In: Mackowiak, Katja [Hrsg.]; Beckerle, Christine [Hrsg.]; Gentrup, Sarah [Hrsg.]; Titz, Cora [Hrsg.]: Forschungsinstrumente im Kontext institutioneller (schrift-)sprachlicher Bildung. Bad Heilbrunn : Verlag Julius Klinkhardt 2020, S. 7-12 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Forschungsinstrumente im Kontext institutioneller (schrift-)sprachlicher Bildung
|
|
|
|
In: Bad Heilbrunn : Verlag Julius Klinkhardt 2020, 159 S. (2020)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
"Langsam vermisse ich die Schule .". Schule während und nach der Corona-Pandemie
|
|
|
|
In: Münster ; New York : Waxmann 2020, 229 S. - (Die Deutsche Schule, Beiheft; 16) (2020)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
FaWi-S – Eine psychometrische Testkonstruktion zum didaktischen Wissen von Grundschullehrkräften in Bezug auf Sprachförderung im Projekt Eva-Prim
|
|
|
|
In: Mackowiak, Katja [Hrsg.]; Beckerle, Christine [Hrsg.]; Gentrup, Sarah [Hrsg.]; Titz, Cora [Hrsg.]: Forschungsinstrumente im Kontext institutioneller (schrift-)sprachlicher Bildung. Bad Heilbrunn : Verlag Julius Klinkhardt 2020, S. 33-53 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Language Testing as a Profession: An Interview with Yan Jin ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Language Testing as a Profession: An Interview with Yan Jin ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Age, Task Characteristics, and Acoustic Indicators of Engagement: Investigations into the Validity of a Technology-Enhanced Speaking Test for Young Language Learners ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Assessment of Word-Level Neural Language Models for Sentence Completion
|
|
|
|
In: Applied Sciences ; Volume 10 ; Issue 4 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Shared Storybook Reading and the Development of Oral Language Skills ... : Das gemeinsame Lesen von Kinderbüchern und die Entwicklung frühkindlicher Sprachfähigkeiten ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
How much does test-takers’ listening proficiency matter in oral interview tests?
|
|
|
|
BASE
|
|
Show details
|
|
|
| 14 |
The impact on candidates of examiner interventions in oral interview tests
|
|
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Comparing rating modes: analysing live, audio, and video ratings of IELTS Speaking Test performances
|
|
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Assessment of candidates' interactional competence using group oral tests
|
|
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Comparing writing proficiency assessments used in professional medical registration: a methodology to inform policy and practice
|
|
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Effects of pre-task planning on paired oral test performance: a case of beginning EFL learners
|
|
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Effects of the number of participants on group oral test performance
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
