Effective Features of Feedback in an Intelligent Tutoring System - A Randomized Controlled Field Trial (Pre-Registration)
Author(s) / Creator(s)
Parrisius, Cora
Wendebourg, Katharina
Rieger, Sven
Loll, Ines
Pili-Moss, Diana
Colling, Leona
Blume, Carolyn
Pieronczyk, Ines
Holz, Heiko
Bodnar, Stephen
Schmidt, Torben
Trautwein, Ulrich
Meurers, Detmar
Nagengast, Benjamin
Abstract / Description
Individualized, scaffolded feedback and motivation are essential for L2 learning. However, teachers often report that they are unable to cater to each student individually because of time constraints alone. Part of the solution is believed to be provided by intelligent tutoring systems (ITS) that aim at personalizing instructions to users by means of artificial intelligence technology. One such system for L2 learning is the ITS FeedBook for seventh-grade English as L2 learners in German secondary schools. In a first efficacy study with the FeedBook, Meurers et al. (2019) found larger learning gains for students who were provided with automatic, scaffolded, and individualized feedback on targeted grammatical structures as compared with students who only received unscaffolded, corrective feedback. We aim to replicate the findings of the Meurers et al. study by means of a follow-up trial with a larger sample of N = 616 students, testing for the effectiveness of the scaffolded feedback. As a second goal, we will examine whether there are additional positive effects on students' English proficiency regarding targeted grammatical structures if - besides the scaffolded, individualized feedback - criterion-referenced feedback and motivational elements were added to the FeedBook. Criterion-referenced feedback was realized by providing the students with a student dashboard including information about their learning progress and performance level in relation to a set learning goal; motivational elements were realized by adding a pedagogical agent presenting praise sentences after each exercise. In this pre-registration, we describe our theoretical rationales, our research questions and hypotheses, and our statistical analysis plan.
Keyword(s)
FeedBook ITS RCT feedback English learning learning outcomePersistent Identifier
PsychArchives acquisition timestamp
2022-08-31 14:16:38 UTC
Publisher
PsychArchives
Citation
Parrisius, C.*, Wendebourg, K.*, Rieger, S., Loll, I., Pili-Moss, D., Colling, L., Blume, C., Pieronczyk, I., Holz, H., Bodnar, S., Schmidt, T., Trautwein, U., Meurers, D., & Nagengast, B. (2022). Effective features of feedback in an intelligent tutoring system - A randomized controlled field trial (pre-registration). PsychArchives. http://dx.doi.org/10.23668/psycharchives.8152
* both authors contributed equally
-
Interact4School_Preregistration_Projects-2&4_2022-08-31.pdfAdobe PDF - 303.07KBMD5: 3e5db775a5693378b0f441e41a6e08d0Description: Preregistration of Interact4School Projects 2&4
-
There are no other versions of this object.
-
Author(s) / Creator(s)Parrisius, Cora
-
Author(s) / Creator(s)Wendebourg, Katharina
-
Author(s) / Creator(s)Rieger, Sven
-
Author(s) / Creator(s)Loll, Ines
-
Author(s) / Creator(s)Pili-Moss, Diana
-
Author(s) / Creator(s)Colling, Leona
-
Author(s) / Creator(s)Blume, Carolyn
-
Author(s) / Creator(s)Pieronczyk, Ines
-
Author(s) / Creator(s)Holz, Heiko
-
Author(s) / Creator(s)Bodnar, Stephen
-
Author(s) / Creator(s)Schmidt, Torben
-
Author(s) / Creator(s)Trautwein, Ulrich
-
Author(s) / Creator(s)Meurers, Detmar
-
Author(s) / Creator(s)Nagengast, Benjamin
-
PsychArchives acquisition timestamp2022-08-31T14:16:38Z
-
Made available on2022-08-31T14:16:38Z
-
Date of first publication2022-08-31
-
Abstract / DescriptionIndividualized, scaffolded feedback and motivation are essential for L2 learning. However, teachers often report that they are unable to cater to each student individually because of time constraints alone. Part of the solution is believed to be provided by intelligent tutoring systems (ITS) that aim at personalizing instructions to users by means of artificial intelligence technology. One such system for L2 learning is the ITS FeedBook for seventh-grade English as L2 learners in German secondary schools. In a first efficacy study with the FeedBook, Meurers et al. (2019) found larger learning gains for students who were provided with automatic, scaffolded, and individualized feedback on targeted grammatical structures as compared with students who only received unscaffolded, corrective feedback. We aim to replicate the findings of the Meurers et al. study by means of a follow-up trial with a larger sample of N = 616 students, testing for the effectiveness of the scaffolded feedback. As a second goal, we will examine whether there are additional positive effects on students' English proficiency regarding targeted grammatical structures if - besides the scaffolded, individualized feedback - criterion-referenced feedback and motivational elements were added to the FeedBook. Criterion-referenced feedback was realized by providing the students with a student dashboard including information about their learning progress and performance level in relation to a set learning goal; motivational elements were realized by adding a pedagogical agent presenting praise sentences after each exercise. In this pre-registration, we describe our theoretical rationales, our research questions and hypotheses, and our statistical analysis plan.en
-
Publication statusotheren
-
Review statusnotRevieweden
-
SponsorshipThe present research was funded by the German Federal Ministry of Research and Education (BMBF; 01JD1905A).
-
CitationParrisius, C.*, Wendebourg, K.*, Rieger, S., Loll, I., Pili-Moss, D., Colling, L., Blume, C., Pieronczyk, I., Holz, H., Bodnar, S., Schmidt, T., Trautwein, U., Meurers, D., & Nagengast, B. (2022). Effective features of feedback in an intelligent tutoring system - A randomized controlled field trial (pre-registration). PsychArchives. http://dx.doi.org/10.23668/psycharchives.8152 * both authors contributed equallyen
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/7446
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.8152
-
Language of contenteng
-
PublisherPsychArchivesen
-
Is related tohttps://doi.org/10.23668/psycharchives.5366
-
Keyword(s)FeedBooken
-
Keyword(s)ITSen
-
Keyword(s)RCTen
-
Keyword(s)feedbacken
-
Keyword(s)English learningen
-
Keyword(s)learning outcomeen
-
Dewey Decimal Classification number(s)150
-
TitleEffective Features of Feedback in an Intelligent Tutoring System - A Randomized Controlled Field Trial (Pre-Registration)en
-
DRO typepreregistrationen