R. F. Demara, D. Turgut, E. Nassiff, S. Bacanli, N. H. Bidoki, and J. Xu

Automated Formation of Peer Learning Cohorts using Computer-Based Assessment Data: A Double-Blind Study within a Software Engineering Course


Cite as:

R. F. Demara, D. Turgut, E. Nassiff, S. Bacanli, N. H. Bidoki, and J. Xu. Automated Formation of Peer Learning Cohorts using Computer-Based Assessment Data: A Double-Blind Study within a Software Engineering Course. In 2018 ASEE Annual Conference & Exposition Conference, June 2018. 17 pages

Download:

Download 

Abstract:

An approach is developed to integrate the complementary benefits of digitized assessments and peer learning. The research hypothesis is that each student’s assessment data at the fine-grained resolution of correct/incorrect question choice selections can be utilized to partition learners into effective peer learning cohorts. A low overhead approach is explored along with its associated tool, referred to as Automated Peer Learning Cohorts (Auto-PLC). The objective of Auto-PLC is to increase scalability to deliver peer-based learning. First, digitized formative assessments are delivered in a computer-based testing center. This enables automated grading, which frees-up the instructor’s and teaching assistants’ workloads to become reallocated to recitation sessions for higher-gain learning activities, such as peer-based remediation sessions. Second, within the recitations held following each formative quiz, students are afforded an opportunity to complete a remedial assignment. Here the auto-graded results of formative assessment submissions have undergone Auto-PLC’s statistical clustering routines using Excel macros and Python scripts to partition the class into four-person peer learning cohorts having mutually-complimentary knowledge gaps and skill efficacies. Within each peer learning cohort, students solve together an assigned remedial problem during the recitation session. Thus, students who have already acquired a particular skill become paired together with those students who are still acquiring that same skill, and vice versa. This also aids scalability to large enrollments within ECE and CS courses by maximizing opportunities for students to teach each other the material which they still need to learn. The motivation, design, and outcomes for Auto-PLC are presented within the required undergraduate course Object-Oriented Software Development at a large state university. To evaluate effectiveness, a double-blind IRB-approved study has been conducted in (redacted course number) with 206 students. All enrolled participated identically, except for their assignment to either randomly-formed or intelligently-clustered remediation groups. At the end of the semester, all students completed an identical final exam to provide a basis by which to compare their relative achievements. The data collected expounds upon the details of Auto-PLC’s impact towards achievement on a topic-specific basis. Additionally, learners’ perceptions about participation in automatically-formed peer learning cohorts are discussed.

BibTeX:

@inproceedings{Demara-ASEE2018,
  title={{Automated Formation of Peer Learning Cohorts using Computer-Based Assessment Data: A Double-Blind Study within a Software Engineering Course}},
  author={R. F. Demara and D. Turgut and E. Nassiff and S. Bacanli and N. H. Bidoki and J. Xu},
  booktitle={2018 ASEE Annual Conference & Exposition Conference},
  year={2018},
  month={June},
  note = {17 pages},
  abstract = {An approach is developed to integrate the complementary benefits of digitized assessments and peer learning. The research hypothesis is that each student’s assessment data at the fine-grained resolution of correct/incorrect question choice selections can be utilized to partition learners into effective peer learning cohorts. A low overhead approach is explored along with its associated tool, referred to as Automated Peer Learning Cohorts (Auto-PLC). The objective of Auto-PLC is to increase scalability to deliver peer-based learning. First, digitized formative assessments are delivered in a computer-based testing center. This enables automated grading, which frees-up the instructor’s and teaching assistants’ workloads to become reallocated to recitation sessions for higher-gain learning activities, such as peer-based remediation sessions. Second, within the recitations held following each formative quiz, students are afforded an opportunity to complete a remedial assignment. Here the auto-graded results of formative assessment submissions have undergone Auto-PLC’s statistical clustering routines using Excel macros and Python scripts to partition the class into four-person peer learning cohorts having mutually-complimentary knowledge gaps and skill efficacies. Within each peer learning cohort, students solve together an assigned remedial problem during the recitation session. Thus, students who have already acquired a particular skill become paired together with those students who are still acquiring that same skill, and vice versa. This also aids scalability to large enrollments within ECE and CS courses by maximizing opportunities for students to teach each other the material which they still need to learn. The motivation, design, and outcomes for Auto-PLC are presented within the required undergraduate course Object-Oriented Software Development at a large state university. To evaluate effectiveness, a double-blind IRB-approved study has been conducted in (redacted course number) with 206 students. All enrolled participated identically, except for their assignment to either randomly-formed or intelligently-clustered remediation groups. At the end of the semester, all students completed an identical final exam to provide a basis by which to compare their relative achievements. The data collected expounds upon the details of Auto-PLC’s impact towards achievement on a topic-specific basis. Additionally, learners’ perceptions about participation in automatically-formed peer learning cohorts are discussed.},
}

Generated by bib2html.pl (written by Patrick Riley, Lotzi Boloni ) on Sun Mar 03, 2024 18:41:15