Skip to content

Latest commit

 

History

History
37 lines (27 loc) · 2.4 KB

index.md

File metadata and controls

37 lines (27 loc) · 2.4 KB
Raw
title subtitle author date output
UK Conference on Teaching Statistics
Manchester, England
| Matthew Beckman | Penn State University
June 14, 2024
html_document
css
stylesheet.css

Research evaluating NLP tools designed to assist instructors with formative assessment for students in large-enrollment STEM education classes

Abstract. The project described here seeks to articulate the benefit of free-response tasks and timely formative assessment feedback and progress toward developing human-in-the-loop natural language processing (NLP) assisted feedback at scale. Research suggests "write-to-learn" tasks improve learning outcomes, yet constructed-response methods of formative assessment become unwieldy when class sizes grow large. If we are to pursue Statistics and Data Science Education across disciplines, we will surely encounter both opportunity and necessity to develop scalable solutions for pedagogical best practices. In a pilot study, several shortanswer tasks completed by nearly 2000 introductory tertiary statistics students were evaluated by human raters and an NLP algorithm. The talk will conclude with recent developments building upon this pilot, as well as implications for teaching and future research.

Resources

  • Slides (PDF)
  • ICOTS Paper (PDF): Lloyd, S. E., Beckman, M., Pearl, D., Passonneau, R., Li, Z., & Wang, Z. (2022). Foundations for AI-Assisted Formative Assessment Feedback for Short-Answer Tasks in Large-Enrollment Classes. In Proceedings of the eleventh international conference on teaching statistics. Rosario, Argentina.
  • EMNLP Paper: Li, Z., Lloyd, S., Beckman, M. D., & Passonneau, R. J. (2023). Answer-state Recurrent Relational Network (AsRRN) for Constructed Response Assessment and Feedback Grouping. Findings of the Association for Computational Linguistics: EMNLP 2023. https://doi.org/10.18653/v1/2023.findings-emnlp.254
  • UKCOTS Website (link)

Acknowledgment

  • We're grateful to the US National Science Foundation for funding this research (NSF DUE-2236150: Project CLASSIFIES)

Contact

Matthew Beckman
Assoc Research Professor | Penn State University
Incoming Director | CAUSE

email: mdb268 [at] psu [dot] edu
personal webpage: https://mdbeckman.github.io/
CAUSE webpage: https://www.causeweb.org