← Back to papers
2022 NAACL NAACL 2022

Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays

Abstract

AbstractMost research in the area of automatic essay grading (AEG) is geared towards scoring the essay holistically while there has also been little work done on scoring individual essay traits. In this paper, we describe a way to score essays using a multi-task learning (MTL) approach, where scoring the essay holistically is the primary task, and scoring the essay traits is the auxiliary task. We compare our results with a single-task learning (STL) approach, using both LSTMs and BiLSTMs. To find out which traits work best for different types of essays, we conduct ablation tests for each of the essay traits. We also report the runtime and number of training parameters for each system. We find that MTL-based BiLSTM system gives the best results for scoring the essay holistically, as well as performing well on scoring the essay traits. The MTL systems also give a speed-up of between 2.30 to 3.70 times the speed of the STL system, when it comes to scoring the essay and all the traits.

🌉 Interdisciplinary Bridge — Deep Learning and Interdisciplinary and Machine Learning and Natural Language Processing
🧭 Keyword Pioneer — essay trait scoring
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Rahul Kumar , Sandeep Mathias , Sriparna Saha , Pushpak Bhattacharyya

Topics

Deep Learning > Architectures > Neural Networks Natural Language Processing > Applications > Text Classification Interdisciplinary > Social > Education Machine Learning > Learning Types > Multi-Task Learning Machine Learning > Learning Paradigms > Multi-Task Learning

Keywords

multi-task learning text classification recurrent neural network bidirectional lstm essay scoring automatic essay scoring bidirectional long short-term memory automatic essay grading automated assessment essay trait scoring essay trait analysis
Download PDF

Related papers

EVI: Multilingual Spoken Dialogue Tasks and Dataset for Knowledge-Based Enrolment, Verification, and Identification 2022
Generating Complement Data for Aspect Term Extraction with GPT-2 2022
Regularized Training of Nearest Neighbor Language Models 2022
Systematicity Emerges in Transformers when Abstract Grammatical Roles Guide Attention 2022
Neural Retriever and Go Beyond: A Thesis Proposal 2022