Portuguese Automatic Short Answer Grading

Resumo

Automatic Short Answer Grading is the study field that addresses the assessment of students' answers to questions in natural language. Besides length, it differs from automatic essay grading by focusing in the evaluation of content instead of answer's style. The grading of the answers is generally seen as a typical classification supervised learning. Many researches have been recently developed, but most works deals with data in the English language. In this paper, we present a new Portuguese dataset and system for automatic short answer grading. The data was collected with the participation of 13 teachers, 12 undergraduate students and 245 elementary school students. Results achieved 69% accuracy in four-class classification and 85% on binary classification.