RSMTool swMATH ID: 29014 Software Authors: Nitin Madnani, Anastassia Loukina Description: Rater Scoring Modeling Tool (RSMTool) - RSMTool: collection of tools building and evaluating automated scoring models. Automated scoring of written and spoken responses is a growing field in educational natural language processing. Automated scoring engines employ machine learning models to predict scores for such responses based on features extracted from the text/audio of these responses. Examples of automated scoring engines include Project Essay Grade for written responses and SpeechRater for spoken responses. RSMTool is a python package which automates and combines in a single :doc:‘pipeline <pipeline>‘ multiple analyses that are commonly conducted when building and evaluating automated scoring models. The output of RSMTool is a comprehensive, customizable HTML statistical report that contains the outputs of these multiple analyses. While RSMTool does make it really simple to run this set of standard analyses using a single command, it is also fully customizable and allows users to easily exclude unneeded analyses, modify the standard analyses, and even include custom analyses in the report. Homepage: https://rsmtool.readthedocs.io/en/latest/ Source Code: https://github.com/EducationalTestingService/rsmtool/blob/master/doc/index.rst Dependencies: Python Keywords: Rater Scoring Modeling; JOSS; Journal Open Source Software; automated scoring; natural language processing; Python Related Software: Python; Scikit; fairseq; PyTorch; NeuralClassifier; OpenKiwi; OpenNMT; AllenNLP; BERT; EXPATS; Skll Cited in: 0 Documents Standard Articles 1 Publication describing the Software Year