Overview and Citation

The herein-presented functions and software are described in the below-mentioned publication. Please cite accordingly:

Tobler, S. (2024) Smart Grading: A Generative AI-Based Tool for Knowledge-Grounded Answer Evaluation in Educational Assessments. MethodsX, 12. https://doi.org/10.1016/j.mex.2023.102531

Software and Code

⌨️ Functions

• eval_single: This function allows running the evaluation function for an individual answer.
• eval_combined: This function allows the evaluation function to run in a loop over all participants.

👾 Software

• SmartGrading_Application: This script allows running the above-described functions in a web application environment. The RShiny application can be directly launched from R Studio. Alternatively, you can run the application via https://stobler.shinyapps.io/smartgrading

📊 Code

• Krippendorff.R: Includes the code for analyzing inter-rater reliabilities, for example, between SmartGrading and own results.