Innovative test item analysis using optical mark recognition technology: An evaluation

Abstract

This study focuses on the need for effective tools to improve assessment processes in education by developing and evaluating a software application that analyzes test items using Optical Mark Recognition (OMR) technology. Traditional methods of test item analysis are often slow and unreliable due to manual handling and limited statistical insights. The proposed software aims to automate the creation, analysis, and management of test items, making the process more efficient for educators. The study follows a mixed-method approach, using qualitative methods for software design and quantitative evaluation based on ISO/IEC 25010 software quality standards. Developmental research principles guide the continuous improvement of the system to meet educational goals and user needs. Initial assessments by IT experts and users confirm the system’s functionality and ease of use. Recent advancements in automated assessment systems highlight the potential of OMR-based technology to make test item analysis faster and more accurate. The evaluation phase uses quantitative measures to assess the system’s reliability, efficiency, and user satisfaction. Findings from related studies on question difficulty prediction further support improvements to the software, ensuring it meets the demands of modern educational assessment.