Simulated computer adaptive testing method choices for ability estimation with empirical evidence

Jumoke I. Oladele, Mdutshekelwa Ndlovu, Erica D. Spangenberg

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Computer adaptive testing (CAT) is a technological advancement for educational assessments that requires thorough feasibility studies through computer simulations to ensure strong testing foundations. This advancement is especially germane in Africa being adopters of technology, and this should not be done blindly without empirical evidence. A quasi-experimental design was adopted for this study to establish methodological choices for CAT ability estimation. Five thousand candidates were simulated with 100 items simulate through the three-parameter logistic model. The simulation design stipulated a fixed-length test of 30 items, while examinee characteristics were drawn from a normal distribution with a mean of 0 and a standard deviation of 1. Also, controls for the simulation were set not to control item exposure or to use the progressive restricted method. Data gathered were analyzed using descriptive statistics (mean and standard deviation) and inferential statistics (Two-way multivariate analysis of variance: MANOVA) for testing the generated hypotheses. This study provided empirical evidence for choosing ability estimation methods for CAT as part of the efforts geared towards designing accurate testing programs for use in higher education.

Original languageEnglish
Pages (from-to)1392-1399
Number of pages8
JournalInternational Journal of Evaluation and Research in Education
Volume11
Issue number3
DOIs
Publication statusPublished - Sept 2022

Keywords

  • Ability estimation
  • CAT
  • Item response theory
  • Methods Simulation

ASJC Scopus subject areas

  • Education

Fingerprint

Dive into the research topics of 'Simulated computer adaptive testing method choices for ability estimation with empirical evidence'. Together they form a unique fingerprint.

Cite this