Differential Weighting of Items to Improve University Admission Test Validity

This paper gives an evaluation of different ways to increase university admission test criterion-related validity, by differentially weighting test items. We compared four methods of weighting multiple-choice items of the Basic Skills and Knowledge Examination (EXHCOBA): (1) punishing incorrect...

Full description

Saved in:
Bibliographic Details
Main Authors: Backhoff Escudero, Eduardo, Tirado Segura, Felipe, Larrazolo Reyna, Norma
Format: Online
Language:spa
eng
Published: REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2001
Online Access:https://redie.uabc.mx/index.php/redie/article/view/32
Tags: Add Tag
No Tags, Be the first to tag this record!
id redie-article-32
record_format ojs
spelling redie-article-322017-04-19T01:08:56Z Differential Weighting of Items to Improve University Admission Test Validity Ponderación diferencial de reactivos para mejorar la validez de una prueba de ingreso a la universidad Backhoff Escudero, Eduardo Tirado Segura, Felipe Larrazolo Reyna, Norma Weighting of items weighted scores evaluation methods predictive validity admissions test. Ponderación de ítems calificación ponderada métodos de evaluación validez predictiva exámenes de admisión. This paper gives an evaluation of different ways to increase university admission test criterion-related validity, by differentially weighting test items. We compared four methods of weighting multiple-choice items of the Basic Skills and Knowledge Examination (EXHCOBA): (1) punishing incorrect responses by a constant factor, (2) weighting incorrect responses, considering the levels of error, (3) weighting correct responses, considering the item’s difficulty, based on the Classic Measurement Theory, and (4) weighting correct responses, considering the item’s difficulty, based on the Item Response Theory. Results show that none of these methods increased the instrument’s predictive validity, although they did improve its concurrent validity. It was concluded that it is appropriate to score the test by simply adding up correct responses. Este trabajo evalúa diversas formas para incrementar la validez criterial de las pruebas de admisión a la universidad, a través de otorgar distintos pesos a los reactivos que componen las pruebas. Se compararon cuatro métodos para ponderar los reactivos de opción múltiple del Examen de Habilidades y Conocimientos Básicos (EXHCOBA): (1) castigando las respuestas incorrectas con un factor constante; (2) ponderando el castigo de las respuestas incorrectas, considerando los niveles de error; (3) ponderando los aciertos según la dificultad del ítem, basándose en la Teoría clásica de la medida y (4) ponderar los aciertos según la dificultad del ítem, basándose en la Teoría de respuestas al ítem. Los resultados muestran que ninguno de estos métodos mejoró la validez predictiva del instrumento, aunque sí mejoraron su validez concurrente. Se concluye que es conveniente calificar la prueba sumando simplemente el número de respuestas correctas. REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2001-05-01 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion text/html application/pdf text/html application/pdf https://redie.uabc.mx/index.php/redie/article/view/32 Revista Electrónica de Investigación Educativa; Vol. 3 No. 1 (2001) Revista Electrónica de Investigación Educativa; Vol. 3 Núm. 1 (2001) 1607-4041 spa eng https://redie.uabc.mx/index.php/redie/article/view/32/1172 https://redie.uabc.mx/index.php/redie/article/view/32/63 https://redie.uabc.mx/index.php/redie/article/view/32/1173 https://redie.uabc.mx/index.php/redie/article/view/32/64 Derechos de autor 2019 Revista Electrónica de Investigación Educativa
institution REDIE
collection OJS
language spa
eng
format Online
author Backhoff Escudero, Eduardo
Tirado Segura, Felipe
Larrazolo Reyna, Norma
spellingShingle Backhoff Escudero, Eduardo
Tirado Segura, Felipe
Larrazolo Reyna, Norma
Differential Weighting of Items to Improve University Admission Test Validity
author_facet Backhoff Escudero, Eduardo
Tirado Segura, Felipe
Larrazolo Reyna, Norma
author_sort Backhoff Escudero, Eduardo
title Differential Weighting of Items to Improve University Admission Test Validity
title_short Differential Weighting of Items to Improve University Admission Test Validity
title_full Differential Weighting of Items to Improve University Admission Test Validity
title_fullStr Differential Weighting of Items to Improve University Admission Test Validity
title_full_unstemmed Differential Weighting of Items to Improve University Admission Test Validity
title_sort differential weighting of items to improve university admission test validity
description This paper gives an evaluation of different ways to increase university admission test criterion-related validity, by differentially weighting test items. We compared four methods of weighting multiple-choice items of the Basic Skills and Knowledge Examination (EXHCOBA): (1) punishing incorrect responses by a constant factor, (2) weighting incorrect responses, considering the levels of error, (3) weighting correct responses, considering the item’s difficulty, based on the Classic Measurement Theory, and (4) weighting correct responses, considering the item’s difficulty, based on the Item Response Theory. Results show that none of these methods increased the instrument’s predictive validity, although they did improve its concurrent validity. It was concluded that it is appropriate to score the test by simply adding up correct responses.
publisher REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE).
publishDate 2001
url https://redie.uabc.mx/index.php/redie/article/view/32
_version_ 1715723496673247232