Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons

Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons

In this paper we present a conceptual model and methodology for the review of translated tests in the context of such international comparisons as the Trends in International Mathematics and Science Study (TIMSS) and the Programme for International Student Assessment (PISA). We also present the r...

Descrizione completa

Salvato in:
Dettagli Bibliografici
Autori principali: Solano-Flores, Guillermo, Contreras Niño, Luis Ángel, Backhoff Escudero, Eduardo
Natura: Online
Lingua:spa
eng
Pubblicazione: REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2006
Accesso online:https://redie.uabc.mx/index.php/redie/article/view/143
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne! !
id redie-article-143
record_format ojs
institution REDIE
collection OJS
language spa
eng
format Online
author Solano-Flores, Guillermo
Contreras Niño, Luis Ángel
Backhoff Escudero, Eduardo
spellingShingle Solano-Flores, Guillermo
Contreras Niño, Luis Ángel
Backhoff Escudero, Eduardo
Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
author_facet Solano-Flores, Guillermo
Contreras Niño, Luis Ángel
Backhoff Escudero, Eduardo
author_sort Solano-Flores, Guillermo
title Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
title_short Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
title_full Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
title_fullStr Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
title_full_unstemmed Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons
title_sort translation and adaptation of tests: lessons learned and recommendations for countries participating in timss, pisa and other international comparisons
description In this paper we present a conceptual model and methodology for the review of translated tests in the context of such international comparisons as the Trends in International Mathematics and Science Study (TIMSS) and the Programme for International Student Assessment (PISA). We also present the results of an investigation into the quality of the Mexican translation of the TIMSS-1995 into the Spanish language. We identified translation errors in a significant percentage of the items, as well as relatively high correlations between the severity of translation errors and the items’ p-values. These findings indicate that our error-coding system is highly sensitive to test-translation error. The results underscore the need for improved translation and translation-review procedures in international comparisons. In our opinion, to implement the guidelines properly for test translation in international comparisons, each participating country needs to have internal procedures that would ensure a rigorous review of its own translations. The article concludes with four recommendations for countries participating in international comparisons. These recommendations relate to: (a) the characteristics of the individuals in charge of translating instruments; (b) the use of review, not simply at the end of the process, but during the process of test translation; (c) the minimum time needed for various translation review iterations to take place; and (d) the need for proper documentation of the entire process of test translation.
publisher REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE).
publishDate 2006
url https://redie.uabc.mx/index.php/redie/article/view/143
_version_ 1715723510694805504
spelling redie-article-1432017-04-19T01:06:51Z Translation and Adaptation of Tests: Lessons Learned and Recommendations for Countries Participating in timss, pisa and other International Comparisons Traducción y adaptación de pruebas: Lecciones aprendidas y recomendaciones para países participantes en TIMSS, PISA y otras comparaciones internacionales Solano-Flores, Guillermo Contreras Niño, Luis Ángel Backhoff Escudero, Eduardo Educational tests international tests test translation TIMSS PISA. Pruebas de aprovechamiento pruebas internacionales traducción de pruebas TIMSS PISA. In this paper we present a conceptual model and methodology for the review of translated tests in the context of such international comparisons as the Trends in International Mathematics and Science Study (TIMSS) and the Programme for International Student Assessment (PISA). We also present the results of an investigation into the quality of the Mexican translation of the TIMSS-1995 into the Spanish language. We identified translation errors in a significant percentage of the items, as well as relatively high correlations between the severity of translation errors and the items’ p-values. These findings indicate that our error-coding system is highly sensitive to test-translation error. The results underscore the need for improved translation and translation-review procedures in international comparisons. In our opinion, to implement the guidelines properly for test translation in international comparisons, each participating country needs to have internal procedures that would ensure a rigorous review of its own translations. The article concludes with four recommendations for countries participating in international comparisons. These recommendations relate to: (a) the characteristics of the individuals in charge of translating instruments; (b) the use of review, not simply at the end of the process, but during the process of test translation; (c) the minimum time needed for various translation review iterations to take place; and (d) the need for proper documentation of the entire process of test translation. En este artículo presentamos un modelo conceptual y una metodología para la revisión de traducciones de pruebas en el contexto de comparaciones internacionales, como es el caso de TIMSS y PISA. También presentamos resultados de una investigación sobre la calidad de la traducción mexicana de TIMSS-1995 a la lengua española. Identificamos errores de traducción en un porcentaje considerable de los ítems, así como correlaciones relativamente altas entre la severidad de los errores de traducción y los valores p de los ítems. Estos hallazgos indican que nuestro sistema de codificación de errores es altamente sensible a los errores de traducción de pruebas. Los resultados ponen de manifiesto la necesidad de mejores procedimientos para traducir y revisar la traducción de pruebas en comparaciones internacionales. En nuestra opinión, para poder implementar apropiadamente los lineamientos para la traducción de pruebas en comparaciones internacionales, cada país participante debe tener procedimientos internos para la revisión rigurosa de sus propias traducciones. El artículo concluye con cuatro recomendaciones para países participantes en comparaciones internacionales. Dichas recomendaciones tienen que ver con: (a) las características del personal a cargo de traducir instrumentos, (b) la revisión durante del proceso de traducción de pruebas (no simplemente al final del mismo), (c) el tiempo mínimo necesario para que tengan lugar varias iteraciones de revisión de la traducción de las pruebas, y (d) la necesidad de documentar adecuadamente todo el proceso de traducción de pruebas. REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2006-11-01 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion text/html application/pdf text/html application/pdf https://redie.uabc.mx/index.php/redie/article/view/143 Revista Electrónica de Investigación Educativa; Vol. 8 No. 2 (2006) Revista Electrónica de Investigación Educativa; Vol. 8 Núm. 2 (2006) 1607-4041 spa eng https://redie.uabc.mx/index.php/redie/article/view/143/1038 https://redie.uabc.mx/index.php/redie/article/view/143/245 https://redie.uabc.mx/index.php/redie/article/view/143/1039 https://redie.uabc.mx/index.php/redie/article/view/143/246 Derechos de autor 2019 Revista Electrónica de Investigación Educativa

Documenti analoghi