Assessing EFL university students' writing: A study of score reliability

The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that ex...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	González, Elsa Fernanda, Trejo, Nelly Paulina, Roux, Ruth
Formato:	info:eu-repo/semantics/article
Lenguaje:	eng
Publicado:	REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2017
Materias:	Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación
Acceso en línea:	https://redie.uabc.mx/index.php/redie/article/view/928
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	repositorioinstitucional-20.500.12930-6208
record_format	dspace
spelling	repositorioinstitucional-20.500.12930-62082023-05-09T15:05:09Z Assessing EFL university students' writing: A study of score reliability Evaluando la escritura de alumnos universitarios de EFL: estudio sobre la confiabilidad de las calificaciones González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics. La evaluación de la escritura en inglés como lengua extranjera (EFL) es un proceso que depende del juicio humano, por lo que es difícil de obtener evaluaciones justas, acertadas y confiables (Pearson, 2004, p. 117; Hamp-Lyons, 2003). Este estudio reporta la variabilidad existente entre las calificaciones analíticas que 11 docentes Mexicanos universitarios de EFL proporcionaron a cinco trabajos escritos. Describe las percepciones de los participantes en torno a la evaluación de la escritura y el uso de las rúbricas de evaluación. Los datos obtenidos de las calificaciones de cada trabajo y de un cuestionario escrito revelaron que existe gran variedad entre las calificaciones proporcionadas y que los evaluadores difieren en sus niveles de exigencia, sugiriendo así que antecedentes homogéneos y el uso de una misma rúbrica no son suficientes para obtener confiabilidad en las evaluaciones. Las percepciones de los participantes fueron similares en relación al uso de las rúbricas. 2017-04-10 2021-06-03T03:07:59Z 2021-06-03T03:07:59Z info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion https://redie.uabc.mx/index.php/redie/article/view/928 10.24320/redie.2017.19.2.928 https://hdl.handle.net/20.500.12930/6208 eng https://redie.uabc.mx/index.php/redie/article/view/928/1525 https://redie.uabc.mx/index.php/redie/article/view/928/1542 https://redie.uabc.mx/index.php/redie/article/view/928/1925 Derechos de autor 2019 Revista Electrónica de Investigación Educativa text/html application/pdf application/xml REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). Revista Electrónica de Investigación Educativa; Vol. 19 No. 2 (2017); 91 - 103 Revista Electrónica de Investigación Educativa; Vol. 19 Núm. 2 (2017); 91 - 103 1607-4041
institution	Repositorio Institucional
collection	DSpace
language	eng
topic	Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación
spellingShingle	Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth Assessing EFL university students' writing: A study of score reliability
description	The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics.
format	info:eu-repo/semantics/article
author	González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth
author_facet	González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth
author_sort	González, Elsa Fernanda
title	Assessing EFL university students' writing: A study of score reliability
title_short	Assessing EFL university students' writing: A study of score reliability
title_full	Assessing EFL university students' writing: A study of score reliability
title_fullStr	Assessing EFL university students' writing: A study of score reliability
title_full_unstemmed	Assessing EFL university students' writing: A study of score reliability
title_sort	assessing efl university students' writing: a study of score reliability
publisher	REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE).
publishDate	2017
url	https://redie.uabc.mx/index.php/redie/article/view/928
_version_	1792610193896374272

Assessing EFL university students' writing: A study of score reliability

Ejemplares similares

Síguenos en: