Assessing EFL university students' writing: A study of score reliability

Assessing EFL university students' writing: A study of score reliability

The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that ex...

Deskribapen osoa

Gorde:
Xehetasun bibliografikoak
Egile Nagusiak: González, Elsa Fernanda, Trejo, Nelly Paulina, Roux, Ruth
Formatua: Online
Hizkuntza:eng
Argitaratua: REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2017
Sarrera elektronikoa:https://redie.uabc.mx/index.php/redie/article/view/928
Etiketak: Etiketa erantsi
Etiketarik gabe, Izan zaitez lehena erregistro honi etiketa jartzen!
id redie-article-928
record_format ojs
spelling redie-article-9282020-12-11T18:02:51Z Assessing EFL university students' writing: A study of score reliability Evaluando la escritura de alumnos universitarios de EFL: estudio sobre la confiabilidad de las calificaciones González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics. La evaluación de la escritura en inglés como lengua extranjera (EFL) es un proceso que depende del juicio humano, por lo que es difícil de obtener evaluaciones justas, acertadas y confiables (Pearson, 2004, p. 117; Hamp-Lyons, 2003). Este estudio reporta la variabilidad existente entre las calificaciones analíticas que 11 docentes Mexicanos universitarios de EFL proporcionaron a cinco trabajos escritos. Describe las percepciones de los participantes en torno a la evaluación de la escritura y el uso de las rúbricas de evaluación. Los datos obtenidos de las calificaciones de cada trabajo y de un cuestionario escrito revelaron que existe gran variedad entre las calificaciones proporcionadas y que los evaluadores difieren en sus niveles de exigencia, sugiriendo así que antecedentes homogéneos y el uso de una misma rúbrica no son suficientes para obtener confiabilidad en las evaluaciones. Las percepciones de los participantes fueron similares en relación al uso de las rúbricas. REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2017-04-10 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion text/html application/pdf application/xml https://redie.uabc.mx/index.php/redie/article/view/928 10.24320/redie.2017.19.2.928 Revista Electrónica de Investigación Educativa; Vol. 19 No. 2 (2017); 91 - 103 Revista Electrónica de Investigación Educativa; Vol. 19 Núm. 2 (2017); 91 - 103 1607-4041 eng https://redie.uabc.mx/index.php/redie/article/view/928/1525 https://redie.uabc.mx/index.php/redie/article/view/928/1542 https://redie.uabc.mx/index.php/redie/article/view/928/1925 Derechos de autor 2019 Revista Electrónica de Investigación Educativa
institution REDIE
collection OJS
language eng
format Online
author González, Elsa Fernanda
Trejo, Nelly Paulina
Roux, Ruth
spellingShingle González, Elsa Fernanda
Trejo, Nelly Paulina
Roux, Ruth
Assessing EFL university students' writing: A study of score reliability
author_facet González, Elsa Fernanda
Trejo, Nelly Paulina
Roux, Ruth
author_sort González, Elsa Fernanda
title Assessing EFL university students' writing: A study of score reliability
title_short Assessing EFL university students' writing: A study of score reliability
title_full Assessing EFL university students' writing: A study of score reliability
title_fullStr Assessing EFL university students' writing: A study of score reliability
title_full_unstemmed Assessing EFL university students' writing: A study of score reliability
title_sort assessing efl university students' writing: a study of score reliability
description The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics.
publisher REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE).
publishDate 2017
url https://redie.uabc.mx/index.php/redie/article/view/928
_version_ 1715723556292132864

Antzeko izenburuak