Assessing EFL university students' writing: A study of score reliability
The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that ex...
Guardado en:
Autores principales: | , , |
---|---|
格式: | Online |
語言: | eng |
出版: |
REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE).
2017
|
在線閱讀: | https://redie.uabc.mx/index.php/redie/article/view/928 |
標簽: |
添加標簽
沒有標簽, 成為第一個標記此記錄!
|
id |
redie-article-928 |
---|---|
record_format |
ojs |
spelling |
redie-article-9282020-12-11T18:02:51Z Assessing EFL university students' writing: A study of score reliability Evaluando la escritura de alumnos universitarios de EFL: estudio sobre la confiabilidad de las calificaciones González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth Inglés como lengua extranjera Evaluación de la escritura Confiabilidad Rúbrica de evaluación The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics. La evaluación de la escritura en inglés como lengua extranjera (EFL) es un proceso que depende del juicio humano, por lo que es difícil de obtener evaluaciones justas, acertadas y confiables (Pearson, 2004, p. 117; Hamp-Lyons, 2003). Este estudio reporta la variabilidad existente entre las calificaciones analíticas que 11 docentes Mexicanos universitarios de EFL proporcionaron a cinco trabajos escritos. Describe las percepciones de los participantes en torno a la evaluación de la escritura y el uso de las rúbricas de evaluación. Los datos obtenidos de las calificaciones de cada trabajo y de un cuestionario escrito revelaron que existe gran variedad entre las calificaciones proporcionadas y que los evaluadores difieren en sus niveles de exigencia, sugiriendo así que antecedentes homogéneos y el uso de una misma rúbrica no son suficientes para obtener confiabilidad en las evaluaciones. Las percepciones de los participantes fueron similares en relación al uso de las rúbricas. REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). 2017-04-10 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion text/html application/pdf application/xml https://redie.uabc.mx/index.php/redie/article/view/928 10.24320/redie.2017.19.2.928 Revista Electrónica de Investigación Educativa; Vol. 19 No. 2 (2017); 91 - 103 Revista Electrónica de Investigación Educativa; Vol. 19 Núm. 2 (2017); 91 - 103 1607-4041 eng https://redie.uabc.mx/index.php/redie/article/view/928/1525 https://redie.uabc.mx/index.php/redie/article/view/928/1542 https://redie.uabc.mx/index.php/redie/article/view/928/1925 Derechos de autor 2019 Revista Electrónica de Investigación Educativa |
institution |
REDIE |
collection |
OJS |
language |
eng |
format |
Online |
author |
González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth |
spellingShingle |
González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth Assessing EFL university students' writing: A study of score reliability |
author_facet |
González, Elsa Fernanda Trejo, Nelly Paulina Roux, Ruth |
author_sort |
González, Elsa Fernanda |
title |
Assessing EFL university students' writing: A study of score reliability |
title_short |
Assessing EFL university students' writing: A study of score reliability |
title_full |
Assessing EFL university students' writing: A study of score reliability |
title_fullStr |
Assessing EFL university students' writing: A study of score reliability |
title_full_unstemmed |
Assessing EFL university students' writing: A study of score reliability |
title_sort |
assessing efl university students' writing: a study of score reliability |
description |
The assessment of English as a Foreign Language (EFL) writing is a complex activity that is subject to human judgment, which makes it difficult to achieve a fair, accurate and reliable assessment of student writing (Pearson, 2004: 117; Hamp-Lyons, 2003). This study reports on the variability that exists between the analytical grades that 11 Mexican EFL university teachers awarded to five writing samples. It describes the raters’ views on writing assessment and their use of analytical scoring rubrics. Data obtained from the grades awarded to each paper, and a background questionnaire, suggested that great variability was found between grades, and raters differed in their levels of leniency and severity, suggesting that having similar backgrounds and using the same rubric are not enough to ensure rater reliability. Participants’ perceptions were found to be similar in terms of the use of analytical rubrics. |
publisher |
REDIE es una publicación del Instituto de Investigación y Desarrollo Educativo (IIDE). |
publishDate |
2017 |
url |
https://redie.uabc.mx/index.php/redie/article/view/928 |
_version_ |
1715723556292132864 |