Item Details

Bridging the gap between learning and evaluation: Lessons learnt from multilingual pupils

Issue: Vol 14 No. 1 (2017)

Journal: Journal of Applied Linguistics and Professional Practice

Subject Areas: Writing and Composition Linguistics

DOI: 10.1558/jalpp.39770

Abstract:

The use of non-dominant linguistic repertoires is often not valued in educational practices, let alone in educational assessment. The competences of multilingual learners are traditionally assessed by tests designed for monolinguals that do not represent the true capabilities of multilingual pupils, because their level of language proficiency in the text language does not reflect their wider abilities. Assessment needs to shift from evaluating a pupil in only the language of schooling towards assessment where the full multilingual repertoire can be used to demonstrate knowledge and competences. In this study, assessment preferences of multilingual pupils are explored, both in assessment accommodations for large-scale testing and in classroom-based assessment that is aligned with assessment for learning. Interviews with 35 pupils in fifth-grade of primary education (age 10–11) in Belgium were conducted. Results indicate that accommodations that use pupils’ first languages are not necessarily the most popular ones, that pupils are in favour of portfolios and oral assessments and that they need more feedback. The findings of this study suggest the need for instruction and evaluation to become more integrated, which would be beneficial for all pupils and could be more inclusive of emergent bilinguals rather than treating them as a separate group.

Author: Fauve De Backer

View Full Text

References :

Abedi, Jamal (2004) The No Child Left Behind Act and English language learners: Assess­ment and accountability issues. Educational researcher 33 (4): 14. https://doi.org/
10.3102/0013189x033001004

Abedi, Jamal (2006) Psychometric issues in the ELL assessment and special education eligibility. Teachers College Record 108 (11): 2282–2303. https://doi.org/10.1111/j.1467-9620.2006.00782.x

Abedi, Jamal (2008) Utilizing accommodations in assessment. In Nancy Hornberger (ed.) Encyclopedia of Language and Education, 2462–2478. Boston, MA: Springer. https://doi.org/10.1007/978-0-387-30424-3_185

Abedi, Jamal, Carolyn H. Hofstetter and Carol Lord (2004) Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research 74 (1): 1–28. https://doi.org/10.3102/00346543074001001

Abedi, Jamal and Carol Lord (2010) The language factor in mathematics tests. Applied Measurement in Education 14 (3): 219–234. https://doi.org/10.1207/s15324818ame1403_2

Assessment Reform Group (2002) Assessment for Learning: 10 Principles. London: Assessment Reform Group.

Black, Paul S. and Dylan William (1998) Assessment and classroom learning. Assessment in Education: Principles, Policing and Perspectives 5 (1): 7–74.

Clark-Gareca, Beth (2016) Classroom assessment and English language learners: Teachers’ accommodations implementation on routine math and science tests. Teaching and Teacher Education 54: 139–148. https://doi.org/10.1016/j.tate.2015.11.003

De Backer, Fauve, Piet Van Avermaet and Stef Slembrouck (2017) Schools as laboratories for exploring multilingual assessment policies and practices. Language and Education 31 (3): 217–230. https://doi.org/10.1080/09500782.2016.1261896

Garcia, Georgia Earnest and David P. Pearson (1994) Assessment and diversity. Review of Research in Education 20 (1): 337–391.

Garcia, Ofelia, Jo Anne Kleifgen and Lorraine Falchi (2008) From English Language Lear­ners to Emergent Bilinguals. Equity Matters: Research Review No.1. New York: Teachers College.

Haag, Nicole, Birgit Heppt, Petra Stanat, Poldi Kuhl and Hans Anand Pant (2013) Second language learners’ performance in mathematics: Disentangling the effects of academic language features. Learning and Instruction 28: 24–34. https://doi.org/10.1016/j.learninstruc.2013.04.001

Hattie, John and Helen Timperley (2007) The Power of feedback. Review of Educational Research 77 (1): 81–112. https://doi.org/10.3102/003465430298487

Heitink, Maaike Christine, Fabienne M. Van der Kleij, Bernard P. Veldkamp, Kim Schild­kamp and Wilma Berdien Kippers (2016) A systematic review of prerequisites for implementing assessment for learning in classroom practice. Educational Research Review 17: 50–62. https://doi.org/10.1016/j.edurev.2015.12.002

Jones, Neil and Nick Saville (2016) Learning Oriented Assessment: A Systemic Approach. Cambridge: Cambridge University Press.

Kieffer, Michael J., Nonie K.Lesaux, Mabel Rivera and David J. Francis (2009) Accommo­dations for English language learners taking large-scale assessments: A meta-analysis on effectiveness and validity. Review of Educational Research 79 (3): 1168–1201. https://doi.org/10.3102/0034654309332490

Kortesluoma, Riitta Liisa, Maija Hentinen and Merja Nikkonen (2003) Conducting a qualitative child interview: methodological considerations. Journal of Advanced Nursing 42 (5): 434–441. https://doi.org/10.1046/j.1365-2648.2003.02643.x

Leech, Nancy L. and Anthony J. Onwuegbuzie (2009) A typology of mixed methods research designs. Quality & Quantity 43 (2): 265–275. https://doi.org/10.1007/s11135-007-9105-3

Lin, Angel (2012) Multilingual and multimodal resources in genre-based pedagogical approaches to L2 English content classrooms. In Constant Leung and Brian V. Street (eds) English: A Changing Medium for Education, 79–103. Bristol: Multilingual Matters. https://doi.org/10.21832/9781847697721-007

Lowden, Jacqueline (2002) Children’s rights: A decade of dispute. Journal of Advanced Nursing, 37(1), 100-107.

Martiniello, Maria (2009) Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educational Assessment 14 (3–4): 160–179. https://doi.org/10.1080/10627190903422906

Menken, Kate (2010) NCLB and English language learners: Challenges and consequences. Theory into Practice 49 (2): 121–128. https://doi.org/10.1080/00405841003626619

Mortelmans, Dimitri (2013) Handboek Kwalitatieve Onderzoeksmethoden. Leuven: Acco.

Murphy, Colette, Laura Lundy, Lesley Emerson and Karen Kerr (2012) Children’s perceptions of primary science assessment in England and Wales. British Educational Research Journal 39 (3): 1–22. https://doi.org/10.1080/01411926.2012.674921

Noble, Tracy, Ann Rosebery, Cartherine Suarez, Beth Warren and Mary Catherine O’Connor (2014) Science assessments and English language learners: Validity evidence based on response processes. Applied Measurement in Education 27 (4): 248–260. https://doi.org/10.1080/08957347.2014.944309

Ong, Saw Lan (2013) Usefulness of dual-language science test for bilingual learners. Studies in Educational Evaluation 39 (2): 82–89. https://doi.org/10.1016/j.stueduc.2012.12.001

Pitoniak, Mary J., John W. Young, Maria Martiniello, Tereasa C. King, Alyssa Buteux and Mitchell Ginsburgh (2009) Guidelines for the Assessment of English Language Learners. Princeton, NJ: Educational Testing Service.

Pulinx, Reinhilde, Piet Van Avermaet and Orhan Agirdag (2015) Silencing linguistic diversity: The extent, the determinants and consequences of the monolingual beliefs of Flemish teachers. International Journal of Bilingual Education and Bilingualism 20 (5): 1–15. https://doi.org/10.1080/13670050.2015.1102860

Putwain, David William (2009) Assessment and examination stress in Key Stage 4. British Educational Research Journal 35 (3): 391–411. https://doi.org/10.1080/
01411920802044404

Reed, Deborah K., Elizabeth Swanson, Yaacov Petscher and Sharon Vaughn (2014) The effects of teacher read-alouds and student silent reading on predominantly bilingual high school seniors’ learning and retention of social studies content. Reading and Writing 27 (7): 1119–1140. https://doi.org/10.1007/s11145-013-9478-8

Rosiers, Kirsten, Evita Willaert, Piet Van Avermaet and Stef Slembrouck (2016) Interaction for transfer: flexible approaches to multilingualism and their pedagogical implications for classroom interaction in linguistically diverse mainstream classrooms. Language
and Education
30 (3): 267–280. https://doi.org/10.1080/09500782.2015.1117097

Roy, Sylvie (2016) Assessing bilingual and multilingual learners in mainstream classrooms. In Shelleyann Scott, Donald E. Scott and Charles F. Webber (eds) Leadership of Assessment, Inclusion, and Learning. The Enabling Power of Assessment 3, 225–241. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-23347-5_9

Shohamy, Elana (2001) The Power of Tests: A Critical Perspective on the Uses of Language Tests. Harlow, UK: Pearson Education.

Shohamy, Elana, Ofra Inbar-Lourie and Matthew E. Poehner (2008) Investigating Assessment Perceptions and Practices in the Advanced Foreign Language Classroom. Center for Advanced Language Proficiency Education and Research, The Pennsylvania State University, Report No. 1108. University Park, PA: Center for Advanced Language Proficiency Education and Research. Available online: http://calper.la.psu.edu/sites/default/files/pubfiles/CALPER_Assessment_Survey.pdf

Sierens, Sven and Piet Van Avermaet (2014) Language diversity in education: Evolving from multilingual education to functional multilingual learning. In David Little, Constant Leung and Piet Van Avermaet (eds) Managing Diversity in Education: Languages, Policies, Pedagogies, 204–222. Bristol, UK: Multilingual Matters. https://doi.org/10.21832/9781783090815-014

Sireci, Stephen G., Shuhong Li and Stanley Scarpati (2003) The Effects of Test Accommo­dation on Test Performance: A Review of the Literature. Center for Educational Assessment Research Report 485. Amherst: University of Massachusetts.

Soh, Kay Cheng (2014) Test language effect in international achievement comparisons: An example from PISA 2009. Cogent Education 1 (1): 1–10. https://doi.org/10.1080/2331186x.2014.955247

Van Laere, Evelien, Kirsten Rosiers, Piet Van Avermaet, Stef Slembrouck and Joahn Van Braak (2016) What can technology offer to linguistically diverse classrooms? Using multilingual content in a computer-based learning environment for primary education. Journal of Multilingual and Multicultural Development 38 (2): 97–112. https://doi.org/10.
1080/01434632.2016.1171871

Vogl, Elisabeth and Reinhard Pekrun (2016) Emotions that matter to achievement. Student feelings about assessment. In Gavin T. L. Brown and Lois R. Harris (eds) Handbook of Human and Social Conditions in Assessment, 111–128. New York: Routledge.

Vygotsky, Lev Semenovich (1978) Mind in Society. Cambridge, MA: Harvard University Press.

Willner, Lynn Shafer and Kouider Mokhtari (2017) Improving meaningful use of accom­modations by multilingual learners. The Reading Teacher 71 (4): 431–439. https://doi.org/10.1002/trtr.1637

Wolf, Mikyung Kim, Joan L. Herman, Jinok Kim, Jamal Abedi, Seth Leon, Noelle Griffin, Patina L. Bachman, Sandy M. Chang, Tim Farnsworth, Hyekyung Jung, Julie Nollner and and Hye Won Shin (2008) Providing Validity Evidence to Improve the Assessment of English Language Learners. CRESST Report 738. Los Angeles: University of California. https://doi.org/10.1037/e643102011-001

Wolf, Mikyung Kim, Jenny C. Kao, Mabel Rivera and Sandy M. Chang (2012) Accommo­dation practices for English language learners in states’ mathematics assessments. Teachers College Record 114 (3): 1–26.

Ysenbaert, Joke, Piet Van Avermaet and Mieke Van Houtte (2017) Literatuurstudie Evaluatie en Diversiteit. Ghent: Steunpunt Onderwijsonderzoek.