Item Details

State of the App: A Taxonomy and Framework for Evaluating Language Learning Mobile Applications

Issue: Vol 34 No. 2 (2017)

Journal: CALICO Journal

Subject Areas:

DOI: 10.1558/cj.27623


The widespread growth in availability and use of smartphones and tablets has facilitated an unprecedented avalanche of new software applications with language learning and teaching capabilities. However, little has been published in terms of effective design and evaluation of language learning apps. This article reviews current research about the potential of apps for language learning and presents a taxonomy of available apps and their use for language learning. The article also presents a framework consisting of four categories for evaluating language learning apps (technology, pedagogy, user experience, and language learning) and a set of criteria within the categories. Finally, the article proposes areas for further research.

Author: Fernando Rosell-Aguilar

View Full Text

References :

Ally, M. (2005). Using learning theories to design instruction for mobile learning devices. In J. Attewell & C. Savill-Smith (Eds.), Mobile learning anytime everywhere: A book of papers from MLEARN (pp. 5–8). London: Learning and Skills Development Agency.

Bax, S. (2003). CALL—past, present and future. System, 31(1), 13–28.

Bloom, B. S., Engelhart, M. D., Hill, W. H., & Furst, E. J. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York: McKay.

Burston, J. (2014). The reality of MALL: Still on the fringes. CALICO Journal, 31(1), 103–125.

Castañeda, D. A., & Cho, M. H. (2016). Use of a game-like application on a mobile device to improve accuracy in conjugating Spanish verbs. Computer Assisted Language Learning, 29(7), 1195-1204.

Chapelle, C. (1998). Multimedia CALL: Lessons to be learned from research on instructed SLA. Language Learning and Technology, 2(1), 22–34. Retrieved from

Colpaert, J. (2006). Pedagogy-driven design for online language teaching and learning. CALICO Journal, 23(3), 477–497.

Domínguez, A., Saenz-de-Navarrete, J., De-Marcos, L., Fernández-Sanz, L., Pagés, C., & Martínez-Herráiz, J. J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380–392.

Doughty, C., & Long, M. H. (2003). Optimal psycholinguistic environments for distance FL learning. Language Learning and Technology, 7(3), 50–80. Retrieved from

Godwin-Jones, R. (2011). Emerging technologies: Mobile apps for language learning. Language Learning and Technology, 15(2), 2–11.

Hubbard, P. (2006). Evaluating CALL software. In L. Ducate & N. Arnold (Eds.), Calling on CALL: From theory and research to new directions in foreign language teaching (pp. 313–334). San Marcos: CALICO.

Jamieson, J., Chapelle, C., & Preiss, S. (2005). CALL evaluation by developers, a teacher, and students. CALICO Journal, 23(1), 93–138.

Kenning, M. M. (2007). ICT and language learning: From print to the mobile phone. Basingstoke: Palgrave Macmillan.

Khaddage, F., & Lattemann C. (2013). The future of mobile apps for teaching and learning. In Z. L. Berge, & L. Muilenburg (Eds.), Handbook of mobile education (pp. 119–128). London: Routledge.

Kim, H., & Kwon, Y. (2012). Exploring smartphone applications for effective Mobile-Assisted Language Learning. Multimedia-Assisted Language Learning, 16(1), 31–57.

Kim, H. S. (2013). Emerging mobile apps to improve English listening skills. Multimedia-Assisted Language Learning, 16(2), 11–30.

Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212–218.

Levy, M., & Stockwell, G. (2006). CALL dimensions: Options and issues in computer-assisted language learning. Mahwah, NJ: Lawrence Erlbaum.

Little, D. (1997). Responding authentically to authentic texts: A problem for self-access language learning? In P. Benson & P. Volley, (Eds.), Autonomy and independence in language learning (pp. 225–236). London: Longman.

Lys, F. (2013). The development of advanced learner oral proficiency using iPads. Language Learning and Technology, 17(3), 94–116. Retrieved from

Meskill, C. (1999). Computers as tools for sociocollaborative language learning. In K. Cameron (Ed.), CALL: Media, design and applications (pp. 141–162). Lisse: Swets & Zeitlinger.

Oxford, R. (1990). Language learning strategies: What every teacher should know. New York: Newbury House.

Peachey, N. (2013). Criteria for evaluating web tools and apps. Retrieved from:

Rodríguez-Arancón, P., Arús, J., & Calle, C. (2013). The use of current mobile learning applications in EFL. Procedia-Social and Behavioral Sciences, 103, 1189–1196.

Rosell-Aguilar, F. (2009). Podcasting for language learning: Re-examining the potential. In L. Lomicka & G. Lord (Eds.), The next generation: Social networking and online collaboration in foreign language learning (pp. 13–34). San Marcos, TX: Calico.

Rosell-Aguilar, F. (2016). User evaluation of language learning mobile applications: A case study with learners of Spanish. In A. Palalas & M. Ally (Eds.), The international handbook of mobile-assisted language learning (pp. 545–581). China Central Radio & TV University Press.

Rosell-Aguilar, F., & Kan, Q. (2015). Design and user evaluation of a mobile app to teach Chinese characters. JaltCALL Journal, 11(1), 19–40.

Rosenthal Tolisano, S. (2012). iPad app evaluation for the classroom. Retrieved from

Schrock, K. (2012). Bloomin’ apps. Retrieved from

Schrock, K. (2013). Critical evaluation of mobile apps. Retrieved from

Skehan, P. (2003). Focus on form, tasks, and technology. Computer Assisted Language Learning, 16(5), 391–411.

Steel, C. (2012). Fitting learning into life: Language students’ perspectives on benefits of using mobile apps. In M. Brown, M. Hartnett, & T. Stewart, ascilite2012 conference proceedings (pp. 875–880). Wellington, New Zealand.

Stockwell, G. (2013). Tracking learners’ usage of mobile phones for language learning outside of the classroom. In P. Hubbard, M. Schulz, & B. Smith (Eds.), Learner–computer interaction in language education: A festschrift in honor of Robert Fischer (pp. 118–136). San Marcos, TX: CALICO.

Sweeney, P., & Moore, C. (2012). Mobile apps for learning vocabulary: Categories, evaluation and design criteria for teachers and developers. International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 2(4), 1–16.

Vincent, T. (2012). Ways to evaluate educational apps. Retrieved from

Walker, H. (2011). Evaluating the effectiveness of apps for mobile devices. Journal of Special Education Technology, 26(4), 59–63.

Yildiz, S. (2012). Use of iPad applications to introduce English as a foreign language to young Turkish learners. Paper presented at the 2012 CALICO Conference, University of Notre Dame, South Bend, IN.