International Association of Educators   |  ISSN: 1308-9501

Original article | International Journal of Educational Researchers 2024, Vol. 15(2) 37-51

Rethinking Evidence-Based Practice in Education: A Critical Literature Review of the ‘What Works’ Approach

Andrew Jones

pp. 37 - 51   |  DOI: https://doi.org/10.29329/ijer.2024.1041.3   |  Manu. Number: MANU-2406-01-0005.R2

Published online: June 30, 2024  |   Number of Views: 54  |  Number of Download: 66


Abstract

This literature review critically examines the concept of ‘evidence-based practice’ (EBP) in education, particularly its implementation in England. EBP, which advocates using scientific research to inform teaching, enjoys widespread support from policymakers and educators. However, concerns exist regarding its emphasis on quantitative evidence, particularly findings from laboratory experiments and randomised controlled trials (RCTs). Critics argue that this approach can reduce teacher autonomy and struggles to adapt to diverse educational contexts. By analysing a broad range of literature, this review explores the current ‘what works’ approach within EBP and highlights its challenges, such as neglecting qualitative data and the complexities of real-world classrooms. The review concludes by advocating for a more balanced approach that integrates both quantitative and qualitative research methods, while fostering collaboration between researchers and practitioners.

Keywords: evidence-based practice, cognitive science, educational research, what works, educational policy


How to Cite this Article?

APA 6th edition
Jones, A. (2024). Rethinking Evidence-Based Practice in Education: A Critical Literature Review of the ‘What Works’ Approach . International Journal of Educational Researchers, 15(2), 37-51. doi: 10.29329/ijer.2024.1041.3

Harvard
Jones, A. (2024). Rethinking Evidence-Based Practice in Education: A Critical Literature Review of the ‘What Works’ Approach . International Journal of Educational Researchers, 15(2), pp. 37-51.

Chicago 16th edition
Jones, Andrew (2024). "Rethinking Evidence-Based Practice in Education: A Critical Literature Review of the ‘What Works’ Approach ". International Journal of Educational Researchers 15 (2):37-51. doi:10.29329/ijer.2024.1041.3.

References
  1. Anwer, M., & Reiss, M. (2023). Linking research and practice in education: The views of expert researchers in the field.  Journal of Education for Teaching, 49(2), 326–340. https://doi.org/10.1080/02607476.2022.2055447  [Google Scholar] [Crossref] 
  2. Ball, S. J. (2021). The education debate (4th ed.). Bristol: Polity Press. [Google Scholar]
  3. Basckin, C., Strnadová, I., & Cumming, T. M. (2021). Teacher beliefs about evidence-based practice: A systematic review.      International Journal of Educational Research, 106. https://doi.org/10.1016/j.ijer.2020.101727   [Google Scholar] [Crossref] 
  4. Becher, A., & Lefstein, A. (2021). Teaching as a clinical profession: Adapting the medical model. Journal of Teacher Education, 72(4), 477–488. https://doi.org/10.1177/0022487120972633 [Google Scholar] [Crossref] 
  5. Bennett, T. (2013). Teacher proof. London: Routledge. [Google Scholar]
  6. Biesta, G. (2007). Why “what works” won’t work: Evidence-based practice and the democratic deficit in educational research. Educational Theory, 1–22. https://doi.org/10.1111/j.1741-5446.2006.00241.x   [Google Scholar] [Crossref] 
  7. Biesta, G. (2010). Why “what works” still won’t work: From evidence-based education to value-based education. Studies in Philosophy and Education, 29(5), 491–503. https://doi.org/10.1007/s11217-010-9191-x   [Google Scholar] [Crossref] 
  8. Biesta, G. (2023). The integrity of education and the future of educational studies. British Journal of Educational Studies, 71(5), 493–515. https://doi.org/10.1080/00071005.2023.2242452   [Google Scholar] [Crossref] 
  9. Biesta, G. (2024) Taking education seriously: The ongoing challenge, Educational Theory, 74, 1-15. https://doi.org/10.1111/edth.12646 [Google Scholar] [Crossref] 
  10. Biesta, G., Priestley M., & Robinson, S. (2015) The Role of Beliefs in Teacher Agency. Teachers and Teaching: Theory and Practice, 21(6), pp. 624-640. https://doi.org/10.1080/13540602.2015.1044325   [Google Scholar] [Crossref] 
  11. Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf,  & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 2. Research designs: Quantitative, qualitative, neuropsychological, and biological (pp. 57–71). American Psychological Association. https://doi.org/10.1037/13620-004   [Google Scholar] [Crossref] 
  12. Burgess, K., Singh, P. J., & Koroglu, R. (2006). Supply chain management: a structured literature review and implications for future research. International Journal of Operations & Production Management, 26(7), 703-729. http://dx.doi.org/10.1108/01443570610672202   [Google Scholar]
  13. Burn, K., & Mutton, T. (2015). A review of ‘research-informed clinical practice’ in initial teacher education. Oxford Review of Education, 41(2), 217-233. https://doi.org/10.1080/03054985.2015.1020104   [Google Scholar] [Crossref] 
  14. Cartwright, N., & Joyce, K. (2019). Bridging the gap between research and practice: Predicting what will work locally. American   Educational Research Journal, 57(3), 1045-1082. https://doi.org/10.3102/0002831219866687   [Google Scholar] [Crossref] 
  15. Cheung, A. C. K., & Slavin, R. E. (2016). How methodological features affect effect sizes in education. Educational Researcher, 45(5), 283-292. https://doi.org/10.3102/0013189X16656615   [Google Scholar] [Crossref] 
  16. Coe, R., & Kime, S. (2019). A (new) manifesto for evidence-based education: Twenty years on. Sunderland. Evidence Based Education. [Google Scholar]
  17. Coldwell, M. (2022). Evidence-informed teaching in England. In: Brown, C., & Malin, J. R., (eds.) The Emerald handbook of evidence-informed practice in education. Emerald Publishing. [Google Scholar]
  18. Coldwell, M., Greany, T., Higgins, S., Brown, C., Maxwell, B., Stiell, B., Stoll, L, Willis, B., & Burns, H. (2017). Evidence-informed teaching: an evaluation of progress in England (London: Department for Education). [Google Scholar]
  19. Connolly, P., Keenan, C., & Urbanska, K. (2018). The trials of evidence-based practice in education: A systematic review of randomised controlled trials in education research 1980-2016. Educational Research, 60(3), 276–291. https://doi.org/10.1080/00131881.2018.1493353   [Google Scholar] [Crossref] 
  20. Cowen, N. (2019). For whom does “what works” work? The political economy of evidence-based education.  Educational Research & Evaluation, 25(1/2), 81–98. https://doi.org/10.1080/13803611.2019.1617991   [Google Scholar] [Crossref] 
  21. Davies, P. (1999). What is evidence-based education? British Journal of Educational Studies, 47(2), 108–121. https://doi.org/10.1111/1467-8527.00106 [Google Scholar] [Crossref] 
  22. De Bruyckere, P., & Kirschner, P. A. (2022). Translating research into classroom practice: Cognitive science and beyond.     Impact, (16). Available at: https://my.chartered.college/impact/issue-16-autumn-2022/ (Accessed: 11  November 2023). [Google Scholar]
  23. Dekker, I. & Meeter, M. (2022). Evidence-based education: Objections and future directions. Frontiers in Education. https://doi.org/10.3389/feduc.2022.941410 [Google Scholar] [Crossref] 
  24. Department for Education (DfE). (2019a). Early career framework (DFE-00015-2019). Available at:                    https://assets.publishing.service.gov.uk/media/60795936d3bf7f400b462d74/Early-Career_Framework_April_2021.pdf (Accessed: 23 October 2023). [Google Scholar]
  25. Department for Education (DfE). (2019b). ITT core content framework (DFE-00015-2019). Available at:           https://assets.publishing.service.gov.uk/media/6061eb9cd3bf7f5cde260984/ITT_core_content_framework_pdf (Accessed: 23 October 2023). [Google Scholar]
  26. Didau, D. (2016). What if everything you knew about education was wrong? Carmarthen: Crown House Publishing. [Google Scholar]
  27. Didau, D., & Rose, N. (2016). What every teacher needs to know about psychology. John Catt Educational. [Google Scholar]
  28. Dunlosky, J. (2013). Strengthening the Student Toolbox: Study Strategies to Boost Learning. The American Educator, 37, 12-     21. [Google Scholar]
  29. Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, Supplement, 14(1), 4–58. https://doi.org/10.1177/1529100612453266   [Google Scholar] [Crossref] 
  30. Eppley, K., Azano, A., Brenner, D., & Shannon, P. (2018). What counts as evidence in rural schools? The Rural Educator, 39(2), 36-40. https://doi.org/10.35608/ruraled.v39i2.208 [Google Scholar] [Crossref] 
  31. Flynn, N. (2019). Facilitating evidence-informed practice. Teacher Development, 23(1), 64–82.                    https://doi.org/10.1080/13664530.2018.1505649 [Google Scholar] [Crossref] 
  32. Gewirtz, S., & Cribb, A. (2020). What works? Academic integrity and the research-policy relationship. British Journal of Sociology of Education, 41(6), 794-806. https://doi.org/10.1080/01425692.2020.1755226 [Google Scholar] [Crossref] 
  33. Gibb, N. (2023). Letter from the Minister of State for Schools celebrating the first cohort of early career teachers completing their training, the Rt. Hon. Nick Gibb MP. October 2023. Available at: https://generateteachinghub.org/wp-content/uploads/2023/11/ECF-Letter-to-schools-October-2023.pdf  (Accessed: 27 May 2024). [Google Scholar]
  34. Goldacre, B. (2013). Building evidence into education. Available at: https://assets.publishing.service.gov.uk/media/5a7a219140f0b66eab999f4f/Building_evidence_into_education.pdf (Accessed: 27 May 2024). [Google Scholar]
  35. Gorard, S., Arthur, J., & Davies, I. (2010). Accessing and understanding research in education. In The Educational Studies      Routledge Textbook (pp. 237-247). Abingdon: Routledge. [Google Scholar]
  36. Gorard, S., See, B.H. & Siddiqui, N. (2020). What is the evidence on the best way to get evidence into use in education?. Review of Education, 8, 570-610. https://doi.org/10.1002/rev3.3200 [Google Scholar] [Crossref] 
  37. Graves, S., & Moore, A. (2018). How do you know what works, works for you? An investigation into the attitudes of senior        leaders to using research evidence to inform teaching and learning in schools. School Leadership and Management, 38(3), 259-277. https://doi.org/10.1080/13632434.2017.1366438   [Google Scholar] [Crossref] 
  38. Hammersley, M. (1997). Educational research and teaching: A response to David Hargreaves’ TTA lecture. British Educational Research Journal, 141–161. https://doi.org/10.1080/0141192970230203 [Google Scholar] [Crossref] 
  39. Hammersley, M. (2005). The myth of research-based practice: The critical case of educational inquiry. International Journal of Social Research Methodology: Theory and Practice, 8(4), 317–330. https://doi.org/10.1080/1364557042000232844 [Google Scholar] [Crossref] 
  40. Hammersley, M. (2013). What is qualitative research? London: Bloomsbury. [Google Scholar]
  41. Hargreaves, D. (1996). Teaching as a research-based profession: Possibilities and prospects (inaugural TTA annual lecture).    London: Teacher Training Agency. Available at:            https://eppi.ioe.ac.uk/cms/Portals/0/PDF%20reviews%20and%20summaries/TTA%20Hargreaves%20lecture.pdf        (Accessed: 27 May 2024). [Google Scholar]
  42. Holloway, J., & Larsen Hedegaard, M. L. (2023). Democracy and teachers: the impossibilities for pluralisation in evidence- based practice. Journal of Education Policy, 38(3), 432–451. https://doi.org/10.1080/02680939.2021.2014571 [Google Scholar] [Crossref] 
  43. Hwa, Y.-Y. (2023). “What works” depends: teacher accountability policy and sociocultural context in international large-scale surveys. Journal of Education Policy, 38(3), 474–499. https://doi.org/10.1080/02680939.2021.2009919 [Google Scholar] [Crossref] 
  44. Joyce, K. E. (2019). The key role of representativeness in evidence-based education. Educational Research and Evaluation, 25(1-2), 43–62. https://doi.org/10.1080/13803611.2019.1617989   [Google Scholar] [Crossref] 
  45. Imray, P., Kossyvaki, L., & Sissons, M. (2023). Evidence‐based practice: the use and abuse of research. Support for Learning,   38(1), 51–66. https://doi.org/10.1111/1467-9604.12438   [Google Scholar] [Crossref] 
  46. Kay, L. (2022). “What works” and for whom? Bold beginnings and the construction of the school-ready child. Journal of Early Childhood Research, 20(2), 172–184. https://doi.org/10.1177/1476718X2110527   [Google Scholar] [Crossref] 
  47. Kirschner, P. A., & Hendrick, C. (2020). How learning happens: seminal works in educational psychology and what they mean in practice. London: Routledge. https://doi.org/10.4324/9780429061523 [Google Scholar] [Crossref] 
  48. Kirschner, P. A., Hendrick, C., & Heal, J. (2022). How teaching happens: Seminal works in teaching and teacher effectiveness and what they mean in practice. London: Routledge. [Google Scholar]
  49. Kriewaldt, J., & Turnidge, D. (2013). Conceptualising an approach to clinical reasoning in the education profession. Australian Journal of Teacher Education, 38(6), 103-115. https://doi.org/10.14221/ajte.2013v38n6.9   [Google Scholar] [Crossref] 
  50. Lemov, D. (2021). Teach like a champion 3.0: 63 techniques that put students on the path to college. New York, NY: Jossey-     Bass. [Google Scholar]
  51. MacRae, E. (2019). Are teachers gaining from educational trials? A question of evidence-based practice. School Science Review, 100(373), 25-28. Retrieved from https://www.ase.org.uk/resources/school-science-review/issue-373 (Accessed: 27 May 2024). [Google Scholar]
  52. Muijs, D. (2020, January 23). Why we do research at Ofsted. Ofsted Blog. Retrieved from                     https://educationinspection.blog.gov.uk/2020/01/23/why-we-do-research-at-ofsted/ (Accessed: 27 May 2024). [Google Scholar]
  53. Neelen, M., & Kirschner, A. K. (2020). Evidence-informed Learning Design: Creating training to improve performance. New York: Kogan Page Limited. [Google Scholar]
  54. Owen, K. L., Watkins, R. C., & Hughes, J. C. (2022). From evidence-informed to evidence-based: An evidence building framework for education. Review of Education, 10(1). https://doi.org/10.1002/rev3.3342   [Google Scholar] [Crossref] 
  55. Pegram, J., Watkins, R. C., Hoerger, M., & Hughes, J. C. (2022). Assessing the range and evidence-base of interventions in a cluster of schools. Review of Education, 10, e3336. https://doi.org/10.1002/rev3.3336   [Google Scholar] [Crossref] 
  56. Perry, T., Lea, R., Jørgensen, C. R., Cordingley, P., Shapiro, K., & Youdell, D. (2021). Cognitive science in the classroom. London: Education Endowment Foundation (EEF). Retrieved from                    https://educationendowmentfoundation.org.uk/evidence-summaries/evidence- (Accessed: 20 May 2024). [Google Scholar]
  57. Roediger III, H. L. (2013). Applying cognitive psychology to education translational educational science. Psychological Science      in the Public Interest, 14, 1–3. https://doi.org/10.1177/1529100612454415 [Google Scholar] [Crossref] 
  58. Rosenshine, B. (2012). Principles of instruction: Research-based strategies that all teachers should know. American Educator, 36(1), 12–39. [Google Scholar]
  59. Scott, S., & McNeish, D. (2013). School leadership evidence review: using research evidence to support school improvement. Department for Education: London. Retrieved from https://www.bristol.ac.uk/media-                   library/sites/cubec/migrated/documents/evidencereview3.pdf (Accessed: 26 May 2024). [Google Scholar]
  60. Sharples, J., Albers, B., & Fraser, S. (2024). Putting evidence to work: a school's guide to implementation. EEF: London. [Google Scholar]
  61. Simmie, G. M. (2021). Teacher professional learning: a holistic and cultural endeavour imbued with transformative possibility. Educational Review, 75(5), 916–931. https://doi.org/10.1080/00131911.2021.1978398 [Google Scholar] [Crossref] 
  62. Simmie, G. M. (2023). The gendered construction of teachers’ identities and practices: feminist critical discourse analysis of policy texts in Ireland. Gender and Education, 35(3), 282–298. https://doi.org/10.1080/09540253.2023.2167944 [Google Scholar] [Crossref] 
  63. Simmie, G. M., O’Meara, N., Forster, A., Ryan, V., & Ryan, T. (2023). Towards a model of Teachers’ Continuing Professional Development (CPD): a border crossing journey with embedded contradictions, ethical dilemmas and transformative    possibilities. Professional Development in Education, 50(1), 46–58.                    https://doi.org/10.1080/19415257.2023.2283420 [Google Scholar] [Crossref] 
  64. Slavin, R. E. (2002). Evidence-Based Education Policies: Transforming Educational Practice and Research. Educational Researcher, 31(7), 15–21. https://doi.org/10.3102/0013189X031007015   [Google Scholar] [Crossref] 
  65. Slavin, R. E. (2008). Evidence-Based Reform in Education: What Will it Take? European Educational Research Journal, 7(1),124-128. https://doi.org/10.2304/eerj.2008.7.1.124   [Google Scholar] [Crossref] 
  66. Slavin, R. E. (2019). How evidence-based reform will transform research and practice in education. Educational Psychologist, 55(1), 21–31. https://doi.org/10.1080/00461520.2019.1611432   [Google Scholar] [Crossref] 
  67. Slavin, R., Cheung, A., & Zhuang, T. (2021). How evidence-based reform could advance education. ECNU Review of Education, 4(1), 7-24. https://doi.org/10.1177/2096531120976060   [Google Scholar] [Crossref] 
  68. Tuli, F. (2010). ‘The basis of distinction between quantitative and qualitative in social science: reflection on ontological, epistemological and methodological perspectives’. Ethiopian Journal of Education and Science, 6(1), 97-108.               https://doi.org/10.4314/ejesc.v6i1.65384 [Google Scholar] [Crossref] 
  69. Watson, S. (2021). New right 2.0: Teacher populism on social media in England. British Education Research Journal, 47, 299-315. https://doi.org/10.1002/berj.3664 [Google Scholar] [Crossref] 
  70. Weinstein, Y., Madan, C. R., & Sumeracki, M. A. (2018). ‘Teaching the science of learning’. Cognitive Research: Principles and Implications. Springer. https://doi.org/10.1186/s41235-017-0087-y [Google Scholar] [Crossref] 
  71. Wolgemuth, J., Marn, T., & Sabnis, S. (2022). ‘On the sidelines of what works: scientifically based indifference’. International Journal of Research & Method in Education, 45(2), 150–163. https://doi.org/10.1080/1743727X.2021.1966620 [Google Scholar] [Crossref] 
  72. Wrigley, T. (2016). Not So Simple: the problem with 'evidence-based practice' and the EEF toolkit. FORUM, 58(2), 237-252. https://doi.org/10.15730/forum.2016.58.2.237   [Google Scholar] [Crossref] 
  73. Wrigley, T. (2018). The power of ‘evidence’: Reliable science or a set of blunt tools? British Educational Research Journal, 44, 359-376. https://doi.org/10.1002/berj.3338   [Google Scholar] [Crossref] 
  74. Wrigley, T., & McCusker, S. (2019). Evidence-based teaching: a simple view of “science”. Educational Research and Evaluation, 25(1-2), 110-126. https://doi.org/10.1080/13803611.2019.1617992   [Google Scholar] [Crossref] 
  75. Zhang, L., Kirschner, P. A., Cobern, W. W., & Sweller, J. (2022). There is an evidence crisis in science educational policy. Educational Psychology Review, 34, 1157-1176. http://dx.doi.org/10.1007/s10648-021-09646-1 [Google Scholar]