Managing assessment in online and offline adult learning environments: a meta-review
DOI:
https://doi.org/10.12775/ED.2024.002Klíčová slova
Management of assessment, management of evaluation, formative feedback, meta-evaluation, metacognitive experience, learning environments, knowledge ecologyAbstrakt
In recent years, there has been exponential growth in the number of research studies on assessment, testing, measurement, and evaluation strategies in online and/or offline learning settings. The efficiency of the management of these methods and their presence in higher education has not, however, been confirmed by a meta-review. Management of assessment receives much attention at the frontier of education studies since it provides the opportunity to plan, monitor, and control learning processes and outcomes. However, not only do many educational managers find this approach demanding, but it also remains unclear what they should do to foster assessment, measurement, and evaluation management standards in nowadays learning processes, which are in online and/or offline learning environments. This study explores the specific features educational managers use to promote the management of assessment, measurement, and evaluation strategies in their professional activities. The article adopts the metasystem transition methodology. After searching for data related to global trends in empirical studies on assessment, evaluation, learning environment, and educational management, the priority of formative assessment was identified. Analyses revealed different perspectives on using formative assessment in educational management strategies. The results show that the metasystems perspective evidences the importance of research on the specifics of educational management in online and/or offline learning environments for the sustainability of higher education.
Reference
Almasri, F. (2024). Exploring the impact of artificial intelligence in teaching and learning of science: A systematic review of empirical research. Research in Science Education, 54(5), 977–997.
Adeshola, I., & Abubakar, A M. (2020). Assessment of Higher Order Thinking Skills: Digital Assessment Techniques. In: E. Railean (Ed.), Assessment, Testing, and Measurement Strategies in Global Higher Education (pp. 153–168). IGI Global.
https://doi.org/10.4018/978-1-7998-2314-8.ch008
Adi, N.H., Riyanda, A.R., Sagala, M.K., Ambiyar, A., Islami, S., & Zaus, M.A. (2022). Analysis of Lecturer Performance in the Application of The Online Learning Process. JTEV (Jurnal Teknik Elektro dan Vokasional), 8(1), 144–150.
Adnan, N.L., Abdullah, W.K., Muda, R., & Sallem, N.R. (2020). Practical Implementation of Assessment Activities for Deep Learning. In: Assessment, Testing, and Measurement Strategies in Global Higher Education (pp. 84–105). IGI Global. https://doi.org/
10.4018/978-1-7998-2314-8.ch005, Akbar M. (2016). Digital technology shaping teaching practices in higher education. Frontiers in ICT, 3(1). https://www.frontiersin.org/articles/10.3389/fict.2016. 00001/full
Bachman, L., & Palmer, A. (2022). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.
Baleni, Z.G. (2015). Online formative assessment in higher education: Its pros and cons. Electronic Journal of e-Learning, 13(4), 228–236.
Baxter, A., Oruc, B.E., Asplund, J., Keskinocak, P., & Serban, N. (2022). Evaluating scenarios for school reopening under COVID19. BMC public health, 22(1), 1–10. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-022-12910-w
Bergnaz N., & Botezatu, V. (2020). Formative Assessment in Higher Education: Particularities of Appreciative Intelligence of University Teachers in Formative Assessment Process. In: Assessment, Testing, and Measurement Strategies in Global Higher Education (pp. 107–131). IGI Global. https://doi.org/10.4018/978-1-7998-2314-8.ch006
Bloom, B.S. (1971). Handbook on formative and summative evaluation of student learning. https://unesdoc.unesco.org/ark:/48223/pf0000220096
Bransford, J.D. et al. (2000). How people learn: brain, mind, experience, and school. Waszyngton: National Academies Press.
Cohen, H.L. (1968). Educational therapy: The design of learning environments. In: J.M. Shlien (Ed.), Research in psychotherapy (pp. 21–53). American Psychological Association. https://doi.org/10.1037/10546-002
David Playfoot, Laura L. Wilkinson & Jessica Mead (2022). Is continuous assessment inclusive? An analysis of factors influencing student grades. Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2150834
Gikandi, J.W., Morrow, D., & Davis, N.E. (2011). Online formative assessment in higher education: A review of the literature. Computers & education, 57(4), 2333–2351.
Gikandi, J.W., Morrow, D., & Davis, N.E. (2011). Online formative assessment in higher education: A review of the literature. Computers & education, 57(4), 2333–2351.
Harrison, R., Meyer, L., Rawstorne, P., Razee, H., Chitkara, U., Mears, S., & Balasooriya, C. (2022). Evaluating and enhancing quality in higher education teaching practice: a meta-review. Studies in Higher Education, 47(1), 80–96.
Irons, A., & Elkington, S. (2021). Enhancing learning through formative assessment and feedback. Routledge. https://doi.org/10.4324/9781138610514
Joslyn, C., Heylighen, F., Turchin, V. (1970). Metasystem Transition Theory. http://pespmc1.vub.ac.be/MSTT.html
Kazemi, K., Javidan, Meybodi, M.R., Rahmani, A.M. (2021). A Two-Level Function Evaluation Management Model for Multi-Population Methods in Dynamic Environments: Hierarchical Learning Automata Approach. Journal of Experimental & Theoretical
Artificial Intelligence, 33(1), 1–26. DOI: 10.1080/0952813X.2020.1721568.
Komarova, N.M., Suslova, T.F. (2022). Designing the Educational Environment in the Formation of Adaptation and Integration Strategies in Children from Migrant Families. International Dialogues on Education: Past and Present, 8(1–2), pp. 7–35.
Liao, X., Zhang, X., Wang, Z., & Luo, H. (2024). Design and implementation of anAI‐enabled visual report tool as formative assessment to promote learning achievement and self‐regulated learning: An experimental study. British Journal of
Educational Technology, 55(3), 1253–1276.
Luzano, J. (2024). Assessment in Mathematics Education in the Sphere of Artificial Intelligence: A Systematic Review on Its Threats and Opportunities. International Journal of Academic Multidisciplinary Research, 8(2), 100–104.
Marks, A., & Al-Ali, M. (2022). Digital transformation in higher education: A framework for maturity assessment. In: COVID-19 Challenges to University Information Technology Governance (pp. 61–81). Springer, Cham.
Mastan, I.A., Sensuse, D.I., Suryono, R.R., & Kautsarina, K. (2022). Evaluation of distance learning system (e-learning): a systematic literature review. Jurnal Teknoinfo, 16(1), 132–137.
Mayanja, C.S. (2020). Participatory monitoring and evaluation for quality programs in higher education: What is the way for Uganda? International Journal of Educational Administration and Policy Studies, 12(1), 52–59.
Ormell, C.P. (1974). Bloom’s taxonomy and the objectives of education. Educational Research, 17(1), 3–18.
Okoye, K., Arrona-Palacios, A., Camacho-Zuñiga, C., Achem, J.A.G., Escamilla, J., & Hosseini, S. (2022). Towards teaching analytics: a contextual model for analysis of students’ evaluation ofteaching through text mining and machine learning classification. Education and Information Technologies, 27(3), 3891–3933.
Railean, E.A. (2020). Pedagogy of New Assessment, Measurement, and Testing Strategies in Higher Education: Learning Theory and Outcomes. In: Assessment, Testing, and Measurement Strategiesin Global Higher Education (pp. 1–19). IGI Global. https://
doi.org/10.4018/978-1-7998-2314 8.ch001
Rata I., Bernaz, N & Railean, E.A. (2020). Assessment for Learning Regarding the Strategy of Rhetorical Competence Development in Initial Teacher Training. In: Assessment, Testing, and Measurement Strategies in Global Higher Education (pp. 193–213). IGI
Global. https://doi.org/10.4018/978-17998-2314-8.ch010
Rea-Dickins, P., Germaine, K., & Germaine, K.P. (1992). Evaluation. Oxford University Press.
Riegel, C. (2024). Leveraging Online Formative Assessments Within the Evolving Landscape of Artificial Intelligence in Education. In: Assessment Analytics in Education: Designs, Methods and Solutions (pp. 355–371). Cham: Springer
International Publishing.
Roberts, T.S. (2006). Self, peer, and group assessment in e-learning. An introduction. In Self, peer and group assessment in e-learning. Information Science Publishing. ISBN 1-59140-965-9.
Rogers, P.J. (2015). Review of ‘evaluation management in South Africa and Africa’. African Evaluation Journal, vol. 3, no. 1, June 2015. Gale Academic OneFile, link.gale.com/apps/doc/A457106991/AONE?u=ussd&sid=bookmark-AONE&xid=b2a71378.
Scriven, M. (1969). An introduction to metaevaluation. Educational Products Report, 2, 36–38.
Smolyaninova, O., & Ekaterina, B. (2020). Eportfolios and Open Badges for Open Recognition of Lifelong Learning Outcomes. In: Assessment, Testing, and Measurement Strategies in Global Higher Education (pp. 59–83). IGI Global. https://
doi.org/10.4018/978-1-7998-2314-8.ch004
Sparks, J.R., Katz, I.R., & Beile, P.M. (2016). Assessing digital information literacy in higher education: A review of existing frameworks and assessments with recommendations for next generation assessment. ETS Research Report Series, 2016(2), 1–33. Struyven, K., Dochy, F., & Janssens, S. (2005). Students’ perceptions about evaluation and assessment in higher education: A review. Assessment & Evaluation in Higher Education, 30(4), 325–341.
Stufflebeam, D.L. (1978). Meta evaluation: an overview. Evaluation & the Health Professions, 1(1), 17–43.
Stufflebeam, D.L. (2011). Meta-evaluation. Journal of Multi Disciplinary Evaluation, 7(15), 99–158.
Taylor, S.E., Neter, E., & Wayment, H.A. (1995). Self-evaluation processes. Personality and Social Psychology Bulletin, 21(12), 1278–1287.
Vallacher, R.R., Nowak, A., Froehlich, M., & Rockloff, M. (2002). The dynamics of self evaluation. Personality and Social Psychology Review, 6(4), 370–379.
Wakefield A., Pike, R., Amici-Dargan, S. (2022). Learner-generated podcasts: an authentic and enjoyable assessment for students working in pairs. https://doi.org/10.1080/02602938.2022.2152426
Weeden, P., Winter, J., & Broadfoot, P. (2002). Assessment. What’s in is for school. Psychology Press. London and New York.
Xu, D., Huang, W.W., Wang, H., & Heales, J. (2014). Enhancing e-learning effectiveness using an intelligent agent-supported personalized virtual learning environment: An empirical investigation. Information & Management, 51(4), 430–440.
Yambi, T.D.A.C., & Yambi, C. (2018). Assessment and evaluation in education. University Federal do Rio de Janeiro, Brazil.
Yorke, M. (1998). The management of assessment in higher education. Assessment & Evaluation in Higher Education, 23(2), 101–116. https://doi.org/10.1080/
0260293980230201
Stahování
Publikováno
Jak citovat
Číslo
Sekce
Licence

Tato práce je licencována pod Mezinárodní licencí Creative Commons Attribution-NoDerivatives 4.0.
Stats
Number of views and downloads: 17
Number of citations: 0