HUMAN-IN-THE-LOOP AI COACHING IN ONLINE EDUCATION: COMBINING AUTOMATED FEEDBACK WITH HUMAN MENTORSHIP

Authors

  • Timofei Rogov Independent Researcher in Educational Technology, Ulan-Ude, Russia

DOI:

https://doi.org/10.46827/ejoe.v11i2.7079

Keywords:

online education, automated feedback, mentoring, personalized learning, pedagogical interpretation, text revision

Abstract

This article examines the organization of feedback in online education under conditions of increasing enrollment and limited opportunities for individualized instructional support. The study focuses on the distinction between automated error detection and the pedagogical interpretation of learning outcomes. Automated feedback provides rapid and consistent analysis; however, its application is associated with the risks of standardized responses, interpretive inaccuracies, and a disconnect between error identification and meaningful revision. The analysis identifies a consistent pattern: the greatest improvements in learning occur not at the moment feedback is received but during its incorporation into an iterative cycle of revision and refinement. Based on these findings, the article proposes a Human-in-the-Loop model in which automated feedback and instructor mentoring are treated as interdependent components of a unified educational process. The model describes the transition from initial diagnosis to pedagogical interpretation, revision, and continuous adjustment of the learner’s educational trajectory. The practical significance of the study lies in clarifying the role of instructors within scalable online learning environments. The findings may be applied to the design of educational programs, the organization of mentoring practices, the development of feedback systems, and the preparation of instructors to work effectively with automated educational technologies.

Author Biography

  • Timofei Rogov, Independent Researcher in Educational Technology, Ulan-Ude, Russia
    Timofei Rogov is an EdTech entrepreneur and online education producer with extensive experience in developing and scaling digital learning projects in the Commonwealth of Independent States (CIS). He is the founder of Vysshiy Ball, an online platform for preparing students for Russia's OGE and EGE examinations, which was acquired by Skillbox in 2019. He has also produced large-scale online educational courses featuring public figures. His professional and research interests focus on the development of online education, the scalability of digital learning platforms, accessibility of distance learning, and the application of educational technologies to improve learning experiences.

References

Alghamdi, L. H., & Alghizzi, T. M. (2025). Educators’ reflections on AI-automated feedback in higher education: A structured integrative review of potentials, pitfalls, and ethical dimensions. Frontiers in Education, 10, 1704820. https://doi.org/10.3389/feduc.2025.1704820

Alnemrat, A., Aldamen, H., Almashour, M., Al-Deaibes, M., & AlSharefeen, R. (2025). AI vs. teacher feedback on EFL argumentative writing: A quantitative study. Frontiers in Education, 10, 1614673. https://doi.org/10.3389/feduc.2025.1614673

Banihashem, S. K., Kerman, N. T., Noroozi, O., et al. (2024). Feedback sources in essay writing: Peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education, 21, 23. https://doi.org/10.1186/s41239-024-00455-4

Demszky, D., Hill, H. C., Taylor, E., Kupor, A., Varuvel Dennison, D., & Piech, C. (2025). Does increased choice over learning topics improve the effectiveness of automated feedback for educators? Education Sciences, 15(9), 1162. https://doi.org/10.3390/educsci15091162

Doyle, L., Nash, R. A., Jakcsiova, V., et al. (2025). ‘They want you to read their work’: Teachers’ and students’ perspectives on the use of AI for school feedback. Technology, Knowledge and Learning, 30, 1917–1941. https://doi.org/10.1007/s10758-025-09903-0

Fajardo-Ramos, D. C., Chiappe, A., & Mella-Norambuena, J. (2025). Human-in-the-loop assessment with AI: Implications for teacher education in Ibero-American universities. Frontiers in Education, 10, 1710992. https://doi.org/10.3389/feduc.2025.1710992

Farhood, H., Nyden, M., Beheshti, A., et al. (2025). Artificial intelligence-based personalised learning in education: A systematic literature review. Discover Artificial Intelligence, 5, 331. https://doi.org/10.1007/s44163-025-00598-x

Kestin, G., Miller, K., Klales, A., et al. (2025). AI tutoring outperforms in-class active learning: An RCT introducing a novel research-based design in an authentic educational setting. Scientific Reports, 15, 17458. https://doi.org/10.1038/s41598-025-97652-6

Kong, X., Fang, H., Chen, W., et al. (2025). Examining human–AI collaboration in hybrid intelligence learning environments: Insight from the Synergy Degree Model. Humanities and Social Sciences Communications, 12, 821. https://doi.org/10.1057/s41599-025-05097-z

Lan, M., & Zhou, X. (2025). A qualitative systematic review on AI empowered self-regulated learning in higher education. npj Science of Learning, 10, 21. https://doi.org/10.1038/s41539-025-00319-0

Navío-Inglés, M., Guzmán Mora, J., O’Connor-Jiménez, P., & García González, A. (2025). What’s next for feedback in writing instruction? Pre-service teachers’ perceptions of assessment practices and the role of generative AI. Education Sciences, 15(11), 1534. https://doi.org/10.3390/educsci15111534

Tran, T. T. T. (2025). Enhancing EFL writing revision practices: The impact of AI- and teacher-generated feedback and their sequences. Education Sciences, 15(2), 232. https://doi.org/10.3390/educsci15020232

Walter, Y. (2024). Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 15. https://doi.org/10.1186/s41239-024-00448-3

Wang, D. (2024). Teacher-versus AI-generated (Poe application) corrective feedback and language learners’ writing anxiety, complexity, fluency, and accuracy. The International Review of Research in Open and Distributed Learning, 25(3), 37–56. https://doi.org/10.19173/irrodl.v25i3.7646

Yusuf, H., Money, A., & Daylamani-Zad, D. (2025). Pedagogical AI conversational agents in higher education: A conceptual framework and survey of the state of the art. Educational Technology Research and Development, 73, 815–874. https://doi.org/10.1007/s11423-025-10447-4

Downloads

Published

2026-10-21

Issue

Vol. 11 No. 2 (2026)

Section

Articles

License

Authors who publish with this journal agree to the following terms:

 

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

 

  1. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

 

  1. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).