Managing the effectiveness of online courses in universities using an analytical dashboard

The article presents the experience of developing and implementing an analytical dashboard “Course monitoring” based on the domestic BI solution Yandex DataLens to support digital management of the effectiveness of online courses within the university’s system of additional professional education (APE). The design process is described in detail — from identifying the target audience (educational program development teams, program coordinators, heads of structural units, and vice-rectors overseeing educational activities, informatization, and information technologies) and selecting key performance metrics (completion rate, net promoter score, customer satisfaction, and practical assignment results) to integrating data from the LMS (Moodle), surveys, and internal databases, followed by prototyping, usability testing, and iterative refinement based on user feedback.

The developed analytical dashboard for evaluating the online courses effectiveness enables timely, data-driven managerial decisions, aligns with the principles of evidence-based education and the learner-centered approach, and complies with Russian data security requirements.

The dashboard was piloted within two APE programs — “Artificial intelligence in education and research” and “Advanced AI technologies in research and development” — involving 1,935 participants from Southern Federal University.

The “Course monitoring” dashboard is implemented on the Yandex DataLens platform and is accessible via a public link, with strict adherence to data confidentiality: all participant data are anonymized, and access to detailed information is restricted in accordance with the university’s internal regulations and the requirements of Federal Law No. 152-FZ “On Personal Data”.

The article demonstrates a practically viable and scalable model for digitizing managerial processes in higher education institutions using domestic technologies, fully aligned with the principles of evidence-based decision-making, data security, and adaptability to the evolving needs of educational organizations.

1. Long P. D., Siemens G. Penetrare la nebbia: Tecniche di analisi per l’apprendimento. Tecnologie Didattiche. 2014;22(3):132–137. DOI: 10.17471/2499-4324/195.

2. Long P. D., Siemens G. Penetrating the fog: Analytics in learning and education. Tecnologie Didattiche. 2014;22(3):132–137. (In Italian.) DOI: 10.17471/2499-4324/195.

3. Slade S., Prinsloo P. Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist. 2013;57(10):1510–1529. DOI: 10.1177/0002764213479366.

4. Verbert K., Duval E., Klerkx J., Govaerts S., Santos J. L. Learning analytics dashboard applications. American Behavioral Scientist. 2013;57(10):1500–1509. DOI: 10.1177/0002764213479363.

5. Ferguson R. Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning. 2013;4(5/6):304–317. DOI: 10.1504/IJTEL.2012.051816.

6. Bezyzvestnykh E. A., Skryabin M. A. Methods for collecting data on participants of online programs additional professional education in universities. Informatics and Education. 2023;38(2):57–65. (In Russian.) DOI: 10.32517/0234-0453-2023-38-2-57-65. EDN: KUKHTR.

7. Greller W., Drachsler H. Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society. 2012;15(3):42–57. Available at: http://www.jstor.org/stable/jeductechsoci.15.3.42

8. Nugumanova L. N., Shaukhutdinova G. A., Yakovenko T. V. Digital transformationof supplementary vocational educationin the Republic of Tatarstan. Professional Education in Russia and Abroad. 2021;(2(42)):107–114. (In Russian.) EDN: WQHMRH.

9. Martynova M. D. Learning analytics in the educational process: Where is big data leading us? Social Norms and Practices. 2024;(4(14)):39–49. (In Russian.) DOI: 10.24412/2713-1033-2024-4-39-49. EDN: EFFLVP.

10. Semyonkina I. A., Prusakova P. V. Lines of research in the area of educational data mining in higher education: A theoretical review. Pedagogy. Theory & Practice. 2023;8(7):761-770. (In Russian.) DOI: 10.30853/ped20230111. EDN: DQAXFA.

11. Swee M., Kumar B., Sanders M. L., et al. Enhancing access to nephrology care: Telenephrology dashboard optimization via human-centered design. BMC Nephrology. 2025;26(1):164. DOI: 10.1186/s12882-025-04076-5.

12. Rahutomo R. Designing customer analytics dashboard in smart device retail using Power BI. Journal of Information Systems and Informatics. 2025;7(2):1743–1757. DOI: 10.51519/journalisi.v7i2.1114.

13. Uvarov A. Yu. Harnessing ICT to enhance provision of school education: The policy recommendations. Informatics and Education. 2019;(2(301)):5–12. (In Russian.) DOI: 10.32517/0234-0453-2019-34-2-5-12. EDN: ZIJFTF.

14. Shevchuk E. V., Shpak A. V. Digital transformation of the quality management process of intermediate certification of students. Informatics and Education. 2023;38(3):64–77. (In Russian.) DOI: 10.32517/0234-0453-2023-38-3-64-77. EDN: WVBEAA.

15. Arnold K. E., Pistilli M. D. Course signals at Purdue: Using learning analytics to increase student success. LAK ’12 Proc. 2nd Int. Conf. on Learning Analytics and Knowledge. NYC, ACM; 2012:267–270. DOI: 10.1145/2330601.2330666.

16. Kizilcec R. F., Saltarelli A. J., Reich J., Cohen G. L. Closing global achievement gaps in MOOCs. Science. 2017;355(6322):251–252. DOI: 10.1126/science.aag2063.

17. Ifenthaler D., Widanapathirana C. Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning. 2014;19:221–240. DOI: 10.1007/s10758-014-9226-4.

18. Papamitsiou Z., Economides A. A. Learning analytics and educational data mining in practice: A systematic litera

19. ture review of empirical evidence. Educational Technology & Society. 2014;17(4):49–64. Available at: https://www.jstor.org/stable/jeductechsoci.17.4.49.

20. Baker R., Siemens G. Educational data mining and learning analytics. In: Sawyer R. K. (ed) The Cambridge Handbook of the Learning Sciences. Cambridge, Cambridge University Press; 2014:253–272. DOI: 10.1017/CBO9781139519526.016.

21. Johnson L., Adams Becker S., Estrada V., Freeman A. NMC Horizon Report. Austin, The New Media Consortium; 2015. 56 p. Available at: https://www.learntechlib.org/p/182010/

22. Attia M. R. Learning analytics technology in adaptive electronic learning environments. Pedagogical Journal of Bashkortostan. 2021;(2(92)):144–153. (In Russian.) DOI: 10.21510/1817-3292-2021-92-2-144-153. EDN: IGRQLI.