<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">infojournal</journal-id><journal-title-group><journal-title xml:lang="ru">Информатика и образование</journal-title><trans-title-group xml:lang="en"><trans-title>Informatics and education</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">0234-0453</issn><issn pub-type="epub">2658-7769</issn><publisher><publisher-name>Publishing House Education and Informatics</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.32517/0234-0453-2023-38-6-59-67</article-id><article-id custom-type="elpub" pub-id-type="custom">infojournal-1008</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ИНФОРМАТИЗАЦИЯ ОБРАЗОВАНИЯ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>INFORMATIZATION OF EDUCATION</subject></subj-group></article-categories><title-group><article-title>О способах анализа качества знаний студентов при дистанционном и смешанном форматах обучения</article-title><trans-title-group xml:lang="en"><trans-title>About the methods of the students competences analysis in distance and blended learning</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-9373-6804</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Савин</surname><given-names>М. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Savin</surname><given-names>M. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Савин Максим Анатольевич, канд. тех. наук, доцент кафедры «Сварочное производство, метрология и технология материалов», механико-технологический факультет</p><p>Пермь</p></bio><bio xml:lang="en"><p>Maksim A. Savin, Candidate of Sciences (Engineering), Associate Professor at the Department of Welding Production, Metrology and Technology of Materials, Mechanical Engineering Faculty</p><p>Perm</p></bio><email xlink:type="simple">abins@pstu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru">Пермский национальный исследовательский политехнический университет<country>Россия</country></aff><aff xml:lang="en">Perm National Research Polytechnic University<country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>25</day><month>12</month><year>2023</year></pub-date><volume>38</volume><issue>6</issue><fpage>59</fpage><lpage>67</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Савин М.А., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Савин М.А.</copyright-holder><copyright-holder xml:lang="en">Savin M.A.</copyright-holder><license license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://info.infojournal.ru/jour/article/view/1008">https://info.infojournal.ru/jour/article/view/1008</self-uri><abstract><p>Быстрое развитие дистанционного и смешанного форматов обучения ставит перед преподавателями серьезную проблему объективной и достоверной оценки знаний студентов. Современные системы дистанционного обучения (СДО) часто не предоставляют всесторонней информации о качестве обучения в удобном для преподавателя виде. Краткий обзор СДО, занимающих лидирующие позиции по использованию в вузах Российской Федерации, позволяет в этом убедиться. Проанализированы возможности популярных СДО, их достоинства и недостатки в обработке информации об успеваемости обучающихся. По результатам анализа становится очевидной необходимость дальнейшей пользовательской обработки данных.</p><p>Показана методика оценивания качества знаний студентов на примере собственной разработки — системы управления процессом обучения Abins.NET, созданной в Пермском национальном исследовательском политехническом университете. Подтверждена необходимость использования минимум двух независимых критериев оценки качества обучения путем проведения корреляционного анализа между оценкой, временем работы и бонусными баллами.</p><p>Проведено сравнение методик начисления бонусных баллов в СДО собственной разработки, iSpring и WebTutor и сделан вывод о необходимости автоматизированного управления бонусами (начисления, списания) по критериям, которые заранее заданы разработчиком. Сформулированы выводы и предложения по выбору значимых критериев и их расчету при работе с любой СДО для оценивания успешности обучения студентов вузов.</p></abstract><trans-abstract xml:lang="en"><p>The rapid development of distance and blended learning formats poses a serious problem for instructors to objectively and reliably assess students’ knowledge. Modern learning management systems often do not provide comprehensive information about the quality of learning in a convenient form for the teacher. A brief review of the leading distance learning systems used in universities of the Russian Federation allows us to make sure of this. The capabilities of popular learning management systems, their advantages and disadvantages in processing information about students’ progress are analyzed. According to the results of the analysis, the necessity of further custom data processing becomes obvious.</p><p>The methodology of evaluating the quality of students’ knowledge is shown in the example of an own development — the Abins.NET learning management system created at Perm National Research Polytechnic University. The necessity of using a minimum of two independent criteria for evaluating the quality of learning by conducting a correlation analysis between the grade, work time, and bonus points is confirmed.</p><p>The comparison of bonus points accrual methods in own-developed learning management system, iSpring, and WebTutor was carried out and the conclusion was made about the necessity of automated bonus management (accrual, write-off) according to the criteria that are predetermined by the developer. The conclusions and suggestions on the selection of significant criteria and their calculation when working with any learning management system to assess the success of university students’ learning are formulated.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>дистанционное обучение</kwd><kwd>анализ эффективности обучения</kwd><kwd>LMS</kwd><kwd>бонусные баллы</kwd><kwd>статистическая обработка</kwd><kwd>Moodle</kwd><kwd>iSpring</kwd><kwd>WebTutor</kwd><kwd>Abins.NET</kwd></kwd-group><kwd-group xml:lang="en"><kwd>distance learning</kwd><kwd>learning effectiveness analysis</kwd><kwd>LMS</kwd><kwd>bonuses</kwd><kwd>statistical processing</kwd><kwd>Moodle</kwd><kwd>iSpring</kwd><kwd>WebTutor</kwd><kwd>Abins.NET</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Ertan K., Kocadere S. A. Gamification design to increase motivation in online learning environments: A systematic review. Journal of Learning and Teaching in Digital Age. 2022;7(2):151–159. DOI: 10.53850/joltida.1020044.</mixed-citation><mixed-citation xml:lang="en">Ertan K., Kocadere S. A. Gamification design to increase motivation in online learning environments: A systematic review. Journal of Learning and Teaching in Digital Age. 2022;7(2):151–159. DOI: 10.53850/joltida.1020044.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Говоров А. И., Говорова М. М., Валитова Ю. О. Оценка актуальности разработки методов использования средств геймификации и игровых технологий в системах управления обучением. Компьютерные инструменты в образовании. 2018;(2):39–54. EDN: VMZCPB.</mixed-citation><mixed-citation xml:lang="en">Govorov A. I., Govorova M. M., Valitova Yu. O. Assessment of relevance of developing methods for using gamification tools and gaming technology in the management systems of training. Computer Tools in Education Journal. 2018;(2):39–54. (In Russian.) EDN: VMZCPB.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Тербушева Е. А., Пиотровская К. Р. Аналитический потенциал платформы Moodle для мониторинга качества персонифицированного обучения. Общество. Коммуникация. Образование. 2021;12(4):19–34. EDN: WSSBWE. DOI: 10.18721/JHSS.12402.</mixed-citation><mixed-citation xml:lang="en">Terbusheva E. A. Piotrowska X. R. Analytical potential of the LMS Moodle for monitoring the quality of personification. Society. Communication. Education. 2021;12(4):19–34. (In Russian.) EDN: WSSBWE. DOI: 10.18721/JHSS.12402.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Лавриненко И. Ю. Перспективы использования LMS в рамках современного высшего образования. Научно-методический электронный журнал «Концепт». 2023;(1):17–35. EDN: JBMUHS. DOI: 10.24412/2304-120X-2023-11002.</mixed-citation><mixed-citation xml:lang="en">Lavrinenko I. Yu. Prospects for the LMS use in modern higher education. Scientific and Methodological Electronic Journal “Koncept”. 2023;(1):17–35. (In Russian.) EDN: JBMUHS. DOI: 10.24412/2304-120X-2023-11002.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Florian B., Glahn C., Drachsler H., Specht M., Fabregat Gesa R. Activity-based learner-models for learner monitoring and recommendations in Moodle. Towards Ubiquitous Learning. EC-TEL 2011. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg, 2011;6964:111–124. DOI: 10.1007/978-3-642-23985-4_10.</mixed-citation><mixed-citation xml:lang="en">Florian B., Glahn C., Drachsler H., Specht M., Fabregat Gesa R. Activity-based learner-models for learner monitoring and recommendations in Moodle. Towards Ubiquitous Learning. EC-TEL 2011. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg, 2011;6964:111–124. DOI: 10.1007/978-3-642-23985-4_10.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Горюнова Е. С., Иванова А. С., Степаненко А. А., Фещенко А. В. Опыт применения инструментов оценки и практик управления качеством электронного обучения (кейс Томского государственного университета). Открытое образование. 2022;26(4):4–18. EDN: EJTLSQ. DOI: 10.21686/1818-4243-2022-4-4-18.</mixed-citation><mixed-citation xml:lang="en">Goryunova E. S., Ivanova A. S., Stepanenko A. A., Feshchenko A. V. Experience in using assessment tools and e-learning quality management practices (case study of Tomsk State University). Open Education. 2022;26(4):4–18. (In Russian.) EDN: EJTLSQ. DOI: 10.21686/1818-4243-2022-4-4-18.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Басев И. Н., Голунова Л. В. Мониторинг учебной деятельности студентов в LMS Moodle (на примере дисциплины «Информатика»). Вестник Сибирского государственного университета путей сообщения: Гуманитарные исследования. 2019;(2(6)):29–36. EDN: PIVWEL.</mixed-citation><mixed-citation xml:lang="en">Basev I. N., Golunova L. V. Monitoring of student educational activities in LMS Moodle (on the example of information technology subject). The Siberian Transport University Bulletin: Humanitarian Research. 2019;(2(6)):29–36. (In Russian.) EDN: PIVWEL.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Dobashi K. Automatic data integration from Moodle course logs to pivot tables for time series cross section analysis. Procedia Computer Science. 2017;112:1835–1844. DOI: 10.1016/j.procs.2017.08.222.</mixed-citation><mixed-citation xml:lang="en">Dobashi K. Automatic data integration from Moodle course logs to pivot tables for time series cross section analysis. Procedia Computer Science. 2017;112:1835–1844. DOI: 10.1016/j.procs.2017.08.222.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Худолей Н. В. Использование LMS Moodle при обучении иностранному языку в вузе (опыт ФГБОУ ВО «Красноярский ГАУ»). Вестник Российского университета дружбы народов. Серия: Информатизация образования. 2018;15(4):410–423. EDN: YXIMOL. DOI: 10.22363/2312-8631-2018-15-4-410-423.</mixed-citation><mixed-citation xml:lang="en">Khudolei N. V. Use of LMS MOODLE in training foreign language at institutions of higher education (experience of Krasnoyarsk State Agrarian University). RUDN Journal of Informatization in Education. 2018;15(4):410–423. (In Russian.) EDN: YXIMOL. DOI: 10.22363/2312-8631-2018-15-4-410-423.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Лейхтер С. Н., Малыгина О. Г., Бажукова Т. А. Компетентностно-ориентированный экзамен по клинической лабораторной диагностике у студентов, обучающихся по специальности «медицинская биохимия». Клиническая лабораторная диагностика. 2020;65(3):197–200. EDN: WPSFUU. DOI: 10.18821/0869-2084-2020-65-3-197-200.</mixed-citation><mixed-citation xml:lang="en">Leikhter S. N., Malygina O. G., Bazhukova T. A. Competence-oriented exam in clinical laboratory diagnostics for students studying in the specialty “medical biochemistry”. Clinical Laboratory Diagnostics. 2020;65(3):197–200. (In Russian.) EDN: WPSFUU. DOI: 10.18821/0869-2084-2020-65-3-197-200.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Великанова Ю. В., Косарева Е. А. Разработка заданий для самоконтроля и анализ их качества с использованием Moodle. Вектор науки Тольяттинского государственного университета. Серия: Педагогика, психология. 2021;(1(44)):19–28. EDN: XNTVBT. DOI: 10.18323/2221-5662-2021-1-19-28.</mixed-citation><mixed-citation xml:lang="en">Velikanova Yu. V., Kosareva E. A. The development of tasks for self-control and analysis of their quality using the Moodle system. Science Vector of Togliatti State University. Series: Pedagogy, Psychology. 2021;(1(44)):19–28. (In Russian.) EDN: XNTVBT. DOI: 10.18323/2221-5662-2021-1-19-28.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Xin O. K., Singh D. Development of learning analytics dashboard based on Moodle Learning Management System. International Journal of Advanced Computer Science and Applications. 2021;12(7):838–843. Available at: https://thesai.org/Downloads/Volume12No7/Paper_93-Develop-ment_of_Learning_Analytics_Dashboard.pdf</mixed-citation><mixed-citation xml:lang="en">Xin O. K., Singh D. Development of learning analytics dashboard based on Moodle Learning Management System. International Journal of Advanced Computer Science and Applications. 2021;12(7):838–843. Available at: https://thesai.org/Downloads/Volume12No7/Paper_93-Develop-ment_of_Learning_Analytics_Dashboard.pdf</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Nwachukwu U., Hernández-García Á., Cuenca-Enrique C., Del-Río-Carazo L. InDash: An interactions dashboard to analyze Moodle logs. Proc. of the Learning Analytics Summer Institute Spain 2022. Salamanca, CEUR Workshop Proceedings; 2022;3238:18–25. Available at: https://ceur-ws.org/Vol-3238/paper3.pdf</mixed-citation><mixed-citation xml:lang="en">Nwachukwu U., Hernández-García Á., Cuenca-Enrique C., Del-Río-Carazo L. InDash: An interactions dashboard to analyze Moodle logs. Proc. of the Learning Analytics Summer Institute Spain 2022. Salamanca, CEUR Workshop Proceedings; 2022;3238:18–25. Available at: https://ceur-ws.org/Vol-3238/paper3.pdf</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Barsukov N. D., Sysoev I. M., Pereskokova A. A., Nikiforov I. V., Posmetnijs D. Analysis of student activity on the e-learning course based on “OpenEdu” platform logs. Proc. of the Institute for System Programming of the RAS. 2020;32(3):91–100. EDN: QYVJBQ. DOI: 10.15514/ISPRAS-2020-32(3)-8.</mixed-citation><mixed-citation xml:lang="en">Barsukov N. D., Sysoev I. M., Pereskokova A. A., Nikiforov I. V., Posmetnijs D. Analysis of student activity on the e-learning course based on “OpenEdu” platform logs. Proc. of the Institute for System Programming of the RAS. 2020;32(3):91–100. EDN: QYVJBQ. DOI: 10.15514/ISPRAS-2020-32(3)-8.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Akçapinar G., Bayazit A. MoodleMiner: Data mining analysis tool for Moodle Learning Management System. İlköğretim Online. 2019;18(1):406–415. DOI: 10.17051/ilkonline.2019.527645.</mixed-citation><mixed-citation xml:lang="en">Akçapinar G., Bayazit A. MoodleMiner: Data mining analysis tool for Moodle Learning Management System. İlköğretim Online. 2019;18(1):406–415. DOI: 10.17051/ilkonline.2019.527645.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Бабанская О. М., Можаева Г. В., Степаненко А. А., Фещенко А. В. Организация системы мониторинга электронного обучения в LMS Moodle. Открытое и дистанционное образование. 2016;(3(63)):27–35. EDN: WMEDIP. DOI: 10.17223/16095944/63/4.</mixed-citation><mixed-citation xml:lang="en">Babanskaja O. M., Mozhaeva G. V., Stepanenko A. A., Feshhenko A. V. The organization of system of monitoring of electronic training in LMS Moodle. Open and Distance Educa-tion. 2016;(3(63)):27–35. (In Russian.) EDN: WMEDIP. DOI: 10.17223/16095944/63/4.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Насыров Н. Ф., Горлушкина Н. Н., Валитова Ю. О., Тартынских П. С. Автоматизация организации взаимопроверки работ обучающихся с использованием разработанного плагина для LMS Moodle. Современная наука: актуальные проблемы теории и практики. Серия: Естественные и технические науки. 2020;(8):88–94. EDN: HTEECO. DOI: 10.37882/2223-2966.2020.08.23.</mixed-citation><mixed-citation xml:lang="en">Nasyrov N. F., Gorlushkina N. N., Valitova Yu. O., Tartynskikh P. S. Automation of organization of mutual verification of student work using the developed plugin for LMS Moodle. Modern Science: Actual Problems of Theory and Practice. Series “Natural and Technical Sciences”. 2020;(8):88–94. (In Russian.) EDN: HTEECO. DOI: 10.37882/2223-2966.2020.08.23.</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Савин М. А., Галягин К. С., Ошивалов М. А., Селянинов Ю. А., Вахрамеев Е. И., Ульрих Т. А. Использование интерактивных автоматизированных систем при обучении студентов вузов. Alma Mater (Вестник высшей школы). 2019;(6):54–60. EDN: LLZOWD. DOI: 10.20339/AM.06-19.054.</mixed-citation><mixed-citation xml:lang="en">Savin M. A., Galyagin K. S., Oshivalov M. A., Selyaninov Yu. A., Vakhrameev E. I., Ulrikh T. A. Usage of interactive computer-aided systems during training of university students. Alma Mater. Vestnik Vysshey Shkoly. 2019;(6):54–60. (In Russian.) EDN: LLZOWD. DOI: 10.20339/AM.06-19.054.</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Гмурман В. Е. Теория вероятностей и математическая статистика: учебник для вузов. М.: Издательство Юрайт; 2023. 479 с.</mixed-citation><mixed-citation xml:lang="en">Gmurman V. E. Probability theory and mathematical statistics: A textbook for universities. Moscow, Yurajt; 2023. 479 p. (In Russian.)</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Stiller K. D., Bachmaier R. Using study times for identifying types of learners in a distance training for trainee teachers. Turkish Online Journal of Distance Education. 2019;20(2):21–45. DOI: 10.17718/tojde.557728.</mixed-citation><mixed-citation xml:lang="en">Stiller K. D., Bachmaier R. Using study times for identifying types of learners in a distance training for trainee teachers. Turkish Online Journal of Distance Education. 2019;20(2):21–45. DOI: 10.17718/tojde.557728.</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Шунайлова С. А. Сочетание балльно-рейтинговой системы и дистанционных образовательных технологий как средство повышения качества математической подготовки студентов заочной формы обучения. Высшее образование сегодня. 2023;(4):69–73. EDN: MLBHRR. DOI: 10.18137/RNU.HET.23.04.P.069.</mixed-citation><mixed-citation xml:lang="en">Shunailova S. A. The combination of a point-rating system and distance educational technologies as a means of improving the quality of mathematical training of students of correspondence education. Higher Education Today. 2023;(4):69–73. (In Russian.) EDN: MLBHRR. DOI: 10.18137/RNU.HET.23.04.P.069.</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Nisar S., Aslam M. Sh. Is ChatGPT a good tool for T&amp;CM students in studying pharmacology? SSRN. 2023:1–16. DOI: 10.2139/ssrn.4324310.</mixed-citation><mixed-citation xml:lang="en">Nisar S., Aslam M. Sh. Is ChatGPT a good tool for T&amp;CM students in studying pharmacology? SSRN. 2023:1–16. DOI: 10.2139/ssrn.4324310.</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Rahman M., Watanobe Yu. ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences. 2023;13(9):5783. DOI: 10.3390/app13095783.</mixed-citation><mixed-citation xml:lang="en">Rahman M., Watanobe Yu. ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences. 2023;13(9):5783. DOI: 10.3390/app13095783.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
