<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">infojournal</journal-id><journal-title-group><journal-title xml:lang="ru">Информатика и образование</journal-title><trans-title-group xml:lang="en"><trans-title>Informatics and education</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">0234-0453</issn><issn pub-type="epub">2658-7769</issn><publisher><publisher-name>Publishing House Education and Informatics</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.32517/0234-0453-2021-36-5-4-11</article-id><article-id custom-type="elpub" pub-id-type="custom">infojournal-686</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ПЕДАГОГИЧЕСКИЙ ОПЫТ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>PEDAGOGICAL EXPERIENCE</subject></subj-group></article-categories><title-group><article-title>Многокритериальная методика оценки качества LMS в рамках эмергентной системы обучения</article-title><trans-title-group xml:lang="en"><trans-title>Multi-criteria methodology for LMS quality assessment within the framework of emergent learning system</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-0577-2360</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Мариносян</surname><given-names>А. Х.</given-names></name><name name-style="western" xml:lang="en"><surname>Marinosyan</surname><given-names>A. Kh.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Мариносян Андреас Хачатурович, специалист, 119049, Россия, г. Москва, Мароновский пер., д. 26</p></bio><bio xml:lang="en"><p>Andreas Kh. Marinosyan, Specialist, 119049, Russia, Moscow, Maronovskiy per., 26</p></bio><email xlink:type="simple">marinos.andrey@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-1566-3427</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Андрюшкова</surname><given-names>О. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Andryushkova</surname><given-names>O. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Андрюшкова Ольга Владимировна, канд. хим. наук, доцент, зав. лабораторией методики преподавания химии кафедры общей химии, 119991, Россия, г. Москва, Ленинские горы, д. 1, стр. 3</p></bio><bio xml:lang="en"><p>Olga V. Andryushkova, Candidate of Sciences (Chemistry), Docent, Head of the Laboratory of Methods of Teaching Chemistry of the Department of General Chemistry, 119991, Russia, Moscow, Leninskie gory, 1, building 3</p></bio><email xlink:type="simple">o.andryushkova@gmail.com</email><xref ref-type="aff" rid="aff-2"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru">Государственный академический университет гуманитарных наук<country>Россия</country></aff><aff xml:lang="en">State Academic University for the Humanities<country>Russian Federation</country></aff></aff-alternatives><aff-alternatives id="aff-2"><aff xml:lang="ru">Химический факультет Московского государственного университета имени М. В. Ломоносова<country>Россия</country></aff><aff xml:lang="en">Lomonosov Moscow State University, Faculty of Chemistry<country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2021</year></pub-date><pub-date pub-type="epub"><day>16</day><month>07</month><year>2021</year></pub-date><volume>0</volume><issue>5</issue><fpage>4</fpage><lpage>11</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Мариносян А.Х., Андрюшкова О.В., 2021</copyright-statement><copyright-year>2021</copyright-year><copyright-holder xml:lang="ru">Мариносян А.Х., Андрюшкова О.В.</copyright-holder><copyright-holder xml:lang="en">Marinosyan A.K., Andryushkova O.V.</copyright-holder><license license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://info.infojournal.ru/jour/article/view/686">https://info.infojournal.ru/jour/article/view/686</self-uri><abstract><p>В статье на примере систем управления обучением (Learning Management System, LMS) рассмотрена методика оценки качества обучения, учитывающая запросы экспертов, преподавателей и учащихся. Актуальность исследования обусловлена цифровизацией образования, переходом на дистанционное обучение в качестве основной или вспомогательной формы организации образовательного процесса. Данная методика базируется на концепции эмергентного обучения, разработанной ранее одним из авторов статьи, и на системе оценки качества обучения на основе негэнтропии. Адаптируя эту методологию применительно к задаче оценки LMS, авторы показывают важность создания иерархической схемы модулей и функциональных элементов, необходимых для качественной организации процесса обучения. Для расчета интегральной оценки, согласно авторской позиции, нужно определить весовой коэффициент каждого модуля и каждого критерия, по которому этот модуль оценивается, проставить численные значения критериев для конкретной LMS. Гибкая система оценки, учитывающая запросы всех сторон образовательного процесса, позволяет, модифицируя весовые коэффициенты, адаптировать формулу расчета в соответствии с особенностями предметной области и образовательного учреждения, в рамках которых используется LMS. Преимущество методики состоит в том, что она дает возможность не только сравнить разные LMS по качеству, но и выявить направления, по которым можно совершенствовать и дорабатывать существующие LMS. В статье проанализированы риски, связанные с превращением систем оценивания из вспомогательного средства в самоцель. Предлагается алгоритм разделения учета качественных и количественных факторов, помогающий избежать негативного эффекта от абсолютизации систем оценок. Намечены пути развития методики и построения на ее основе такой системы управления и организации образовательного процесса, в которой требования качества превалируют над привходящими требованиями.</p></abstract><trans-abstract xml:lang="en"><p>In the article, using the case of Learning Management System (LMS), we consider a methodology for assessing the quality of education, taking into account the requests of experts, lecturers, and students. There is a growing relevance of such research due to the digitalization of education, the transition to distance learning as the main or auxiliary form of organizing the educational process. The applied methodology relies on the earlier developed concept of emergent learning and the system for the assessment of the quality of education, using the conception of negentropy. By adapting this methodology to the LMS assessment task, we show the importance of creating a hierarchical scheme of modules and functional elements necessary for an effective organization of the learning process. In order to provide an integral assessment, it is necessary, according to our position, to determine the weighting factor of each module and of each criterion by which this module is assessed and then to determine the values of each criterion for a specific LMS. A proposed flexible assessment system that takes into account the requests of all aspects of the educational process, allows, by modifying the weighting factors, to adapt the equation in accordance with the specificity of the subject area and educational institution within which the LMS is used. As an advantage of this methodology, it makes it possible not only to compare different LMSs in terms of quality but also to identify areas in which it is possible to improve and refine existing LMSs. We analyze the risks associated with the transformation of assessment systems from an auxiliary tool into an end in itself. In this regard, we propose an algorithm for separating qualitative and quantitative factors accounting, which helps to avoid the negative effect of the absolutization of assessment systems. In the conclusion, we outline the ways of developing the design of such a system of the management of educational process in which quality requirements prevail over circumstantial ones. </p></trans-abstract><kwd-group xml:lang="ru"><kwd>цифровизация</kwd><kwd>информатизация образования</kwd><kwd>электронное образование</kwd><kwd>онлайн-обучение</kwd><kwd>дистанционные образовательные технологии</kwd><kwd>система дистанционного обучения</kwd><kwd>эмергентность</kwd></kwd-group><kwd-group xml:lang="en"><kwd>digitalization</kwd><kwd>informatization of education</kwd><kwd>e-education</kwd><kwd>online learning</kwd><kwd>distance learning technologies</kwd><kwd>distance learning system</kwd><kwd>emergentness</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Андрюшкова О. В., Григорьев С. Г. Эмергентное обучение в информационно-образовательной среде. М.: Образование и Информатика, 2018. 104 с.</mixed-citation><mixed-citation xml:lang="en">Andryushkova O. V., Grigoriev S. G. Ehmergentnoe obuchenie v informatsionno-obrazovatel’noj srede [Emergent training in the information educational environment]. Moscow, Obrazovanie i Informatika, 2018. 104 p. (In Russian.)</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Kellaghan T., Stufflebeam D. L. International handbook of educational evaluation. Dordrecht: Springer, 2003. 1060 p. DOI: 10.1007/978-94-010-0309-4</mixed-citation><mixed-citation xml:lang="en">Kellaghan T., Stufflebeam D. L. International handbook of educational evaluation. Dordrecht, Springer, 2003. 1060 p. DOI: 10.1007/978-94-010-0309-4</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Dunn L., Morgan C., O’Reilly M., Parry S. The student assessment handbook: New directions in traditional and online assessment. London: Routledge, 2003. 320 p. DOI: 10.4324/9780203416518</mixed-citation><mixed-citation xml:lang="en">Dunn L., Morgan C., O’Reilly M., Parry S. The student assessment handbook: New directions in traditional and online assessment. London, Routledge, 2003. 320 p. DOI: 10.4324/9780203416518</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Cox K., Imrie B. W., Miller A. H. Student assessment in higher education: A handbook for assessing performance. London: Routledge, 1998. 292 p. https://www.routledge.com/Student-Assessment-in-Higher-Education-A-Handbook-for-Assessing-Performance/Cox-Imrie-Miller/p/book/9780749427979</mixed-citation><mixed-citation xml:lang="en">Cox K., Imrie B. W., Miller A. H. Student assessment in higher education: A handbook for assessing performance. London, Routledge, 1998. 292 p. Available at: https://www.routledge.com/Student-Assessment-in-Higher-Education-A-Handbook-for-Assessing-Performance/Cox-Imrie-Miller/p/book/9780749427979</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Andryushkova O., Grigoriev S. The influence online learning quality criteria selection on negentropy // Proc. 4th Int. Conf. on Informatization of Education and E-learning Methodology: Digital Technologies in Education. 2020. Vol. 2770. P. 127–139. http://ceur-ws.org/Vol-2770/paper17.pdf</mixed-citation><mixed-citation xml:lang="en">Andryushkova O., Grigoriev S. The influence online learning quality criteria selection on negentropy. Proc. 4th Int. Conf. on Informatization of Education and E-learning Methodology: Digital Technologies in Education. 2020, vol. 2770, p. 127–139. Available at: http://ceur-ws.org/Vol-2770/paper17.pdf</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Андреев А. А. Оценка качества онлайн курсов // Территория науки. 2015. № 1. С. 20–26.</mixed-citation><mixed-citation xml:lang="en">Andreev A. A. Otsenka kachestva onlajn kursov [Evaluation of the quality of online courses]. Territoriya nauki — Territory of Science, 2015, no. 1, p. 20–26. (In Russian.)</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Horvat A., Dobrota M., Krsmanovic M., Cudanov M. Student perception of Moodle learning management system: a satisfaction and significance analysis // Interactive Learning Environments. 2015. Vol. 23. Is. 4. P. 515–527. DOI: 10.1080/10494820.2013.788033</mixed-citation><mixed-citation xml:lang="en">Horvat A., Dobrota M., Krsmanovic M., Cudanov M. Student perception of Moodle learning management system: a satisfaction and significance analysis. Interactive Learning Environments, 2015, vol. 23, is. 4, p. 515–527. DOI: 10.1080/10494820.2013.788033</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Han I., Shin W. S. The use of a mobile learning management system and academic achievement of online students // Computers &amp; Education. 2016. Vol. 102. P. 79–89. DOI: 10.1016/j.compedu.2016.07.003</mixed-citation><mixed-citation xml:lang="en">Han I., Shin W. S. The use of a mobile learning management system and academic achievement of online students. Computers &amp; Education, 2016, vol. 102, p. 79–89. DOI: 10.1016/j.compedu.2016.07.003</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Farid S., Ahmad R., Alam M., Akbar A., Chang V. A sustainable quality assessment model for the information delivery in E-learning systems // Information Discovery and Delivery. 2018. Vol. 46. Is. 1. P. 1–25. DOI: 10.1108/IDD-11-2016-0047</mixed-citation><mixed-citation xml:lang="en">Farid S., Ahmad R., Alam M., Akbar A., Chang V. A sustainable quality assessment model for the information delivery in E-learning systems. Information Discovery and Delivery, 2018, vol. 46, is. 1, p. 1–25. DOI: 10.1108/IDD-11-2016-0047</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Cerezo R., Bogarín A., Esteban M., Romero C. Process mining for self-regulated learning assessment in e-learning // Journal of Computing in Higher Education. 2020. Vol. 32. Is. 1. P. 74–88. DOI: 10.1007/s12528-019-09225-y</mixed-citation><mixed-citation xml:lang="en">Cerezo R., Bogarín A., Esteban M., Romero C. Process mining for self-regulated learning assessment in e-learning. Journal of Computing in Higher Education, 2020, vol. 32, is. 1, p. 74–88. DOI: 10.1007/s12528-019-09225-y</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Henriksen D., Creely E., Henderson M. Folk pedagogies for teacher transitions: Approaches to synchronous online learning in the wake of COVID-19 // Journal of Technology and Teacher Education. 2020. Vol. 28. Is. 2. P. 201–209.</mixed-citation><mixed-citation xml:lang="en">Henriksen D., Creely E., Henderson M. Folk pedagogies for teacher transitions: Approaches to synchronous online learning in the wake of COVID-19. Journal of Technology and Teacher Education, 2020, vol. 28, is. 2, p. 201–209.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Gillett-Swan J. The challenges of online learning: Supporting and engaging the isolated learner // Journal of Learning Design. 2017. Vol. 10. No. 1. P. 20–30. DOI: 10.5204/jld.v9i3.293</mixed-citation><mixed-citation xml:lang="en">Gillett-Swan J. The challenges of online learning: Supporting and engaging the isolated learner. Journal of Learning Design, 2017, vol. 10, no. 1, p. 20–30. DOI: 10.5204/jld.v9i3.293</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Kara M., Erdoğdu F., Kokoç M., Cagiltay K. Challenges faced by adult learners in online distance education: A literature review // Open Praxis. 2019. Vol. 11. No. 1. P. 5–22. DOI: 10.5944/openpraxis.11.1.929</mixed-citation><mixed-citation xml:lang="en">Kara M., Erdoğdu F., Kokoç M., Cagiltay K. Challenges faced by adult learners in online distance education: A literature review. Open Praxis, 2019, vol. 11, no. 1, p. 5–22. DOI: 10.5944/openpraxis.11.1.929</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Fresen J. W. Embracing distance education in a blended learning model: challenges and prospects // Distance Education. 2018. Vol. 39. Is. 2. P. 224–240. DOI: 10.1080/01587919.2018.1457949</mixed-citation><mixed-citation xml:lang="en">Fresen J. W. Embracing distance education in a blended learning model: challenges and prospects. Distance Education, 2018, vol. 39, is. 2, p. 224–240. DOI: 10.1080/01587919.2018.1457949</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Damary R., Markova T., Pryadilina N. Key challenges of on-line education in multi-cultural context // Procedia — Social and Behavioral Sciences. 2017. Vol. 237. P. 83–89. DOI: 10.1016/j.sbspro.2017.02.034</mixed-citation><mixed-citation xml:lang="en">Damary R., Markova T., Pryadilina N. Key challenges of on-line education in multi-cultural context. Procedia — Social and Behavioral Sciences, 2017, vol. 237, p. 83–89. DOI: 10.1016/j.sbspro.2017.02.034</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Ouma R., Nkuyubwatsi B. Transforming university learner support in open and distance education: Staff and students perceived challenges and prospects // Cogent Education. 2019. Vol. 6. Is. 1. DOI: 10.1080/2331186X.2019.1658934</mixed-citation><mixed-citation xml:lang="en">Ouma R., Nkuyubwatsi B. Transforming university learner support in open and distance education: Staff and students perceived challenges and prospects. Cogent Education, 2019, vol. 6, is. 1. DOI: 10.1080/2331186X.2019.1658934</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Nage-Sibande B., Morolong B. L. A trend analysis of opportunities and challenges of open and distance learning provision in dual-mode institutions // Distance Education. 2018. Vol. 39. Is. 4. P. 495–510. DOI: 10.1080/01587919.2018.1457951</mixed-citation><mixed-citation xml:lang="en">Nage-Sibande B., Morolong B. L. A trend analysis of opportunities and challenges of open and distance learning provision in dual-mode institutions. Distance Education, 2018, vol. 39, is. 4, p. 495–510. DOI: 10.1080/01587919.2018.1457951</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Palvia S., Aeron P., Gupta P., Mahapatra D., Parida R., Rosner R., Sindhi S. Online education: Worldwide status, challenges, trends, and implications // Journal of Global Information Technology Management. 2018. Vol. 21. Is. 4. P. 233–241. DOI: 10.1080/1097198X.2018.1542262</mixed-citation><mixed-citation xml:lang="en">Palvia S., Aeron P., Gupta P., Mahapatra D., Parida R., Rosner R., Sindhi S. Online education: Worldwide status, challenges, trends, and implications. Journal of Global Information Technology Management, 2018, vol. 21, is. 4, p. 233–241. DOI: 10.1080/1097198X.2018.1542262</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Kebritchi M., Lipschuetz A., Santiague L. Issues and challenges for teaching successful online courses in higher education: A literature review // Journal of Educational Technology Systems. 2017. Vol. 46. Is. 1. P. 4–29. DOI: 10.1177/0047239516661713</mixed-citation><mixed-citation xml:lang="en">Kebritchi M., Lipschuetz A., Santiague L. Issues and challenges for teaching successful online courses in higher education: A literature review. Journal of Educational Technology Systems, 2017, vol. 46, is. 1, p. 4–29. DOI: 10.1177/0047239516661713</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Chen S.-Y., Basma D., Ju J., Ng K.-M. Opportunities and challenges of multicultural and international online education // Professional Counselor. 2020. Vol. 10. No. 1. P. 120–132. https://eric.ed.gov/?id=EJ1251004</mixed-citation><mixed-citation xml:lang="en">Chen S.-Y., Basma D., Ju J., Ng K.-M. Opportunities and challenges of multicultural and international online education. Professional Counselor, 2020, vol. 10, no. 1, p. 120–132. Available at: https://eric.ed.gov/?id=EJ1251004</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Cloete A. L. Technology and education: Challenges and opportunities // Theological Studies. 2017. Vol. 73. No. 3. P. 1–7. DOI: 10.4102/hts.v73i3.4589</mixed-citation><mixed-citation xml:lang="en">Cloete A. L. Technology and education: Challenges and opportunities. Theological Studies, 2017, vol. 73, no. 3, p. 1–7. DOI: 10.4102/hts.v73i3.4589</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Yusuf B. N. Are we prepared enough? A case study of challenges in online learning in a private higher learning institution during the COVID-19 outbreaks // Advances in Social Sciences Research Journal. 2020. Vol. 7. No. 5. P. 205–212. DOI: 10.14738/assrj.75.8211</mixed-citation><mixed-citation xml:lang="en">Yusuf B. N. Are we prepared enough? A case study of challenges in online learning in a private higher learning institution during the COVID-19 outbreaks. Advances in Social Sciences Research Journal, 2020, vol. 7, no. 5, p. 205–212. DOI: 10.14738/assrj.75.8211</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Kear K., Rosewell J., Williams K., Ossiannilsson E., Rodrigo C., Sánchez-Elvira Paniagua Á., Santamaría Lancho M., Vyt A., Mellar H. Quality assessment for E-learning: A benchmarking approach. Maastricht: EADTU, 2016. http://oro.open.ac.uk/47597/</mixed-citation><mixed-citation xml:lang="en">Kear K., Rosewell J., Williams K., Ossiannilsson E., Rodrigo C., Sánchez-Elvira Paniagua Á., Santamaría Lancho M., Vyt A., Mellar H. Quality assessment for E-learning: A benchmarking approach. Maastricht: EADTU, 2016. Available at: http://oro.open.ac.uk/47597/</mixed-citation></citation-alternatives></ref><ref id="cit24"><label>24</label><citation-alternatives><mixed-citation xml:lang="ru">Xu H., Mahenthiran S. Factors that influence online learning assessment and satisfaction: Using Moodle as a Learning Management System // International Business Research. 2016. Vol. 9. No. 2. P. 1–18. DOI: 10.5539/ibr.v9n2p1</mixed-citation><mixed-citation xml:lang="en">Xu H., Mahenthiran S. Factors that influence online learning assessment and satisfaction: Using Moodle as a Learning Management System. International Business Research, 2016, vol. 9, no. 2, p. 1–18. DOI: 10.5539/ibr.v9n2p1</mixed-citation></citation-alternatives></ref><ref id="cit25"><label>25</label><citation-alternatives><mixed-citation xml:lang="ru">Андрюшкова О. В., Горбунов М. А., Козлова А. В. Learning Management System как необходимый элемент Blended Learning // Открытое образование. 2017. Т. 21. № 3. С. 80–88. DOI: 10.21686/1818-4243-2017-3-80-88</mixed-citation><mixed-citation xml:lang="en">Andryushkova O. V., Gorbunov M. A., Kozlova A. V. Learning Management System kak neobkhodimyj ehlement Blended Learning [Learning Management System as a necessary element of Blended Learning]. Otkrytoe obrazovanie — Open Education, 2017, vol. 21, no. 3, p. 80–88. (In Russian.) DOI: 10.21686/1818-4243-2017-3-80-88</mixed-citation></citation-alternatives></ref><ref id="cit26"><label>26</label><citation-alternatives><mixed-citation xml:lang="ru">Stobart G. Testing times: The uses and abuses of assessment. London: Routledge, 2008. 224 p. DOI: 10.4324/9780203930502</mixed-citation><mixed-citation xml:lang="en">Stobart G. Testing times: The uses and abuses of assessment. London, Routledge, 2008. 224 p. DOI: 10.4324/9780203930502</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
