Preview

Informatics and education

Advanced search

USE OF THE ANALYTIC HIERARCHY PROCESS FOR WORK CONSISTENCY ESTIMATION OF EXPERTS OF THE REGIONAL SUBJECT COMMISSIONS ON ASSESSMENT OF THE PROBLEMS WITH DETAILED ANSWERS OF THE GENERAL STATE EXAM AND THE UNIFIED STATE EXAM

https://doi.org/10.32517/0234-0453-2018-33-8-20-25

Abstract

Use of the Analytic Hierarchy Process for work consistency estimation of experts of the regional subject commissions on assessment of the problems with detailed answers of the General State Exam and the Unified State Exam is considered in the paper. This process is a mathematical technique of system approach for the complex problems of decision making. It is used in the different fields from management on interstate level to the solving the sectoral and particular problems in business, industry, public health and education. Its use for work consistency estimation of experts of the regional subject commissions on assessment of the problems with detailed answers of the General State Exam and the Unified State Exam is conditioned by a need of such technique development which will allow decreasing extremely the influence of subjectivity at commission formation as well as at awarding the status to ones and others experts inside the commission. And this is the key specialty of this process because in the most cases the approaches, considered for the solving the similar problems, are based on the results of the third (seniors or leading) experts as standard. Suggested technique allows estimating the work of every concrete expert in the frame of all commission even at the case, when he was carrying out cross validation with only some others its members. At thus the status of expert is not significant for estimation his efficiency but the absence or presence a difference in grades suggested by him and other commission members for problems solutions of exam participant are significant. At the same time the efficiency of last ones work is also estimated personally by the similar way at the consideration of their cross validations with other expert groups. Suggested principle of Analytic Hierarchy Process’ application allows using the results of work of the regional subject commissions on assessment of the problems with detailed answers of the General State Exam and the Unified State Exam in the current year for modification of the commission in the next one with a purpose to enhance the consistency of exam works validation by the experts.

About the Authors

G. Sh. Shkaberina
Reshetnev Siberian State University of Science and Technology
Russian Federation
Associate Professor at the Department of Informatics and Computer Engineering of Reshetnev Siberian State University of Science and Technology
660049, Russia, Krasnoyarsk, ul. Markovsky, 57, office A102


P. O. Krasnov
Reshetnev Siberian State University of Science and Technology
Russian Federation
Ph.D. of Physical and Mathematical Sciences, Associate Professor at the Department of Applied Physics of Reshetnev Siberian State University of Science and Technology, Chairman of the Krasnoyarsk Territory Subject Commission on Physics
660049, Russia, Krasnoyarsk, ul. Markovsky, 57, office A102


References

1. Приказ Минобрнауки России No 1394 от 25.12.2013 «Об утверждении Порядка проведения государственной итоговой аттестации по образовательным программам основного общего образования» (в редакции приказов Минобрнауки России No 10 от 16.01.2015, No 305 от 24.03.2016). http://fipi.ru/oge-i-gve-9/normativnopravovye-dokumenty

2. Приказ Минобрнауки России No 1400 от 26.12.2013 «Об утверждении Порядка проведения государственной итоговой аттестации по образовательным программам среднего общего образования» (в редакции приказов Минобрнауки России No 9 от 16.01.2015, No 693 от 07.07.2015, No 306 от 24.03.2016, No 6 от 09.01.2017). http://fipi.ru/ ege-i-gve-11/normativno-pravovye-dokumenty

3. Письмо Федеральной службы по надзору в сфере образования и науки No 02-97 от 11.03.2014 «О направлении методических рекомендаций по разработке положения о государственной экзаменационной комиссии субъекта Российской Федерации по проведению государственной итоговой аттестации по образовательным программам среднего общего образования и методических рекомендаций по формированию и организации работы предметных комиссий субъекта Российской Федерации». http://obrnadzor. gov.ru/common/upload/doc_list/17818.pdf

4. Статистико-аналитические отчеты о результатах ЕГЭ в Красноярском крае в 2015 и 2016 годах. https://coko24. ru/?page_id=12546

5. Афонина М. В., Гонштейн М. А. Анализ согласованности работы экспертов при проверке заданий с развернутым ответом ЕГЭ по информатике и ИКТ // Педагогическое образование на Алтае. 2017. No 1. С. 21–25.

6. Гиголо А. И. Методика анализа качества проверки заданий с развернутым ответом ЕГЭ по физике // Педагогические измерения. 2017. No 1. С. 66–72.

7. Щербинин Т. А., Гранков М. В. Метод кластеризации в системе оценки результатов работы экспертов по проверке экзаменов в форме ЕГЭ // Вестник Донского государственного технического университета. 2016. Т. 86. No 3. С. 110–118.

8. Саати Т. Принятие решений. Метод анализа иерархий. М.: Радио и связь, 1993.

9. Saaty T. L. Relative measurement and its generalization in decision making: Why pairwise comparisons are central in mathematics for the measurement of intangible factors — The Analytic Hierarchy/Network Process // Revista de la Real Academia de Ciencias Exactas, Fisicas y Naturales — Serie A: Matematicas. 2008. Vol. 102. No. 2. P. 251–318.

10. Saaty T. L. How to make a decision: The Analytic Hierarchy Process // European Journal of Operational Research. 1990. No. 48. P. 9–26.

11. Harker P. T. The art and science of decision making: The Analytic Hierarchy Process, in: Golden B. L., Wasil E. A., Harker P. T. (Eds.). The Analytic Hierarchy Process: applications and studies. Springer Berlin Heidelberg, 1989. P. 3–36.

12. Saaty T. L. Decision making with the analytic hierarchy process // International Journal of Services Sciences. 2008. Vol. 1. No. 1. P. 83–98.

13. Yin Q. An analytical hierarchy process model for the evaluation of college experimental teaching quality // Journal of Technology and Science Education. 2013. Vol. 3. No. 2. P. 59–65.

14. Rouyendegh B. D., Erkan T. E. Selection of academic staff using the fuzzy analytic hierarchy process (FAHP): A pilot study // Technical Gazette. 2012. Vol. 19. No. 4. P. 923–929.

15. Moayeri M., Shahvarani A., Behzadi M. H. The application of fuzzy analytic hierarchy process in high school math teachers ranking // Mathematics Education Trends and Research. 2016. No. 1. P. 20–30.

16. Atsan N. Measuring educational service quality using Analytic Hierarchy Process // International Journal of Education and Research. 2015. No. 2 (3). P. 527–538.

17. Kousalya P., Mahender Reddy G., Supraja S., Shyam Prasad V. Analytical Hierarchy Process approach — An application of engineering education // Mathematica Aeterna. 2012. Vol. 2. No. 10. P. 861–878.

18. Sahroni T. R., Ariff H. Design of analytical hierarchy process (AHP) for teaching and learning // 11th International Conference on Knowledge, Information and Creativity Support Systems (KICSS). 2016. P. 1–4.

19. Rafikul I., Rasad S. M. Employee performance evaluation by the AHP: A case study // Asia Pacific Management Review. 2006. Vol. 11. No. 3. P. 163–176.

20. Norddin N. I., Ahmad N., Yusof Z. M. Selecting best employee of the year using Analytical Hierarchy Process // Journal of Basic and Applied Scientific Research. 2015. Vol. 5. No. 11. P. 72–76.

21. Mutmainah, Marfuah U., Panudju A. T. Employee performance appraisal model using human resources scorecard and Analytical Hierarchy Process (AHP) // International Journal of Scientific & Technology Research. 2017. Vol. 6. No. 11. P. 81–84.

22. Jurнk L., Sakбl P. Application of Analytic Hierarchy Process method in the evaluation of managers of industrial enterprises in Slovakia // Trendy v podnikбnн. 2015. Vol. 5. No. 3. P. 28–35.


Review

For citations:


Shkaberina G.Sh., Krasnov P.O. USE OF THE ANALYTIC HIERARCHY PROCESS FOR WORK CONSISTENCY ESTIMATION OF EXPERTS OF THE REGIONAL SUBJECT COMMISSIONS ON ASSESSMENT OF THE PROBLEMS WITH DETAILED ANSWERS OF THE GENERAL STATE EXAM AND THE UNIFIED STATE EXAM. Informatics and education. 2018;(8):20-25. (In Russ.) https://doi.org/10.32517/0234-0453-2018-33-8-20-25

Views: 917


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 0234-0453 (Print)
ISSN 2658-7769 (Online)