Preview

Informatics and education

Advanced search

The system for automated assessment of knowledge and practical skills in programming

https://doi.org/10.32517/0234-0453-2023-38-2-66-74

Abstract

The article describes a software package (automated knowledge assessment system) that allows in practice to apply a new type of tasks for automated control of knowledge and skills in programming, based on a constructive-selective method. In such tasks, the student constructs an answer (program) from the proposed components (lines of program code), and the task involves many correct answers. A new type of task allows assessing the knowledge of previously studied algorithms and skills of writing programs, that complement black-box testing. The developed automated control system consists of two subsystems: “Processing” and “Demonstration”. The “Demonstration” subsystem, which is a web application, provides the minimum necessary set of features for using this type of tasks in the educational process, and it also serves as an example that can be used when developing extensions for other systems. The “Processing” subsystem allows integration of a new type of programming tasks into various automated knowledge assessment systems and LMS, if they provide an opportunity for expansion. A teacher creates manually or using the tools developed by the authors of this article a pattern and a list of components before applying a new type of task. A student makes up the answer (program) from the proposed components (lines of program code). The assessment algorithm evaluates the compliance of the student’s answer with the pattern and assesses compliance in the interval [0; 1].

About the Authors

I. A. Zhukov
Tomsk State University
Russian Federation

Igor A. Zhukov, a postgraduate student at the Computer Science Theory Department, Institute of Applied Mathematics and Computer Science

Tomsk



Yu. L. Kostyuk
Tomsk State University
Russian Federation

Yuriy L. Kostyuk, Doctor of Sciences (Engineering), Professor, Professor at the Computer Science Theory Department, Institute of Applied Mathematics and Computer Science

Tomsk



References

1. Shumikhina M. S., Yashina I. A. LMS Moodle in teaching programming. Actual Problems of Aviation and Cosmonautics. Proc. XIV Int. Scientific and Practical Conf. Dedicated to the Day of Cosmonautics. 2018;3(4(14)):803–804. (In Russian.) EDN: YWPLUL

2. Barabanova P. S., Lyamkin R. A., Makarova I. S. The development of the electronic course on programming for independent learning of technical university students. Bulletin of the Laboratory of Mathematical, Natural Science Education and Informatization: Proc. Int. Scientific and Practical Conf. “Mathematical, Natural Science Education and Informatization”. Moscow, MCU; 2015;6:62–66. (In Russian.) EDN: VHJSIB

3. Biňas M. Version Control System in CS1 course: Practical experience. 2013 IEEE 11th Int. Conf. on Emerging eLearning Technologies and Applications (ICETA). 2013:23–28. DOI: 10.1109/ICETA.2013.6674398

4. Bazhenova I. Yu. Peculiarities of teaching a programming language in the remote form of education. Modern Information Technologies and IT-education. 2014;(10):190–196 (In Russian.) EDN: TJTTXF

5. Shagbazyan D. V., Shtanyuk A. A. Methods for knowledge assessment of university students in programming. Generation of the Future: the View of Young Scientists. Collection of Scientific Articles of the 4th Int. Youth Sci. Conf. Kursk, CJCS “University book”; 2016;2:119–121. (In Russian.) EDN: XDXIKH

6. Magomedov A. M., Lawrenchenko S. A., Ibragimova Z. I. Algorithm for automating test creation. Herald of Dagestan State University. Series 1. Natural Sciences. 2019;34(2):63– 71. (In Russian.) EDN: CHLRYE. DOI: 10.21779/2542-03212019-34-2-63-71

7. Golanova A. V., Golikova E. I. Organization of the final control of knowledge on the discipline “Programming” of future bachelors of teacher education. XXII Tsarskoye Selo Readings. Proc. Int. Sci. Conf. Saint Petersburg, Pushkin Leningrad State University; 2018;3:75–79. (In Russian.) EDN: YXOZUS

8. Peryazeva J. V. Extending moodle functionality with computer-assisted assessment. Modern Information Technologies and IT-education. 2019;15(4):876–885. (In Russian.) EDN: BECCUB. DOI: 10.25559/SITITO.15.201904.876-885

9. Ramos J., Trenas M. A., Gutiérrez E., Romero S. E-assessment of Matlab assignments in Moodle: Application to an introductory programming course for engineers. Computer Applications in Engineering Education. 2013;21(4):728–736. DOI: 10.1002/cae.20520

10. Karmanova E. V. Automated control for teaching programming on the Python using the plugin CodeRunner in LMS Moodle. Science. Informatization. Technologies. Education. Proc. XIV Int. Scientific and Practical Conf. Yekaterinburg, Russian State Vocational Pedagogical University; 2021:102– 108. (In Russian.) EDN: TEDZUF

11. Guo P. J. Online python tutor: Embeddable webbased program visualization for cs education. Proc. 44th ACM Technical Symposium on Computer Science Education (SIGCSE ‘13). New York (United States), Association for Computing Machinery; 2013:579–584. DOI: 10.1145/2445196.2445368

12. Gulwani S., Radiček I., Zuleger F. Automated clustering and program repair for introductory programming assignments. Proc. 39th ACM SIGPLAN Conf. on Programming Language Design and Implementation (PLDI 2018). New York (United States), Association for Computing Machinery; 2018:465–480. DOI: 10.1145/3192366.3192387

13. Suzuki R., Soares G., Head A., Glassman E., Reis R., Mongiovi M., D’Antoni L., Hartmann B. TraceDiff: Debugging unexpected code behavior using trace divergences. Proc. 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Raleigh, NC, IEEE; 2017:107–115. DOI: 10.1109/VLHCC.2017.8103457

14. Reis R., Soares G., Mongiovi M., Andrade W. L. Evaluating feedback tools in introductory programming classes. Proc. 2019 IEEE Frontiers in Education Conf. (FIE). Covington, KY, USA, IEEE; 2019:1–7. DOI: 10.1109/FIE43999.2019.9028418

15. Shevelev M. Yu., Vishnyakova L. A., Shevelev Yu. P. Knowledge assessment in e-learning. Non-anthropomorphic approach. Saarbrücken, LAP LAMBERT Academic Publishing; 2014. 404 p. (In Russian.)

16. Zhukov I. A., Kostyuk Yu. L Model of representation of multivariate tasks for automated control of programming knowledge. Tomsk State University Journal of Control and Computer Science. 2020;(53):110–117. (In Russian.) EDN: TERGOW. DOI: 10.17223/19988605/53/11]

17. Zhukov I. A., Kostyuk Yu. L. An extended assessment algorithm for multivariate task presentation model. Tomsk State University Journal of Control and Computer Science. 2021;(57):101–109. (In Russian.) EDN: AOWESF. DOI: 10.17223/19988605/57/11]


Review

For citations:


Zhukov I.A., Kostyuk Yu.L. The system for automated assessment of knowledge and practical skills in programming. Informatics and education. 2023;38(2):66-74. (In Russ.) https://doi.org/10.32517/0234-0453-2023-38-2-66-74

Views: 252


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 0234-0453 (Print)
ISSN 2658-7769 (Online)