Evaluating the impact of curriculum learning on the training process for an intelligent agent in a video game
A thesis submitted in partial fulfillment of requirements for M.Sc in Systems and Computing Engineering degree
Dept. of Systems and Industrial Engineering. Faculty of Engineering. National University of Colombia. Bogotá, Colombia.
We want to measure the impact of the curriculum learning technique on a reinforcement training setup, several experiments were designed with different training curriculums adapted for the video game chosen as a case study. Then all were executed on a selected game simulation platform, using two reinforcement learning algorithms, and using the mean cumulative reward as a performance measure. Results suggest that curriculum learning has a significant impact on the training process, increasing training times in some cases, and decreasing them up to 40% percent in some other cases.
Se desea medir el impacto de la técnica de aprendizaje por currículos sobre el tiempo de entrenamiento de un agente inteligente que está aprendiendo a jugar un video juego usando aprendizaje por refuerzo, para esto se diseñaron varios experimentos con diferentes currículos adaptados para el video juego seleccionado como caso de estudio, y se ejecutaron en una plataforma de simulación de juegos seleccionada, usando dos algoritmos de aprendizaje por refuerzo, y midiendo su desempeño usando la recompensa media acumulada. Los resultados sugieren que usar aprendizaje por currículos tiene un impacto significativo sobre el proceso de entrenamiento, en algunos casos alargando los tiempos de entrenamiento, y en otros casos disminuyéndolos en hasta en un 40% por ciento.
Curriculum Learning, Reinforcement Learning, Training Curriculum, Mean Cumulative Reward, Proximal Policy Optimization, Video Games, Game AI, Unity Machine Learning Agents, Unity ML-Agents Toolkit, Unity Engine.
Published on Sep 30, 2021
- Paper Document: http://journal.iberamia.org/index.php/intartif/article/view/532/146
- Journal Website: http://www.journal.iberamia.org/index.php/intartif/article/view/532
- Research Gate: https://www.researchgate.net/publication/354981744_Evaluating_the_impact_of_curriculum_learning_on_the_training_process_for_an_intelligent_agent_in_a_video_game
- Google Scholar: https://scholar.google.com/citations?view_op=view_citation&hl=en&user=Zz4zIF4AAAAJ&citation_for_view=Zz4zIF4AAAAJ:u-x6o8ySG0sC
- Semantic Scholar: https://www.semanticscholar.org/paper/Evaluating-the-impact-of-curriculum-learning-on-the-Camargo-S%C3%A1enz/b689f565e9a63d831b332504c356b77dc25e23a0
Published on Jul 07, 2020
- Thesis Document: https://repositorio.unal.edu.co/bitstream/handle/unal/78592/1018417749.2020.pdf
- Unal Repository: https://repositorio.unal.edu.co/handle/unal/78592
- Research Gate: https://www.researchgate.net/publication/380127141_Evaluating_the_impact_of_curriculum_learning_on_the_training_process_for_an_intelligent_agent_in_a_video_game
- Google Scholar: https://scholar.google.com/citations?view_op=view_citation&hl=en&user=Zz4zIF4AAAAJ&citation_for_view=Zz4zIF4AAAAJ:u5HHmVD_uO8C
- Agencia UNAL:
- Virtual Pro: https://www.virtualpro.co/noticias/ia-aprende-mas-rapido-un-videojuego-con-niveles-graduales-de-dificultad
- UniRioja: https://dialnet.unirioja.es/servlet/articulo?codigo=8234147
- Fatcat: https://fatcat.wiki/release/sjfcptixn5cedkytvfdfwavl3i
- OAmg: https://oa.mg/work/10.4114/intartif.vol24iss68pp1-20
- Dblp: https://dblp.org/db/journals/aepia/aepia24.html#CamargoS21
- Adjam: https://library.ajman.ac.ae/eds/detail?db=asn&an=154089422
Rigoberto Sáenz Imbacuán
- LinkedIn: https://linkedin.com/in/rsaenzi/
- Curriculum Vitae: https://bit.ly/rsaenziCV
- Google Scholar: https://scholar.google.com/citations?user=Zz4zIF4AAAAJ&hl=en
- CvLac: https://scienti.minciencias.gov.co/cvlac/visualizador/generarCurriculoCv.do?cod_rh=0001440347
Ph.D. Jorge Eliecer Camargo Mendoza