1. Proceedings
  2. I3M
  3. 2018
  4. DHSS
  5. 10.46354/i3m.2018.dhss.009

A hybrid machine learning approach to Automated Scenario Generation (ASG) to support adaptive instruction in virtual simulations and games

  • a  Robert A. Sottilare  
  • a US Army Natick Soldier Center
Cite as
Sottilare R.A. (2018). A hybrid machine learning approach to Automated Scenario Generation (ASG) to
support adaptive instruction in virtual simulations and games. Proceedings of the 8th International Defence and Homeland Security Simulation Workshop (DHSS 2018), pp. 64-72. DOI: https://doi.org/10.46354/i3m.2018.dhss.009
 Download PDF

Abstract

This paper examines machine learning methods to automatically generate a large number of child scenarios
from a small number of parent scenarios in support of adaptive instruction conducted in virtual simulations and game-based platforms. Adaptive instructional systems (AISs) include Intelligent Tutoring Systems (ITSs), intelligent mentors, recommender systems, personal assistants, and intelligent instructional media. AISs attempt to tailor instruction for individuals and teams based on their learning needs (e.g., knowledge or skill
deficiencies), goals, and preferences. This often requires much more content than current non-adaptive systems which provide one or a very limited set of training scenarios to address a given set of learning objectives. The goal of the research described in this paper is to reduce the authoring burden for developing a large number of unique and relevant training scenarios. The methodology presented also ranks the resulting scenarios with respect to a set of author-specified learning objectives and learner/team competency in the domain of instruction. The unique contributions of this paper are tied to its hybrid machine learning approach, and consideration for both learning objectives and learner/team competency in automatically ranking generated scenarios.

References

  1. Wisher, R. A., Macpherson, D. H., Abramson, L. J., Thorton, D. M., Dees, J. J., 2001. The Virtual Sand Table: Intelligent Tutoring for Field Artillery Training: U.S. Army Research Institute for the Behavioral and Social Sciences
  2. Baker, James E. (1987). "Reducing Bias and Inefficiency in the Selection Algorithm". Proceedings of the Second International Conference on Genetic Algorithms and their Application. Hillsdale, New Jersey: L. Erlbaum Associates: 14–21
  3. Brawner, K. & Sottilare, R. (2018, June). Proposing Module-level Interoperability for Adaptive Instructional Systems. In the Exploring Opportunities to Standardize Adaptive Instructional Systems (AISs) Workshop of the 18th International Conference of Artificial Intelligence in Education (AIED), London, United Kingdom, June 201 
  4. Brown, D., Bell, B. and Goldberg, B., 2017. Authoring Adaptive Tutors for Simulations in Psychomotor
    Skills Domains. In Proceedings of MODSIM World 2017, Virginia Beach, VA: NTSA
  5. Dave, R.H. (1970). Psychomotor levels. In R.J. Armstrong (Ed.), Developing and Writing Behavioral Objectives. Tucson, Arizona: Educational Innovators Press
  6. Folsom-Kovarik, J.T. & Brawner, K. (2018, May). Automating Variation in Training Content for Domain-general Pedagogical Tailoring. In Proceedings of the 6th Annual Generalized Intelligent Framework for Tutoring (GIFT) Users Symposium. US Army Research Laboratory, Orlando, FL
  7. Harrow, A. (1972) A Taxonomy of Psychomotor Domain: A Guide for Developing Behavioral
    Objectives. New York: David McKay.
  8. Harrow, A. (1972) A Taxonomy of Psychomotor Domain: A Guide for Developing Behavioral Objectives. New York: David McKay.
  9. Lehman, J., & Stanley, K.O. (2011). Novelty search and the problem with objectives Genetic Programming Theory and Practice IX (pp. 37-56): Springer
  10. Liapis, A., Yannakakis, G. N., & Togelius, J. (2015). Constrained novelty search: A study on game
    content generation. Evolutionary computation, 23(1), 101-129.
  11. Luo, L., Yin, H., Cai, W., Zhong, J., & Lees, M. (2016).Design and evaluation of a data-driven scenario generation framework for game-based training. IEEE Transactions on Computational Intelligence and AI in Games
  12. Mallawaarachchi, V. (2017). Introduction to Genetic Algorithms – Including Example Code. Towards
    Data Science. Retrieved from: https://towardsdatascience.com/introduction-togenetic-algorithms-including-example-codee396e98d8bf
  13. Mitchell, Melanie (1996). An Introduction to Genetic Algorithms. Cambridge, MA: MIT Press. ISBN
    9780585030944
  14. Mitrovic, A., Suraweera, P., Martin, B., Zakharov, K., Milik, N., & Holland, J. (2006, June). Authoring constraint-based tutors in ASPIRE. In International Conference on Intelligent Tutoring Systems (pp. 41-50). Springer, Berlin, Heidelber
  15. Romiszowski, A. (1999). The development of physical skills: Instruction in the psychomotor domain. In
    Instructional-design theories and models: a new paradigm of instructional theory (Vol. 2). Mahwah, NJ: Erlbaum
  16. owe, J., Smith, A., Pokorny, R., Mott, B., and Lester, J., (2018, May). Toward Automated Scenario Generation with Deep Reinforcement Learning in GIFT. In Proceedings of the 6th Annual Generalized Intelligent Framework for Tutoring (GIFT) Users Symposium. US Army Research Laboratory, Orlando, FL
  17. Shiffman, D. (2012). The Nature of Code: Simulating Natural Systems with Processing. Daniel
    Shiffman.
  18. Simpson E.J. (1972). The Classification of Educational Objectives in the Psychomotor Domain.
    Washington, DC: Gryphon House.
  19. Sinatra, A.M. & Sottilare, R. (2016). Chapter 14 ‒ Exploring the Diversity of Domain Modeling for Training and Educational Applications. In R. Sottilare, A. Graesser, X. Hu, A. Olney, B. Nye & A. Sinatra (Eds.) Design Recommendations for Intelligent Tutoring Systems: Volume 4 – Domain Modeling. US Army Research Laboratory, Orlando, Florida. ISBN: 978-0-9893923-9-6 (digital version).
  20. Sottilare, R. A., Brawner, K. W., Goldberg, B. S., & Holden, H. K. (2012). The generalized intelligent
    framework for tutoring (GIFT). Orlando, FL: US Army Research Laboratory–Human Research &
    Engineering Directorate (ARL-HRED).
  21. Sottilare, R. A., Brawner, K. W., Sinatra, A. M., & Johnston, J. H. (2017). An updated concept for a Generalized Intelligent Framework for Tutoring (GIFT). GIFTtutoring. org
  22. Sottilare, R. & Brawner, K. (2018a, March). Exploring Standardization Opportunities by Examining
    Interaction between Common Adaptive Instructional System Components. In Proceedings of the First Adaptive Instructional Systems (AIS) Standards Workshop, Orlando, Florida
  23. Sottilare, R. & Brawner, K. (2018b, June). Component Interaction within the Generalized Intelligent
    Framework for Tutoring (GIFT) as a Model for Adaptive Instructional System Standards. In the Adaptive Instructional System (AIS) Standards Workshop of the 14th International Conference of Intelligent Tutoring Systems (ITS), Montreal, Quebec, Canada, June 201
  24. Sottilare, R.A. & Ososky, S. (2017, July). Defining Complexity in the Authoring Process for Adaptive
    Instruction. In Foundations of Augmented Cognition (pp. 237-249). Springer International Publishing.
  25. US Army (2007). Field Manual No. 3-21.8 - The Infantry Rifle Platoon and Squad. Department of
    the Army Washington, DC, 28 March 2007
  26. US Army (2007). Field Manual No. 3-21.8 - The Infantry Rifle Platoon and Squad. Department of
    the Army Washington, DC, 28 March 2007
  27. US Army (2007). Field Manual No. 3-21.8 - The Infantry Rifle Platoon and Squad. Department of
    the Army Washington, DC, 28 March 2007
  28. Zook, A., Lee-Urban, S., Riedl, M.O., Holden, H.K., Sottilare, R.A., & Brawner, K.W. (2012, May 29- June 1). Automated scenario generation: Toward Tailored and Optimized Military Training in Virtual Environments. Paper presented at the International conference on the Foundations of Digital Games, Raleigh, NC