Home - Interactml/iml-unreal GitHub Wiki

images/titles/InteractML_Title.png

Extended Reality Design Tools : Bringing Machine Learning to Unreal Engine

InteractML brings machine learning visual scripting to Unreal, empowering creators to develop novel gameplay mechanics, visual experiences, and control schemes without writing code. You can create machine learning models by joining Blueprint nodes together, feeding them from any available parameters, and then using the outputs to drive any in-engine systems or effects you like.

Contents

  1. Introduction - About the project, the plugin, and some typical use cases
  2. Team and Terms - Who's behind the project and what's it made of
  3. Setup - Getting set up, plugin installation, configuration, first steps
  4. Machine Learning - Brief info on the ML systems available with Interact ML and what they do
  5. Model Types - Models available, specific behaviour and use
  6. Asset Types - The model, training set, and label asset types and what they are for
  7. Blueprint Nodes - Overview of the Blueprint nodes available and common features
  8. Collecting Parameters - How to source and gather together parameters for input
  9. Recording Examples - How to record example data
  10. Training Models - How to train your dragon
  11. Running Models - How to run a model
  12. Training Set - Training set specifics, including editing window
  13. Labels - Label and Label Table asset specifics and use
  14. Your Data - How and where the example and model data is stored and what you can do with it
  15. Demo Project - Information on all the demos available, what they show, and how they are set up
  16. Utility Blueprints - Details of the demo blueprints, helpers, interaction, state, utility
  17. Technical - Some technical/implementation details, diagrams, and designs
  18. Release Notes - Information on each new build/version of the plugin