Search Unity

  1. Looking for a job or to hire someone for a project? Check out the re-opened job forums.
    Dismiss Notice
  2. Unity 2020 LTS & Unity 2021.1 have been released.
    Dismiss Notice
  3. Good news ✨ We have more Unite Now videos available for you to watch on-demand! Come check them out and ask our experts any questions!
    Dismiss Notice

Unity Post Your ML-Agents Project

Discussion in 'ML-Agents' started by jeffrey_unity538, Nov 13, 2020.

  1. jeffrey_unity538

    jeffrey_unity538

    Unity Technologies

    Joined:
    Feb 15, 2018
    Posts:
    59
    Thread on community created ML-Agents projects. Please share any posts, images, videos or project links.
     
  2. mbaske

    mbaske

    Joined:
    Dec 31, 2017
    Posts:
    336
    Hi, here are a couple of my project videos. There are source files available for most of them, but I haven't really kept those up to date, some are using old versions of ML-Agents. Also, since I'm still finding my way around Unity, I would approach some things differently now than I did back when I created these projects...
    You can find more info in the video descriptions and a few other Unity and ML-Agents related videos on my channel.




    https://github.com/mbaske/ml-motorcycles


    https://github.com/mbaske/ml-dogfight


    https://github.com/mbaske/ml-hover-bike-race


    https://github.com/mbaske/robot-ants
     
  3. mbaske

    mbaske

    Joined:
    Dec 31, 2017
    Posts:
    336
  4. mbaske

    mbaske

    Joined:
    Dec 31, 2017
    Posts:
    336
  5. jeffrey_unity538

    jeffrey_unity538

    Unity Technologies

    Joined:
    Feb 15, 2018
    Posts:
    59
  6. ThatGeoff

    ThatGeoff

    Joined:
    Oct 3, 2019
    Posts:
    4
    I've put together a project that makes the machine learning process into the game itself! I've set up a twitch stream where you can watch creatures learn to navigate their environment to reach an exit and bet game coins on which ones you think will make it the furthest. It's running at https://twitch.tv/orbward
     
    mbaske and akTwelve like this.
  7. akTwelve

    akTwelve

    Joined:
    Oct 7, 2013
    Posts:
    7
    @mbaske Your project videos are always incredible. Also, that boxing match is hilarious!
     
  8. mbaske

    mbaske

    Joined:
    Dec 31, 2017
    Posts:
    336
    Thanks!
     
  9. Adam_Streck

    Adam_Streck

    Joined:
    Jul 31, 2013
    Posts:
    24

    Attached Files:

    Last edited: Jan 2, 2021
  10. kodobolt

    kodobolt

    Joined:
    Jul 19, 2017
    Posts:
    4
    Hi everyone! I've been playing with ML agents again over the holidays and trying to see if I can build a small RTS game where units are trained agents.

    Duel training with self-play:



    Resource gathering:



    I'm experimenting with giving player control over high-level policies (e.g. which resource to gather, whether to prioritize attack or survival), curriculum learning (I've set up a system of lessons and scenarios to learn complex behavior step by step), various perception sensors (e.g. basic "range" sensor with OverlapSphere, "smell map" sensor with decaying influence that could give rough pathfinding data).

    My overall goal is to build a small prototype/proof of concept to understand how RL can be part of a designer's toolbox and learn best practices along the way.

    I started looking into ML for Unity several years ago but had no time to fully flesh out something. I initially tried to set up my own interface to python, then the first version of ML-Agents came out but it was a bit rough around the edges. I'm very impressed with how far it has come and found it quite easy to understand and use. Thanks for making it!
     
  11. aureliantactics

    aureliantactics

    Joined:
    Jan 15, 2021
    Posts:
    1
    I'm working on getting Unity ML to help train the AI for a tactics game (turn based strategy game). First I did TicTacToe. Code available on my github.


    Next I implemented a GridWorld mini-game in the game.
    .

    I tried to do a more advanced mini-game (one vs. one duel) but it ran way too slowly for the agent to learn anything. I'm working on speeding up the code. I can't duplicate the game board and have many games run in parallel (like TicTacToe and the Unity examples) without a lot of changes to my code. I can get by without having to render anything so I'm trying to do some research to see how to go about creating a 'fast' mode to the game.
     
    AngrySamsquanch likes this.
  12. Roboserg

    Roboserg

    Joined:
    Jun 3, 2018
    Posts:
    50
    RoboLeague - a car soccer environment inspired by Rocket League for deep reinforcement learning experiments in an adversarial self-play setting. The project is open source - https://github.com/roboserg/RoboLeague


     
    andrewcoh_unity and mbaske like this.
  13. dhyeythumar

    dhyeythumar

    Joined:
    Mar 15, 2020
    Posts:
    7
    Hi everyone! I am experimenting with ML-Agents on Unity's Boat Attack environment. I have reduced the environmental objects for a smooth training process.
    To project is open source and to get the assets and build versions of this environment, check out the following links:
    Github env build repo - https://github.com/Dhyeythumar/BoatAttack-with-ML-Agents-build-versions
    Github env assets repo - https://github.com/Dhyeythumar/BoatAttack-with-ML-Agents

    Check out the following video of the trained agent:



    The following video contains the complete training process streamed from Google Colab to the twitch server:

     
    mbaske and Sab_Rango like this.
  14. mbaske

    mbaske

    Joined:
    Dec 31, 2017
    Posts:
    336
    Hi, you can now find updated "Angry AI" source files working with the latest (1.7.2-preview) ML-Agents release on Github.
    The project uses imitation learning, multi-stage training, hierarchical/tiered agent control and grid sensor observations.

    https://github.com/mbaske/angry-ai

     
    Sab_Rango likes this.
  15. unity_vS2z9d1vWrMH-Q

    unity_vS2z9d1vWrMH-Q

    Joined:
    Jun 29, 2020
    Posts:
    2
  16. AngrySamsquanch

    AngrySamsquanch

    Joined:
    Dec 28, 2014
    Posts:
    20
    I've been experimenting with agent flocking behaviors:



    Demo Link
     
unityunity