Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Unite 2023 Registrations are now LIVE!

Resolved Are Agents Set To Heuristic Ignored?

Discussion in 'ML-Agents' started by LastSpark, Jun 22, 2021.

  1. LastSpark

    LastSpark

    Joined:
    May 23, 2021
    Posts:
    8
    Hi,

    I am working on a dog-fighting AI and currently wanting to train it by learning to hit a stationary enemy, a heuristic enemy, then self play. Through this process I have it setup where the enemy is an identical agent-ship prefab, except its set to heuristic so I don't have it moving/training.

    However, I have the code setup that when the stationary (heuristic) enemy is killed it gets a punishment and its episode ends (along with the other agent getting a reward), or say the training agent running into a wall and crashing then it gets punished and the heuristic gets rewarded.

    My question is, does the heuristic agent affect training? Does it getting a reward or punishment and ended episodes affect the avg.mean/training or no?

    Thanks in advance!
     
    LastSpark, Jun 22, 2021
    #1

  2. ervteng_unity

    ervteng_unity

    Unity Technologies

    Joined:
    Dec 6, 2018
    Posts:
    150
    Heuristic agents don't affect training in any way, from the perspective of the trainer they're the same as a scripted NPC not built with ML-Agents.
     
    ervteng_unity, Jun 23, 2021
    #2
    LastSpark likes this.

  3. LastSpark

    LastSpark

    Joined:
    May 23, 2021
    Posts:
    8
    Perfect, thank you for the response!
    Does make my life easier this way.
     
    LastSpark, Jun 23, 2021
    #3