Search Unity

  1. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

What optimizer do ml-agents use?

Discussion in 'ML-Agents' started by elieceralejandromv, Jul 27, 2020.

  1. elieceralejandromv

    elieceralejandromv

    Joined:
    Jul 13, 2020
    Posts:
    8
    Hi guys.

    I'm thinking the Adam optimizer are being used in ML-Agents, but i want to be sure to properly optimize.

    Thanks!
     
  2. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    162
    Yes, we use Adam.
     
  3. YodoLuca

    YodoLuca

    Joined:
    May 16, 2018
    Posts:
    10
    Hello!

    I know it is an old question, but I'm interested in this topic.
    Does ML agents use Adam for all its trainers? (ppo, sac and poca)

    I suppose ppo is the one which uses Adam (from your previous answer), is it the case for poca too? (the one for the cooperative learning)

    Thank you!