Search Unity

What optimizer do ml-agents use?

Discussion in 'ML-Agents' started by elieceralejandromv, Jul 27, 2020.

  1. elieceralejandromv

    elieceralejandromv

    Joined:
    Jul 13, 2020
    Posts:
    8
    Hi guys.

    I'm thinking the Adam optimizer are being used in ML-Agents, but i want to be sure to properly optimize.

    Thanks!
     
    elieceralejandromv, Jul 27, 2020
    #1

  2. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    162
    Yes, we use Adam.
     
    andrewcoh_unity, Jul 27, 2020
    #2

  3. YodoLuca

    YodoLuca

    Joined:
    May 16, 2018
    Posts:
    10
    Hello!

    I know it is an old question, but I'm interested in this topic.
    Does ML agents use Adam for all its trainers? (ppo, sac and poca)

    I suppose ppo is the one which uses Adam (from your previous answer), is it the case for poca too? (the one for the cooperative learning)

    Thank you!
     
    YodoLuca, Mar 28, 2023
    #3