Search Unity

  1. Looking for a job or to hire someone for a project? Check out the re-opened job forums.
    Dismiss Notice
  2. Unity 2020 LTS & Unity 2021.1 have been released.
    Dismiss Notice
  3. Good news ✨ We have more Unite Now videos available for you to watch on-demand! Come check them out and ask our experts any questions!
    Dismiss Notice

Help Wanted Train a ML-agent with # curiosity module

Discussion in 'ML-Agents' started by XXXXchris, Apr 6, 2021.

  1. XXXXchris

    XXXXchris

    Joined:
    Jan 24, 2021
    Posts:
    6
    Hi, I used ML-agent train agent with curiosity, so How can I record the agent’s intrinsic and extrinsic rewards for every observation and timestep?
     
  2. XXXXchris

    XXXXchris

    Joined:
    Jan 24, 2021
    Posts:
    6
    or how do I record the rewards for every observation and timestep?
     
  3. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    134
    The cumulative reward per timestep for all reward signals is reported in tensorboard. Are you asking for a different statistic than this?
     
  4. XXXXchris

    XXXXchris

    Joined:
    Jan 24, 2021
    Posts:
    6
    Yes, when I use curiosity configuration, how can I distinguish between intrinsic and extrinsic rewards? so In Ml-agent, the only statistic I can know is the cumulative reward per timestep for all reward signals?
     
  5. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    134
    If you open the Policy tab in tensorboard, you will see Curiosity Reward and Extrinsic Reward as separate plots.
     
  6. XXXXchris

    XXXXchris

    Joined:
    Jan 24, 2021
    Posts:
    6
    got it, thanks.
     
unityunity