Search Unity

  1. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Should I see anything on the TensorBoard Curiosity Forward Loss chart?

Discussion in 'ML-Agents' started by JPhilipp, Feb 3, 2020.

  1. JPhilipp

    JPhilipp

    Joined:
    Oct 7, 2014
    Posts:
    56
    I've done a successful helicopter-find-target training without Curiosity (orange), and am now doing the exact same but with Curiosity (blue, in progress; the experiment is whether it improves getting stuck at walls). However, is it normal that both the "Losses/Curiosity Forward Loss" and the "Losses/Curiosity Inverse Loss" graphs are empty?



    My Config settings are

    Code (Boo):
    1. HelicopterFindTarget:
    2.     max_steps: 500000
    3.     normalize: true
    4.     num_layers: 3
    5.     reward_signals:
    6.         extrinsic:
    7.             strength: 1.0
    8.             gamma: 0.99
    9.         curiosity:
    10.             strength: 0.1
    11.             gamma: 0.99
    12.             encoding_size: 256
    Thanks!

    Next Day Edit: Now also asked at StackOverflow.
     
    Last edited: Feb 4, 2020
  2. caioc2

    caioc2

    Joined:
    May 11, 2018
    Posts:
    8
    If you are using the "curiosity reward signal" yes.

    TBH, I think your graphic is just out of scale. If you notice the Environment/Cummulative Reward is at 500k, while the curiosity is at 900m, just click the 3 button below the graphic and it will adjust.
     
    JPhilipp likes this.
  3. JPhilipp

    JPhilipp

    Joined:
    Oct 7, 2014
    Posts:
    56
    Thanks for the help!