Should I see anything on the TensorBoard Curiosity Forward Loss chart?

I've done a successful helicopter-find-target training without Curiosity (orange), and am now doing the exact same but with Curiosity (blue, in progress; the experiment is whether it improves getting stuck at walls). However, is it normal that both the "Losses/Curiosity Forward Loss" and the "Losses/Curiosity Inverse Loss" graphs are empty?



My Config settings are

Code (Boo):

1. HelicopterFindTarget:
2.     max_steps: 500000
3.     normalize: true
4.     num_layers: 3
5.     reward_signals:
6.         extrinsic:
7.             strength: 1.0
8.             gamma: 0.99
9.         curiosity:
10.             strength: 0.1
11.             gamma: 0.99
12.             encoding_size: 256

Thanks!

Next Day Edit: Now also asked at StackOverflow.

 

If you are using the "curiosity reward signal" yes.

TBH, I think your graphic is just out of scale. If you notice the Environment/Cummulative Reward is at 500k, while the curiosity is at 900m, just click the 3 button below the graphic and it will adjust.

 

Thanks for the help!