Search Unity

How to enable curiosity?

Discussion in 'ML-Agents' started by Claytonious, Apr 24, 2020.

  1. Claytonious

    Claytonious

    Joined:
    Feb 16, 2009
    Posts:
    904
    This change to the docs says we now enable curiosity by "adding the 'curiosity' reward signal" to our config yaml file.

    But *where* do we add it!? The example trainer_config.yaml has this reward_signals section in it:

    Code (CSharp):
    1.     reward_signals:
    2.         extrinsic:
    3.             strength: 1.0
    4.             gamma: 0.99
    5.  
    Do we add a new property called "intrinsic" with a property called "curiosity" under that, with a value of true?
     
  2. Claytonious

    Claytonious

    Joined:
    Feb 16, 2009
    Posts:
    904
    I blindly did what some random dude on the internet was doing and arrived at this:
    Code (CSharp):
    1.     reward_signals:
    2.         extrinsic:
    3.             strength: 1.0
    4.             gamma: 0.99
    5.         curiosity:
    6.             strength: 0.2
    7.             gamma: 0.99
    8.             encoding_size: 512
    9.  
    No idea what gamma or encoding_size do yet. Is this my best place to start understanding those?
     
  3. Roboserg

    Roboserg

    Joined:
    Jun 3, 2018
    Posts:
    83
    > Is this my best place to start understanding those?
    yes