Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

How to enable curiosity?

Discussion in 'ML-Agents' started by Claytonious, Apr 24, 2020.

  1. Claytonious

    Claytonious

    Joined:
    Feb 16, 2009
    Posts:
    864
    This change to the docs says we now enable curiosity by "adding the 'curiosity' reward signal" to our config yaml file.

    But *where* do we add it!? The example trainer_config.yaml has this reward_signals section in it:

    Code (CSharp):
    1.     reward_signals:
    2.         extrinsic:
    3.             strength: 1.0
    4.             gamma: 0.99
    5.  
    Do we add a new property called "intrinsic" with a property called "curiosity" under that, with a value of true?
     
  2. Claytonious

    Claytonious

    Joined:
    Feb 16, 2009
    Posts:
    864
    I blindly did what some random dude on the internet was doing and arrived at this:
    Code (CSharp):
    1.     reward_signals:
    2.         extrinsic:
    3.             strength: 1.0
    4.             gamma: 0.99
    5.         curiosity:
    6.             strength: 0.2
    7.             gamma: 0.99
    8.             encoding_size: 512
    9.  
    No idea what gamma or encoding_size do yet. Is this my best place to start understanding those?
     
  3. Roboserg

    Roboserg

    Joined:
    Jun 3, 2018
    Posts:
    83
    > Is this my best place to start understanding those?
    yes