Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

What is the specific meaning of Gamma

Discussion in 'ML-Agents' started by bfengice, Apr 19, 2021.

  1. bfengice

    bfengice

    Joined:
    Mar 15, 2020
    Posts:
    1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99

    I set DecisionPeriod to 10,If I want to get rewards in 30 period after OnActionReceived(),what should I do?
    Set gamma to 3?Or use IEnumerator to postpone the reward ?
    Can you tell me the true meaning of x value of 0.99, whether it can exceed 1
    From Google Translate, thanks
     
  2. ruoping_unity

    ruoping_unity

    Unity Technologies

    Joined:
    Jul 10, 2020
    Posts:
    134
    The setting of gamma isn't related to decision period. gamma is used in training to weigh the future rewards. This can be viewed as how far into the future the agent should care about possible rewards, compared to the current rewards. It won't make sense to have gamma larger than one in training since your reward could go to infinite.

    To see the detailed explanations of all training configs please see this doc.
     
    bfengice likes this.