Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Mean cumulative episode reward

Discussion in 'ML-Agents' started by YorYYi, Aug 24, 2022.

  1. YorYYi

    YorYYi

    Joined:
    May 2, 2022
    Posts:
    7
    Hello, what does cumulative episode reward on mlagents mean? The mean of all episodes up to a point in training or the mean of the last 100 episodes?
     
  2. arrghhhh

    arrghhhh

    Joined:
    Jul 28, 2022
    Posts:
    2
    If you're talking about reward that's displayed in tensorboard, then it's a mean cumulative reward per
    summary_freq
    steps, it's a parameter in your yaml config.
    Also note, that curriculum uses a different metric, it checks reward per
    min_lesson_length
    steps, which is a parameter of a particular lesson.
     
    YorYYi likes this.