Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Join us on March 30, 2023, between 5 am & 1 pm EST, in the Performance Profiling Dev Blitz Day 2023 - Q&A forum and Discord where you can connect with our teams behind the Memory and CPU Profilers.
    Dismiss Notice
New Forum User Notice Performance Profiling Dev Blitz Day 2023

Mean cumulative episode reward

Discussion in 'ML-Agents' started by YorYYi, Aug 24, 2022.

  1. YorYYi

    YorYYi

    Joined:
    May 2, 2022
    Posts:
    7
    Hello, what does cumulative episode reward on mlagents mean? The mean of all episodes up to a point in training or the mean of the last 100 episodes?
     
    YorYYi, Aug 24, 2022
    #1

  2. arrghhhh

    arrghhhh

    Joined:
    Jul 28, 2022
    Posts:
    2
    If you're talking about reward that's displayed in tensorboard, then it's a mean cumulative reward per 
    summary_freq
    steps, it's a parameter in your yaml config.
    Also note, that curriculum uses a different metric, it checks reward per 
    min_lesson_length
    steps, which is a parameter of a particular lesson.
     
    arrghhhh, Aug 26, 2022
    #2
    YorYYi likes this.