Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Does GAIL make any sense in later Curriculum Learning sessions?

Discussion in 'ML-Agents' started by JulesVerny, Jan 1, 2022.

  1. JulesVerny

    JulesVerny

    Joined:
    Dec 21, 2015
    Posts:
    47
    Happy New Year :)

    I have found the benefits of Curriculum Learning, to be convenient in helping my agent progress, from very simple scenarios, to more challenging environments. I have also used GAIL, to provide some human demonstrations, to help kick start the Agents learning.

    However I believe can only provide Demonstrations on the Initial entry Level (in Heuristic play), I don't see how I can provide demonstrations across different Curriculum levels. So I am questioning the benefit of GAIL demonstrations in helping my agent through later Levels. I notice by GAIL loss, climbing up in the later Levels.

    Is is advised to use or not use GAIL with Curriculum Learning ? - And if so how can I provdie demonstrations for later Curriculum levels ?