Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

Question Is it normal ELO Drop down and Up based on Agent swap steps?

Discussion in 'ML-Agents' started by OmarVector, Dec 25, 2022.

  1. OmarVector

    OmarVector

    Joined:
    Apr 18, 2018
    Posts:
    92
    I'm using DodgeGame demo. the orignial one , ELO always increasing during self play.

    When I have different agents setup, what happen is:

    Each swap steps , The rewards are flipped, like GroupMeanReward become negative and ELO decrease, then after 500K steps , the GroupMeanReward become positive and ELO increase.... then after another 500K, GroupMeanReward become negative and ELO decrease.

    Is that normal? why it does not act the same?

    upload_2022-12-25_12-16-44.png
    upload_2022-12-25_12-19-13.png
    upload_2022-12-25_12-19-23.png
     
    OmarVector, Dec 25, 2022
    #1

  2. OmarVector

    OmarVector

    Joined:
    Apr 18, 2018
    Posts:
    92
    Up
     
    OmarVector, Dec 26, 2022
    #2

  3. OmarVector

    OmarVector

    Joined:
    Apr 18, 2018
    Posts:
    92
    Anyone can help?
     
    OmarVector, Jan 4, 2023
    #3

  4. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    175
    hughperkins, Jan 7, 2023
    #4

  5. OmarVector

    OmarVector

    Joined:
    Apr 18, 2018
    Posts:
    92
    The post owner talked to me, and told me he does not remember exactly the reason and mentioned those steps.

    I'm trying to carefully checking my code, but I dont use any find function on any level
     
    OmarVector, Jan 9, 2023
    #5

  6. OmarVector

    OmarVector

    Joined:
    Apr 18, 2018
    Posts:
    92
    Is there anyone from unity staff can help here?
     
    OmarVector, Jan 10, 2023
    #6