Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Question Recording demos for self-play

Discussion in 'ML-Agents' started by beinzheans, Jan 13, 2023.

  1. beinzheans

    beinzheans

    Joined:
    Dec 16, 2021
    Posts:
    12
    So I've been wondering whether or not it's possible to record demos for self-play? I've done both seperately before but never at the same time. The problem is what type to record.

    So, how would I record it? I've been thinking of doing:

    • Recording a demo without any opponents (but the reward would mess up)
    • Record a demo with opponents (difficult to do since I'm the only one doing it)
    • Do a training session with demos, then do the next session with self-play (time-consuming to make 2 environments of the same thing)

    If anyone did something similar to this, please tell me your method, thanks in advance
     
  2. NanushTol

    NanushTol

    Joined:
    Jan 9, 2018
    Posts:
    127
    I have been wondering about selfplay with imitation training my self,
    currently I'm using either curriculum or imitation as a first step & when the agent gets to a state where they can play the game (even if badly) I continue on with selfplay.