Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Join us on March 30, 2023, between 5 am & 1 pm EST, in the Performance Profiling Dev Blitz Day 2023 - Q&A forum and Discord where you can connect with our teams behind the Memory and CPU Profilers.
    Dismiss Notice

Question Recording demos for self-play

Discussion in 'ML-Agents' started by beinzheans, Jan 13, 2023.

  1. beinzheans


    Dec 16, 2021
    So I've been wondering whether or not it's possible to record demos for self-play? I've done both seperately before but never at the same time. The problem is what type to record.

    So, how would I record it? I've been thinking of doing:

    • Recording a demo without any opponents (but the reward would mess up)
    • Record a demo with opponents (difficult to do since I'm the only one doing it)
    • Do a training session with demos, then do the next session with self-play (time-consuming to make 2 environments of the same thing)

    If anyone did something similar to this, please tell me your method, thanks in advance
  2. NanushTol


    Jan 9, 2018
    I have been wondering about selfplay with imitation training my self,
    currently I'm using either curriculum or imitation as a first step & when the agent gets to a state where they can play the game (even if badly) I continue on with selfplay.