Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice

Question Adding separately collected experiences to SAC experience buffer

Discussion in 'ML-Agents' started by Aleksander_Wit, Mar 26, 2022.

  1. Aleksander_Wit

    Aleksander_Wit

    Joined:
    Dec 13, 2020
    Posts:
    18
    I would like to collect experiences collected on multiple separate computers where players play against the AI or other similar situations. After this, I would like to add the collected experiences into the training experience pool when training with SAC.

    I do not need the specific internet network solution but would like to know how (or if) I can more manually add pre-received experiences to the SAC experience buffer not received from the current training. SAC seems quite good for this with how it learns from a huge experience buffer rather than more directly from the environment like PPO.

    Any help would be greatly appreciated as I may be interested in having a model train on a main server on data collected from distributed player vs model interactions. Collecting those experiences and training on them.