Search Unity

Question Adding separately collected experiences to SAC experience buffer

Discussion in 'ML-Agents' started by Aleksander_Wit, Mar 26, 2022.

  1. Aleksander_Wit

    Aleksander_Wit

    Joined:
    Dec 13, 2020
    Posts:
    19
    I would like to collect experiences collected on multiple separate computers where players play against the AI or other similar situations. After this, I would like to add the collected experiences into the training experience pool when training with SAC.

    I do not need the specific internet network solution but would like to know how (or if) I can more manually add pre-received experiences to the SAC experience buffer not received from the current training. SAC seems quite good for this with how it learns from a huge experience buffer rather than more directly from the environment like PPO.

    Any help would be greatly appreciated as I may be interested in having a model train on a main server on data collected from distributed player vs model interactions. Collecting those experiences and training on them.