Search Unity

Question AI Model Size vs. Maturation: How to Tell When it is Done?

Discussion in 'ML-Agents' started by Ziberian, Oct 20, 2023.

  1. Ziberian


    Jan 9, 2018
    I have realized that the longer I train a model, the larger the size of the
    model that is created at the end. But at the same time, the size of the model reaches a final size at some point. For example:
    • At 500,000 steps it'll be in ~100s of kb
    • At 5,000,000 steps it'll be 1.2 mb
    • At 20,000,000 steps it'll still be 1.2 mb
    Can I conclude from this information that the training between 5-20 million steps wasn't necessary? I understand that at a high level the more you train the better, but of course there is a time value as well since nobody wants to train a model forever. What metrics do you look at to decide when the model is "done" or matured enough? Should I focus more on if the rewards stabilized at a high value?
    Last edited: Oct 20, 2023