Question Setting tensorboard to frequently update while training

Hello there,

I am working on a project with Unity ML as part of a dissertation, I've never used it before. The project consists of an agent that goes around gathering resource and filling its inventory, then goes back to its base and deposits the resources for points, rewards with being given based on points and penalties on distances, along with some other minor rules.


Episodes last quite a long time, as I've set episodes to end after an amount of points have been gathered, after which the level resets. The game also automatically exits playmode after an amount of episodes so I can stop training and extract the .onnx file.

The issue I've been having is with TensorBoard. I need it to update frequently so I can observe how well the agent is training so that if need be I can tweak some values for better training. However, TensorBoard seems to update very irregularly, especially the cumulative reward which is what I require.

I tried adjusting the 'summary-freq' in the config to little avail. Is there any way to have TensorBoard update more frequently during training?

Thanks a ton

 

AFAIK summary-freq is indeed what determines how often results are written to the logs.

Note that tensorboard itself sometimes needs reloading and stuff, to see the results changes. Did you try refreshing the tensorboard page?