Is there any information on how high the time-scale parameter can be set without a problem? Is 5 ok? 50? I mean, it has a big impact on the training speed
The main issue is physics. If you don't have any trouble with undetected collisions or something similar then it shouldn't be a problem to crank it up.
Depends on the scene. If you're learning Pong you can safely set it to 50. If you have a 3D navigation task the game will probably start lagging at 10 already. Default is 20, and most of the time I just leave it there.
Are you guys sure a high time-scale can cause issues? Does ML-Agents enforce a higher framerate at the expense of possible physics dropouts? Or will Unity slow code execution down in order to wait for the physics engine?