A very simple RL project with ML-Agents, without Unity IDE

I have a very simple (graphically) RL test project: just drawing 2D lines on white canvas (using Python image libs like Pillow). For certain reasons, I want to do this with ML-Agents. Due to the simplicity, there's no need to use Unity's IDE. Question: can I use ML-Agents for RL training directly, so that I define the simple environment (2D lines) and provide any observations, without Unity's IDE? Python and AI skills are not an issue, handling the 2D-line environment in Python is not a problem. The issue is: how would I interface my simple environment with ML-Agents for RL-training? I'm aware the "headless" mode, but, as I understand it, it still relies on Unity to set up the environment.

 

Thanks, Christopher. Just to clarify: if I implement my own Environment Class in ML-Agents, Unity IDE will not be needed at any stage of the project, correct?