Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We’re making changes to the Unity Runtime Fee pricing policy that we announced on September 12th. Access our latest thread for more information!
    Dismiss Notice
  3. Dismiss Notice

Feature Request Using CNN in a more easy/elegant way

Discussion in 'ML-Agents' started by GamerLordMat, Dec 18, 2022.

  1. GamerLordMat


    Oct 10, 2019
    Hello folks,

    So I have a Texture2D that is filled with data I would like this to be added as a CNN to the learning. Now I did a work around using a RenderTextureSensorComponent, but it is somehwat unelegant.

    Implementing a custom sensor somehow using ISensor (or whatever is needed) seems for me personlly too tedious, I know there are other opinions about that, but without a bunch of examples and very detailed documentation it just is not possible to do easily or conveniently, at least I gave up after 30 min reading through excisting examples.

    Like with adding VectorObservation their should be a stupid easy way: sensor.addCnnOfSomeSize(somefloatarray). Or: CNN cnn = new CNN(int[] dimensions); sensor.add(cnn)

    What do you think about it? Have I overseen some excisting nice way to do that? Could we get maybe some short tutorial how to make custom sensors?

    Kind regards
  2. topitsky


    Jan 12, 2016
    I have the same problem, it seems weird that there is not a ready made component for observing a 2D array