Search Unity

  1. We are migrating the Unity Forums to Unity Discussions. On July 12, the Unity Forums will become read-only.

    Please, do not make any changes to your username or email addresses at id.unity.com during this transition time.

    It's still possible to reply to existing private message conversations during the migration, but any new replies you post will be missing after the main migration is complete. We'll do our best to migrate these messages in a follow-up step.

    On July 15, Unity Discussions will become read-only until July 18, when the new design and the migrated forum contents will go live.


    Read our full announcement for more information and let us know if you have any questions.

Feature Request Using CNN in a more easy/elegant way

Discussion in 'ML-Agents' started by GamerLordMat, Dec 18, 2022.

  1. GamerLordMat

    GamerLordMat

    Joined:
    Oct 10, 2019
    Posts:
    186
    Hello folks,

    So I have a Texture2D that is filled with data I would like this to be added as a CNN to the learning. Now I did a work around using a RenderTextureSensorComponent, but it is somehwat unelegant.

    Implementing a custom sensor somehow using ISensor (or whatever is needed) seems for me personlly too tedious, I know there are other opinions about that, but without a bunch of examples and very detailed documentation it just is not possible to do easily or conveniently, at least I gave up after 30 min reading through excisting examples.

    Like with adding VectorObservation their should be a stupid easy way: sensor.addCnnOfSomeSize(somefloatarray). Or: CNN cnn = new CNN(int[] dimensions); sensor.add(cnn)

    What do you think about it? Have I overseen some excisting nice way to do that? Could we get maybe some short tutorial how to make custom sensors?

    Kind regards
     
  2. topitsky

    topitsky

    Joined:
    Jan 12, 2016
    Posts:
    102
    I have the same problem, it seems weird that there is not a ready made component for observing a 2D array