Convolutional Neural Networks without using an image render

Hi,
There's a related thread here https://forum.unity.com/threads/can-i-change-the-number-of-channels-for-a-visual-observation.832906/

You should be able to follow the example there to create a 3-D observation (height x width x channels). If you have different states, you'll probably want to have one channel per state, so you could think of each "pixel" would be the one-hot encoding of that state.

 

Sorry, maybe I was assuming too much from your original question

What I meant was if you had a 2D grid representing a tic-tac-toe game with 3 states (empty, X, O), you'd want to represent a board like (I hope this displays correctly)

Code (CSharp):

1.  
2. .|.|X
3. -----
4. .|O|.
5. -----
6. .|.|X
7.  

and you would encode it as something this

Code (CSharp):

1. 100|100|010
2. -----------
3. 100|001|100
4. -----------
5. 100|100|010

where "100" means a 1 in the first channel and 0 in the others.

In order for the observations to work well in a CNN, you want the convolution to happen on the "spatial" dimensions, and you want to do the encoding on the "channel" dimension.

I can't quite tell from your example, but if your data doesn't have some 2D spatial structure, trying to use a CNN probably won't work well for training.