Search Unity

  1. Unity 2020.1 has been released.
    Dismiss Notice
  2. Good news ✨ We have more Unite Now videos available for you to watch on-demand! Come check them out and ask our experts any questions!
    Dismiss Notice

Help Wanted Computer Vision and Machine Learning integration.

Discussion in 'AR' started by kislotaooankit, Jul 29, 2020.

  1. kislotaooankit


    Apr 20, 2020
    Hello guys i come from python background and,

    I was getting familiar with ARFoundation and was thinking is there any possibility to do some image processing via python which can further assist in enhancing out AR experiences.

    As per my current knowledge there is no proper way to integrate powerful python functionalities (OpenCV , tensorflow) to unity editor directly i have scraped the internet and 90% of examples rely on WebSockets for communicating between these two environments.

    My Idea was to basically somehow send the frames of camera from unity to my python code via some sort of messaging queue service (such as rabbitmq) and then process the received frames in python for further image processing tasks.

    However i feel sketchy about this approach as it looks resources expensive + requires nice internet connection if implemented for mobile ... not to mention of uncertainty of will this ever work or not.

    I have heard about ML agents unless my understanding is wrong ,they dont allow that much customization of code in python side for the work.

    Can anyone would suggest some improvement in my approach or I would be really grateful hear other approaches.

    Thank You !!