Integrating Unity3D with Kinect Fusion and WPF

Hi,

I am working on a project for my thesis, using a Kinect v1.0, a virtual character is rendered in the same room as the player and interacts with them (augmented reality).

For this, I am using Kinect Fusion to get a 3D mesh of the room, which will be used by the character AI to avoid it walking into walls and obstacles. This all works within a WPF application.

I want to use Unity to render the character. I need to be able to connect my C# WPF application to Unity so that I can render the character on top of the kinect feed, and pass on the mesh data to Unity to stop the character from walking into walls and obstacles.

My question is, how can I bring all of these things together? Should this be done within Unity itself, or is there some way to import Unity3D assets (namely the character rendering) into the WPF application and on top of the kinect feed? The main problem I have is that this 3D mesh data of the room is essential to the way the character will behave.

If anyone has any experience with this or any pointers I would greatly appreciate it.

 

this is from 4.6.1 release notes:

and here is a note, about 3 posts down with some sample code.

http://answers.unity3d.com/questions/245242/is-it-possible-to-use-unity-inside-wpf.html

hope that helps.