[RELEASED] VR Interaction Framework

Take a look at /Scripts/Components/ScaleBetweenPoints.cs for an example of how to scale between controllers / positions. The idea is to measure the distance between controllers and scale based on that value.

Here's a video outlining some features for v1.3 :

And here are a few more detailed notes :

1. Added XRInput support for Unity versions 2019.3 and up. This allows HMD's like the HTC Vive to now work properly with the framework. Windows Mixed Reality support is almost there - the controllers are rotated 90 degrees, should be a straightforward fix.
2. Added 3 door examples : sliding door, door that requires handle to open, and double doors.
3. New weapon models for pistol, rifle, and knife (courtesy of @BATTLEKOT)
4. New Grab Point system allows you to specify multiple grab points on a grabbable, as well as constrain their rotation. Try picking up the knife by the hilt with different grips to see how this works.
5. Fixed issue with IK Body not rotating during climbing
6. Added Joystick Deadzone support
7. Separated LocmotionSelector out from DemoScript
8. Better remote grab rotations - nice and smooth now!
9. Including some basic FinalIK / VRIK and EmeralAI integration packages
10. Lots of bug fixes, physics tweaks, and performance improvements

I've also started working on a Roadmap if you're interested to see where this is all headed - happy to receive any feedback on that. I will continue to fill this in as I move forward. The next version (1.4) will be focused on tutorials, documentation, and polishing.

 

I wouldn't go down the route of SteamVR at the moment. The new XR Management system doesn't support OpenVR/SteamVR. Until there's a plugin for SteamVR it could mess things up if people are already using the XR Management system... learned that the hard way.

 

Can you please make some video tutorials ??? thank you!

 

@BeardedNinjaGames
I ended up caving and getting EmeralAI because of the integration (and it honestly looked like Invector AI just wasn't meant to work with VR). Do I need to do anything special for the integration?

 

Working on those now! Anything in particular you're looking for?

There's a package to extract located in /BNG Framework/Integrations/Emeral AI/ as well as some instructions in a text file.

Basically you attach the EmeraldAIDamageable component to any AI gameobject that needs to be damaged. This takes our damage and passes it along to the emerald system. Then you need to assign the CharacterController a new Tag (EmeraldPlayer, for example) and assign that tag in the emerald settings, to make sure the AI can see the player. It's covered better in the instructions.txt, but that's the gist.

 

Custom hands would be a nice one. Been a nightmare so far. Top of that, any assets in the asset store seem to have no support from their devs, which doesn't help either.

Thanks for this. Works just fine! So far EmeralAI has been a slow process. Compared to Invector it takes ages to setup and animate. Let's hope this'll be worth it haha.

@BeardedNinjaGames how would the AI actually damage the player?

 

- setup new weapons
- emerald AI integration
- FinalIK Full body

thank you

 

One tip i can give you on the weapons. I created a vector, which has a completely different type of body build, but considering it's a rifle as well, I copied the rifle. Made a new vector mesh, put it in the graphics folder and removed the rifle body. Then move around the trigger, colliders, grips. Create a new slide as a child of the existing one, but remove that mesh. Result is fully functioning vector (you can alter its stats)

That's the nice thing of the guns being so modular in their build

 

I was actually hoping that the new version already had full SteamVR support. Currently, SteamVR/OpenVR is by far the most polished and feature-complete VR API available. Unity is trying to catch up but they've had a pretty sad history with everything related to VR since 2015, so I'm not particularly hopeful. At the moment, Unity is just messing things up - like usual (at least they did finally adopt many of the concepts that OpenVR was built upon, since the very beginning; too bad they are doing it in a way that broke compatibility).

So ... is skeletal input (using SteamVR) still on the table?

 

It's certainly still on the table. At this point I feel like Unity XR / OpenVR support could still be quite a ways off. I'd love to be wrong, though. I've got a few items to wrap up on the roadmap, and then will swing back around to SteamVR and Skeleton Poser.

 

Cant seem to get smooth loco with the HTC Vive.
Left thumb pad does not toggle it.
It is enabled in the inspector. Have even tried removing the teleport script, but still no joy.

Any ideas?
Thanks.

 

Make sure Smooth Locomotion is on in the "LocomotionManager" (on the Player object), and you also want to disable "Load Locomotion from Prefs" as well - that may be overwriting the setting.

The Vive uses the trackpad to initiate the teleport, so I disabled the teleport / smooth locomotion toggle for HTC. Otherwise when you pushed it in to teleport it would just toggle to smooth motion.

 

@BeardedNinjaGames How would one setup the Emerald AI player health system with the OVR character controller?

 

Just wanted to say thanks for the advice, that did the trick, and now its running really smoothly.

I did have a quick question regarding climbing.
Is it possible to set an entire mesh as climbable? or even terrain?

I just wondered, because while setting smaller blocks they can be grabbed on the same face at multiple points.
But when I tried on both a cliff face using Unity terrain, and a huge cube. Both with colliders, and the grab script, it did not work.

I didnt try subdividing the mesh,and applying the scripts, as I was trying for performance.

Is it possible to have this working?

Again thanks for the support of this cracking asset..

 

Ah, I'm glad you mentioned this. If you set the "Break Distance" property on the Climbable component to something high it should work on your mesh. The break distance property lets you "break" the grip if the distance between your hand and the transform exceeds a specified distance (1 meter by default), so on a big mesh you're breaking the grip as soon as you grab it since the center of the transform is most likely > 1 meter away.

I will update this so break distance uses your original grab position instead of the center of the transform. That would be a better way of handling this. For now you can just set the Break Distance to something relatively high or 0 to disable the break distance feature.

 

Works like a dream, even on terrain

Thank you.

 

Thank you my good man

 

I will try to make more videos I'm having some issues with sound.

 

@BeardedNinjaGames

Good idea for a tutorial would be on using the UI Example you've added to actually change game values, like player settings for example
That way it could be used to toggle between locomotion types, or enable post processing settings in the game (as an example).

 

The Sceneloader you have in there (on death), custom I assume?

 

It's another asset i own you can use a free one it's should work as well

 

In this video you can see where i put the UI at on his hand

 

On sidenote. Are you running Emerald AI 2.4.1? I notice your AI is using ranged attacks, and for me they don't work (not just me, several people running into the same issue).

 

yes i'm using 2.4.0.1 on unity 2019.3.3f1 I'm still playing with the ranged attacks .

 

Coming from a easy setup (SteamVR) which out of the box is easy for ALL platforms
I would like to love this asset, because it comes with stuff like inventory, stick, remote grab things that i need.

However, i found controls work fine with oculus, but not HTC, so now im questioning does it work with Index?

Also where do i make adjustsments for controllers.? Example.

On my rift s, the demo scene works fine.
On my HTC cosmos, only the thumbstick buttons and slowmotion works, everything else NOT.

I need it to work, any ideas?

I also get the feeling, this is more for mobile development and not so much pc development,
there is a lot of focus on android in this.

 

Hehe also a funny one, was trying to see if i could run it in a old game where i allready have steamVR and Steam implemented
Maybe to convert from SteamVR to this (when we get controllers confirmed working)

Funny IK screenshot when SteamVR and OculusVR and VR interactions running at the same time..



https://imgur.com/a/2BbynAB

 

SteamVR doesn't work with the Oculus Quest, which I consider a very important platform.

If you're looking for OpenVR support (so this runs through Steam), then just make sure the OpenVR SDK is set first :



This will support devices such as the HTC Vive. Unfortunately OpenVR / Unity XR doesn't support the Valve Index, so if you want to run the Index you'd need to add the bindings from SteamVR yourself. That's just where Unity XR is at the moment, and not really something I have any control over. I may add SteamVR as an integration package in the future, but for now if you're familiar with SteamVR it shouldn't be too difficult to update the inputs in the InputBridge based on SteamVR actions.

This is intended for both PC and Quest development. There tends to be more of a focus on the Quest when doing tutorials, simply because there are more steps for supporting that platform. For PC you pretty much just import the Oculus Integration Package and this asset and hit Play. For the Quest you need to perform a couple of additional steps to make sure it runs smoothly.

I also target the Quest when creating the Demos, as it's much easier to scale up from there than it is to scale down from a PCVR setup. It's a great performance benchmark. That's beneficial for PCVR users, as if we're hitting ~72FPS on a Quest then you should have plenty of room to add additional visuals / features for your PC build.

 

Here are some tutorial videos - I hope they help! I'm looking to get a v1.31 version out soon that has some minor updates and fixes, then I may look at doing some more in-depth videos if there is interest.

 

Thank you for a speedy response, love the asset and might use it in a future project.
Currently i was just looking for a few things i need.

- Remote grab
- And the small inventory pack/item slot system
- belt slots

If you have any interaction systems similar with these things, i would happily pay 50£€$ for that if they support SteamVR.
I know steamVR is implementing XVR, but they are very slow over at Valve, so i wont exspect them to be ready until 2021 at the earliest.

Considering my current users consist of 22% index users and increasing, i'm sticking with SteamVR for now.

 

I'm interested in this very much but I have some questions about compatibility with HTC vive. I know it says it supports vive and i even played the demo with my vive.

However they were some control issues when grabbing things and it was uncomfortable. The side button on the controller was used to grab the items and you had to continually hold it and that was a pain.

I'm guessing there will be a way to change the buttons to the grip button to hold right?

 

Hey there. I don't have easy access to a Vive at the moment due to Corona, so I kind of have to guess at what would work well for controls. You can certainly change the grab to use the trigger instead. I chose the side button as that seemed to work best if I want to hold a pistol and then use the trigger to shoot. Certainly open to suggestions! I'm not sure what the standard is for Vive.

 

Ok. I figured if you press the side button to pick, you shoot with the trigger. But in the demo, I had to keep holding the side button to hold onto the gun which was uncomfortable. Can it be done that way?

 

Any chance for game creator or playmaker integration????

 

I'm trying to make that work at some point next week.

 

The Respawn function in the Emerald Damage Script does not work. I Flase Destroy on Death and set Respawn True with 10 seconds. Once NPC is dead, it stays dead.

 

Yes, that could work. Might be weird when trying to throw the item. I will set up one of the pistols as a toggle and post the PC demo up later so you can test the difference yourself.

The included Emerald Damage script only transfers damage from the VRIF system to Emerald. Anything AI related should then be handled through Emerald's system. So however you might respawn an enemy in Emerald should work fine.

I haven't really used PlayMaker before, so not sure what that would look like. Anything in particular you're looking for? I would think you would still be able to use PlayMaker just fine with this, and use the included UnityEvents with VRIF to handle anything Grabbable related.

 

Yes Playmaker works just fine with this. You can set the scripts on items with your scripts and it all works fine.

 

OK thank you. How can I make Emerald AI to damage player?

 

Another question. I enter in the damage script Health 10000 but the emerald AI dies after one hit with the gun?!

 

I figured if you want to throw the item then you can just unequip it but it should depend on the type of item though. Like throwing stars or balls you should hold button to hole onto item and release button to drop. But for items like guns and swords then maybe you can equip so you dont need to keep holding. It would probably depend on the type of game. I was just playing half life alyx and you dont hold a grip to hold onto a weapon.

Anyway im looking forward to the demo. I want to test it out before buying.

 

@BeardedNinjaGames

Hey, what would be the best way to allow for a player to remain seated, but keeping the height at standing eye level?

 

Not part of the sale

 

It's totally worth it at full price. If you've ever tried using the Oculus plugin's prefabs and found them to not function or be full of bugs, or used VRTK and found it to be way over-engineered, or worked with Unity's XR framework and just be totally lost on where to start, this plugin solves all those issues.

 

I don't doubt that it is. I just have like 100 things in my wishlist and the sale ones are definitely going to get purchased first

 

I hear ya. If you're just buying to build up your asset library, definitely get your sale items first. But if you're trying to get a VR project going now, don't hesitate!

 

So I'm trying to use my own character with this system, but I'm having trouble grabbing objects. I copy-and-pasted the 'GrabberOffsetLeft' to my characters left hand. When I add the 'PistolNEW' prefab to my scene, I'm able to point at it and the circle on the gun shows, but I can't seem to grab it. It seems as though the input system isn't set up correctly. What I'm doing is setting up my player exactly as the 'PlayFinalIK Variant', so I have all the scripts attached to the correct objects. There's something I'm missing. Thoughts?

Thanks!

@BeardedNinjaGames , it would be great to have a video tutorial on how to set up a character from scratch.

 

Currently the Player has to have the "Player" tag on it in order for the InputBridge component to be found (Uses GameObject.FindWithTag()). In the upcoming update this will be a singleton so you don't have to use a tag.

I'll make a video once I've finished this first pass of the input system. This should be able to be hooked up to just about any rig (Steam, XR, Oculus, etc.) and I agree it would be helpful to show how to hook it up to a custom character from scratch. Now that I've had some time using this with other systems besides Oculus I have a better idea of how to abstract that. More to come on that later.

 

@BeardedNinjaGames

Hi, where would I make the camera adjustment so when I'm seated the eye level would be at the characters standing height when using VRIK from FinalIK? I tried changing the OVRCameraRig to Eye Level and that was way to high. I also tried moving the IKHeadTarget, and that fixed the VRIKs heads position, but it did not move the camera rig. I tried moving the TrackingSpace, but that always gets reset to the HMD position. Thanks.

 

Take a look at the included FinalIK scene. If you hit the 'A' button your character will reset it's height depending on where your HMD is. So if you squat down and reset, the character will become very small. You can see me resize a couple of times in the Youtube tutorial :