AR Foundation: Continously update position of gameobject

Hello!

Me and a friend has been following a tutorial:

In this tutorial a placment marker is implemented that shows the user where an object will be placed when the screen is tapped. Using the exact same code does not seem to work but when i simply add a ARPlanManager to the ar session origin object it does sort of work but the smoothness seen in the tutorial is not at all achieved. The marker kind of "vibrates" around the center point unless i move my phone very slow. Any ideas?

First i create the Vector needed

Code (CSharp):

1. Vector3 screenCenter = Camera.current.ViewportToScreenPoint(new Vector3(0.5f, 0.5f));

Then i perform a raycast

Code (CSharp):

1. arSessionOrigin.Raycast(screenCenter, hits, TrackableType.Planes);

then i simply set the position of the marker

Code (CSharp):

1. marker.transform.position = hits[0].pose.position

This is all performed withing update.

I'm using Unity 2018.3.3f1 and AR Foundation 1.0.0-preview.22 and an OnePlus 6

-EDIT I changed the Update type of the Tracked Pose Driver of the AR Camera to "Update" and now it's super smooth!

 

You must be using Android. I've experienced the same issue. I believe it's a mismatch in frame-rates between the camera feed and Unity render rate.

I haven't been able fix it even by setting

Code (CSharp):

1. Application.targetFrameRate = 30;

or

Code (CSharp):

1. Application.targetFrameRate = 60;

If it seems jittery, Unity is probably rendering at double the frame-rate.

 

Yeah jittery is the right word to describe it all and yes i am using android. I've also been unsucessfull with trying the

Application.targetFrameRate

 

I'm happy to say i seem to have found a solution! What you need to do is go into the track pose driver of the ar camera and change the Update Type from "update and before render" to "Update" only. Now it is super smooth!

 

The reason for this is because the pose may change between your Update script code and when rendering actually takes place. For XR, we sample the pose as close to rendering as possible to reduce latency. If you are placing objects each frame in your Update script, then the Tracked Pose Driver needs to match, so setting it to "Update" only is one approach.

 

Update didn't work for me, but for some reason "Before Render" worked better, with a very little lag that it is almost unnoticeable

 

Any updates on this? I talked about a similar problem in this thread https://forum.unity.com/threads/pla...h-arfoundation-2-1-0-mostly-on-iphone.688432/

 

The pose provided by the Tracked Pose Driver (TPD) in a MonoBehaviour Update will be from the previous frame on ARCore and ARKit (though it tends to be more noticeable on ARCore). If you need the pose associated with the current frame, you can subscribe to the Application.onBeforeRender event. The pose is resampled by the TPD just before this event and will give you the correct pose.

 

Hi @tdmowrer

I am trying to use this sample to place objects continously but I am facing an issue in iOS
every time I point to a table I can't go back to the floor, it seems it gets stuck in a higher plane
but in android I can move from table to floor and vice versa without a problem

I am using 2019.2 with ar foundation 2.0.1 do you any ideia why this is happening ?

 

Is there any way to get the frame accurate transform in the frameReceived callback? This information is crucial for my computer vision task and cameraObj.transform seem to be off when doing logic in that callback.

1. Would I get the latest frame and pose if I saved the texture in frameReceived (by for example blitting it to a render texture) and then did all my processing (getting transform.localToWorldMatrix and using the saved texture) in Application.onBeforeRender?

2. What about the intrinsics matrix, when is this updated? I've seen from my native ARKit apps that the intrinsics can change from frame to frame. It would be great if there was a single callback that provided synchronized values, like the one ARKit provides.

 

Can i place GameObject at each location if i have a list of locations?

 

Is arcore more stable than arfoundation? I've seen I'm getting more jittering on arfoundation but I'm not sure

 

AR Foundation uses ARCore on Android devices.