Question Can we use ARKit 6?

Hi all,

I'm confirming that we are indeed working on ARKit 6 support. We will make a full announcement later covering the full scope of this work, but in the meantime I want to let you know that 4K video is available now via the

ARCameraManager

and does not require a new AR Foundation version.

To access 4K video configurations on compatible devices:

• Install the Xcode 14 beta to your Mac via Apple Developer downloads, and install the iOS 16 beta on a compatible device (iPhone 11 and up or iPad Pro 5th Generation)
• Set up a scene to request a 4k camera configuration (sample code provided below)
• Build your Unity project as normal for iOS
• Open the resulting iOS project in Xcode 14, then build and run the application on your iOS 16 device

Here's a sample MonoBehaviour you could add to your Main Camera to switch to the 4K camera configuration. (On my iPhone 13 Pro, there is only one 4K configuration available.)

Code (CSharp):

1. using System.Collections;
2. using Unity.Collections;
3. using UnityEngine;
4. using UnityEngine.XR.ARFoundation;
5.  
6. [RequireComponent(typeof(ARCameraManager))]
7. public class CameraConfigurator : MonoBehaviour
8. {
9.     IEnumerator Start()
10.     {
11.         // Wait for configurations to become available
12.         yield return new WaitForEndOfFrame();
13.  
14.         // Get available camera configurations
15.         var cameraManager = GetComponent<ARCameraManager>();
16.         using var configs = cameraManager.GetConfigurations(Allocator.Temp);
17.  
18.         // Switch to the first available 4k camera configuration
19.         var fourKResolution = new Vector2(3840, 2160);
20.         foreach (var c in configs)
21.         {
22.             if (c.resolution == fourKResolution)
23.             {
24.                 Debug.Log($"Switching to 4k camera configuration:\n{c}");
25.                 cameraManager.currentConfiguration = c;
26.                 break;
27.             }
28.         }
29.     }
30. }
31.  

 

@garrido86 If your device has an available 1920x1080 camera configuration, then yes this would work. Note that your device might also have multiple 1920x1080 camera configurations at different frame rates. I would recommend logging all the configurations on your device inside the loop above to see your options. (You should not assume that all user devices will have a particular camera configuration available.)

 

Thanks for checking in! Here's where things stand at the moment.

Complete

• 4K video is available now. See my post above.
• Newly added ear joints on 2D skeleton body tracking. You can see these in the 2D body tracking sample in our Samples project
• ARKit 6 introduced a change to the way that plane tracking works under the hood. We made a corresponding change so that your apps are unaffected and continue to work the same on iOS 16 as older versions.
• iOS 16 also quietly introduced a change to the behavior of multithreaded rendering. We released a patch to address this, and another patch is coming soon to further address follow-up issues that users have reported. You can follow this conversation on GitHub.

In Progress

The following ARKit 6 features require API changes to the Apple ARKit XR Plug-in, and won't be available until our next minor version. We are unable to share any potential release dates at this time.

• Configurable capture device settings
• High resolution background image
• Accessing EXIF tags

Blocked

• HDR. ARKit 6 HDR is dependent on lower-level Graphics changes that will take some time.

Does that answer your question?

 

@skowronski_m This is already available: https://github.com/Unity-Technologies/arfoundation-samples#worldcamerawithuserfacingfacetracking

 

@ThomasPzr Please start a new thread for this question as we're veering away from the ARKit 6 discussion in this thread. I also don't fully understand your question so if you wouldn't mind elaborating a bit as well that would help!