Search Unity

ARFoundation and 2D image target tracking

Discussion in 'Handheld AR' started by jariwake, Jun 27, 2018.

  1. jariwake

    jariwake

    Joined:
    Jun 2, 2017
    Posts:
    83
    As both ARCore and ARKit have support tracking 2D image targets (such as posters on the wall), I suppose ARFoundation will support this as well. The feature is not supported in the initial ARFoundation preview version, but according to Mike Durand (in the closed beta group, which is not so active anymore..) "functionality will be expressed via subsystem that will ship post Unity 2018.3."

    Now, as "post 2018.3" might be almost a year away from now (which is an eternity in the XR technology world), my question is: is using ARKit/Core SDK:s directly for the image targets in parallel with ARFoundation fully supported and possible?
     
    Last edited: Jul 7, 2018
    robertonunez likes this.
  2. Hinne123

    Hinne123

    Joined:
    May 29, 2018
    Posts:
    1
    Would be very interesting for us to!
     
  3. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    It's something I am interested in using also!
     
  4. YohanB

    YohanB

    Joined:
    Jun 9, 2015
    Posts:
    8
    Very interested in this as well!
     
  5. mdurand

    mdurand

    Unity Technologies

    Joined:
    Aug 1, 2016
    Posts:
    29
    Hi All-

    We're designing a multi-platform 2D image tracking system now and the tentative plan is to release it as a package in the coming months. However, it will only work with 2018.3 and later. Sorry if my "post 2018.3" quote was too ambiguous.

    -Best,
    Mike
     
    ROBYER1 and rob_ice like this.
  6. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    Is it outside of the ARKit and ARCore implementations or is it some bridging of the two so that trackable images for both android and ios can be managed with one top level control?
     
  7. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
    The idea for ARFoundation in general is to provide a multi-platform layer so that you only have to write once and it will run everywhere. So the intent is for all the subsystems including the Image Tracking one to have multi-platform support. In this case, we want to use the underlying ARKit and ARCore implementations to provide the data for the subsystem.

    But there could be a 3rd party who decides they can do image tracking better than these SDKs, and they are more than welcome to use the Image Tracking subsystem to deliver their data in a multi-platform manner.
     
    rob_ice likes this.
  8. jariwake

    jariwake

    Joined:
    Jun 2, 2017
    Posts:
    83
    @jimmya and @mdurand Thanks for the answers. How about the question in the original post: is using ARKit/Core SDK:s directly for the image targets in parallel with ARFoundation fully supported and possible?

    I would assume nothing is keeping from using any tech alongside ARFoundation, but I am just a bit worried if they might somehow "clash"...like when ARFoundation and ARKit/Core are all required to use the camera image simultaneously etc. Is there anything that would expose the underlying ARKit/Core in the ARFoundation API?
     
  9. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    Am looking into how I can take and use the image tracking element of arkit in the ARFoundation as a hacky workaround for now, has anyone done this yet?
     
  10. Ggabe

    Ggabe

    Joined:
    Sep 20, 2015
    Posts:
    4
    I'm curious about this as well. Is cross-platform image tracking really a year out? Would using native ARKit/ARcore image tracking in unity break AR Foundation?
     
    rob_ice likes this.
  11. pshawt2

    pshawt2

    Joined:
    Mar 24, 2017
    Posts:
    15
    Is there any update on when this might be ready? I have a very limited amount of time and need this functionality. I'd rather use your solution but may have to go the Vuforia route if it's still months away.

    Warmest regards,
    Chris
     
    rob_ice likes this.
  12. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    547
    We plan to have full ARKit 2.0 and ARCore 1.3 support by the end of this year (not a year from now), which will include 2D image tracking.

    It's not currently possible because they would indeed clash (there can only be a single ARSession at a time). We're actively working on image tracking support. We'll let you know when it's ready.
     
    Go_Psychic and rob_ice like this.
  13. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    That's great news! Thanks for all the efforts in bringing the separated AR plugins together for simplicity of use
     
  14. CisDonkers

    CisDonkers

    Joined:
    Nov 27, 2017
    Posts:
    3
    Hey can we use ImageTarget now in the new Beta:
    Unity 2018.3.0b1?
     
  15. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
    ARFoundation new features are released in new version of the ARFoundation packages, not in Unity version releases. They are also released at a faster cadence than Unity releases.
     
  16. CisDonkers

    CisDonkers

    Joined:
    Nov 27, 2017
    Posts:
    3
    Can I use now the ImageTarget than? Or is it possible to combine ARFoundation with Vuforia?
     
  17. jariwake

    jariwake

    Joined:
    Jun 2, 2017
    Posts:
    83
    No, it is not possible to have Vuforia and ARFoundation in the same project. If you do, you get a weird error about conflicting AndroidManigest.xml files when trying to build. I think the fact that you cannot use both should be indicated a lot more clearly in Unity.

    @jimmya Is there an estimate on when the image targets would be available via ARFoundation?
     
  18. waldgeist

    waldgeist

    Joined:
    May 6, 2017
    Posts:
    51
    Thanks for this interesting thread. I personally think that AR Foundation (which is a great approach) should allow the low-level use APIs of AR Kit and AR Core, if needed. Otherwise, there will always be a huge time delay. And the AR world is moving fast. Very fast.

    (I would also love to see support for Vuforia, but I can understand that this is a way heavier task to achieve.)
     
  19. waldgeist

    waldgeist

    Joined:
    May 6, 2017
    Posts:
    51
    Slightly Off-Topic: Is there any estimate when AR Foundation will also support World Mapping? This is the other feature I am missing dearly.
     
  20. cam415

    cam415

    Joined:
    Mar 26, 2014
    Posts:
    6
    I'd also like to know when image targets will be supported in ARFoundation...
     
  21. jariwake

    jariwake

    Joined:
    Jun 2, 2017
    Posts:
    83
    I doubt ARFounation will have support for Vuforia, since it is kind of "competing" abstraction layer - Vuforia already has this thing called Vuforia Fusion which uses ARCore or ARKit under the hood if they are available and supported by the device. So far it only utilizes the surface tracking, though.

    But Vuforia does not expose the underlying ARCore/Kit API either, which kinda sucks. Vuforia´s image tracking is way more robust and faster the one in ARCore though. ARkit image tracking I havent tried yet.
     
  22. StaffanEk

    StaffanEk

    Joined:
    Jul 13, 2012
    Posts:
    380
    Any news on the inclusion of image targets in ARFoundation?
     
    ManjitSBedi likes this.
  23. Mal_Duffin

    Mal_Duffin

    Joined:
    Jan 22, 2015
    Posts:
    44
  24. Jilairan

    Jilairan

    Joined:
    Sep 4, 2018
    Posts:
    1
    hope image tracking will be released this month since its the last of this year
     
    cam415 likes this.
  25. ManjitSBedi

    ManjitSBedi

    Joined:
    Mar 8, 2014
    Posts:
    32
    I guess many people have seen this video from the recent Unity 2018 LA conference.



    In the video they did talk about image tracking & creating image databases around about 5 minutes in.

    I would really like to be able to try an alpha version of this if possible. I am doing some prototyping of some AR projects currently & to be able to make the projects cross platform for AR Core & AR Kit would be ideal.
     
  26. Jonas_Hartmann

    Jonas_Hartmann

    Joined:
    Apr 9, 2018
    Posts:
    4
    Are there any news on when 2D Image Tracking will be available?
     
    ArmanUnity, Kroute, Saicopate and 4 others like this.
  27. ArmanUnity

    ArmanUnity

    Joined:
    Nov 29, 2015
    Posts:
    21
    is the image tracking available in AR foundation with new unity 2018.3 release ?????
     
  28. robertonunez

    robertonunez

    Joined:
    Oct 1, 2018
    Posts:
    4
     
  29. Mal_Duffin

    Mal_Duffin

    Joined:
    Jan 22, 2015
    Posts:
    44
    > is the image tracking available in AR foundation with new unity 2018.3 release ?????

    I think you mean in the AR Foundation package that was just released, and can only be downloaded using 2018.3.

    No, unfortunately it's not available yet.
     
  30. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
  31. robertonunez

    robertonunez

    Joined:
    Oct 1, 2018
    Posts:
    4
    Not image Tracking yet :(
     
  32. silverduck

    silverduck

    Joined:
    May 16, 2010
    Posts:
    8
    Does anyone know if the image tracking or 3D object tracking would be able to effectively track a cylindrical label on something like a glass bottle?

    If so, does AR Foundation render Vuforia largely redundant? Or is AR Foundation meant to be used in addition to Vuforia?
     
  33. Jonas_Hartmann

    Jonas_Hartmann

    Joined:
    Apr 9, 2018
    Posts:
    4
    How propable is it, that image tracking will be available by the end of this month?
     
  34. Mal_Duffin

    Mal_Duffin

    Joined:
    Jan 22, 2015
    Posts:
    44
    > How propable is it, that image tracking will be available by the end of this month?

    The probability of a required feature appearing within a time frame is always inversely proportional to the importance of your project needing that feature within that time frame :p
     
  35. jorgejaas

    jorgejaas

    Joined:
    May 6, 2018
    Posts:
    3
    Are there any news on when 2D Image Tracking will be available?
     
    rob_ice likes this.
  36. dnoparker

    dnoparker

    Joined:
    Aug 28, 2013
    Posts:
    61
    I would like to know too! It would make my next project so much easier!
     
    rob_ice likes this.
  37. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    Neither the ARCore or ARkit Unity repos have had an update since early-mid December 2018 which suggests to me that the actual ARCore and ARKit developments have halted or slowed around Christmas time (understandably). While ARKit has fully tracked Image tracking, ARCore still only has non-tracked markers where you can only track something that isn't moving (like a poster on a wall). It's been mentioned a few times that Google are working on moving image tracking but that hasn't been released yet.

    I can only assume for now people use other SDKs like Vuforia for moving image tracking on Android and IOS so I guess we gotta wait!

    What fascinates me is that ViroReact has cross-platform image tracking on Android and IOS with ARkit and ARCore but I haven't seen anyone developing on that platform who has complained that ARCore on Android doesn't track moving markers still.. odd!
     
  38. rob_ice

    rob_ice

    Joined:
    Nov 11, 2016
    Posts:
    112
    It's usually recommended to not allow 2d markers to bend, Vuforia has its own solutions for this so I would recommend looking at it for your use case.

    As for ARFoundation and Vuforia, you shouldn't use the two together as they are both going to be doing similar things and will conflict if you try to use both of them together.
     
  39. brucewu_trigger

    brucewu_trigger

    Joined:
    Sep 8, 2015
    Posts:
    3
    Looking at the Unite LA video, it seems like the image targets are scriptable assets and referenced by the AR Image Manager.


    Does this mean it is possible to make AR activations into hosted asset bundles, and have new activation using new image target without the need to update the app ?

    I know the image target feature is not released yet, but wanted to know if this is possible when it roll out!
     
  40. robertonunez

    robertonunez

    Joined:
    Oct 1, 2018
    Posts:
    4
    I wouldn't like this post become just a list comments asking if the image tracking is already available or not. So I won't ask again but I would like to know where can we check any update about this subject. I have been checking this post almost every day but maybe there is a best place to check updates.
     
    Last edited: Feb 15, 2019
  41. sroq

    sroq

    Joined:
    Jun 28, 2015
    Posts:
    8
    dnoparker likes this.
  42. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
    The only update I can give you is that the release is imminent, and there are people hard at work on this.
     
    mende, nuno_dias, ROBYER1 and 5 others like this.
  43. Migen

    Migen

    Joined:
    Feb 26, 2013
    Posts:
    2
    Wait and see then, I can't wait to see it. Meanwhile if anybody has a solution to mix Vuforia for image recognition and ARFoundation that could be interesting
     
  44. unbreakable3D

    unbreakable3D

    Joined:
    Jun 13, 2017
    Posts:
    3
    Ready to try re-writing my Vuforia-based app with AF Foundation as soon as this is released!
     
    ROBYER1 and janlucvd like this.
  45. janlucvd

    janlucvd

    Joined:
    Jun 8, 2013
    Posts:
    21
    I'm here to be in the know the split second 2D image tracking with AR Foundation is revealed! Right now I'm making an experience using ClueKeeper and ZappAR. Works great, but user interface of ClueKeeper is non customizable and ugly.
     
    ROBYER1 likes this.
  46. ElinH

    ElinH

    Joined:
    Aug 29, 2017
    Posts:
    18
    Any update on image tracking? @jimmya
    I have to start a new project this week. At the moment i'm using ar kit. But i would prefer using ar foundation
     
    mende likes this.
  47. flyingaudio

    flyingaudio

    Joined:
    Dec 3, 2010
    Posts:
    88
    Hey @jimmya or @tdmowrer, do you have a closed alpha or beta package of AR Foundation with 2D image tracking/detection that I can participate in?
    Monday I start on our AR features, but it doesn't ship for awhile. I would rather work with your unified front, even if it is a moving target, then build my own layer. All I need is plane detection and 2D image detection, the image detection you showcased at Unite in the hallway.
    Thanks.

    Edit: To clarify, I need 2D image detection, not tracking. World tracking plus image detection/targets.
     
    Last edited: Mar 13, 2019
  48. pjchardt

    pjchardt

    Joined:
    Jul 16, 2015
    Posts:
    6
    hi unity folks @jimmya and @tdmowrer! as @flyingaudio mentioned, I am also interested in participating in an alpha or beta for image tracking. Starting cross platform image tracking support for an art installation project.
     
    mende likes this.
  49. vzheng

    vzheng

    Joined:
    Dec 4, 2012
    Posts:
    34
    looking for that. up up up
     
    mende likes this.
  50. abgrac

    abgrac

    Joined:
    Jul 23, 2013
    Posts:
    4
    UP UP UP
    We need Image Tracking!!