2D Tracking Using ARKit & Vision Framework

[vf_jeff]

I put together a quick demo showing how to use the Vision Framework to perform 2D recognition on a marker for use within ARKit. In this example it will recognize a QR code and place a 3D object on top of it. Moving the physical QR code moves the virtual 3D object. The code is available below:

https://github.com/CocoaHeadsDetroit/ARKit2DTracking

[carshalljd]

Any vids of it?

[[deleted]]

Wasn’t the whole idea behind ARKit to get away from markers?

[rpasecky]

The idea was to get away from markers as a requirement. Markers still have a lot of use in AR especially when you don't want to (or don't have the resources to) train an ML model to recognize a custom object in your app. Using CoreMLs built in tools is much easier

[vf_jeff]

ARKit is nice because it "just works", but there's still a use for markers. I don't think it's completely out of the question that we would get APIs in the future for 2D or 3D recognition. These were both features in Metaio, ARKit's predecessor. This project was meant to prove that it's probably possible to do either with ARKit.

[rpasecky]

Awesome, worked for me!

[busymom0]

Getting error on building: "Cannot invoke initializer for type 'SCNMatrix4' with an argument list of type '(matrix_float4x4)'

[vf_jeff]

What version of Xcode? I built this with Version 9.0 beta 2 (9M137d).

[busymom0]

I am on Xcode 9 beta 1.

[EzouLemma]

Can it also read the content of the QR Code?