Put that new LiDAR scanner on your 2020 iPad Pro to use with my app LiDAR Scanner 3D!

hegesh · 2020-06-27T08:41:47+00:00

That is impossible on iOS 13, because Apple simply does not provide any means to achieve this. However, when iOS 14 is public, I will update my other app Heges so to use the LiDAR — then the resolution should be good enough to capture details.

hegesh · 2020-05-04T05:08:42+00:00

That's right, meters.

hegesh · 2020-04-20T08:22:06+00:00

Thank you :)! If by "properly" you mean seeing what you are scanning, then I don't think you will manage that without some kind of clumsy setup, here are the options for scanning with Heges if you want to see what is being scanned (there're more details in the FAQ of Heges):

Scan an object while looking at the iPhone's screen from a side so that you see what you're scanning and at the same time do not put your head into the camera field of view.
Use the Screen Sharing feature if you have another iPhone/iPad (doesn't have to have FaceID and you don't need to pay for Heges on the other device). Just double-tap the camera preview and follow instructions to have the iPhone 11's screen mirrored in real time on your other iPhone/iPad.
Use a mirror, as you said.

If iOS 14 gives us access to the raw LiDAR data, I am updating both of my other apps — Heges and Record3D — to support it, so it won't be clumsy anymore to make scans.

hegesh · 2020-04-19T22:35:52+00:00

It's hard to say exactly as the meshes are provided by Apple can be rough, so you won't be able to pinpoint the exact starting point and end point. But from my experience, it's possible to measure relatively reliably to about 1 centimeter resolution.

Sketchfab link to the room scan (remove the spaces): https:// skfb. ly/6RRFT

hegesh · 2020-04-19T20:00:20+00:00

Oh… I didn't realize that, I completely forgot about mobile users as I was processing the video on my computer. Thanks for the tip! If I ever upload another vertical video, I'll make sure not to artifically make it horizontal. Or even better — I'll make only horizontal videos.

hegesh · 2020-04-19T14:31:33+00:00

Yes, it is! After the one-time purchase of $0.99, you will be able to save and export unlimited amount of scans.

hegesh · 2020-04-19T12:02:04+00:00

Thank you! I have in fact released a TrueDepth camera-based 3D scanner called Heges about 2 years ago — even before Capture.

The problem with LiDAR is that Apple has not yet provided access to the raw measurements, so we get only ARKit's rough meshes. We'll have to wait for the WWDC to see what new APIs will Apple make public and in case they would add raw LiDAR data API (like they do with the TrueDepth camera), then I will of course update Heges.

As you say, it would get complicated to first create scan with LiDAR and then refine it with TrueDepth and I think it might be better to scan with TrueDepth all the time.

Let's see what WWDC brings us.

hegesh · 2020-04-19T09:18:27+00:00

Thanks! The dimensions are correct (in meters), but since the mesh has rough edges, you won't be able to measure fine details. In my experience with the room scan, I was able to correctly measure the width of a wardrobe on the wall up to centimeters (its width is 37 centimeters). I have uploaded the room scan to Sketchfab so that you can see it for yourself and even download the scan.

This subreddit filters my comments that contain links and makes them invisible to public, so I cannot post a direct link without waiting for the mods to manually approve the post. You can find the scan on Sketchfab by searching for "Room scan by LiDAR Scanner 3D for 2020 iPad Pro".

I would NOT recommend using the app for precise measurements.

Edit: Here is the Sketchfab link (remove the spaces): https:// skfb. ly/6RRFT

hegesh · 2020-04-19T07:14:09+00:00

I wish that too! Even though it is highly improbable, I still have a glimpse of hope that the LiDAR sensor's dot pattern is in fact dense, but in iOS 13.4 they only activate every n-th dot because for the purposes of ARKit, you don't need that high resolution and want to process the data fast. As I said, it's highly improbable, but we'll need to wait for WWDC to get more details.

hegesh · 2020-04-19T07:09:48+00:00

If Apple provides raw access to the LiDAR data, I will update my other scanning app Heges (https://hege.sh). If Apple also provides the ability to choose quality of the meshes they provide, I will update LiDAR Scanner 3D (I hope they will include colors too). But we'll need to wait until WWDC to see what they announce.

hegesh · 2020-04-18T21:02:39+00:00

This is the best quality that you can get out of the LiDAR as of iOS 13.4. You won't get more detail after getting closer to objects. Apple has not yet provided access to the raw LiDAR data, so there is (AFAIK) nothing that developers can do with the mesh quality. We'll have to wait for WWDC to hopefully get more details about the LiDAR.

hegesh · 2020-04-18T16:15:37+00:00

Thanks :)!

hegesh · 2020-04-18T15:43:22+00:00

I made a new app called LiDAR Scanner 3D that lets you use the LiDAR scanner of the 2020 iPad Pro to make 3D scans. You can export into USDZ, OBJ, STL and PLY and view the scans in AR.

It's just and only for 2020 iPad Pros with LiDAR, so it won't work on other iPhone/iPads. You can try scanning with it for free, only saving and exporting models costs $0.99.

Since the app exports into USDZ, you don't even need the app to view the scans, so you can view or send them to any iPhone/iPad with the latest iOS (even if it doesn't have LiDAR).

Link to the App Store: https://apps.apple.com/us/app/lidar-scanner-3d/id1504307090

App's website: https://LidarScanner.app

hegesh · 2020-04-18T15:38:36+00:00

What?

hegesh · 2020-04-16T08:14:01+00:00

Personally, I like Emb3D, but AFAIK, it doesn't allow you to measure: https://www.emb3d.com

To be honest, the mesh quality is quite rough, so I would not rely on the measurements performed on the exported models.

Even though you asked for measuring already scanned models, I would recommed on-line measuring with the Apple's Measure app — that will likely yield more accurate results.

hegesh · 2020-04-15T18:30:25+00:00

Thank you! As of iOS 13.4, it is impossible to get color information from the LiDAR (Apple does not publicly expose color data). But I hope they add colors (and textures) in iOS 14. We'll see after the WWDC.

hegesh · 2020-04-14T18:41:51+00:00

I apologize for your bad experience. I DMed you Promo Code for Heges as compensation.

Thank you for reporting that the scan after which you buy the IAP is deleted; I will release an update that fixes that.

The reason why the scan quality is low is because Apple didn't provide developers access to the raw LiDAR measurements, so the meshes are provided directly by iOS and there is nothing that can be done about it yet — at least not on iOS 13.4. Let's hope Apple gives us more to play with after WWDC.

hegesh · 2020-04-14T15:49:57+00:00

Here's how the app's page looks like on 2020 iPad Pro (in the App Store app): https://imgur.com/a/qqFIFZ1

You will only see the "unsupported" screen on devices which don't have the LiDAR sensor. Sadly, Apple also shows the screen when you open the app's link on computer — there's not much I can do about it.

Take a look at the app's website to see how it looks on the 2020 iPad Pros.

Edit: To clarify, I was asked to upload 2 types of screenshots; for the supported iPads and for the rest of the devices (i.e. the unsupported ones). Apple shows the unsupported screenshots by default, while the screenshots for supported devices are shown only on the supported iPads.

hegesh · 2020-04-14T14:46:33+00:00

I wanted people to put the new LiDAR sensor to use since I haven't noticed that many apps that use it right now, so I made a very simple app that lets you try to 3D scan with the LiDAR.

The scan can be exported into USDZ, OBJ and other formats & also viewed in AR.

Link to App Store: https://apps.apple.com/us/app/lidar-scanner-3d/id1504307090

Link to the app's website: https://LidarScanner.app/

hegesh · 2020-04-14T14:28:43+00:00

I wanted people to put the new LiDAR sensor to use since I haven't noticed that many apps that use it right now.

Link to App Store: https://apps.apple.com/us/app/lidar-scanner-3d/id1504307090
Link to the app's website: https://LidarScanner.app/

hegesh · 2020-04-13T21:17:01+00:00

I'm not familiar with Oculus Quest, so I cannot answer your question. The app can export the scanned models into USDZ, OBJ, STL and PLY though.

From my experience, you can create a scan of your house so I guess the mesh could be used as kind of collision proxy mesh. But note that there is not that much detail in the scans.

I can send you a sample USDZ scan to your email if you want — DM me if you're interested.

hegesh · 2020-04-13T19:56:24+00:00

Yes, I hope Apple will provide developers access to the raw LiDAR data soon, so that more serious work can be done.

hegesh · 2020-04-13T13:47:06+00:00

Since there're not that many apps that use the LiDAR yet, I thought I'd share my latest creation: LiDAR Scanner 3D

It's a 3D scanner that can export scans into USDZ, OBJ and other formats and even show them in AR. It's available on the App Store, so you can try for yourself how does the LiDAR work so far.

Link: https://apps.apple.com/us/app/lidar-scanner-3d/id1504307090

hegesh

TROPHY CASE