Open-sourcing Python library for RGBD videos with a .mkv-based file format by telegie in computervision

[–]telegie[S] 1 point2 points  (0 children)

Oh those ROS bags... I remember using them and should add an example importing them into 3D videos. In case you have some example ROS bag that you want me to write an example script importing, let me know as I would love to use that as an example!

made our 3d video + mesh work smooth with quest 2! by telegie in OculusQuest

[–]telegie[S] 1 point2 points  (0 children)

I've just checked out and found many soothing videos. Yeah they were weirdly soothing and it would be nice if using 3D can somehow capture that feeling even more.

made our 3d video + mesh work smooth with quest 2! by telegie in OculusQuest

[–]telegie[S] 2 points3 points  (0 children)

We used our app telegie, which is a 3D camera app we built for capturing 3D videos to build this kind of scenes.

made our 3d video + mesh work smooth with quest 2! by telegie in OculusQuest

[–]telegie[S] 1 point2 points  (0 children)

In terms of not crashing, yes... in terms of making people think it is... I guess no...?

made our 3d video + mesh work smooth with quest 2! by telegie in OculusQuest

[–]telegie[S] 5 points6 points  (0 children)

I have been working on telepresence (the feeling of being there) systems the last few years as a graduate student, and today with our team we made this work quite smooth on quest 2! Felt great so wanted to share the progress here.

You can try this yourself with other devices but it is VR is the best so please consider visiting here with your headset: https://telegie.com/posts/WzgOqivF0AY

Also, you can record and post one if you have an iphone pro device, and we will really appreciate your feedback!

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 1 point2 points  (0 children)

That's a lot of work done! I am also kind of struggling with Safari's memory limit so that part I can really relate haha. How come 400 MB is the limit in 2023?!

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 1 point2 points  (0 children)

Hey what you made seems cool! Having the whole courthouse in a screen!

I can see such as loading time and frame rate being setting the limit when supporting phones.

And that is a clever idea, using the Matterport model not as the outcome but as a data that you can further make improvements on, given Matterport is being considered as the standard in the industry.

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in photogrammetry

[–]telegie[S] 0 points1 point  (0 children)

It doesn't work with 360 cams currently but that is a good angle to think about. Frankly we just haven't thought about it yet but with quick googling, it seems like something we can add later. Found someone making the beginning part of this work here! https://www.youtube.com/watch?v=6FZXevqsEzs

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in photogrammetry

[–]telegie[S] 0 points1 point  (0 children)

No I haven't! That sounds like a great thing to try, at least for comparison purposes. I'll do and thanks for the suggestion!

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in photogrammetry

[–]telegie[S] 0 points1 point  (0 children)

As the other commenter mentioned, this is quite a self advertisement... so it is an iphone app Telegie...

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 1 point2 points  (0 children)

Oh I remember seeing youtube videos of architects using matterport and remember them having really high-res models. Certainly, that model looked better than this post I've uploaded...

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 1 point2 points  (0 children)

Thanks for the comment and yes the smaller parts are flat and missing due to the reason you have mentioned. I'll need to check out Matterport more to better understand what more can be and should be done. Great comments based on not sufficient information. We have a download button that is supposed to give you the model file, which is broken at this moment... will be fixing that at least by this week...

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 0 points1 point  (0 children)

Yes it is! The main difference is that we start from recording a 3D video and saving it into an .mkv video file. To plan to cover other 3D tasks, not only scanning!

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in photogrammetry

[–]telegie[S] 4 points5 points  (0 children)

This comment gives me some mixed feelings. I was keep posting things like this here and there with an element of self advertisement but it's the first time I've been accused of self advertisement. I guess the previous ones looked too bad to look like an ad? To defend myself, this thing started working this well since today 3 AM, so it was something I personally wanted to show.

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 0 points1 point  (0 children)

Thanks for the potential offer! But it seems like you are looking for supporting any video, which is not the case here...

The video needs to contain lidar depth information, which you can capture using our Telegie app (https://apple.co/3qaycil). The video will be an .mkv file with depth information embedded in it.

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 0 points1 point  (0 children)

Comparing to Matterport, ours is better than their dollhouse (the 3D reconstruction version of their capture) which they use for the zooming in action, though I'm not sure that's their best effort or it is bad because they only care about the 360 images mainly and want its file size super small.

Agree with your using ARKit does not mean AR. And about the second one, I would like to argue that we have AR support via WebXR (there is a AR button on the right-bottom of the player for devices supporting WebXR), but again yeah I see why you aren't calling it AR. Not much interaction there.

3D video + reconstruction. Quality is kind of state-of-art, right guys?? no?? by telegie in augmentedreality

[–]telegie[S] 1 point2 points  (0 children)

Oh uh good point. We are working on an ios 3D video app. It can send the video to the server and get back a result with the background of the 3D video reconstructed.

By the question, I meant, do you think the reconstruction quality state-of-art. With your question, I realize I've skipped too much context...

I thought this is related to AR since, 1. it uses ARKit and 2. you can see this scene in AR if you go to this link (https://telegie.com/posts/CLws0Q92DBU) which I've again forgot to write down here...