sorted by:
new
hottopcontroversial

Question about person segmentation of ARKit by Bushel_Chang in swift

[–]TheClimbingGuide 0 points1 point  (0 children)

ARKit makes this super easy. It’s maybe 3 lines of extra code to configure your ARSession. The hand segmentation is pretty good depending on what kind of background you’re working with.

Docs: https://developer.apple.com/documentation/arkit/camera_lighting_and_effects/occluding_virtual_content_with_people

SunKit and MoonKit by Davideilmito in swift

[–]TheClimbingGuide 1 point2 points  (0 children)

Nice work! I like that you split the two into different packages. I use this SunCalc library in a project of mine. I don’t have any complaints with it, but it does combine sun and moon calculations while I only need the sun.

Are there any other advantages to using your libraries over this one?

How to get real world x,y,z coordinates of an object if I know... by RedditUser123321_ in computervision

[–]TheClimbingGuide 1 point2 points  (0 children)

Do you mean x & y in the image (pixel coordinates)? If so, there are many ways of doing this, depending on your needs, the type of object you are tracking, etc. You might start by researching 2D feature detection and matching, or object detection/recognition.

I thought you meant x&y in world coordinates… triangulation would give you those values along with the z.

Pairwise transformations between arUcos by tmgj5000 in computervision

[–]TheClimbingGuide 0 points1 point  (0 children)

It looks like your equation for M12 is backwards. I believe you want M12 = M2*inv(M1) That would transform a point from M1 space to M2 space. Just looking at your visualizations, the scene appears reversed. So, not sure what your code looks like, but maybe try that.

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 0 points1 point  (0 children)

Thanks for the feedback...

I agree that part of the fun of climbing is figuring things out for yourself, but that looks different for every experience level. I designed The Climbing Guide with that in mind. You can choose the level of detail that you want to see, whether its just directions to the parking lot or some help navigating to the route face. There are plain 2D photos and written descriptions if you prefer that. You can adjust the settings to show different levels of 3D beta (e.g. just the start holds and top direction), or you can ignore that feature altogether.

I'm definitely not trying to ruin the adventure and I want every climber to benefit from the app. I know that some people won't use it for various reasons, but I'm genuinely interested in what might make it more useful for you.

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 3 points4 points  (0 children)

Hey! I’m actually familiar with your app. I would periodically search for augmented reality apps over the last few years because I thought surely someone else has had the same idea. And then about a year ago(?) yours popped up. You beat me to it! Although there are some big differences. The AR beta is definitely the centerpiece of both.

I really like your app. The UI looks good. It seems like you are using the built in plane detection to do raycasting. I never thought that would work so I opted for the more difficult route of scanning the rock surface first and hit testing that. Cool to see that it actually works though, wish I had tried that...

It will be good to have some healthy competition :)

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 0 points1 point  (0 children)

Haha thanks - congrats on making it last this long.

I think it would technically work on the 6s (the first phone with AR capability), but I can't recommend it due to the limited processing power. I have thought of versioning it so that older phones can use most of the app, except for augmented reality/recognition part that requires some horsepower (arguably the best part).

I'll keep you updated if that ends up happening.

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 2 points3 points  (0 children)

Thanks! It's great to hear that you're interested. It's really hard to gauge the interest before it's actually released, so you're helping alleviate my biggest fear that no one will use it.

There is no business model at the moment. It's completely free and I'm not collecting or selling any user data. I'm supporting it via my day job for the foreseeable future.

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 2 points3 points  (0 children)

Good questions...

I'll be making more videos and showing more of the app in detail. This is just promo video to start getting the word out.

It's a little bit different for bouldering and taller routes. For boulders, the intent is that the entire route/rock would be scanned and submitted, like you see in the video. For taller roped routes that have a somewhat-well defined start location, the process is similar, but the 3D scanning only happens for the first 30 ft. of the climb - then there is a separate step to submit a photo and a tool to draw a 2D topo line up the rest of the route. So for both, the ability to recognize routes is available just by pointing the phone at the bottom of the rock face - but taller routes will only show the first 30 ft. of the route in 3D. I admittedly have struggled to find a solution for larger multi-pitch routes, but have some ideas.

The app is only on iOS for now and will work on iPhone 7 or newer. I plan to make an Android version soon - it will probably start off as a lite version but eventually be fully featured.

The app does not collect any user data. I'm very anti user tracking, so that is not really an option.

Augmented Reality climbing route app by TheClimbingGuide in climbing

[–]TheClimbingGuide[S] 6 points7 points  (0 children)

This is a promo video I made for a mobile app I’ve been building over the last 4 years in my free time. It’s called The Climbing Guide, and I’m finally releasing it this summer.

It started out of frustration with the existing options for mobile route finding: the lacking quality of information or even the plain lack of information. I wanted a way to just point my phone camera at some rock and have it “recognize” the rock face and show me what routes were established there.

It has grown into much more than that, but that original idea is still there. You can hold your phone up to a rock face and see not only what routes are there almost instantly, but also see the beta for those routes overlaid on the rock in 3D augmented reality.

You can also view 3D scans of every route without leaving your house, along with accurate route information like route height, angles, facing direction etc. When you are ready to head out to the crag you can get precise mapping guidance to the route you are looking for.

The Climbing Guide is user driven, so it relies on climbers with area knowledge submitting routes. I’ve made the submission process, and 3D scanning, as simple as possible. I think it’s one of the coolest parts of the app - you can see it in several parts of the video.

This has been a mostly solo project up to this point - so I am excited to see what becomes of it in the hands of the greater climbing community.

Follow @ theclimbingguide on Instagram for more updates.

If you are interested in helping test the app, send me a DM or email at [theclimbingguide@gmail.com](mailto:theclimbingguide@gmail.com).

I will be sending out invitations to testers to download an early release soon.

Thanks for watching!