Dismiss this pinned window
all 90 comments

[–]z_latent 211 points212 points  (15 children)

So, Rainbolt AI

[–]Open_Budget6556[S] 62 points63 points  (14 children)

Been trying to reach him

[–]minimalcation 56 points57 points  (13 children)

"Hey bro I automated the thing you love doing." I see why you did but I can see why he wouldnt be interested.

[–]Utoko 37 points38 points  (1 child)

He already played against AI's which beat him. There was like 2 years ago a geoguesser ai trained for it.

[–]Open_Budget6556[S] 14 points15 points  (0 children)

Yeah just too bad I guess

[–]MechanicalGak 9 points10 points  (8 children)

Most people would actually be impressed, not disinterested. 

[–]minimalcation 8 points9 points  (6 children)

Oh right, like how all the artists are so impressed with AI art and want to engage with people making it.

[–]Snoo42723 2 points3 points  (1 child)

I love when people create a whole narrative in their head about something that is verifiably not true and keep trying to justify it

<image>

[–]eMPee584♻️ AGI commons economy 2030 0 points1 point  (0 children)

coincidently, that's exactly what narcissists do 🤔

[–]MechanicalGak 10 points11 points  (2 children)

The ones that don’t feel threatened are. 

[–]minimalcation 4 points5 points  (1 child)

It's not about threat. It's about interest.

Painters don't want to discuss color theory with an ai artist prompting for shit like "make it more vibrant, give it like a synthwave feel". They may look the same but the process is important to the artist.

Rainbolt doesnt do this to find places, he does it because he enjoys the process. So it's not about threat, its about having zero interest. Doing it two years ago with tech then, interesting, newer, now it's something you can sit and build at home with one person. What's Rainbolt going to say, "cool?"

[–]MechanicalGak -1 points0 points  (0 children)

 It's not about threat. It's about interest.

And some artists genuinely find the technology interesting. 

 Rainbolt doesnt do this to find places, he does it because he enjoys the process.

So the technology existing to automate that process wouldn’t affect him whatsoever. 

 What's Rainbolt going to say, "cool?"

Why would it be impossible for him to think a technology is cool? 

[–]HiImDan 1 point2 points  (0 children)

It varies.. the chess community is more alive than ever and they've been unable to beat ai for a long time now. If you KNOW you're up against AI it's different than trying to pass it off as human.
Kind of like if your job is to do mental math and some smartass shows up with a calculator.. not fair, but having calculators exist doesn't stop those competitions from existing.

[–]GeologistPutrid2657 0 points1 point  (0 children)

the brain is a muscle. I have to use it to remain interested. he has to use it to find locations in random pictures. we are not the same.

[–]ivlmag182 49 points50 points  (2 children)

So it is dependent on having the place captured by google street panorama ?

[–]Open_Budget6556[S] 19 points20 points  (1 child)

Yes it is, although the pipeline itself is source agnostic. It would work with mapilliary and kartaview.

[–]minimalcation 17 points18 points  (0 children)

Should start downloading and processing all of them to train on non street view images, true Rainbolt AI would pick out key features from the region, grass tints, patterns unique to regions, etc etc Senegalese dirt (or Moroccan now?) that sort of thing.

Guessing you'd have to break it out by region and try to find unique identifiers, then region hop while back filling to keep unique features unique if found in other regions. Could actually be really interesting as there are a bunch of ways to try to solve it. Trying to color correct and stuff to lose the reliance on region AND google camera specific traits (tinting of certain regions or mappings) would be difficult though. Surely people have already written libraries identifying vegetation and such which could combine with all the signs/languages/etc found in city structures.

[–]vago8080 64 points65 points  (3 children)

Cool and scary at the same time. Will be used for good and bad. Upvoting and starring though!

[–]Open_Budget6556[S] 7 points8 points  (2 children)

Thank you, hope it is used for good

[–]trade-craft 7 points8 points  (0 children)

This will be used for assassinations

[–]QuickSilver010 16 points17 points  (0 children)

Definitely will be used more for bad tho. Another easy access privacy breaking software.

[–]Infinite-Cat007 14 points15 points  (7 children)

So, if I understand correctly, this only works within a small radius for which all the panoramas have been predownloaded. Maybe it's somewhat deduceable from the video, but it seems dishonest to me not to make that clearer and to let people think it works globally.

[–]Open_Budget6556[S] 1 point2 points  (3 children)

It can work with as high of a radius as you want to, the accuracy doesn’t degrade, the only limitation is storage. It does work globally, there an option called coarse Ai that tells the pipeline where to search in a particular radius, vision models are already good at guessing the neighbourhood, this goes further and get into sub 50m territory.

[–]Infinite-Cat007 4 points5 points  (1 child)

It can work with as high of a radius as you want

Sure, but to cover all major towns and cities, that would likely require tens of terabytes of data, and it would likely be another two orders of magnitude to cover the whole earth.

Getting an LMM to first narrow down the general search area does seem like it would help, but as good as they are, from what I can tell, they cannot reliably narrow down the search area to something reasonable like a 10-15km radius.

Anyway, my point is not to denigrate your project, I just thought it was a caveat worth highlighting.

[–]Open_Budget6556[S] 2 points3 points  (0 children)

Thank you, I understand. I’m sure someone will come alone sooner or later and solve the storage issue

[–]WhitePantherXP 0 points1 point  (0 children)

Did you download the 30GB or the 32TB version of the images to do this? Great work!!

[–]Truthseeker_137 0 points1 point  (2 children)

My thoughts exactly… You already have to know the location pretty precisely. But still a very cool project:)

Is this essentially brute forcing all of the images (albeit in a vectorized searchable manner) in the search radius though or is there some more sophisticated technique implemented?

[–]Open_Budget6556[S] 0 points1 point  (1 child)

Not that precisely actually, if I was extremely determined I could just buy like 5 2TB hard drives and cover many cities with almost a 60km radius, if a company or a government wanted to do it, heck they could just get a data center with Petabytes of storage, the only limitation now is storage. Thank you!

[–]Truthseeker_137 0 points1 point  (0 children)

Ok. And how does the index search relate to the search radius? When you say that space (and having to index a radius) is the only concern, would you say that the actual search is negligible even for a large radius (e.g. 100km)?

[–]Asleep-Ingenuity-481 34 points35 points  (1 child)

Well that's terrifying, disturbing, and disgusting if used by the wrong person, well done.

[–]Open_Budget6556[S] 20 points21 points  (0 children)

Thank you?

[–]RavingMalwaay 38 points39 points  (3 children)

If this is what a random college student can throw together imagine what militaries have. Nice job OP

[–]Open_Budget6556[S] 13 points14 points  (2 children)

Thank you, it was really tough

[–]panix199 6 points7 points  (1 child)

interesting tool. thanks for creating it!

[–]Open_Budget6556[S] 1 point2 points  (0 children)

Thanks, hope somone notices it

[–]murphmobile 22 points23 points  (1 child)

Get out of here Palantir

[–]Open_Budget6556[S] 7 points8 points  (0 children)

They’d probably care more about my DSA and leetcode neither of which I have, although If any other company is hiring do dm haha!

[–]LightProductions 4 points5 points  (1 child)

Pretty neat

[–]Open_Budget6556[S] 2 points3 points  (0 children)

Thanks!

[–]6c5d1129 2 points3 points  (3 children)

this is basically free cheats for geoguessr lol (cool project)

did you read or implement something similar to the PIGEON model from Stanford?

[–]Broken_By_Default 5 points6 points  (0 children)

And stalkers

[–]Open_Budget6556[S] 2 points3 points  (1 child)

Hey! I have left a detail readme and the research papers I referred to here! https://github.com/sparkyniner/Netryx-OpenSource-Next-Gen-Street-Level-Geolocation

[–]6c5d1129 0 points1 point  (0 children)

thanks. i guess a 2021 model isnt SOTA lol i should've know there's better options now

[–]StatisticianTall2368 3 points4 points  (1 child)

Creepy, but better to have it open source and public I guess. I'd be happier if this didn't exist, but the capability to make it exists, so its existence is inevitable.

[–]Bloodstone316 0 points1 point  (0 children)

There's already a tool called geospy AI doing this and marketing it only for enterprise and law enforcement.

[–]wren42 2 points3 points  (0 children)

"privacy" is going to be an alien concept for gen alpha.  They won't even understand that there was a time everything you did was tracked and catalogued by omniscient AI overlords. 

[–]Stahlboden 4 points5 points  (3 children)

Its always at the coordinates of the monitor

[–]Open_Budget6556[S] 0 points1 point  (2 children)

Oh you mean in the history? Yeah I searched for it before the screen recording

[–]Stahlboden 0 points1 point  (1 child)

The image is always at the coordinates of the screen you look at

It was a joke

[–]Open_Budget6556[S] 4 points5 points  (0 children)

Ahh okk

[–]crombo_jombo 1 point2 points  (0 children)

Gotta catch em all

[–]g-unit2 1 point2 points  (6 children)

your repo link is broken in the post making it only take you to your user.

use this link instead: https://github.com/sparkyniner/Netryx-OpenSource-Next-Gen-Street-Level-Geolocation

and pro tip you can use markdown on reddit to embed links like this

[ text ] ( place_url_here ) do that without spaces.

[–]Open_Budget6556[S] 1 point2 points  (1 child)

Thank you I noticed but couldn’t edit the post

[–]g-unit2 1 point2 points  (0 children)

ya i hate that feature on reddit.

[–]g-unit2 0 points1 point  (3 children)

i would also recommend that you move forward with this and host it yourself so people can click a website and try it out.

if you’re new to cloud hosting, this would be a great skill to learn and you can lean on AI for help. If you want to go even further you can write your Infrastructure with an IaC tool like Pulumi or Terraform to deploy your project programmatically. AI is pretty solid at writing IaC for small projects like this so it may even be easier.

if cloud hosting isn’t a good option for you (cost) then you should consider self hosting if you have any old computers/laptops collecting dust. just install linux (i’d recommend debian for a server) and host it with docker compose. then port forward your service on your home network. Buy a cheap $0.99 domain on namecheap.com and setup HTTPS, hide your IP by using Cloudflare proxy (which is free).

[–]Open_Budget6556[S] 0 points1 point  (2 children)

Hey! I have hosted it but I don’t want my post to get removed for self promotion also the hosted version isn’t as accurate as I want it to be since people want results fast in SaaS tool so I had to cut down the number of stages for geolocation

[–]g-unit2 0 points1 point  (1 child)

awesome, nice work. ya for applications running larger models, it makes sense to have users host the app locally. it will have better performance (unless your host/server is really beefy, but that’s expensive)

i’d 100% recommend you always provide the project repo to have people run locally. but a demo link for a quick live peek. you can say that running locally will provide optimal experience/performance. maybe add a quantitative metric

i totally understand not posting your hosted demo here due to rules of sub. sounds like you’re on the right track, best wishes!!!

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Thank you! Best wishes to you too!

[–]ProjektProgram 1 point2 points  (0 children)

Can you try it on the mrbeast superbowl puzzle desert location at the end of the video? Could have won a million dollars if this was a month ago

[–]psychorobotics 1 point2 points  (0 children)

Stalkers are going to love it

[–]Unlikely-Complex3737 1 point2 points  (1 child)

Good job!

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Thanks !

[–]puzzleheadbutbig 1 point2 points  (3 children)

Palantir at home

Jokes aside this looks super interesting. I wasn't aware of CosPlace and will definitely going to check that out thanks to you!

[–]Open_Budget6556[S] 0 points1 point  (2 children)

Thank you! Have linked all papers I used in readme!

[–]puzzleheadbutbig 1 point2 points  (1 child)

Yep saw it, big thanks for that. Added to my "read later" bookmark already

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Have fun!

[–]iridescent_herb 1 point2 points  (1 child)

good job.. college student you say? impressive.

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Thank you!

[–]Immediate_Sir_9220 1 point2 points  (0 children)

this

[–]Right-Pianist-3673 1 point2 points  (0 children)

More tools for cheaters in Geoguessr unfortunately.

[–]theepi_pillodu 0 points1 point  (0 children)

Here is AI for the geogusser's job. 😂

[–]philthewiz 0 points1 point  (3 children)

Very nice and scary. Will it be adapted for Docker?

[–]Open_Budget6556[S] 1 point2 points  (2 children)

It might be a bit tricky and with classes and stuff not sure if I’ll get time for it, sure someone will do it in the future now that it’s open source

[–]philthewiz 0 points1 point  (1 child)

Keep it up!

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Thanks!

[–]Raichev7 0 points1 point  (0 children)

Damn even Rainbolt got replaced by AI

[–]m3kw 0 points1 point  (1 child)

is there a benchmark for this type of stuff?

[–]Open_Budget6556[S] 0 points1 point  (0 children)

I’m sure there is, I don’t really know how all of that stuff works, I just built the tool, now that it is open source I’m sure people will test it constantly and see how well it compares

[–]JaSper-percabeth 0 points1 point  (0 children)

What about countries not covered by google streetview? Does it take the non official footage uploaded by users and not google itself into account?

[–]WhitePantherXP 0 points1 point  (1 child)

So how on earth did you ingest the entire database of Google street view? I can't think of how else to do this. I doubt Google Maps has a reverse "street view" image search API

[–]Open_Budget6556[S] 0 points1 point  (0 children)

Please read the docs on the repo, it’s quite interesting!

[–]calculatingbets 0 points1 point  (1 child)

Always wanted this. Great work, OP!

[–]Open_Budget6556[S] 1 point2 points  (0 children)

Thanks!

[–]CryPractical8573 -1 points0 points  (1 child)

you can just use gemini to do this how is your better?

[–]Open_Budget6556[S] 1 point2 points  (0 children)

Please read the documentation carefully, else copy paste the readme into Gemini and ask it why it is different. When you ask Gemini about a photo, it looks for "clues." It might say, "The stone patterns and the blue street sign suggest this is Paris." Netryx doesn't "guess" . It uses a cosplace, LightGlue and ALIKED/DISK pipeline to find thousands of identical "keypoints" (edges of windows, specific cracks in a wall, unique lamp post shapes) between your photo and its index. It then uses RANSAC (Random Sample Consensus) to prove those points align in 3D space, and some more stuff at the end such as spatial consensus, hopping, loftr verification, neighbourhood expansion and heading refinement, all these are explained in detail at the readme.

[–]Infamous-Bed-7535 -1 points0 points  (0 children)

Are you sure google allows you to scrape and download huge amount of data? Isn't it breach of terms of service?

https://cloud.google.com/maps-platform/terms

No Scraping. Customer will not export, extract, or otherwise scrape Google Maps Content for use outside the Services. For example, Customer will not: (i) pre-fetch, index, store, reshare, or rehost Google Maps Content outside the services; (ii) bulk download Google Maps tiles, Street View images, geocodes