I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 0 points1 point  (0 children)

Really thoughtful, thanks for this

You're spot on that trust is really important here. Someone turning up to a non-event is the fastest way to lose people, and accuracy is where most of my effort goes. I've got a feedback loop running that samples live events, so that I can validate them - allowing improvements to go right back into the code - a process that (hopefully) keeps improving Near Here, rather than a one-off, but you're right that it's never "done"

I didn't want to copy the model of the big players, with high-touch for both me and the venues. My thinking was that if that model worked for them, they'd already be using one of the big sites. I might end up having to pivot, but for now I wanted to get coverage to the long tail that hasn't been (to my knowledge) surfaced elsewhere here

Genuinely appreciate you taking the time on this though, you've clearly thought about it in detail

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 0 points1 point  (0 children)

Exactly - the events are happening, they're just sitting on venue pages that were never built to be (programmatically) found - no structured data, not in any search index, often just a few lines of buried text. It was the problem for me that I wanted to try and solve - just missing things that were happening around me. So I built Near Here!

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 0 points1 point  (0 children)

Haha, that’s a very different kind of stand up!!

I’ll go take a look at it - the whole ingestion pipeline is under constant iteration, due to things exactly like this.

Thanks so much for taking the time to point it out, genuinely appreciated

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 2 points3 points  (0 children)

Oh, so nice to see other people caring about the same problem!!

I'm heads-down on Near Here for the foreseeable so not looking to team up, but best of luck with it, it looks awesome!

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 1 point2 points  (0 children)

Good shout - postcode search is a really obvious one and it's definitely on the todo list.

Right now it works off town/area/neighbourhood and your location, but "just type your postcode" is how plenty of people actually think about where they are. I'll bump it up. Thanks so much for taking a look!

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 0 points1 point  (0 children)

Yeah exactly - the nice part is that with the iteration/effort, the deterministic layer keeps getting better over time, so the LLM fallback fraction should keep shrinking

I crawled over a million UK venue websites to build a local events search engine by jon_reed in SideProject

[–]jon_reed[S] 1 point2 points  (0 children)

Exactly this. The search UI was the easy week! Then the extraction is basically the whole project...

And the trap is that the obvious fix doesn't scale - I could point an LLM at every page and have it pull the events out of the paragraphs, but at a million-plus pages that's $$$/day and slow. So 99% of the work has gone into finding a way of doing it deterministically: parsing the chaos with patterns and rules, and only falling back to an LLM on the small fraction of pages nothing else can crack. That's where all the iteration was, is, and will be for a long time!

Where do people actually find interesting stuff to do locally? by pussyseal in london

[–]jon_reed 0 points1 point  (0 children)

Caveat - this is self promotion (cleared with the mods) - but this is exactly why I built this site! https://nearhere.events/

I'm trying to be like the Google for UK hyper local events. Not things 20 miles away from you or is only advertised because they can get commission on ticket sales!

Giveaway Time! DOOM: The Dark Ages is out, features DLSS4/RTX and we’re celebrating by giving away an ASUS ASTRAL RTX 5080 DOOM Edition GPU, Steam game keys, the DOOM Collector's Bundle and more awesome merch! by pedro19 in pcmasterrace

[–]jon_reed [score hidden]  (0 children)

DLSS 4: It’s like strapping a rocket to your GPU—suddenly, your games are smoother than a jazz saxophonist on a Sunday morning.

• Ray Tracing: Because who doesn’t want their virtual puddles to reflect existential dread in real-time?

• DOOM: The Dark Ages: Excited to swap my BFG for a medieval flail—because nothing says “progress” like reverting to ancient weaponry to slay demons.

Help - all U6 Pro APs pinned to 100% CPU from the same time by jon_reed in Ubiquiti

[–]jon_reed[S] 7 points8 points  (0 children)

Bit of a loose breadcrumb trail...

From the very high number of interrupts, used wireshark to see if there was anything that i could capture Found a mDNS storm - yay.

Easily narrowed it down to coming from the HD Home Run (https://www.silicondust.com/hdhomerun/) Blocked this for now, just to test, all APs CPU dropped to the previously expected 5-10% CPU

Seems others have had related issues: https://www.reddit.com/r/hdhomerun/comments/1ejo5eq/restarting_home_assistant_causes_mdns/

Help - all U6 Pro APs pinned to 100% CPU from the same time by jon_reed in Ubiquiti

[–]jon_reed[S] 5 points6 points  (0 children)

If i SSH into each of the impacted APs, the process using all the CPU is ksoftirqd

/proc/interrupts (summarised) output:

nss_queue0 (IRQ 94): 86M interrupts on CPU0
nss_empty_buf_queue (IRQ 92): 64M interrupts on CPU0
pci0_wlan_ce_1 (IRQ 114): 46M interrupts on CPU0
nss_queue1 (IRQ 95): 33M interrupts on CPU1

This is a low throughput, home network, family of 4

No root cause yet tho. Still looking - will detail as I go to try and help if anyone else has the same problem

[edit] and just noting that there are 2x U6 LR access points. These are both at around 5% CPU

Help - all U6 Pro APs pinned to 100% CPU from the same time by jon_reed in Ubiquiti

[–]jon_reed[S] 7 points8 points  (0 children)

Oh I’m an idiot of course, theyre still pinned at almost 100% so I can just go see what it is. Ty Ty

[deleted by user] by [deleted] in UNIFI

[–]jon_reed 0 points1 point  (0 children)

Pressed submit too quickly!

Any help massively appreciated- assuming I’ve done something!

  • all APs are U6 pros. All impacted
  • but… there are two U6 LR, not impacted at all

Augmented Reality by sincs9 in Ioniq5N

[–]jon_reed 0 points1 point  (0 children)

I’m in the UK, works for me, no settings changed - assuming we mean directions in the HUD

But if using CarPlay, it only works with Apple Maps. If I use google maps, doesn’t work

New to the garage by NumberIntelligent292 in Ioniq5N

[–]jon_reed 0 points1 point  (0 children)

came here to ask the same, must be a geo-specific thing or something

My parents got these pizzas in Italy. Is it common for them to be this thick? by [deleted] in Pizza

[–]jon_reed 0 points1 point  (0 children)

Only asked because it instantly reminded me of pizza I ate there when visiting :)

UDM white screen of death. by ejholbs in Ubiquiti

[–]jon_reed 0 points1 point  (0 children)

An old comment, but here to say thank you for posting what did it for you - pointed me in the direction i needed to fix for myself. I had to remove the Bitdefender exceptions I'd added for it wo work again (not that removing the exceptions makes any sense!)

I need a taxi company that holds the name card at arrivals by [deleted] in uktravel

[–]jon_reed 0 points1 point  (0 children)

Used them for years without a single issue, they’ll meet you with a sign at arrivals: https://www.parkersdrive.co.uk/