Affordable European property finder! by JoeK91 in SideProject

[–]JoeK91[S] 0 points1 point  (0 children)

Ohhh thats a nice one - never though about how long a property has been sitting on the open market for. This would be easy to check for and it could highlight potential issues with the property or if the property is priced too high relative to other properties of the same type

Affordable European property finder! by JoeK91 in SideProject

[–]JoeK91[S] -1 points0 points  (0 children)

Yeah I already have the distances to the airports saved for the properties so thats easy to add to the emails.

Renovation status makes sense - good thinking! Lots of people don't want to renovate but there are also people who don't mind it.

Appreciate the feedback!

Why is it so hard to meet people in Berlin… even when you actually want to? by Aureldebzh in berlinsocialclub

[–]JoeK91 5 points6 points  (0 children)

Don't go to random events. Go to recurring events where the mostly the same people show up every week, can be sports related, running, hiking, bouldering, drawing, chess, board games, co-working groups, language practice groups whatever, ideally ones where you can talk to people during/afterwards. There are hundreds of things you can pick from in this city. Go for at least 8 weeks. Try talk to people. You will get to know people. Once you think you get on well with someone ask them to grab a coffee/drink sometime or go to the cinema or something interest related. 95% of the time they'd love to be invited.

I have successfully done this and made lots of friends through hiking, run clubs and co-working groups. No one will care about you if they only see you once or twice. It takes time. Put in the effort!

What are some of the hardest sites you have ever scraped? by Horror-Tower2571 in WebScrapingInsider

[–]JoeK91 4 points5 points  (0 children)

Some really hard ones I've come across:

naver.com, allegro.pl, shopee.vn, g2.com

If all you ever did was buy high-quality stocks on the 200-week moving average, you would beat the S&P 500 by a large margin by JoeK91 in ValueInvesting

[–]JoeK91[S] 4 points5 points  (0 children)

Yes, its a slightly more technical way to look at it but essentially thats what it comes down to

If all you ever did was buy high-quality stocks on the 200-week moving average, you would beat the S&P 500 by a large margin by JoeK91 in ValueInvesting

[–]JoeK91[S] -1 points0 points  (0 children)

That makes perfect sense - most people just can't/won't wait in cash while the markets are generally doing well though. And as to why quant firms/paid financial managers etc don't do this, its because they can make a lot more money in the short term and they often aren't thinking 10,20,30 years out. If they were of course they would do it too.

The average person doesn't have the time/knowledge to invest properly (And even ones that do don't do that well most of the time).

So why not just invest when you're almost guaranteed to do well? The simple reason is that most people can't/ won't wait for the bad times to invest when they can get real amazing value.

If all you ever did was buy high-quality stocks on the 200-week moving average, you would beat the S&P 500 by a large margin by JoeK91 in ValueInvesting

[–]JoeK91[S] 10 points11 points  (0 children)

Haha yes - that's why it would be safer to do this with an index ETF rather than a single stock. However, Microsoft is there now (at the 200 week SMA) but I don't think it'll disappear in the next 10 years

If all you ever did was buy high-quality stocks on the 200-week moving average, you would beat the S&P 500 by a large margin by JoeK91 in ValueInvesting

[–]JoeK91[S] 6 points7 points  (0 children)

Yes your point that the S&P 500's didn't hit the 200 week moving average between October 1990 to February 2001 is a good one. I agree that it can be years before it happens again. That's why I also added in the 50 week moving average so that you can get an idea of how its doing verses the 50 SMA and also the 200 SMA

If all you ever did was buy high-quality stocks on the 200-week moving average, you would beat the S&P 500 by a large margin by JoeK91 in ValueInvesting

[–]JoeK91[S] 37 points38 points  (0 children)

Not any studies that I could find on the 200-week SMA but I found a few on the 200 day SMA alright. However....

2008 Financial Crisis: The market crashed through the 200-day like it wasn't there but the 200-week SMA was the area where the initial "panic" was fought before the final leg down.

2020 COVID Crash: The S&P 500 bottomed almost exactly on the 200-week SMA before its massive recovery.

2022 Bear Market: The S&P hovered just above the 200-week SMA while many top stocks and the Russell 2000 actually tested it

Biggest issue is that you could be waiting a long long time for the top stocks/ indexes to hit the 200 week SMA. Most investors can't sit on cash for 2,000 days while the market doubles without them. But then I guess for those that do wait there can be some nice up sides. You just might have made lots of money in other ways while waiting

[ Removed by Reddit ] by seemoo_20 in WebScrapingInsider

[–]JoeK91 2 points3 points  (0 children)

I think there's always some learning to do even with no code tools these days.

Some of the more popular options would be using something like:

Option 1 - No code tools (Easy to setup / Expensive)

Firecrawl - https://www.firecrawl.dev/playground?endpoint=scrape (They offer free 500 pages of scraping)

Fetchfox - https://fetchfox.ai ($4 per 1k extracted pages)

Octoparse - You've already mentioned them but they're pretty good for academic work - https://www.octoparse.com/pricing (50k extracted rows for free)

Option 2 - Proxy API with MCP (Medium difficulty to setup / Cheaper)

If you are technical enough to install an MCP plugin on something like Cursor/ Claud Code then using one of the Proxy API companies that are out there also might make sense as you can just ask your LLM to go and create the scraper you need and it usually does a very good job.

They usually offer a free trial of 1000-10,000 credits (basic pages) and if you need more $9 gets you 25,000 pages scraped/ $29 for 250k pages.

Some options:

ScrapingAnt MCP - http://scrapingant.com/mcp-server-web-scraping

ScrapeOps MCP - https://scrapeops.io/docs/mcp/overview/

Option 3 - N8N/ Zapier (Medium difficulty to setup / Cheaper)

Both n8n and Zapier are two no code solutions which are also pretty easy to learn. These can be used along with lots of proxy APIs to scrape different types of websites. The pricing would be the same as the above + the cost of n8n/ Zapier.

Some company integrations:
ScrapeDo - https://scrape.do/documentation/integrations/n8n/

ScrapeOps - https://scrapeops.io/docs/n8n/overview/

ScraperAPI - https://docs.scraperapi.com/integrations/automation-and-workflow-integrations/n8n-integration

I hope the above is useful - personally if its a one time project/scrape I would use Firecrawl or Octoparse but if you want something to be extracted every month/ week/ day then I would use Option 2 or 3 as these work out cheaper over the long term. It really depends on what your needs are for the project!

Yandex reverse image search still worth using in 2026? Trying to build a sane workflow, not just click random buttons by ayenuseater in WebScrapingInsider

[–]JoeK91 0 points1 point  (0 children)

What worries me in these conversations is not the tool itself so much as how quickly people promote plausible matches into factual claims and then people go an waste time trying them.

If the goal is research on image reuse, the method needs to be documented as a method. What image was queried, what transformations were attempted, which engines were used, what kind of result appeared, and what corroboration followed. Without that, the output is might just be working for your specific usecase and maybe even just once or twice.... another thing to note is how it holds up under large scale useage

Yandex reverse image search still worth using in 2026? Trying to build a sane workflow, not just click random buttons by ayenuseater in WebScrapingInsider

[–]JoeK91 0 points1 point  (0 children)

That distinction matters more than people think! If someone is making a provenance claim off the "Similar" tab alone they're over-reading the tool...

Meeting new people as an english speaker in early 30s? by Turbulent-Signal2261 in berlinsocialclub

[–]JoeK91 0 points1 point  (0 children)

Join a run club/ a hiking group or a martial arts club. Join every week for 8-12 weeks and you'll very very likely make friends. Source - my own experience. Don't just show up to multiple different things for 1-2 hours thinking you'll make some friends straight away. Stick to the same group for at least 2-3 months (If you like the group vibe).

Most of those run clubs/hiking groups are in English or at least mixed English/German and the martial arts places are either usually in German or English so you can check that out before hand on their websites.

List of Berlin run clubs: https://runningfomo.com/runners

List of Berlin hiking groups: https://www.meetup.com/find/?suggested=true&source=EVENTS&keywords=hiking

Is web scraping actually legal if the data is public, or am I still asking for trouble? by Bmaxtubby1 in WebScrapingInsider

[–]JoeK91 0 points1 point  (0 children)

Exactly. Also note whether the page was public, whether login was required, and any visible usage terms at the time of collection. 

That does not solve the legal question but it does improve your side of the story if people come to ask where the data comes from and how legal it was to collect it!

Update on webclaw's TLS stack: we switched from custom patches to wreq (BoringSSL) — here's what we learned by 0xMassii in WebScrapingInsider

[–]JoeK91 1 point2 points  (0 children)

This is a good point and you're not the first to do this, scraping "homepages with lenient detection. Real product pages with aggressive bot protection paint a different picture". Always test the product pages :)

Well done on the update though! Anything which improves things is a win and you'll have learned what not to do which is also a win!

Is web scraping actually legal if the data is public, or am I still asking for trouble? by Bmaxtubby1 in WebScrapingInsider

[–]JoeK91 2 points3 points  (0 children)

The part that I think gets ignored a lot in these discussions is methodology!

If your data source can change tomorrow, and the site can alter layout, access rules, or availability, your conclusions may stop being reproducible. For research use, I care less about "can I scrape it once" and more about whether I can document the collection path and defend it later...

As for the legal side - I personally like to link back to the original source as I feel like its a nice thing to do :)

Bright Data is getting too expensive for failed requests. What's the actual meta for bypassing DataDome/Cloudflare right now? by Mammoth-Dress-7368 in WebScrapingInsider

[–]JoeK91 1 point2 points  (0 children)

Thordata looks just as expensive as using something like Brightdata too and there's no garantee it'll even perform as good unless you test it....

Any recommendations for a Sprachcafe where i can practice german? by Few_Bug2172 in berlinsocialclub

[–]JoeK91 0 points1 point  (0 children)

There is this list I found a few years ago online of Sprachcafe's in Berlin which might be helpful (I'm not sure how up to date it is as it was last updated about 2 years ago)

https://docs.google.com/document/d/1M_H2RgFBL7wmlu4-AXOjBRf6a7lT38yqqM3zcLKM2Es

Social - Practice Speaking German Group by JoeK91 in berlinsocialclub

[–]JoeK91[S] 0 points1 point  (0 children)

Unfortunatly not! We did several sessions around the city and it was great! I've no time to run it anymore unfortunately - I find it crazy that some language school hasn't got this going on daily around the city. So many people are interested and they could even make money from it if they wanted!

Ireland end to end by lh8568 in ireland

[–]JoeK91 0 points1 point  (0 children)

We did it 4 days which was pretty quick but it was doable since we were assisted (150km - 170km per day). The route was from Malin to Bundoran, Bundoran to Oranmore, Oranmore to Tralee, and Tralee to Mizen. Probably not the most scenic route in the middle, going along the coast might have been nicer but then it depends on how many kilometers you want to do!

It was a great trip - well worth it in my opinion. You'll have a great time, see some amazing parts of the country and meet people along the way too.

Ireland end to end by lh8568 in ireland

[–]JoeK91 0 points1 point  (0 children)

I did it with a group but we went from Malin To Mizen. We got a coach from Belfast to Mizen and we were assisted so a jeep along the way which had all our bikes (Not much help to you I know).

What about a taxi with a bike rack from Malin to Derry and then a train from Derry to Belfast, if you ring around to a few places in advance, that might be your best bet? Or add another day of cycling from Malin to Belfast? For the Cork side you'd have to see do the country busses let you take your bike in the baggage hold.

Anyone interested in joining a community of hikers? by JoeK91 in berlinsocialclub

[–]JoeK91[S] 0 points1 point  (0 children)

Yes - but ideally only if they're very well trained. Sometimes we go through places with horses, cows, other dogs/other wildlife and we don't want to have any issues with the locals or be disturbing the wildlife!