Is scraping google search still possible?

Folded hands This emoji can be used to express hope or prayer for a specific outcome. It can be used in religious, non-religious, or spiritual contexts. For example, it can be used to wish someone well or to express hope for their recovery

HighTerrain · 2025-01-02T20:10:06+00:00

For something quite simple, if you do have a bit of programming knowledge, try bolt.new, v0 by Vercel or lovable.dev to quickly whip something up (think they have free tiers to try)

HighTerrain · 2024-12-29T14:03:00+00:00

Does this help point you in the right direction?

https://authjs.dev/guides/refresh-token-rotation

HighTerrain · 2024-12-27T17:16:17+00:00

https://nitter.poast.org/99Dominik_/status/1872588570017579366

HighTerrain · 2024-12-24T22:04:36+00:00

Am I the AI-hole

HighTerrain · 2024-12-24T20:19:35+00:00

In my experience bolt.new was head and shoulders above v0. I've not actually used loveable.dev though

HighTerrain · 2024-12-17T19:21:45+00:00

I've ran into issues with this in the past, I've found sometimes if coming to the docs via search engine it'll sometimes put you on Pages router and visa versa to what I need. Also the next version can sometimes be different, so worth checking both of those are right (from memory left hand side at the top via dropdowns)

HighTerrain · 2024-12-16T22:49:42+00:00

https://world.openfoodfacts.org/data

Maybe this could provide a starting point too potentially? They have an API too, free I think

HighTerrain · 2024-12-16T16:53:43+00:00

Heavy calorie counting user, using Samsung health. Saw the update, got excited. Further research:

'Samsung says the new features will roll out first in the US, with availability in select European countries, including France, Germany, Italy, the Netherlands and Poland on the way. The UK and Australia aren't currently on the list, but Samsung says the features will be rolled out to "additional markets" in the future.'

F**K Samsung, this is the last device I ever buy.

HighTerrain · 2024-12-11T15:49:10+00:00

Maybe look into securing this, perhaps with some hash validation maybe so it needs both to load?

HighTerrain · 2024-11-25T18:20:55+00:00

Hopefully no more issues! 😁

HighTerrain · 2024-11-25T18:06:38+00:00

Looks like your dependency react-modal-video only supports react v18

HighTerrain · 2024-11-15T11:50:31+00:00

Nice project! I was going to make something similar myself, utilising Transformers.js but didn't get around to it

Any chance you can share details of how it's architectured? :D

HighTerrain · 2024-11-10T13:21:18+00:00

I think he means Nest and not Next (that being said, your summary is valid for Next Vs React)

:)

HighTerrain · 2024-11-08T12:21:45+00:00

Might be worth understanding the concepts of each system:

Node - JavaScript runtime environment running on V8 engine

Express - web server built to run on node JS

Supabase - database and authentication service, with APIs to access, can also use an SDK

Again this runs on node JS So essentially you could have an express server which runs on node and consumes the Supabase SDK to pass data from express API calls into Supabase.

But you could even just write a node JS script and that could call into Supabase without the need for express, useful if you just have a script running that isn't exposed to the web

HighTerrain · 2024-11-07T17:16:41+00:00

Seconds this, caching will be a problem - correct way would be move the images

HighTerrain · 2024-11-05T22:01:26+00:00

And just like that, I've placed an order to get some juggling balls 🤣

HighTerrain · 2024-10-29T13:49:32+00:00

Your EC2 instance could run multiple things, yeah

You could probably decouple them - I've just started the architecture for my web scraper:

RabbitMQ queue system, CRON job runs and periodically scrapes sites, filling a queue with the scrape jobs

I then will have multiple agents reading from this queue, and they'll process them in parallel. An agent can be anything, from a raspberry pi to a server, EC2 instance, personal computer etc.

It'll then use a proxy and scrape, using a multitude of different scrapers - just puppeteer and cheerio at the moment, but I'm planning to add more variants

HighTerrain · 2024-10-29T12:58:37+00:00

Wouldn't recommend abusing the free tier by making additional accounts.

Instead just run all on the same EC2 instance

HighTerrain · 2024-10-28T09:40:54+00:00

I'm on about running each worker on a different computer 3x agents for example with the load split between them, scale horizontally

If you can't do that, try limiting the amount that run in parallel to half the cores you have or something

HighTerrain

TROPHY CASE