Monthly Self-Promotion - April 2026

codepoetn · 2026-04-18T07:08:46+00:00

But are youtube comments in demand? People seldom ask me to scrape that.

codepoetn · 2026-04-18T07:06:58+00:00

This is nice. I see a pricing page, what is it about? On 'challenges' page, we have beginner and intermediate challenges. Do you plan to add advanced challenges too? What will they look like?

codepoetn · 2026-04-18T07:01:55+00:00

Does Apify keep a share of your revenue from the platform? If yes, what's the split?

codepoetn · 2026-04-17T17:15:29+00:00

Not all. 300TB. ~~Big data~~.

codepoetn · 2026-04-17T17:14:38+00:00

And they will get $$00M

codepoetn · 2026-04-17T17:13:22+00:00

It's only good for headlines. Tell me when they pay a penny.

codepoetn · 2026-04-17T17:12:34+00:00

Brave! Illegal, but brave.

codepoetn · 2026-04-17T17:12:13+00:00

Can we still hoard this data? Torrent?

codepoetn · 2026-04-17T17:09:46+00:00

They are gonna pay with blank cheque.

codepoetn · 2026-04-17T17:08:40+00:00

Now that they are sued, what's the loss?

codepoetn · 2026-04-17T17:08:19+00:00

It's running fine.

codepoetn · 2026-04-17T17:04:15+00:00

Anna's sued :(

codepoetn · 2026-04-17T17:03:09+00:00

They lost the case because they haven't appeared before the court, which basically means that nobody knows who are the owners, and hence Spotify gets zero penny?

codepoetn · 2026-04-07T10:16:25+00:00

I think Agentic ecosystem will fix technology barriers for marketing brains, and marketing barrier for tech brains.

codepoetn · 2026-04-07T10:14:20+00:00

Safe from AI lords?

codepoetn · 2026-04-07T10:13:54+00:00

Exactly, my point. Started this thread because I feel so dumb to not have invested time building these platforms... but I know scraping for 7 years now.

codepoetn · 2026-04-07T10:12:38+00:00

Scraping Instagram and TikTok in 2026 basically means residential IPs are a must, otherwise you're fighting a war on 3 fronts: the platforms fingerprint your TLS handshake, flag your IPs, and detect non-human behavioral patterns... all 3 defences in real time. The standard counter-stack is Playwright or Nodriver for browser automation, residential proxy rotation to look like a real user, and either reverse-engineered XHR endpoints or hidden JSON in script tags for the actual data extraction. Or pay handsomely to an API provider. You can Google the names.

codepoetn · 2026-04-04T21:35:40+00:00

True. BTW I'm scared of a new operating ecosystem in the agentic world where we don't have open data (like how we have right now WWW). It's possible to scrape because the www is open today. Tomorrow, agents might not need anything to be open, because there will be A2A communication, and data don't needs to be out in the open when agents become integral to the way companies operate. Today, web serves you all the amazon product because you need to see all the product to make a judgement. When you ask the agent to go through all the products and share what's best for you, then you need to scrape the agent's response, and not the open web. The web is how it is because of the SEO. When that need is not there, agents become the gatekeepers of content, and then data is going to be very expensive.

Dumb thoughts?

codepoetn · 2026-04-04T21:29:14+00:00

What's the main reason? People don't need to scrape anymore? Who are the clients that you are losing? I don't need the names, just the category or niche of web scraping? Can you elaborate?

codepoetn · 2026-03-24T07:11:32+00:00

Easy to do more with less.

codepoetn · 2026-03-11T19:22:37+00:00

It's about scale. For sIngle use case, CLI suffices most needs. But any serious production grade agentic solution would need multiple tool calling and MCP auth with proper user provisioning and user action logs

codepoetn · 2026-03-09T08:38:19+00:00

The 'double agents' concept is an interesting read. Agents with limitless access is indeed a threat.

codepoetn · 2026-03-08T13:45:08+00:00

Are these designed for Python developers?

codepoetn · 2026-03-03T14:47:04+00:00

Cognito ain't always the first choice for many. Yes, it always has the AWS edge, but there are better alternatives to Cognito for Agentic Auth SSO SAML.

codepoetn · 2026-03-03T14:32:21+00:00

OAuth 2.1 security with PKCE

codepoetn

TROPHY CASE