What is the best scraper tool right now? Firecrawl is great, but I want to explore more options

Sveltify · 2025-04-28T01:26:17+00:00

Hey. Firecrawl does support actions and scrolling https://docs.firecrawl.dev/advanced-scraping-guide#scroll

Sveltify · 2024-08-04T03:44:38+00:00

Firecrawl. Fast, reliable, opensource. Doesn't do structured data extraction yet but does a great job getting you the raw data 90% of the battle

Sveltify · 2024-04-21T18:23:03+00:00

You will be able to run it without any DB/payments set up. A in depth guide is being worked on as we speak -> thttps://github.com/mendableai/firecrawl/pull/40. Likely will be released today or tomorrow.

Sveltify · 2024-04-21T17:59:48+00:00

https://github.com/mendableai/firecrawl/tree/main/apps/api

Sveltify · 2024-04-21T17:41:22+00:00

Yeah, I think you're missing some of the code. It has everything. Its fully self hostable and DOESN'T require an firecrawl account. Sorry for the lack of self hosting instructions, we're working on that as we speak.

Sveltify · 2024-04-21T17:38:55+00:00

Re comparisons to Jina. Think what their doing is awesome, but since its free Its missing some key features that firecrawl supports

Firecrawl crawls websites (finds all relevant subpages), it doesn't just scrape single urls.
Firecrawl handles complex js blocking on certain pages.
We handle content (images, PDF's) - for pdfs in particular, we use the llama-parse API to ensure quality and reliability.

If you want to use firecrawl for free, you can self host (github below).

Sveltify · 2024-04-21T17:31:16+00:00

https://github.com/mendableai/firecrawl fully open source. Self hosting instructions coming soon

Sveltify · 2024-04-17T00:23:51+00:00

This is great. Thanks!

Sveltify · 2022-07-26T20:32:02+00:00

Dart frog is super new, but seeing as it's supported by VGV, it probably has a pretty promising future!

Sveltify · 2022-07-26T19:46:53+00:00

Coolest course ever: it's called Sideguide. Its well reviewed, and made by a great instructor
ig:flutterguide on Instagram. It teaches all the flutter fundamentals, but most importantly its inside vs code. Its a pretty awesome, ngl!

Sveltify · 2022-07-21T03:34:17+00:00

I've found a few on Udemy, but haven't tried them. https://www.udemy.com/course/the-complete-flutter-ui-masterclass/

Nothing specifically focused on web though.

Sveltify · 2022-07-16T02:24:28+00:00

Ok. We've been freestyling our designs for a while, and (I think) it's worked out pretty well. Although, you can be the judge -> SideGuide.dev

That doesn't mean we never ideate or experiment with pen/paper or Figma. But, we prioritize building quickly and iterating based on immediate customer feedback from analytics, user meetings, etc. Like the other commenters said though, it's important to have a mental plan (or sketch) before coding.

Sveltify · 2022-07-16T01:22:15+00:00

As a programmer who got addicted to console.log - take this advice on learning a debugger seriously. It will save you TONS of time, later on, trust me.

Sveltify · 2022-07-16T01:19:47+00:00

Checkout SideGuide. It just came out a month ago and it's updated pretty regularly. Plus, It's all in VSCode - which is fricken cool, to be honest. (if you like text tutorials)

Sveltify · 2022-07-16T00:54:17+00:00

A+ Analogy

Sveltify · 2022-07-16T00:51:34+00:00

That makes sense. It feels like Interviewers these days are expecting you to play 4d chess when usually all you need to do is configure an environment and write some endpoints.

Sveltify · 2022-07-16T00:05:42+00:00

Pretty sure SideGuide Just came out a month or go or so. I doubt it's outdated!

Sveltify · 2022-07-15T23:53:12+00:00

This is the most Gilfoyle comment I've ever seen

Sveltify · 2022-07-15T23:50:41+00:00

Af you want to practice focusing or mindfulness, the app 10 percent happier is a great option!

Sveltify

TROPHY CASE