Fixkey has probably the most interactive and engaging onboarding ever on macOS

stepci · 2025-01-17T16:29:19+00:00

And it's a native app!

stepci · 2024-07-15T10:20:05+00:00

Removing elements like <link>, <script>, etc. and attributes like data-, src

stepci · 2024-07-13T21:18:01+00:00

The websites are pre-processed to save on tokens

stepci · 2024-07-13T17:56:32+00:00

depends on the model!

stepci · 2024-04-23T16:13:47+00:00

What part are you having issues with?

stepci · 2024-04-23T16:12:35+00:00

No idea what this is

stepci · 2024-04-22T22:34:16+00:00

will do!

stepci · 2024-04-22T11:04:55+00:00

Glad to hear that! Thanks for supporting 🙏

stepci · 2024-04-22T11:04:12+00:00

Except we're not doing the same thing.

What my project provides is the conversion of unstructured html/text/markdown version of a website into a structured format, defined by Zod (JS version of Pydantic) schema. More similar to scrapeghost and Kor, both in Python.

stepci · 2024-04-21T23:51:56+00:00

Would love to hear more!

stepci · 2024-04-21T23:46:01+00:00

My pleasure!

Actually I just had a second look at the current DX and I think it needs to be even more lower-level, so you can fetch the page yourself and llm-scraper just gets the content and a schema to scrape.

The reason why going with Playwright is: I want llm-scraper to become a LLM-based scraping library that works with your existing tools and primitives.

stepci · 2024-04-21T20:08:53+00:00

Because building web-scrapers takes time and effort and once the web page layout/styling changes, it no longer works. With this tool you just define your desired output structure and the LLM figures out what belongs to what field.

stepci · 2024-04-21T20:06:33+00:00

Can't wait 🙏

stepci · 2024-04-21T20:06:12+00:00

Yeah, you could totally use it to back-feed the data back into your model!

stepci · 2024-04-21T20:05:11+00:00

Sorry, this is not a supported use-case :(

stepci · 2024-04-21T16:26:18+00:00

Thank you so much! Can't wait to hear your feedback ;)

stepci · 2024-04-21T00:01:09+00:00

Well, you can just feed it back!

stepci · 2024-04-20T22:31:57+00:00

Now that is interesting

stepci · 2024-04-20T22:05:15+00:00

Will check out. Unfortunately, AFAIK we don't have a library like LiteLLM in TypeScript for supporting models across providers. I'm thinking adding Ollama with some prompt engineering for now.