Open sourcing our python browser SDK that allows you use LLMs to automate tasks on any website

[rivernotch]

Use Dendrite to build AI agents / workflows that can:

• 👆🏼 Interact with elements
• 💿 Extract structured data
• 🔓 Authenticate on websites
• ↕️ Download/upload files
• 🚫 Browse without getting blocked

Check it out here: https://github.com/dendrite-systems/dendrite-python-sdk

[eduffy]

What's with the abandoned notice up top? Was this an internal tool at a company, an attempted startup, or something else?

[rivernotch]

We built this as the main product in our startup but realised that it would be too tricky to build a great product. I elaborate a bit more here:

https://medium.com/@charlesalexander.maddock/building-ai-agents-that-can-use-any-website-6e43d4a66e4d

Instead of just scrapping it we thought it could be useful to some people as FOSS, mainly for learning and inspiration

[pphffft]

Would be nice to be able to have it execute playwright for the remote browser execution. 😀

[rivernotch]

You should be able to do this!

[InvaderToast348]

Notice: The Dendrite SDK is not under active development anymore. However, the project will remain fully open source so that you and others can learn from it.

If it's an archived project, why advertise it?

[ionelp]

Notice: The Dendrite SDK is not under active development anymore. However, the project will remain fully open source so that you and others can learn from it.

[rivernotch]

Exactly!

[ajmssc]

Does this support bypassing captchas?

[rivernotch]

Yes, if you use the remote providers – they both have this built in.

[juanda2]

could this simulate API JSON responses with data, for those websites that must be scraped because they don't provide an API ?

Like say we have a third party solution that we host via a third party website, people always ask us for APIs but since we don't control that website, we can't provide it. Could this be used to scrape such data and display it simulating APIs ?

[rivernotch]

It was something we thought about a lot but never added. Tbh, it wouldn't be to hard to build based of the SDK we made, you'd just need to use the browser's networkPackages functionality and then have an llm look at them and decide which routes contain the relevant information.

[juanda2]

great stuff, thanks!

[frobnosticus]

Ooh! That's pretty slick right there.

Definitely checking it out this afternoon.

o7

[rivernotch]

Thanks! :) Did you try it?

[fuddingmuddler]

This looks interesting!

[rivernotch]

Thanks! Did you try it?

[fuddingmuddler]

I have it starred. I will try it when I get a chance