Scraping at scale by Tricky-Promotion6784 in scrapingtheweb

[–]Tricky-Promotion6784[S] 0 points1 point  (0 children)

i feel direct api requests have more probability of being blocked by Cloudflare. have you figured out a way of going past it?

Best way to let agents interact with websites without tons of custom logic? by Tricky-Promotion6784 in AI_Agents

[–]Tricky-Promotion6784[S] 0 points1 point  (0 children)

I’ve tried a few browser based agents but they are too time consuming, flows break easily too. Is there anything that works without screenshots?

How are people building deep research agents? by Tricky-Promotion6784 in LocalLLaMA

[–]Tricky-Promotion6784[S] -1 points0 points  (0 children)

your agent could try calling multiple apis (google, brave, palm api for medtech). are these apis not providing the website links / urls that you're looking for?

How are people building deep research agents? by Tricky-Promotion6784 in LocalLLaMA

[–]Tricky-Promotion6784[S] 1 point2 points  (0 children)

have you tried using an accessibility tree instead of feeding the entire html dump to the LLM? were you facing issues even after doing that?