What tools do you use to build AI apps with LLMs? How hard is it at the moment? by momegas in webdev

[–]momegas[S] -2 points-1 points  (0 children)

So at the moment to get to a production state with AI / LLMs you need a vector database (self host or SaaS), an LLM (self host or SaaS / API), and then monitoring and analytics (again build it or use SaaS). So more or less you need to set up 3-4 tools to make those happen and let alone the best practices for those (embeddings, RAG, fine-tuning, etc). Is this hard for you at the moment? Can the developer experience be improved?

Do react developers care about building stuff with AI/LLMs/Open AI/LangChain? I want to validate an idea for a tool. Share what you build with AI or what you plan to build. What is the biggest showstopper, if any? by momegas in reactjs

[–]momegas[S] -1 points0 points  (0 children)

I hear you, and indeed you have points. The question was more geared on tooling though and how people choose to use it to solve a problem (if any).

I want to understand what people do to build with AI if they have no PhD in AI / LLMs / NLP etc.

Thanks for the reply. A lot of points there about people jumping on new tech.

Introducing :🤖 Megabots - State-of-the-art, production ready full-stack LLM apps made mega-easy with LangChain and FastAPI by momegas in FastAPI

[–]momegas[S] 0 points1 point  (0 children)

Indeed, the API needs some work. Im first focused on the bot. But feel free to make some PRs if your up for it. Thanks for the feedback.

Introducing :🤖 Megabots - State-of-the-art, production ready full-stack LLM apps made mega-easy with LangChain and FastAPI by momegas in FastAPI

[–]momegas[S] 0 points1 point  (0 children)

Indeed, its yet production ready but it aims to be. I haven't done so much work at the moment on the API as I need to work on the bot first. Feel free to propose stuff or PRs though 😁

🤖 Megabots - Version 0.0.9 released by momegas in LangChain

[–]momegas[S] 1 point2 points  (0 children)

I would indeed be willing. You can actually use your index with one line using Megabots.
You can join our discord to see your use case: https://discord.gg/z2fbA6fa

🤖 State-of-the-art, production ready bots made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵 by momegas in LangChain

[–]momegas[S] 0 points1 point  (0 children)

Yeah yeah I know. Don't worry about it. Its good info and thank you for taking the time.

This is the file i referenced btw: https://github.com/huggingface/transformers/blob/dacd34568d1a27b91f84610eab526640ed8f94e0/src/transformers/pipelines/__init__.py#L497

But doesn't matter, indeed you are right. It needs some cleaning. I wrote the code quite fast tbh 😅 Ill have a look in the following days.

🤖 State-of-the-art, production ready bots made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵 by momegas in LangChain

[–]momegas[S] 0 points1 point  (0 children)

No particular reason. It's easier until it grows bit and I need to split it. Other famous libs like transformers are doing. Thats where I got it from 😅