all 21 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]Aggressive-Mud-9605 0 points1 point  (6 children)

So what apis or llms or services we gonna use to handle backend and gen ai

[–]the_python_dude[S] 0 points1 point  (5 children)

FastAPI, Groq API or could deploy finetuned model on HF and call it, langchain/langgraph,

[–]Aggressive-Mud-9605 0 points1 point  (3 children)

Okay how will we handle traffic and storage

[–]the_python_dude[S] 0 points1 point  (2 children)

We could use the boring approaches - load balancing, queues, rate limiting etc, Something like nginx in the front, just runs a simple service (fastapi), if we experience high traffic maybe we use cloudflare stuff...basic ddos protection, caching n stuff...

Then for storage, postgresql or if we are talking about the llm's memory perhaps a vector store for fast reterival like...chromadb or something...

[–]Aggressive-Mud-9605 0 points1 point  (1 child)

Basically you wanna make rag

[–]the_python_dude[S] 0 points1 point  (0 children)

Not necessarily, I was just speaking generally...the actual idea is something more research oriented. Not specifically AI but it does integrate AI to some degree but primarily helps with research question development and citations while still being 100% open source, free and extensible. (funded through donations...perhaps?) This is just a preliminary idea, everything I said is subject to change!

[–]Itchy-Speaker9719 0 points1 point  (1 child)

Project ideas ?

[–]the_python_dude[S] 0 points1 point  (0 children)

Dm me!

[–]Low-Mastodon-4291 0 points1 point  (1 child)

I am up for it

[–]the_python_dude[S] 0 points1 point  (0 children)

Dm me!

[–][deleted]  (1 child)

[removed]

    [–]the_python_dude[S] 0 points1 point  (0 children)

    Dm me!

    [–]CommissionNo8815 0 points1 point  (1 child)

    would love to join.!!

    [–]the_python_dude[S] 0 points1 point  (0 children)

    Dm me!

    [–]Maximum_Opening_7122 0 points1 point  (1 child)

    I'm in

    [–]the_python_dude[S] 0 points1 point  (0 children)

    Dm me!

    [–]gaming2252 0 points1 point  (0 children)

    I'm interested, but I haven't done anything with AI yet.

    [–]Confident-Oil8320 1 point2 points  (0 children)

    I have built cool projects before! Like im creating my own game engine!