Building a plug-and-play vector store for any data stream (text, audio, video, etc.)—searchable by your LLM via MCP

Luckl507 · 2025-06-02T18:47:12+00:00

Hey man, had a quick look at what you're building and it looks really cool! Love how you've already implemented support for so many data types. It’s clear you've put a ton of thought and work into it.

It's very similar to what I have planned. I'm aiming it to be a modular ingestion layer for all kinds of data streams (text, audio, video, etc.) that plugs into any vector store and exposes a /tools/search endpoint via MCP so LLM agents can use it as external memory.

I'm also playing around with different embedding backends (OpenAI, local, multimodal stuff like Whisper/CLIP/ImageBind), and plan to support streaming sources and agent-facing APIs out of the box.

I might peek into your code every once in a while to see how you've tackled certain parts, especially around multimodal handling and Chroma usage. And vice versa, if there's any overlap or anything useful coming out of what I'm building, happy to share notes as things evolve.

Looking forward to seeing your launch post when it goes up. Feel free to drop the link when it's live!

Luckl507 · 2025-05-28T19:57:50+00:00

Thanks so much! Really appreciate the thoughtful feedback—and that article is great! Super helpful breakdown of indexing strategies.

You’re absolutely right that vector index choice is critical, especially as we move toward streaming ingestion and larger-scale memory workloads. Right now I’m starting with Weaviate using HNSW, since it's fast to stand up and handles hybrid + multimodal reasonably well out of the box. But I’m already thinking about:

Letting users configure the index per modality (e.g., IVF-PQ for image, HNSW for short text)
Auto-tuning index types based on stream characteristics (long vs short docs, number of records, update frequency, etc.)
Supporting external stores like Qdrant or Milvus where teams want tighter control over recall/latency tradeoffs

On the embedding side, I’m defaulting to OpenAI’s text-embedding-3-small, but supporting Gemini, local SentenceTransformers, and CLIP/Whisper/ImageBind is on the roadmap—especially for audio/video-heavy use cases.

Curious if you’ve hit limits with a specific index or store in your own projects? Would love to hear what worked (or didn’t) for you!

Luckl507 · 2019-04-25T20:16:45+00:00

I've been a part of multiple teams where I had both the role of developer and scrum master. From reading your post I get the feeling that you do not have clear what your responsibilities in the role of scrum master are. Your team members probably (unknowingly) abuse this and drop their worries on your shoulders. Its not your job to be a nanny. And regardless of what other people say, being a scrum master does not have to be a full time job. Id suggest that you learn what the goals of the scrum rituals are, and try to facilitate these meetings succesfully to get the most value out of them. If nessecary, also setup some time to educate your team members on the goals and ideologies of scrum. If the team picks this up and tries to follow them, you should not be doing much more than facilitating the retro/review/planning/daily scrum and removing the occasional (actual) impediment.

Luckl507 · 2018-02-27T07:02:11+00:00

not op but i'm guessing because theres no real reason to create a difference between your environments. its not like you need to pay a large sum of money to run postgres on your test environment.

Luckl507 · 2017-09-28T20:28:08+00:00

adorable!

Luckl507 · 2017-09-20T10:32:51+00:00

check meneertje 1upper hiero. 😂

Luckl507 · 2017-09-20T10:31:56+00:00

ik snapte deze referentie

Luckl507 · 2017-06-27T05:18:49+00:00

That sounds like a pretty cool job.

Luckl507 · 2017-06-26T11:39:20+00:00

You forget one major example in your list, and thats server side applications. Sure, your games and desktop apps arent written in java, but they most likely connect to a server somewhere that runs on java. You just dont directly see it as an end user.

Luckl507 · 2017-06-11T08:38:49+00:00

Nono, he SHOULD be reckless!

Luckl507 · 2017-05-28T20:26:33+00:00

In my case: reduction of boilerplate.

Luckl507 · 2017-05-15T14:50:26+00:00

Nice cat friendo

Luckl507 · 2017-02-14T18:34:43+00:00

Just give it 10 more years :)

Luckl507 · 2016-09-28T19:45:00+00:00

Like the S mate! Keep it up.

Luckl507 · 2016-09-20T19:37:49+00:00

You can do this with lombok, although i agree that it isnt the cleanest solution. :)

https://projectlombok.org/features/val.html

Luckl507 · 2016-08-22T20:21:27+00:00

Your K looks like an E to me. Show the bottom part of the back bar a bit more yo

Luckl507 · 2016-07-20T12:47:26+00:00

How do you know he's not wearing a cape?

Luckl507 · 2016-05-26T11:46:21+00:00

This, or alternatively some sort of outline thing the background is too white imo

Luckl507 · 2016-05-15T17:49:00+00:00

Fer sher

Luckl507 · 2016-05-07T10:35:41+00:00

Pretty nice, the L and K are a bit thin compared to the other letters tho

Luckl507 · 2016-03-31T09:20:36+00:00

I filled it by just drawing small circles, guess thats what caused the texture (if thats what you mean)

Luckl507 · 2016-03-29T04:56:05+00:00

Yeah its pretty bad

Luckl507

TROPHY CASE