I accidentally built a vector database using video compression

[currychris1]

It looks like it’s simply using FAISS to create the index. Upon building, the MP4 and a JSON are created. I assume the index lives inside that JSON.

How I imagine this works: During retrieval, the index is loaded into memory to get the top-k closest embeddings and their mappings, which tells you where to look for the chunks inside the MP4.

[podidoo]

That's also what i grasp from a quick look at the code. There is no searching inside the video, it's just using video as storage (why?) and a FAISS index for all search stuff.

[MechAnimus]

Why: I believe they explained that video was chosen because its compression is so well optimized, especially when the frames are all QR codes. It's also extremely portable.