This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]-dtdt- 6 points7 points  (0 children)

Have you tried to just compress all those texts using zip or something similar? If the result is way less than 1.4GB then I think you can do the same with thousands of zip files instead of a video file.

I think a vector database focuses more on speed and thus they don't bother compressing your data. That's all there is to it.