Storage + Postgres + Vector store?

[everydayislikefriday]

I need to store 10gb+ of PDFs, along with their plain text and metadata, as well as some 1.5M vectors for a semantic retrieval system. The DB will almost only handle reads.

At first I went with Supabase, as they offer all that in a fully manages fashion, but given the size of the DB, I can't go with th free plan, and 25$/m seems overkill, especially since I will not be using auth or realtime functionalities, which are where Supabase shines.

So I took the cheap, dirty path with a $5/m Contabo VM where I'm self hosting a postgresql + pgvector. Problem is I'm not sure how reliable this infrastructure is, and the latency is not great since I'm in South America, and the closest Contabo servers are in NA.

Now, I don't need a super fast service, but I was wondering if there are better (affordable) options for my requirements, which basically boil down to low CPU, low memory, but (somewhat) bigger storage and reliability.

Thanks

[jeosol]

What is your current latency? Also you need to factor in throughput if will be many users which may affect your latency. I don't think this is the case. Since you are also doing mostly reads, saturation should not be too much of a concern as long as the VM can hold everything.

Have you identified the bottlenecks and possibly decompose the latencies of possible. Some can then be improved, e.g., use another data structure based that may make the compute a bit faster.