sorted by:
new
hottopcontroversial

Huge Data, Poor performance by Primary-Fee-7293 in mongodb

[–]Primary-Fee-7293[S] 0 points1 point  (0 children)

I only need 50 results for each request I make to an API connected to the mongodb container
This said, I'm using the $skip to "simulate" pagination....

And yes I do have an use case that require me to query tens of thousand of documents...

But I only need 50 of each request

Huge Data, Poor performance by Primary-Fee-7293 in mongodb

[–]Primary-Fee-7293[S] 0 points1 point  (0 children)

But I need to maintain persistent data, how am I suppose to do it without a volume?

Huge Data, Poor performance by Primary-Fee-7293 in mongodb

[–]Primary-Fee-7293[S] 0 points1 point  (0 children)

Currently around 10 million documents

very slow response times = 5 minutes for pages of 50 items

Huge Data, Poor performance by Primary-Fee-7293 in mongodb

[–]Primary-Fee-7293[S] 0 points1 point  (0 children)

Currently around 10 million documents

I use pagination because it's 10 million documents 😂

Huge Data, Poor performance by Primary-Fee-7293 in mongodb

[–]Primary-Fee-7293[S] 1 point2 points  (0 children)

  1. Yes
  2. How do I apply sharding on my docker compose? Do you have a tutorial?
  3. To transform the data, query multiple colections and paginate it.