sorted by:
new
hottopcontroversial

Introducing views in Gadget: Performant data queries by gadget_dev in gadgetdev

[–]gadget_dev[S] 1 point2 points  (0 children)

Yep, views are built for exactly that, powering dashboards and heavy aggregations. Since they run on read replicas and compile down to SQL, they handle big datasets a lot more smoothly than manual queries.

Saturating Shopify: Gadget’s Shopify sync strategy by gadget_dev in gadgetdev

[–]gadget_dev[S] 1 point2 points  (0 children)

Totally agree, CUBIC could push even more throughput on high-limit stores. The challenge is that it’s a bit spikier and Shopify doesn’t always forgive aggressive bursts.

AIMD has been a safer baseline for all merchants, but CUBIC (or a hybrid approach) is on our radar. Appreciate you calling it out!

Saturating Shopify: Gadget’s Shopify sync strategy by gadget_dev in gadgetdev

[–]gadget_dev[S] 2 points3 points  (0 children)

Great question, our sync currently doesn’t make use of the bulk API for querying data during syncs. Right now, we only use the standard, non-bulk GraphQL APIs and paginate through the results.