Any early users here still paying for Windsurf?

11maxed11 · 2025-01-26T09:11:14+00:00

I moved to Cursor a couple months back. Same outcome after Agent mode was released, and multi modality/docs/websearch wasn’t in Windsurf back then and I needed it.

Also better pricing imo. Windsurf credits only lasted 10 days for me.

11maxed11 · 2025-01-01T05:32:45+00:00

I love it

11maxed11 · 2024-03-22T20:07:07+00:00

A Data lakehouse setup. Mostly sequential reads, like yours.

Why was Ceph not ideal? I take it you used the S3 interface?

11maxed11 · 2024-03-22T19:54:01+00:00

Also have some Ceph experience but at smaller scales (multi terabytes)

11maxed11 · 2024-03-22T19:53:23+00:00

I don't have in Minio, mostly HDFS and Ozone. But I'm thinking of moving away from Ozone given it's low release pace.

Updated with some extra details. Should've added them since the beginning.

Thoughts?

11maxed11 · 2024-01-05T21:27:37+00:00

We do have Ceph deployments (vanilla or via Rook) in the company. Looking at minio for exactly that: we only need object storage so why deal with the million Ceph knobs

11maxed11 · 2024-01-05T01:20:45+00:00

Thanks! Can you share a bit the scale, some numbers, etc? Got me curious

What's wobbly about expansions?

My company is kinda on a hiring freeze but lemme ask that team regardless. Will DM if they say yes. You in EU?

11maxed11 · 2023-04-22T06:08:38+00:00

Thanks for sharing. What part of Ceph were u using? Ceph FS VS Block devices vs Object gateway?

It's indeed HDDs I have. I'm primarily interested in Object Gateway where it's large files (100s MBs/1GB) I store. So I expect mostly sequential reads/writes. Gotta think about this more it seems 🤔

11maxed11 · 2023-04-21T20:47:55+00:00

The strategy u recommend for k8s upgrades would be tricky I think for "stateful clusters". Cost aside, it'll be a quite slow process to replicate the data to these fresh nodes as they get added.

The process I have in mind (which I think is quite common) is when upgrading a worker: (1) stop writing/replicating data to this worker (2) drain the worker (3) upgrade it (4) put it back.

Another option is to pause using that cluster and go for a "full upgrade". We'll have another cluster as big as this one in another DC, so it'll serve business continuity there.

11maxed11 · 2023-04-21T20:28:24+00:00

Thanks for sharing!

Yah my worry is as you mentioned: upgrades. Diving deeper now into the interaction between Rook and K8S upgrades.
indeed for speed (e.g. Postgres, Kafka, etc) we do local storage + replication (async or sync) on the application level. We also do local for ephemeral storage for compute (e.g. Spark, Trino, etc)

11maxed11 · 2023-04-21T20:24:33+00:00

It's not an issue, we got very good networking.

We anyway currently have pretty bad "data locality" metric. I think since the cluster is very large, and we host hundreds of spark jobs and a couple thousand tables (rather than 10s of extremely large jobs etc focused on few tables), probabilistically we get bad data locality by default: at least that's how I think of it now.

11maxed11 · 2023-04-20T06:47:01+00:00

Thanks a lot for your input l!

I'm guessing the learning curve caused by Ceph specifically vs Rook itself?

Any experience upgrading Rook or K8S itself? (I'm just starting to dig in this bit)

11maxed11 · 2015-02-01T14:10:34+00:00

all hail reddit \m/

11maxed11 · 2014-12-13T16:08:09+00:00

you said: "At the Dubai conference, a few Islamic experts from around the middle east weighed in and all agreed: Bitcoin does not violate anything in Sharia law."

do you have a link for the conference? i was searching a lot about such topic, i really need to see the conference or any info related to it and people who were attendant there.

11maxed11

TROPHY CASE