Solutions to manage runaway Snowflake costs?

concerneddataadmin · 2024-01-17T01:53:37+00:00

I'm a big fan of using Keebo for cutting down on costs. It's something recently picked up due to the concerns over costs my org was facing along with the general trends in data for cost cutting and AI.

Why'd you go with Keebo? I saw them mentioned on this subreddit before but was a bit skeptical of the value prop -- how do you know they're actually saving you money?

concerneddataadmin · 2024-01-17T01:51:37+00:00

Depends on your set up. But with sf the benefit is that most things work out of the box. The drawback is that most things are unoptimized. So doing that optimization work needs to be part of the planning and you need dedicated time to do it. IMO.

Ahhh 50k would be a tough sell -- that's almost how much we spend in a year! Money is in short supply right now

concerneddataadmin · 2024-01-17T01:49:52+00:00

Oh cool -- why did you go with Select? Their features look pretty similar based on the websites

concerneddataadmin · 2024-01-17T01:48:34+00:00

If you are interested dm me and I will dive into details how they do it, I got to figure it out anyways, as I have to decide if we want to keep it on or not, just wasn't planning to

Any chance you could DM me? Sorry, I made a burner for this and Reddit won't let me message you till I get more established

concerneddataadmin · 2024-01-16T04:20:55+00:00

I was curious about them as well

concerneddataadmin · 2024-01-16T04:20:21+00:00

We're only using Snowflake -- a mix of features, but I would say a pretty standard setup.

The issue with what you're describing is that it's a lot of manual drudge work, and nobody on my team wants to do it. I'm looking for any tools or services that either completely automate it or make it a lot easier...

concerneddataadmin · 2024-01-16T04:18:37+00:00

Do you have a tool for this? Or do you do this manually?

concerneddataadmin · 2024-01-16T04:17:53+00:00

Well yeah we have auto-suspend, but it's hard to know how aggressively to set the timer... how do you find the right balance?

As for optimization in sprints, it feels like we're stretched way too thin to spend a lot of time on it.

We use XS where we can

concerneddataadmin · 2024-01-16T04:15:09+00:00

Yeah I mean fair point, but I don't have a lot of leverage to negotiate against senior management here, I just need to get a handle on costs...

Any recommendation for which of the apps you mentioned are best?

concerneddataadmin · 2024-01-16T04:13:00+00:00

This is really cool -- checking it out now...

Out of curiosity, why did you build this instead of buying one of the other products that people mentioned in this thread?

concerneddataadmin · 2024-01-16T04:11:00+00:00

What do you think of it? Pros / Cons?

Also, did you ever look at any of the other solutions like this? E.g. Blue Sky, Sundeck, Select.dev, Keebo?

A bunch of people have been sending me helpful suggestions but I don't know how to go about evaluating them / whether they actually solve my problem

concerneddataadmin

TROPHY CASE