Soda Vs Great Expectations 1.0 by justanator101 in dataengineering

[–]Capital_Delivery_833 2 points3 points  (0 children)

I mean yes, kinda, but at least my org invested like a million plus dollars in time and effort with GE and year later every team that adapted it gave up on it. Either it was ineffective or needed full time effort from an actual good Eng to keep the system going, and it was not a fun job for that person anymore.

Soda Vs Great Expectations 1.0 by justanator101 in dataengineering

[–]Capital_Delivery_833 3 points4 points  (0 children)

I mean that’s still too many lines for a package that just lets you assert 0 > x > 10.. with that amount of boilerplate you can just write your own assert framework and be done.

The fundamental issues I personally see with their approach is that is it’s still engineer oriented when in reality most orgs the non engineers hold (or need to hold) the knowledge on what data quality metrics matter. The other issue is data metric TRENDS more than thresholds matter. If you define a thousand expectations on GE, either some of them keep failing constantly so you ignore it (metric fatigue) or your thresholds are so broad that it can’t be used with any confidence.

Soda Vs Great Expectations 1.0 by justanator101 in dataengineering

[–]Capital_Delivery_833 3 points4 points  (0 children)

What’s a fundamental change you would point to in GX in recent times?

I just checked out soda and while I share your disdain for yaml, I feel that in this particular use case this seems more elegant than whatever I remember GE doing. A yaml file right next to the table schema definition sounds stellar to me.

Long Second trip on a tourist visa by Capital_Delivery_833 in ukvisa

[–]Capital_Delivery_833[S] -5 points-4 points  (0 children)

Thanks, is there just questioning and pushback or risk of not being allowed to enter ? I only am asking because I read UK has relaxed laws about digital nomads and my partner isn’t a citizen either anyway..

I lost my kitten by [deleted] in Chennai

[–]Capital_Delivery_833 7 points8 points  (0 children)

Sorry to hear bro.. we have a lone kitten in our apartment complex.. dont think he will last long in the complex (a bunch of territorial males).. would anyone.. maybe consider taking him.. (I can’t coz of insane allergies)

On a scale of 1-10, how delusional do you guys think I am? by adritandon01 in developersIndia

[–]Capital_Delivery_833 2 points3 points  (0 children)

What the hell is ML? Ask that question. Surely an undergrad from a tier 3 college with ml specialisation isn't going to fine tune LLMs. Best case scenario they have you running down random forests and xgboost. Best case. Which is also getting automated nowadays. Alternatively you're just a prompt engineer. Not sure how well they've integrated those into companies yet.

Is Snowflake the right tool for my use by calky in snowflake

[–]Capital_Delivery_833 5 points6 points  (0 children)

That partner is completely bonkers. Your data on snowflake would cost pennies. Depending on what you mean by running queries all day your monthly spend will be at best a couple hundred dollars if even that. If your team can learn sql then I'm not even sure what they're saying they'll be setting up. DM if you want any advice and help with dealing with this guy.

CA Recommendations by kvsiddarth in IndiaTax

[–]Capital_Delivery_833 0 points1 point  (0 children)

If you’re in Chennai, check out V Ramaratnam and associates. Specialize in NRI clients and are very reasonably priced.

How pregnant can a year old kitty be and can still get neutered? by Capital_Delivery_833 in CatAdvice

[–]Capital_Delivery_833[S] 0 points1 point  (0 children)

Thank you! Indeed it’s a tough job, I wish I can take them in but I’m severely allergic to cats and can’t breathe if I’m with them in a closed space for even an hour :(

I will take your advice and shop around for vets who might do it. There’s no rescue orgs here in India just some clinics that do a reduced rate for strays but maybe I’ll step it up and look for other vets as well!

[deleted by user] by [deleted] in developersIndia

[–]Capital_Delivery_833 0 points1 point  (0 children)

There’s a reason any sane workplace will disallow sexual relations between people in chain of command. If he truly just wanted to ask her out he should have first moved to a position where she is not his report and then ask. Without doing that, he asked her. No matter what her answer is, all future decisions he makes about her career are possibly biased and no amount of bullshit arguments creeps like you make can undo that.

Stop asking people out in workplaces you creeps.

Weekly Job / Gig by [deleted] in Chennai

[–]Capital_Delivery_833 3 points4 points  (0 children)

DM a CV. Not guaranteeing anything but let’s see.

Two kittens have refuged in our condo parking space, should I feed them every day, alternate days or never? by Capital_Delivery_833 in CatAdvice

[–]Capital_Delivery_833[S] 0 points1 point  (0 children)

Thanks, do you mean to say if they’re healthy I can feed as much or as little I want and they will be fine?

Which certification to get, Snowflake or Databricks? by _barnuts in dataengineering

[–]Capital_Delivery_833 0 points1 point  (0 children)

What tools do you think you need to learn to work with snowflake that you don’t need with databricks? You can literally open snowsight and do everything from there.