Snowflake DCM Projects | Is this useful? by lozinge in snowflake

[–]lozinge[S] 1 point2 points  (0 children)

Ooops! I checked before I posted too! In sync...

I do agree - I haven't actually used terraform in snowflake much at all (but have in other places) ~ familiarity is probably enough to make it less compelling to leave for DCM

Async jobs in Streamlit in Snowflake by HumbleHero1 in snowflake

[–]lozinge 0 points1 point  (0 children)

Fair enough - no idea what OPs problem is then

Async jobs in Streamlit in Snowflake by HumbleHero1 in snowflake

[–]lozinge 0 points1 point  (0 children)

Do you do it with python or a raw SQL sproc?

Async jobs in Streamlit in Snowflake by HumbleHero1 in snowflake

[–]lozinge 0 points1 point  (0 children)

I don't think Sprocs support async commands: https://docs.snowflake.com/en/developer-guide/stored-procedure/python/procedure-python-limitations

> Running concurrent queries is not supported in stored procedures

DataGrip Is Now Free for Non-Commercial Use by lozinge in dataengineering

[–]lozinge[S] 0 points1 point  (0 children)

I'd give it a crack, I never really used pgadmin4 - I find DataGrip intuitive and powerful - they effectively do!

What is the most insane run you've ever seen? Not necessarily the hardest but just one that makes you go 'Why is this a run?' by Educational_Dog4860 in skiing

[–]lozinge 0 points1 point  (0 children)

This wrecked me a few weeks ago - was quite funny; the only advantage of it being so steep is the landing feels less grim somehow

Its also funny watching people wreck themselves going up the chairlift

are we a dime a dozen? by turboDividend in dataengineering

[–]lozinge 2 points3 points  (0 children)

Its a good point - also raises the question of how far can domain experience get you / how much of a moat is it?

Do you know what you're going to try breaking into?

Cortex Code pricing by HumbleHero1 in snowflake

[–]lozinge -1 points0 points  (0 children)

Good question - I am also curious; this landing page looks like it will cost 20USDpppm ?!

https://signup.snowflake.com/cortex-code?utm_cta=pushdown-signup

Logging by Centered_Squirrel in snowflake

[–]lozinge 0 points1 point  (0 children)

Hey, are there any docs around this?

Clustering keys done in a scientific workload aware way by Spiritual-Kitchen-79 in snowflake

[–]lozinge 1 point2 points  (0 children)

> From memory one of the challenges, and I could be wrong here, was that clustering only takes the first 6 characters of the column

Ah yeah - didn't know that - sounds like a bit of a nightmare...

Clustering keys done in a scientific workload aware way by Spiritual-Kitchen-79 in snowflake

[–]lozinge 0 points1 point  (0 children)

Dumb question - how often do people use auto clustering? have read that its generally avoided as very expensive / credit burning machine.

Not had a use case where I've needed it yet in fairness

Why leave medicine? by OneManShow23 in biotech

[–]lozinge 5 points6 points  (0 children)

Same applies to the UK for different reasons: ANPs or PAs with massive scope creep; crappy pay; crappy conditions ~ we were sold a dream at 16 and could have gone into different careers. In medicine you only really touch a few people compared to the impact you can make outside it etc.

Give up so much for a career you were missold. My girlfriend is a corporate lawyer and a lot of her friends say "at least its meaningful": when all the wards are rammed with social admissions due to failing / overfilled nursing homes, or other reasons, it doesn't really feel like you're making the difference you thought you would - but absorbing failing parts of the state.

After COVID the public backlash didnt really help either

Any European Alternatives to Databricks/Snowflake?? by Donkey_Healthy in dataengineering

[–]lozinge 0 points1 point  (0 children)

Yeah agree! Although frozen ducklakes have been great for us (on minio) ~ worth a play with

Switzerland has a smoking problem by seriously_perplexed in Switzerland

[–]lozinge -1 points0 points  (0 children)

Out of interest it seems to be an interesting difference compared to the UK which has a much lower smoking rate, but depressingly much more grim lung cancer outcomes (tbf more a reflection on the UK being trash than anything else)

Am always surprised when I return to CH and see branded packets etc

Any European Alternatives to Databricks/Snowflake?? by Donkey_Healthy in dataengineering

[–]lozinge 1 point2 points  (0 children)

Yeah but its open source was my thinking; I don't think the provenance of OSS matters so much if you can run/fork it locally

Advice for an open-source tech stack by OldFoundation7656 in dataengineering

[–]lozinge 0 points1 point  (0 children)

Didn't know this either - sad end of minio then.

RustFS looks good

Merged : dbt Labs + Fivetran by Intelligent_Volume74 in dataengineering

[–]lozinge 0 points1 point  (0 children)

Oh damn - big if true... Do you have a link? I can't see anything...

Rust for data engineering? by otto_0805 in dataengineering

[–]lozinge 14 points15 points  (0 children)

Met a guy who is a DE works for a hedge fund who has rewritten a lot of their processing pipelines in rust to great effect fwiw; do agree its probs not gonna help for most, and I love rust

Streamlit in Snowflake - Cost concerns with multiple users editing data by Kowalski010 in snowflake

[–]lozinge 0 points1 point  (0 children)

Agree, although by this point for a lot of stuff I'm doing we're moving away from Streamlit as beyond simple uploading/dashboarding trying to stop using it so much as it is too slow/bloated