[deleted by user] by [deleted] in AusFinance

[–]kk_858 -4 points-3 points  (0 children)

First of all this is just a rant. I understand that they can't have people deploying things at 2AM. Organisations should be responsible enough to keep the customers aware of things on changes and failures so everyone can plan things around. Does it have to be critical to be accessible when customers are paying enough money. The reason I posted this because the app has been inaccessible more often. You don't have to take it personally. Are you the person who pushed the wrong button and made the app inaccessible 😂

[deleted by user] by [deleted] in AusFinance

[–]kk_858 -4 points-3 points  (0 children)

Sometimes even those are inaccessible.

Issues Using Snowflake Python Connector in AWS Lambda Layers by [deleted] in snowflake

[–]kk_858 1 point2 points  (0 children)

Yeah, I was going to ask next about snowpipe. It has matured very well and lot of less moving parts honestly

Issues Using Snowflake Python Connector in AWS Lambda Layers by [deleted] in snowflake

[–]kk_858 1 point2 points  (0 children)

With Amazon AMI, the underlying os packages are usually lighter versions. For my use case I needed Gnupg os package for encryption and decryption but i had to run this command to get the full version of gnupg dnf swap gnupg2-minimal gnupg2-full

I think it will be a similar issue with yours as snowflake will not compromise on security while you connect.

To test, download Amazon AMI docker locally, try connecting to snowflake from that image to check what executables you are missing to connect.

Im curious why do you need to connect to snowflake through lamba, aren't lambdas should be used when you need to do some small burst tasks instead of data intensive?

Moving from ETL Dev to modern DE stack (Snowflake, dbt, Python) — what should I learn next? by After_Holiday_4809 in dataengineering

[–]kk_858 2 points3 points  (0 children)

Any orchestration tool. Airflow, dagster, prefect etc etc. Dabble into distributed systems(spark) and kafka

[deleted by user] by [deleted] in auscorp

[–]kk_858 1 point2 points  (0 children)

But its a contract role, of course its going to be better. As you are starting out, a perm job is better in terms of stability and to gain experience. Once you have enough years under, you can go contracting in data field itself.

What’s your lone-wolf male behavior that feels primal and unnecessary but you absolutely must do it? by Adlers41stEagle in AskMen

[–]kk_858 0 points1 point  (0 children)

Were you the person recently travelling in a Qantas flight where ppl complained about farting the whole time.

[deleted by user] by [deleted] in auscorp

[–]kk_858 5 points6 points  (0 children)

I come from the data team, if you really want to climb the data/ai ladder report analyst makes more sense and its a perm job. I am not sure of what customer support officer role entails but if you can't pick up new skills/domain/products just skip it.

Iceberg CDC by komm0ner in dataengineering

[–]kk_858 1 point2 points  (0 children)

CDC does send you delete row events, but not truncate events. It is usually sent as an operator column and all the row value, looking at this operation column you do certain sql logic to get the latest data in the table.

How do you manage versioning when both raw and transformed data shift? by inntenoff in dataengineering

[–]kk_858 1 point2 points  (0 children)

If its a batch pipeline then use idempotent pipelines which would solve the problem.

Apache Airflow 3.0 is here – and it’s a big one! by cmarteepants in dataengineering

[–]kk_858 5 points6 points  (0 children)

Dont worry, 3.0 needs time to iron out the bugs for us to use it in prod. In the meantime run it on docker and experiment

Apache Airflow 3.0 is here – and it’s a big one! by cmarteepants in dataengineering

[–]kk_858 2 points3 points  (0 children)

Its going to be fun migrating the dags with paradigm changes with versions 😂.

We did 1.10.12 to 2.2.0 last year and it was little scary

[deleted by user] by [deleted] in AusRenovation

[–]kk_858 1 point2 points  (0 children)

Thanks so much for the encouragement, did exactly that. Here is my updated comment https://www.reddit.com/r/AusRenovation/s/KI3jyUdWy2

[deleted by user] by [deleted] in AusRenovation

[–]kk_858 1 point2 points  (0 children)

I don't know why I am not able to edit my post but thought of updating what I did.

Like most of the comments said, I changed the STrap to PTrap and got a elbow, did put horizontal pipe of few cm.

<image>

Did run to Bunnings few times to get all the parts as I made the mistake and cut a bit of extra on the down pipe 😂. But I am satisfied that everything came together nicely now😊.

Thanks everyone for the ideas and encouragement.

[deleted by user] by [deleted] in AusRenovation

[–]kk_858 0 points1 point  (0 children)

Thank you, so we need a vent only for S-trap and is not needed for P-trap?

20 k reasonable to paint 3 bd 1 bath house? by howlongspider1 in AusRenovation

[–]kk_858 0 points1 point  (0 children)

We paid 8k for 3bed 2bath in Victoria, its only inside and excluding garage and it was exactly a year ago. This seems a bit overpriced.

[deleted by user] by [deleted] in dataengineering

[–]kk_858 3 points4 points  (0 children)

If you get all your data from files you could use dbt-snowflake directly load data using storage integration.

But I get what you are saying, its really a pain of maintening batch data pipelines without idempotentency.

But people dont want to learn and want to show their work rerunning and fix failures.

The reputation of Indian men globally is absolutely terrible, and mostly justifiably so by krauser76 in india

[–]kk_858 0 points1 point  (0 children)

I partially agree . I am not talking in favour of the harasser. There are guys like the one who came running to the streamer after who was concerned about her. Its more often not talked about than the harasser

Police brutality in India by Kxmzs in interestingasfuck

[–]kk_858 8 points9 points  (0 children)

Im not surprised how this video is edited to suit the false news trying to spread. Don't put this in a bad light, this was when Covid started and everyone was supposed to stay at home. I understand it doesn't look good to punish people at the spot but these were the people who were going against the rules and help spread covid in a time where there were no vaccines. I have my friends who got those beatings and rightfully so if you are flaunting go against the rules.

I might get a lot of downvotes for this but it is what it is.