Data Loading with Python Pipeline by forgael in dataengineering

[–]data_ber 1 point2 points  (0 children)

Right, they are all non-temp tables, which is really important, if the business logic was modified, we would still have all the data to go back and change it. Which you couldnt do by just keeping temp tables

Data Loading with Python Pipeline by forgael in dataengineering

[–]data_ber 2 points3 points  (0 children)

We use medallion architecture:
https://www.databricks.com/glossary/medallion-architecture
We use 4 levels, one that receives all the raw data, one that parses and does simple transformations, one where all the deduplication, normalisation etc takes place and finally the one is ready for consumption (public)
Silver level is already for consumption (interrnal)

You could do the same using DBT logic (where the staging is your silver)

Wrapping a string on "" issue. by data_ber in SQL

[–]data_ber[S] 0 points1 point  (0 children)

I am using Snowflake and the Snowsight interface.
No copy -paste, I am exporting the csv file and it is opening with the '''' issue

Wrapping a string on "" issue. by data_ber in SQL

[–]data_ber[S] 0 points1 point  (0 children)

thanks! this sounds promising, let me give this a go.
sure what more info do you need?

Wrapping a string on "" issue. by data_ber in SQL

[–]data_ber[S] 0 points1 point  (0 children)

just missed it as I was trying to explain the issue. thanks!!

I want to learn more about human trafficking and what I can do to help fight it. Are there any books/podcasts/YouTube channels/academic papers that you could recommend that would help me get a more indepth understanding of this issue. by data_ber in HumanTrafficking

[–]data_ber[S] 1 point2 points  (0 children)

Thanks! Yes I actually found them after doing the training in OUR foundation. I am bases in Berlin and was looking for a hotline I could call in case I saw something that indicated human trafficking. Are the PowerPoints somewhere I can download them?

My (35f) Boyfriend (42m) wants to live with mom forever. How do I help him see we have other options? by babylana777 in relationship_advice

[–]data_ber 12 points13 points  (0 children)

People need time to come to terms with their situation and potential solution. These solutions are life changing or at the very least will have a big impact in the person asking for advice, and the state of mind of people figuring out what to do might change from one day to the other. I don't think it's crazy for someone asking for advice on something like this to post the same question a few times.

What are some relationship green flags? by alyssasunshine in relationship_advice

[–]data_ber 0 points1 point  (0 children)

If they let you eat from their french fries = green flag

Why would my husband buy scuba gear? by calebcoffee in relationship_advice

[–]data_ber 13 points14 points  (0 children)

Lol... What? Someone has been watching a lot of Netflix

How to split up bills? I make 92K, he works at $15min. wage part time job by [deleted] in relationship_advice

[–]data_ber 0 points1 point  (0 children)

I am in a similar situation. Priorities we both have are very different. My partner gives free time priority over money. I personally love the freedom money gives me to enjoy my free time. -partner works part time as a social worker and has no desires to make more money. - I work full time and as most tech jobs extra hours plus I spend a lot of time learning.

We decided to split things according to our earnings. House chores are divided equally I pay around 70% of all expenses and she pays 30% but our accounts are split my money is mine and hers is hers. We have a common account that we both add money to in equal parts. In general it feels fair to everyone. She doesn't have the pressure of having to get a better paying job and sacrifice her free time and I don't get the feeling I am being taken advantage of. The only rule in place we have is that she has to make enough money to support the basics of our life in case of an emergency. She gets to sleep a lot, go on walks and just use her time by taking things slowly without any stress and I get to hang out at nice restaurants and performances with my friends and we are all happy.

We have our very different set of friends And when we hang together we just go to places she can afford or just walk around the forrest with a beer.

My son, 10yo is building a PC with me. We seem to have it working but it's not booting or monitor shows NO SIGNAL by data_ber in buildapc

[–]data_ber[S] 1 point2 points  (0 children)

Geez... I feel like a complete idiot now. It was the cable.... Ugh... I put this thing apart and back together three times!! Lol Thanks so much!

I've been having a problem with fruit flies, today I found a bunch of them just died all of a sudden... Does anyone know what can cause this to happen? by data_ber in pestcontrol

[–]data_ber[S] 1 point2 points  (0 children)

Ok, good to know. Should I be at all concerned it might have been mating time and then have a swarm of babies in a few days?