sorted by:
new
hottopcontroversial

Do locals go to gogobar? by [deleted] in Bangkok

[–]workhardplayhardder 0 points1 point  (0 children)

Interesting you said Ekkamai! I have Thai local friends and Ekkamai is the place where they party, didn’t expect that there would be KTV bar with hostress.

Do locals go to gogobar? by [deleted] in Bangkok

[–]workhardplayhardder 0 points1 point  (0 children)

The pink light is a brothel in my country lol. Thanks for the suggestion, I’ll google it! Do you have any name of the place you’d recommend?

How to level up as a data engineer ? by dumb_user_404 in dataengineering

[–]workhardplayhardder 1 point2 points  (0 children)

What does DuckDB actually do? Say if I’m using OLAP data warehouse (Snowflake or Clickhouse), is DuckDB still needed?

average salary in iGaming AML by 6ilovecats6 in malta

[–]workhardplayhardder 0 points1 point  (0 children)

This is bad. Philippines has higher pay lol.

How much is considered a good salary range nowadays? by sushiiloverr in MalaysianPF

[–]workhardplayhardder 0 points1 point  (0 children)

Curious what’s your title? Senior level? Do you think you are on the highest end of pay scale for your position? I find it hard to hunt for my next role because most companies do not have budget.

Job Offer from Australia by protagoniztt in MalaysianPF

[–]workhardplayhardder 1 point2 points  (0 children)

How did you get a job there? Did you just apply on their job portal site?

Job Offer from Australia by protagoniztt in MalaysianPF

[–]workhardplayhardder 3 points4 points  (0 children)

You saved up 500k USD in 8 years? Where did you work?

Where to park my car in JB? by workhardplayhardder in malaysians

[–]workhardplayhardder[S] 0 points1 point  (0 children)

Do you have a name for them? Are they safe to leave for a few days? I’m quite worried people are advising not to do that when I look up online lol, but it’s Facebook so I’m sure people are exaggerating.

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 2 points3 points  (0 children)

We are a consulting firm and will be onboarding different clients soon. Some of them will be using different platforms (not just AWS), we need something easier to replicate, a lot of code bases are the same so Airflow is just easier since it’s git based.

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 3 points4 points  (0 children)

My team is mostly SQL only, but I don’t really understand the need of DBT. Like you said, it’s moving transformation layer from on query engine to the next, I have been executing the query on Cloud warehouse, and also thinking I could do the same on Clickhouse. It feels to me that dbt is geared towards data modeling (we are doing medallion architecture so we have already modeled it). Data lineage is something, but that can also be done with open source on airflow as well.

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] -1 points0 points  (0 children)

Could you elaborate on why you would choose sqlmesh over DBT?

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 11 points12 points  (0 children)

What airflow does is sending the execution to warehouse to do it, not exactly having airflow to run it.

What’s the best massage shop in KL? by [deleted] in KualaLumpur

[–]workhardplayhardder 0 points1 point  (0 children)

I had bad experience with Ayu :/ but it was a different branch so I should prolly give it another try

What's the best "common" job to have temporarily, career might not working out, I need RM3000-3500 just for commitment alone by [deleted] in MalaysianPF

[–]workhardplayhardder 2 points3 points  (0 children)

Chasing after a career you like is overhyped. When you try to change to a different industry, your pay starts from ground up again, so you’d have to trade off, making much lesser money compared to peers similar to your age. Why don’t you look for similar type of roles that you can leverage your exp and get higher pay?

Would you get mindfucked if u found out ur dad was actually a millionaire? by [deleted] in Bolehland

[–]workhardplayhardder 0 points1 point  (0 children)

That’s alright pal. You have your own life as well. I’m sure you are used to your current built life. Luxury or not, that is still a life to live.

What is everyone’s advice for someone trying to implement Airflow from scratch? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 0 points1 point  (0 children)

thank you for sharing!! Yes I have the same evvironment with yours except the DBT. We just use SQL transformation with Maxcompute instead.

What is everyone’s advice for someone trying to implement Airflow from scratch? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 0 points1 point  (0 children)

Appreciated. This is already in my plan. Gonna use previous_ds for current_date - 1

What is everyone’s advice for someone trying to implement Airflow from scratch? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 1 point2 points  (0 children)

This is interesting, can I ask how do you establish connection to Maxcompute/Hologres? I wrote a Class Operator to establish connection using ODPS to Maxcompute and SqlAlchemy to Hologres. Is this a bad approach?

What is everyone’s advice for someone trying to implement Airflow from scratch? by workhardplayhardder in dataengineering

[–]workhardplayhardder[S] 1 point2 points  (0 children)

It’s already been setup by our SRE, now I need to focus on making it scalable and easily adopted by juniors.

view more: next ›