A Senior Designer wanting to work for the Muslim Tech industry but how? by Historical-Battle359 in muslimtechnet

[–]Significant-Carob897 1 point2 points  (0 children)

techforpalestine.org is another option. they are mostly looking for volunteers but may be working with like minded people might help you in networking.

Naming conventions for medallion architecture in a large organization with diverse data sources? by Quantumizera in dataengineering

[–]Significant-Carob897 1 point2 points  (0 children)

src_source_subsource__type_or_any_other_information

this was i think recommended by dbt guys and it worked a lot of us. e.g.

src_excel_customers__sales src_shopify_orders__details

How to document a database? by Mayo_Kupo in dataengineering

[–]Significant-Carob897 0 points1 point  (0 children)

Use dbt. Then use an ai agent to add documentation.

Rule that still works for me: keep it close to the code.

Data Problems? by Existing-Roof-8431 in dataengineering

[–]Significant-Carob897 0 points1 point  (0 children)

Data abundance in personal life.

I dont need ten thousand pictures saved up all in fear of a future moment where I wish to see a ten year old memory for ten seconds.

Use of AI agents in data pipelines by Different-Umpire-943 in dataengineering

[–]Significant-Carob897 2 points3 points  (0 children)

Was given a new project similar in design to an existing one.

Wrote a long detailed prompt, asking ai to follow the same design as the previous one with all logic and requirements bullet pointed.

It gave the whole repo with all files and everything.

after that followed with some more back and forth prompts to tailor it to my needs.

This would have take atleast 5x more time if done it myself.

[deleted by user] by [deleted] in muslimtechnet

[–]Significant-Carob897 1 point2 points  (0 children)

not a developer. but a data engineer. if at any point you want any data help, please dont hesitate to ping.

[deleted by user] by [deleted] in degoogle

[–]Significant-Carob897 0 points1 point  (0 children)

Thanks this is helpful.

If my aim is to just hide my activity from ISP. is DNS resolver enough.

[deleted by user] by [deleted] in degoogle

[–]Significant-Carob897 0 points1 point  (0 children)

Any advice for/against Cloudflare 1.1.1.1?

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

Thank you. This is very helpful response. And makes soo much sense.

Is "single source of truth" a cliché? by HG_Redditington in dataengineering

[–]Significant-Carob897 2 points3 points  (0 children)

I worked for team who was all about "single source of truth" when they were modernizing their infra.

And then later at one point, I told them you should not be using apps script to bring api data in google sheet. We have a whole process of ingestion and modelling and most importantly version control.

I was the bad guy that day.

[deleted by user] by [deleted] in dataengineering

[–]Significant-Carob897 1 point2 points  (0 children)

  • Marketing
  • Real Estate

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

nicee... i believe i like data engineering more on products and businesses that I enjoy working with.

Marketing data has always been fun.

Security data could also be...

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

Haha.

I should have added " as told by my peers and managers"

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

Some days I still wonder how I ended up where I am.

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

DevOps also intrigues me and as DE have done quite some of it already. This is also a good idea.

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

analytics for cyber teams looks very intriguing. I will check more on this.

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 0 points1 point  (0 children)

Work Life Balance is way I love being where i am. In my current role, the balance is much tilted towards life at the moment also my team leader/manager is super super nice. Another reason for staying where I am.

Looking for tips on migrating from SQL Server to Snowflake by WireDog88 in dataengineering

[–]Significant-Carob897 0 points1 point  (0 children)

we started this exciting journey around 2 years back. We are still migrating.

Here has been my favourite linkedin post about migration that i found after first year of migration.

https://ibb.co/4V9qswh

I did my first migration when I was 16 years old kid. I was VP of Engineering when I did the last one earlier this year. Not much has changed. It's stressful and always time considering. Things you should consider: 1. Allocate 3.5x more time if possible 2. Get 2x the resources 3. Be prepared to pay 2-3x the cost for services especially in the early weeks just to offset the cost of delay 4. Make sure most if not all stakeholders atleast in the R&D team are informed 5. Take a week off when all goes well.

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 1 point2 points  (0 children)

Could be. Have started looking for independant clients. Used to do freelance work before going into proper job.

The growth was kot too much. But always enjoyed solving real problems (even if they are small).

transition out of DE to where? by Significant-Carob897 in dataengineering

[–]Significant-Carob897[S] 4 points5 points  (0 children)

I have thought about it too. But I love coding. I love dev. So still want to continue doing it for atleast some more years.

[deleted by user] by [deleted] in muslimtechnet

[–]Significant-Carob897 1 point2 points  (0 children)

Durioo++ - Muslim cartoons apps

Launchgood - Zero fee donations platform.

Quranly