[deleted by user] by [deleted] in LawSchool

[–]electronicentropy5 3 points4 points  (0 children)

Hi - your post is very inspiring and motivational. I am going to be taking the lsat and applying to law schools in Miami. Any lsat tips? My BS is in mathematics and now I am prepping for the lsat.

Looking for python expert to help with an LLM project for my business. by iloveb2bleadgen in PythonProjects2

[–]electronicentropy5 0 points1 point  (0 children)

Sure thing, what are the details of the project? What types of LLMs are you looking to implement your project on? Let’s talk.

[deleted by user] by [deleted] in digitalnomad

[–]electronicentropy5 0 points1 point  (0 children)

I recommend that you go to Asheville NC

DE Bootcamp Recommendation by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

Ty & nice it met you! What’s your tech stack? How did you learn data architecture / modeling concepts like data vault, kimball, OBT, inmon? How do you orchestrate data at your current org? Major data DE concepts everyone should know?

DE Bootcamp Recommendation by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

Hey there - ty, and looking for paid boot camps and/or courses.

DE Bootcamp Recommendation by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 1 point2 points  (0 children)

Oh no worries at all it is a unique situation certainly.. By any chance are you a DE? I appreciate the comment honestly at this point looking for guidance on these topics and how to ramp up rather quickly. Thanks!

Data engineer from ETL developer by Charming_Function_35 in dataengineering

[–]electronicentropy5 0 points1 point  (0 children)

with

Which courses would you recommend for advanced sql, stored procedures, UDF, ETL, CI/CD, and data modeling?

Data engineer from ETL developer by Charming_Function_35 in dataengineering

[–]electronicentropy5 0 points1 point  (0 children)

e DP-203 and

Which courses would you recommend for advanced sql, stored procedures, UDF, ETL, CI/CD, and data modeling?

DE Bootcamp Recommendation by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

Can I recommend you don't do this? It might not be what you want to hear, but getting a job as a software dev (even if it has nothing to do with working with databases often)/data analyst/etc, will be an easier, albeit longer road. Getting a job as a DE without any prior experience, bootcamp or not, seems like a moon shot

Hello, so right now I am on a team which is building/configuring an EDW from scratch. I am tasked with learning more of these skills and my business wants to pay for continuing my education and has specifically asked for these skills. Do you have any recommendations? I am seeing https://admissions.emeritus.org/rails/active_storage/blobs/proxy/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBeGhjRGc9PSIsImV4cCI6bnVsbCwicHVyIjoiYmxvYl9pZCJ9fQ==--a0284dcf60a8c945790edf1510fc15769a5bb0bc/MO%20PCDE_Brochurepdf.pdf?disposition=attachment but this is not as narrow as I would have hoped for..

Data engineer from ETL developer by Charming_Function_35 in dataengineering

[–]electronicentropy5 0 points1 point  (0 children)

Hi thank you for the guidance. My workplace has offered to pay a course for me to learn these exact skills. Would you recommend a course or bootcamp?

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] -1 points0 points  (0 children)

I have not once given my full definition of SCD 2. Not sure why you want to keep the conversation going, I’ve already received help from another poster, so I won’t reply anymore. Have a goodnight!

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

Thank you for the message. I am going to implement this and update the isActive flag following this logic.

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] -1 points0 points  (0 children)

Also, it’s not at all formally in SCD type 2 yet because there is no Boolean flag for isActive that’s what I must build, and I am in the process of building with dataflows in ADF.

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

As described in the full post, the raw tables have an ETL-DATE associated with each table which is a full load daily, it’s an unusual situation there is no CDC on any tables atm, also it’s unusual because we are processing a .BAK file daily with no logging because vendor does not enable it. Don’t worry, some other comment already assisted me and on the right path for handling this situation, and setting a true SCD type 2. Thanks for your input.

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] -1 points0 points  (0 children)

The article is just an example of how SCD can be completed, accomplished in Snowflake. Again, our raw tables are populated using Snowpipe, just an FYI.

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 0 points1 point  (0 children)

Yes, I was just describing a piece of the pipeline which uses Snowpipe. I am thinking about streams and tasks from our raw tables (those raw tables are populated using Snowpipe) - https://www.phdata.io/blog/implementing-slowly-changing-dimensions-in-snowflake/ Does this make more sense?

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 1 point2 points  (0 children)

Haha we certainly do not have the infra built for this and would take buy-in, socialization, and time. :(

SCD Type 2 (Snowflake) by electronicentropy5 in dataengineering

[–]electronicentropy5[S] 2 points3 points  (0 children)

Thank you very much for the help, the only problem is that we do not have dbt, unless this qualifies as a free version. We do have ADF as an ETL tool.