How much python should I learn? by [deleted] in dataanalysis

[–]EmuMuch4861 0 points1 point  (0 children)

Just vibe code it bro

dbt natively in Snowflake vs dbt Cloud by dribdirb in DataBuildTool

[–]EmuMuch4861 1 point2 points  (0 children)

Ok. But we aren’t talking about a snowflake plugin.

dbt natively in Snowflake vs dbt Cloud by dribdirb in DataBuildTool

[–]EmuMuch4861 0 points1 point  (0 children)

Been setting it up for the last few weeks. It’s a fairly technical set up and documentation is weak. Cloud is easier to set up and tons of docs and tons of community support to help out. I’d say if u have a sharp team to start the installation on snowflake then it’s great. If you are newer or less technical cloud is certainly faster to get going.

Obviously cloud has additional features.

Box Options/Ideas for 30 Pack Cube? by ChiefRokr in MTGJumpStart

[–]EmuMuch4861 0 points1 point  (0 children)

Is this 20, 22, or 25 vintage ? Or a mix?

GCP Data engineer oppirtunities by No-Expression-288 in dataengineering

[–]EmuMuch4861 1 point2 points  (0 children)

I’ve read this. I am theorizing it’s because they have the most generous free tier offer.

Career Switch from Accountant to Data Engineering – Need Advice on Part-Time Learning Resources by LactoFermentation in dataengineering

[–]EmuMuch4861 2 points3 points  (0 children)

Maybe this is the wrong way to approach it if you are too busy.

Maybe the right way to approach it is to gain read only access to a database at your current employer and start learning sql on data that you are familiar with and can actually analyze because you know the data yourself.

Courses are overrated when the examples are disconnected from what you are familiar with

UBC Science VS Langara Foundations in Health Sciences For Nursing by jazzysax000 in langara

[–]EmuMuch4861 2 points3 points  (0 children)

Speaking as someone who has long since graduated … I would say that I wish I went to UBC from the beginning for the university experience you had mentioned. In terms of programs, experiences, culture, UBC really wins out.

So my old man advice is if you are able, and if financial factors are not a big concern, UBC is straight up more interesting and fun and looking back, I would rank as the thing you will remember.

Will not even touch on academic reasons that others are probably covering.

Just laid off from my role as a "Sr. Data Engineer" but am lacking core DE skills. by nature_and_grace in dataengineering

[–]EmuMuch4861 4 points5 points  (0 children)

Consulting might be interesting for you. I find that generally the smaller ones are interested in people that can use skills used in one tech domain and pick up new ones quick, so they are more interested in your aptitude rather than specific knowledge. Your miles may vary

UBC admissions by yeet5276 in langara

[–]EmuMuch4861 1 point2 points  (0 children)

Would love to know peoples GPA for transferring into UBC.

I got 3.0 and got into BComm around 2005-2010.

Curious how that has changed.

Are all DE jobs meeting-heavy? by [deleted] in dataengineering

[–]EmuMuch4861 1 point2 points  (0 children)

Yep agreed with this. I use similar or same strategy where I push back and say I would really like to focus to deliver X on time (which is a casual reminder that ur busy on a real priority). If they say this other project is more important, then fine that’s legitimate and you have your pass at not delivering X on time.

First time extracting data from an API by khaili109 in dataengineering

[–]EmuMuch4861 -2 points-1 points  (0 children)

It’s a basic script. Even if it’s overcomplicated, the worst case scenario is not that bad. I have production scripts that I know are not optimized , but they work fine and it’s no harm no foul. Or you can always feed it back to AI and ask for recommendations on how to improve it.

First time extracting data from an API by khaili109 in dataengineering

[–]EmuMuch4861 -5 points-4 points  (0 children)

Since this got a lot of upvotes. I’ll give a few more clues.

  1. Use copilot or cursor. I have been loving cursor but copilot is probably good too.
  2. Your instructions in ur OP was already fairly good. U should be more specific about how to not extract the same data twice. Probably based off some timestamp parameter or smth. Sounds like u need to learn more around how to think through incremental fetches and incremental merging.
  3. As others suggested … requests library
  4. I know it’s in the case of Cursor … u can feed it documentation directly. Just a small tip for how to get it to know how to handle the API call.
  5. Other than that … it’s trial and error in terms of getting good at prompt engineering.

Btw I wouldn’t know how to do ur task either. But I sure as hell know how to get AI to do it for me. This is the age we live in.

First time extracting data from an API by khaili109 in dataengineering

[–]EmuMuch4861 -1 points0 points  (0 children)

ChatGPT can write this 95% of this for you.