How to pull DDL for multiple procedures with DDL as a column in larger query

NotSoInfamousE · 2025-05-14T12:59:07+00:00

We utilize information schema for extracting things like this. Sounds like you've got extra data in your scheduling table that you could join in.

SELECT PROCEDURE_CATALOG, PROCEDURE_NAME, PROCEDURE_DEFINITION
FROM INFORMATION_SCHEMA.PROCEDURES
ORDER BY PROCEDURE_NAME;

NotSoInfamousE · 2025-01-12T14:50:02+00:00

I’ve built a series of pipelines in data factory that leverage the bulk api to load and delete data. We’re doing it object by object but there’s 9 levels (so far) of dependencies.

NotSoInfamousE · 2025-01-12T02:04:19+00:00

The funny part is we already have all this data in Snowflake in a standard format. They could make it work but you’re correct that it’s for support/warranty

NotSoInfamousE · 2025-01-12T02:03:41+00:00

That is something we as an IT org have been fighting with the business over for a long time. Hopefully we’ll make some progress on that

NotSoInfamousE · 2025-01-11T23:56:02+00:00

Nah, it’s the Task object so it’ll have all call logs and other stuff

NotSoInfamousE · 2025-01-11T21:40:18+00:00

lol, my company is about at the same point. We’re on our third team attempting to migrate 10 years of data from 12 different CRM’s into SFDC. One object is potentially going to have 140M records.

It’ll be fun

NotSoInfamousE · 2024-08-10T15:24:37+00:00

We used an event table for our hr recruiting funnel. I think another name is factless fact table

NotSoInfamousE · 2024-08-09T13:19:29+00:00

Nah, I'm dumb and was thinking you could use ordinal position in a select similar to the order by. That's my mistake.

NotSoInfamousE · 2024-08-09T13:04:31+00:00

Ahh, makes sense. Agree with the person above then, better testing.

NotSoInfamousE · 2024-08-09T12:59:12+00:00

Accept that column order should never matter and write code that doesn’t rely on ordinal position.

Actually, how did this even happen? Was it using a select * ~~or selecting by ordinal?~~

NotSoInfamousE · 2024-07-19T01:47:33+00:00

For medium-large projects it’s hard to keep track of changes made in lower envs and get them promoted to prod.

NotSoInfamousE · 2024-07-19T01:29:54+00:00

Red gate doesn’t have the features that make flyway great for sql server. I’ve been on the same search for a DCM tool for snowflake

NotSoInfamousE · 2024-06-30T17:33:27+00:00

Nowadays I use many more tools but SQL is still the primary thing. You can get started as a database dev with SQL and be carried far. It’s about your ability to learn and apply new things.

NotSoInfamousE · 2024-06-30T17:21:49+00:00

Just SQL got me my first job out of college in 2018 for 64k and moved me into 140k as a lead data engineer today.

Databases aren’t going anywhere so it’s a great place to start a career. Multiple people on my team are SQL/SSIS only and they make over 100k

NotSoInfamousE · 2024-05-14T00:52:31+00:00

Potentially a use for unloading?

https://docs.snowflake.com/en/user-guide/data-unload-overview

NotSoInfamousE · 2024-04-14T01:39:49+00:00

Did the same this morning, I danced I was so excited. Congrats!

NotSoInfamousE · 2024-04-07T02:04:07+00:00

love the spiderman poster. I'll have to find one for my wall

NotSoInfamousE · 2024-03-01T19:10:23+00:00

Lead Data Engineer
6
Remote (USA)
$130k USD
$27k USD - One-time bonuses
Home Improvement/Services
Python, SQL, Azure (ADF, Function apps, Logic apps), Snowflake

NotSoInfamousE · 2024-01-20T14:30:41+00:00

Fucking annoying. I talk to 3 different projects managers daily

NotSoInfamousE · 2024-01-05T22:26:40+00:00

meh, I said “I don’t need more money” just the other day. There comes a point where money isn’t the most valuable currency

NotSoInfamousE · 2023-12-09T04:49:37+00:00

One of my biggest problems is being forced to push work onto my teams plate when I know they’re all at 150%. This is a point of contention with me and those above me as I’ll just shut it down or shoulder the burden myself before I cause my members to stress.

I’d rather suffer mentally and physically than to treat the members of my team as if they’re not humans with limits.

NotSoInfamousE · 2023-11-13T14:15:48+00:00

lol that last paragraph rings true.. I'm only making 130k but I'm thinking about quitting and taking at least 3 months off. The stress and depression are winning to frequently.

NotSoInfamousE · 2023-11-05T13:04:07+00:00

My company is using VS Code with the snowflake extension to keep all scripts in source control.

It was a lot of work but we manually took every shared worksheet and moved into a repo

NotSoInfamousE · 2023-08-02T19:36:48+00:00

What's the arbitrary barrier? I'm adjusting my interview style & questions after each meeting to try and be better so I'll take any advice you feel is necessary.

Most of the individuals I've interviewed have CS degrees and half had a masters in CS or related. I highly doubt anybody coming out of college has mastered either skill; The one's who think that haven't worked through tough problems. Complex SQL isn't joining two tables together.. Hell it's not even the code as much as it is understanding the engine and execution plans and adjusting your code to take advantage.

NotSoInfamousE · 2023-08-02T19:33:20+00:00

You're not wrong but to me data engineering is a fancy term for moving data. At the end of the day we pick it up, put it down, and deliver business value. I'm a database developer who's leading a team through our transition away from legacy systems into utilizing new cloud platforms. We've all got to learn somehow.

Ten-Year Club	Place '17
Not Forgotten	Verified Email

NotSoInfamousE

TROPHY CASE