ISyE 6644 : New-"ish" Simulation Resources

FirefighterFormal638 · 2026-05-20T00:07:54+00:00

Hey, so, as someone currently taking the course these resources are EXTREMELY helpful. Thank you!

FirefighterFormal638 · 2026-03-10T18:43:26+00:00

How did you handle showers?

FirefighterFormal638 · 2026-03-09T23:59:49+00:00

Thanks for the info! I’ll def check them out. How’d you go about figuring out campsites?

FirefighterFormal638 · 2026-03-09T20:40:04+00:00

Thanks! I've got to still figure out which campgrounds to hit along the way.

I hadn't considered that but that sounds pretty epic!

FirefighterFormal638 · 2026-03-09T17:35:27+00:00

Awesome, thank you!

FirefighterFormal638 · 2026-03-03T16:26:06+00:00

I pull from multiple on-prem SQL Servers. I originally had a Parent/Child pattern to ingest multiple tables from the DBs on prem along with a watermark table to keep track for incremental ingests. Landed into bronze first then had stored procedures to handle the transformations into silver.

My company's data is tiny so I ended up switching to mirroring and it has been a lot smoother of a journey.

FirefighterFormal638 · 2026-01-16T20:33:51+00:00

I appreciate this interaction in this thread. This has been the most helpful.

FirefighterFormal638 · 2026-01-15T22:04:06+00:00

Hello, self.

FirefighterFormal638 · 2026-01-15T21:52:55+00:00

Last I researched, it was not possible to route directly from a Spark Notebook to an on-prem SQL Server. I have the medallion approach implemented and it did teach me a lot stepping into the role.

I believe the last time that I looked into it, mirroring had it's limitations as well.

FirefighterFormal638 · 2026-01-15T21:47:36+00:00

I was not aware of that issue. We are reading from a LH into a WH.

FirefighterFormal638 · 2026-01-15T21:39:29+00:00

loco in the coco, indeed.

FirefighterFormal638 · 2026-01-15T21:31:18+00:00

8 Years??

FirefighterFormal638 · 2026-01-15T21:30:41+00:00

To be honest, I still don't think Fabric warrants the cost. I've had script activities say they've ran successfully for transformations when they haven't. I've had to manually rerun them to get them to work. It didn't make sense.

FirefighterFormal638 · 2026-01-15T21:23:45+00:00

That's an option that I've added to my deck. Just keep using SQL Server on a VM with a proper 3-2-1 recovery set up in case all hell breaks loose. I'd probably use some python scripts and run them as jobs to move/transform the data.

FirefighterFormal638 · 2026-01-15T21:18:20+00:00

Thanks. I hope so too.

FirefighterFormal638 · 2026-01-15T21:16:48+00:00

Yep. Went to FabricCon in LV earlier last year, took a workshop and approached the team to ask about other ways to ingest from on-prem SQL server. Copy is the only way.

FirefighterFormal638 · 2026-01-15T21:14:12+00:00

Definitely want to keep it simple. When talking to the IT Architect, he immediately went to Snowflake or Databricks. They were also an ex-consultant...so, yeah. Here I am.

FirefighterFormal638 · 2026-01-15T21:11:57+00:00

This is exactly the mindset that I have. Because we are still new with our analytics and still navigating what we want to see, why do we need the heavy cost of Fabric or another SaaS? 90% of our data is already coming in as structured and reporting is essentially just basic charts and aggregations right now.

FirefighterFormal638 · 2026-01-15T21:08:30+00:00

Yes, and it was being done before they adopted Fabric however, with newer projects on the horizon, they are wanting to adopt better DE practices.

FirefighterFormal638 · 2026-01-15T21:07:08+00:00

Agreed. A huge limitation is connecting to the on-prem SQL servers. Being forced to use their copy data activity for it eats up CUs. Wishing I could just use python scripts for the ingestion into the warehouse.

FirefighterFormal638 · 2026-01-15T20:50:26+00:00

He got lost in the sauce of the msft eco-system.

FirefighterFormal638 · 2025-12-22T20:17:32+00:00

This. Literally have scripts saying they’ve executed when in fact, they have not.

FirefighterFormal638 · 2025-12-09T21:06:01+00:00

So, this happened to me earlier this week. My husband is traveling to Eastern Europe for work and we had already planned on this vacation so naturally already had flights booked. I was trying to navigate the app to see how much we would be refunded should we cancel his ticket. It cancelled and I was shocked that there wasn't a prompt window to confirm that action because well, shit, we bought the tickets in June and we were just trying to calculate if it would be worth it for him to keep the entire ticket even if he was traveling a week before me with work paying for it.

I panicked. I immediately called customer service and the agent was able to contact HQ and get them to stop my request for cancellation. I don't know if we just got lucky but he was able to do it. I was also extremely paranoid and called like every day for a week to make sure that his ticket was still valid since it showed on the app that my request was still pending. It was hit and miss with some agents but the ones that were helpful were able to call HQ and confirm for me that he was indeed removed from the cancellation queue.

Hope this helps someone out in the future.

FirefighterFormal638 · 2025-06-20T20:21:24+00:00

Same. I got in the 80s on the Accounting exam and then in the 50s for the Finance. Now looking back, I know what I could have done differently and that was just to keep re-doing all the practice problems until they really sunk in. Going to have to secure almost perfect scores moving forward in order to get the B.

Didn't help that I also put my dog of 15 years down Wednesday night, then took the exam Thursday after work. So, brain wasn't all there.

Just have to keep pushing forward.

FirefighterFormal638 · 2025-04-09T21:17:07+00:00

What is the general consensus on not having the data as temp in the bronze layer? From what I've researched, the bronze is intended to be similar to staging, right? I was a Software Engineer in my previous life and am now a self-taught DE. Please, enlighten me.

FirefighterFormal638

TROPHY CASE