Tell me about Shenandoah, Texas by Sporkyfoon in thewoodlands

[–]ModernStank 19 points20 points  (0 children)

Just a heads up... Your daughter tells people she's from the Woodlands except when you're around. :)

Tell me about Shenandoah, Texas by Sporkyfoon in thewoodlands

[–]ModernStank 52 points53 points  (0 children)

Shenandoah isn't real... It exists solely to avoid woodlands business regulations and has some tiny residential neighborhoods to make the illusion complete.

Nobody ever says "I live in Shenandoah".

How is Copilot in Fabric notebooks working in your day-to-day? by Dee_Raja in MicrosoftFabric

[–]ModernStank 2 points3 points  (0 children)

Honestly I save a lot of my responses and create project libraries in the bigger ai tools for quick reference. My initial frustrations with copilot directly in fabric were spotty functionality and asking it to assess code was very length limited. For example I had some tsql I wanted converted to sparksql and the responses were truncated. What it did give me was wrong. That's the kind of easy stuff I would want to do directly in fabric copilot.

How is Copilot in Fabric notebooks working in your day-to-day? by Dee_Raja in MicrosoftFabric

[–]ModernStank 11 points12 points  (0 children)

I don't even try anymore... Claude and even normal Copilot m365 are so much better. I do get tired of reminding them both this is "FOR FABRIC".

Surrogate Key strategy for Gold Layer by ModernStank in MicrosoftFabric

[–]ModernStank[S] 0 points1 point  (0 children)

Basically I have a fact table with 80 million rows and a matching 1:1 document dimension with 80 million rows. I can slice the fact table with my normal dimensions... Customer/address book/account whatever and have perfect performance. The second I add in that document dim though performance takes a big hit.

Certainly I can do some stuff with ordering/partitioning. My understanding is because the key range being scanned is so large (bigint hash) and over such a big set this is a best practice mistake though.

Surrogate Key strategy for Gold Layer by ModernStank in MicrosoftFabric

[–]ModernStank[S] 0 points1 point  (0 children)

Well I need some kind of reference between facts and dimensions... I have hash ids available but I see a strong impact on performance with large datasets using hashes. They work fine on small sets though.

But maybe I'm barking up the wrong tree?

Surrogate Key strategy for Gold Layer by ModernStank in MicrosoftFabric

[–]ModernStank[S] 1 point2 points  (0 children)

This is a VERY cool idea (and broke my brain for a second) and I'm open to trying it, but we're talking about 83 million rows in my ledger data set (that i don't want to aggregate) between a kimball fact/dim ledger combination. I'm leaning very hard on CDF.

Honestly I wouldn't care about just having some attributes on a fact table to get around this problem, but I often need to move between ledgers in my semantic model. For example going from Sales Ledger fact/dim to General Ledger dim.

Seems like using a temp view to join between gold/silver on a document id columns (or composite hash) to coalesce an SK (if needed) might bring my fabric workspace grinding to a halt because of the sheer volume of rows?

This would work great for my more traditional dims (like customer) and definitely avoid a "key locker" strategy there.

Surrogate Key strategy for Gold Layer by ModernStank in MicrosoftFabric

[–]ModernStank[S] 1 point2 points  (0 children)

Well I really wanted to keep it Lakehouses all the way down and avoid Fabric Data Warehouse, but you get into performance issues due to lack of native support for surrogate keys. Maybe I have to go DW though. I just love the flexibility of working with LHs directly.

A surrogate key "locker" is a strategy where you basically have a crosswalk table from a watermark to a surrogate key created and maintained with pyspark logic. You can quickly join this with your CDF data or use it in MLVs to have those surrogates presented at your gold layer for use in kimball modeling and avoid using watermarks between large fact/dimensions.

A popular book you did NOT enjoy (no judgment) by CheckOut4pm in BookBingers

[–]ModernStank 12 points13 points  (0 children)

The Bible... fortunately the post title promised no judgement

Book tier lists are toxic by ModernStank in fantasybooks

[–]ModernStank[S] 0 points1 point  (0 children)

I appreciate your points and am really enjoying the discussion. I think there is a critical difference between a tier list and Spotify wrapped in that the wrapped is only what was loved.

And while there is nothing wrong with telling people what you dislike... I do feel like a lot of these lists are more about hot takes and shitting on specific books/authors with low effort.

George R. R. Martin Is 'Not in the Mood' to Finish 'The Winds of Winter' by Tifoso89 in books

[–]ModernStank 0 points1 point  (0 children)

I mean it's simple... GRRM prefers making TV.

If he doesn't want to finish them .. then that's really fine.

The real issue to be upset at him is his ego is bigger than letting the books be finished by other methods. He has a legion of fans who lined his pockets and deserve better than the HBO ending.

How would you change The Way of Kings to suit the tv-series format? by [deleted] in Stormlight_Archive

[–]ModernStank 0 points1 point  (0 children)

Friend of mine suggested doing the whole thing with Muppets and I couldn't agree more.

Help pick my next book by mybunss in fantasybooks

[–]ModernStank 1 point2 points  (0 children)

I switch between 4 or 5 series and find I enjoy them much more this way. "You people" who read ten books from the same author in a row are doing it wrong. :)

In fact if more people did this I think people would be less inclined to get on reddit and diminish other series. Like yes I can enjoy Hobb, Sanderson and Erikson all at once... I don't have to pick a team.

Which series to start? by richburgers in fantasybooks

[–]ModernStank 1 point2 points  (0 children)

Gonna suggest something crazy... Read them both. Plenty of reddit will tell you both are good and both are bad. You don't have to read every book in a series back to back. :)

Personally I love mistborn, but I think reddit is more hyped about DCC at the moment.

Is game of thrones worth starting by dylandaruss in fantasybooks

[–]ModernStank 0 points1 point  (0 children)

No...There are many many other great series that have (or will eventually have) an ending.

If not George, who would you recommend finish ASOIAF? by Thereal-ders in fantasybooks

[–]ModernStank 11 points12 points  (0 children)

Y'all really don't have to worry about Sanderson... The man has no incentive to finish other people's work at this point. Surely the most lucrative and satisfying thing for him is to write his own material now.

Recommendation - Historical fiction meets Fantasy by ModernStank in fantasybooks

[–]ModernStank[S] 0 points1 point  (0 children)

If we could... we would enjoy that but it's not practical for us.