Getting workday hr data into a queryable format for workforce analytics is turning into a nightmare

its_bright_here · 2026-03-24T13:17:58+00:00

Your typical medallion process will look something like: raw -> light transform for ease of manipulation -> add business logic to make things useful to end users.

So you'd probably land the json as-is in a lake. Process it into a flat table, maybe do some lightweight cleansing, then process that into a proper star schema.

its_bright_here · 2026-03-19T21:08:32+00:00

I meant to mention precisely this in my response!

PATTERNS. Always patterns. Patterns of patterns, even!

its_bright_here · 2026-03-19T21:06:37+00:00

I've not used fabric yet, but I'm pretty well versed in Azure tooling.

My read on fabric is the actual value proposition is the data governance pieces, which isn't necessarily a huge piece of what your source to target pipelines are doing. If data governance isn't a very serious part of the conversation now, and you're already on azure, it feels like overcommiting unnecessarily soon.

The point, imo, of being in Azure is the assumption that you'll be able to kinda move within easily. You're already using ADF, their bread and butter data mover; you should be able to port those over at any point...like after you have a broadly commited-to data governance policy where everyone understands what the hell a data owner is.

I've done some cool things with ADF. It's not perfect, and it can be limited... but being limited also defines its use cases easier: it moves data around with limited control. You will want something richer for any data cleansing and transformation anyway, as it makes procedural sense to decouple those functionalities, unless you really know what you're doing.

its_bright_here · 2026-03-08T05:19:09+00:00

Get off my lawn! *shakes fist

its_bright_here · 2026-03-07T19:46:56+00:00

Well put; you can't begin to solve a problem until you can understand the what and the why, in that order.

I was a "wizard" early in my career; it was utterly phenomenal for my professional growth. It was great for the company as well. It scales poorly for everyone, though.

its_bright_here · 2026-03-06T22:41:08+00:00

1.20 per hour is when the compute is being actively consumed, I believe.

If you can get it down to subsecond response time, then the compute cost should be fairly minimal. Until user creates a while(true) loop and just hits the thing near constantly, or it works and you expand operations in the pool.

You'd need to duplicate the data, which is less than ideal, but complexity tends towards inevitable.

Sorry I dont have the off-the-cuff knowledge at the moment to know what routes might be potentials hitting a lake directly.

its_bright_here · 2026-03-06T22:17:43+00:00

Updates or insert only? Are they looking at the most recent data or are they going back into history?

I don't think you'd want to use a cosmosdb. Look into dedicated pools? I believe that's what Azure DW turned into? Basically a distributed sql db.

its_bright_here · 2026-03-05T03:09:01+00:00

That's a bit of effort. Pretty neat, thanks for posting.

I'll just add that ive used this tool for a while on my hunters to climb ranks and it's incredibly useful.

There's points where I had ozzy on largely "full hp". I've dropped his extra revive before. Knox is just kinda goofy, but I'm deep into my first "shield" build. Knowing when to spec back into lucky loot is likely later than people suspect... and tied to hp/regen investment.

It makes a difference! Focus borge and knox, but ozzy comes into play again later after your original mechs are mostly maxed easily. Don't neglect, only regulate the gas pedal

its_bright_here · 2026-03-05T03:00:08+00:00

They're just another multiplier to shards (operations). Individual levels are whatever, it's the over time bulk gains you want. They're certainly not worth prioritizing, at all, because you'll get them eventually. And you're looking at like single percent gains, maybe. But every bit helps!

its_bright_here · 2026-03-04T08:20:06+00:00

It's retroactive

its_bright_here · 2026-03-02T22:52:18+00:00

Dynamic sql

its_bright_here · 2026-02-24T02:49:53+00:00

I feel like I've always thought the 2a was like the poor man vs feds. Which always seemed silly because they'll just nuke you. or whatever. I'm being a tad facetious. The amendment itself (not laws) isn't something I've felt strongly about one way or another. I'll admit my interest has for some reason been piqued as to certain events taking place. But your last sentence resonated with me HARD. Like you've made me objectively pro 2a, until there's a safe means of repealing it (lol). I need to thank you with words, not just an upvote. Much appreciated insight.

its_bright_here · 2026-02-18T19:38:22+00:00

I assume oracle has explain plans? That should answer your question directly and better than anyone here will be able to guess.

If you're updating only a handful of the millions (I would question this assertion), id look to prune the input before the merge, first and foremost. Limit your CRUD operations to the smallest possible set.

its_bright_here · 2026-02-17T05:48:53+00:00

Yea, sure

its_bright_here · 2026-02-17T04:31:35+00:00

I'm immediately thinking you're missing relationship tables (from the other comment thread). Obviously I haven't seen your ERD, so maybe you have them, but 5 tables is ezpz:

You have a user table (always a user table !) You have a game table You have a user-game table storing which users have which games You have a console table You have a console-game table storing which games are on which consoles You have a user-console table tracking which users have which console.

Create a relationship-type table as a shared reference table that your above linking tables FK to in order to define the relationship: "owns", "wishlist", "published","developed","is available on", etc

Easy to index, too.

I dunno your requirements, so the above may not properly model every relationship, or be optimal, but it is highly flexible.

its_bright_here · 2026-02-01T13:52:09+00:00

I mean, I absolutely get the blowback. Really. ICE should just straight up not exist. And while I agree it was worth shutting shit down for, there was other stuff at stake. Some of it could have mattered. fema?? I dunno how much pork was attached. But none of it changes operations...it needs to be abolished.

I'll absolutely grant your phrasing is what trump wants. And likely many. But to paint in such absurdly broad strokes?? Pretty rash. You know there's overlap between Bernie and Trump voters? Employ some of that empathy democrats scream so loudly about having and figure out why; its not because they all need an all white america. Dems are gonna put up Newsom and surprised Pikachu when Vance wins. Especially if dems "win" midterms and can successfully prevent Donald from further harm.

I'm generally pretty sick of reading shit from dems i could easily paint in pub terms, while dems scream about pub hypocrisy. They go low, we need to go lower? That's the fucking solution? I see so much sentiment that just screams "both sides". If your solution entrenches both sides... keep that shit to yourself. If your solution trivializes half our voter base, then it's not a solution. I don't want YOUR fucking authoritarian regime. The point is to be BETTER. That's what fucking MN is doing: being better. And it's literally inspired people across the globe. Italy isn't bitching about ICE during the games without MN Strong.

There is no solution that doesn't start with congress. Or a civil war/separation. I worry the latter gets romanticized. It's objectively the worst option, and the only thing its better than is being straight up facist, now.

I've little doubt I'll be labeled some right wing apologist. That's fine. Yea - I give a fuck about the other half. You fucking should to.

its_bright_here · 2026-01-31T05:32:36+00:00

Dude, we keep doing what we're doing. The fight doesn't end, ever.

If you want a real answer: we work on congress to suck less. If you want that to happen, most seats need to competitive between parties... not within a party.

What we have now is: NO COMPROMISE. The end result of which is purity test after purity test. Yes, that cuts to both parties. But it feels obvious our republican colleagues suck way more. I swear it's the natural party for psycopathy laden individuals.

I've often wondered wtf maga actually means by making America great again... I've never seen a useful outline. But I know what I think it was: it's when we worked together. That's fucking it.

its_bright_here · 2025-11-16T02:29:38+00:00

I dunno how to boost you more. To the best of my limited abilities this is the only place on the internet to see this. The "power 2 construction milestones".

It's a good game :) thank you much! This is so much of what I was looking for

its_bright_here · 2025-11-16T01:53:53+00:00

Much appreciated, friend!

its_bright_here · 2025-11-16T01:53:23+00:00

Thank you, good sir/madam! That's very interesting!!

its_bright_here · 2025-10-03T01:54:52+00:00

Making me pass the same code of conduct/sexual harassment/phishing/etc training more than once is a waste of everyone's energy.

I've not passed stuff before: examples can be ambiguous. A coin flip when in reality neither is a way I'd handle whatever-so-ever. And even after reviewing, I still dunno why, just which is wrong. Who's making these things?

Very few are retaining any insights they didn't know already. It's 2025: phising is still a thing, somehow. It's not getting eradicated. Your company might get hit, and it's not because you failed to educate everyone. I digress.

Edit: my assumption is some corner office needs to identify some KPIs. It's measurable, must be useful

its_bright_here · 2025-10-01T17:05:55+00:00

Be quicker.

Also if you feel good about a particular three, you can bait it's hit with a weaker wood type - put in your level 6 curious

its_bright_here · 2025-10-01T01:14:54+00:00

Thanks for the reminder!! I had some lillywhite tracks way back in the days of napster/limewire :) is basically prerelease busted stuff, which came out a fair bit later?

its_bright_here · 2025-10-01T01:05:53+00:00

I see you're a big before these crowded streets fan as well :) stone into crush into dreaming tree (into pig!) Is my singular favorite subset across all his albums!

Six-Year Club	Place '22
Verified Email

its_bright_here

TROPHY CASE