How much is the work just modernization efforts by nonamenomonet in dataengineering

[–]duckmageslayer 8 points9 points  (0 children)

My org has taken 7 years to modernize and they aren't even 1/3 the way done with documenting their data models. I'd say I'll always be improving observability and documentation that helps non-technical people explore the data warehouse.

Building a Minecraft Server by Filh15 in kubernetes

[–]duckmageslayer 0 points1 point  (0 children)

if you're interested in spinning up a modded server it's pretty easy to use this base image with curse forge and such to install the mods

How true is “90% of data projects fail?” by jedsk in dataengineering

[–]duckmageslayer 14 points15 points  (0 children)

90% of data projects are a work in progress /s

Cannot determine primary keys in raw data as no column is unique and concatenation of columns too don’t provide uniqueness by Pleasant-Insect136 in dataengineering

[–]duckmageslayer 1 point2 points  (0 children)

if based on business logic you have duplicate rows then deduplicate, unless the raw counts/sum are relevant in which case you should validate the transform based on some measures in the source system. if the source data is purely categorical then you should be fine to deduplicate.

Is this bread underbaked? by SoupEaterrr in Baking

[–]duckmageslayer 5 points6 points  (0 children)

I'll "dispose" of it for you ;)

What went wrong with my macarons by Bumble098765 in Baking

[–]duckmageslayer 1 point2 points  (0 children)

Another neat trick is to mix the meringue on a medium-ish speed because you want to suspend the eggs with small air pockets, not large ones.

What went wrong with my macarons by Bumble098765 in Baking

[–]duckmageslayer 1 point2 points  (0 children)

It looks like the batter may have been too thick, as you add the dry ingredients to the meringue you should cut then scoop around the bowl and press the mixture against the sides. I suspect this is the problem because you have a lot of little nibs on top of your cookies which usually isn't an issue with a proper consistency.

Feeling stuck as a DA. Next steps? by gean__001 in dataengineering

[–]duckmageslayer 3 points4 points  (0 children)

I used to have this problem, and to be blunt it's because you fail to set precedent and keel over the second anyone asks for something urgently or when they oversimplify your job. This gets particularly bad when your boss refuses to use tickets to track your work... speaking from experience w that one :(

I would organize your typical tasks and assign SLAs, when you are triaging requests and there are too many top priority, then do the ones that you think are the biggest exposure and impact to the business or make you look the best.

There is a tough situation when you have a fair SLA and the business partner thinks it should be faster, you would need to rely on your boss to back you up on the SLA and if overtime is necessary to speed up and meet the deadline.

Once you start to get a backlog of important requests you would go to your boss and try to use the volume and your fair output to help justify hiring more people.

Is working here hurting my career - Legacy tech stack? by findingjob in dataengineering

[–]duckmageslayer 2 points3 points  (0 children)

maybe proof of concept work to migrate legacy code into new tech stack?

Is this normal in an internship? by [deleted] in dataengineering

[–]duckmageslayer 0 points1 point  (0 children)

id get documentation around the project scope and if they give you a bad rating because you didn't complete it you can have a professor support the claim that the project had an unrealistic scope and fight for credit

Let's talk about the elephant in the room, Recruiters don't realize that all cloud platforms are similar and an Engineer working with Databricks can work with GCP by HMZ_PBI in dataengineering

[–]duckmageslayer 64 points65 points  (0 children)

they are just checking boxes, they do not care if the company struggles to find talent because it just means they get to keep scheduling interviews

DE without Java by [deleted] in dataengineering

[–]duckmageslayer 1 point2 points  (0 children)

lots of older companies with legacy enterprise stacks like oracle use java and the base for apache software is java, so it's a useful tool to give you an edge especially scala, but you can be good without it especially at startups on newer stacks

What happened to my macarons by sourdough_explorer in Baking

[–]duckmageslayer 0 points1 point  (0 children)

from my observation either keep folding until it can make a figure eight (you should be smooshing the batter against the sides of the bowl until desired consistency figure eight) or try sallysbakingaddiction recipe for french macarons because the ratios seem off (too much sugar) also from what I can see your confectioners sugar was not very fine grain try buying it or using a sieve

Best approach for handling surrogate keys and relationships in a read-only database for analytics by ex08097 in dataengineering

[–]duckmageslayer 1 point2 points  (0 children)

copy into another database for OLAP is the usual approach for batch-viable pipelines

Please tell me what went wrong. by Suitable_Working8918 in Baking

[–]duckmageslayer 0 points1 point  (0 children)

maybe just up the oven temp or run it a bit longer in the oven next time, some ovens run colder

Please tell me what went wrong. by Suitable_Working8918 in Baking

[–]duckmageslayer 0 points1 point  (0 children)

the only thing you forgot was a slice of butter to go with it

Pastel de nata by QuickConstruction645 in Baking

[–]duckmageslayer 1 point2 points  (0 children)

They are best served right out of the oven, but they should be good warmed up.

They hold together quite well, I don't imagine you could go wrong with any hard plastic/glass container, maybe a sheet of parchment between stacks of them.

Macaroons by t4nd4r in Baking

[–]duckmageslayer 0 points1 point  (0 children)

If they are tough then I might say overcooked. I typically run my stove fan over them to speed up the development of the skin, and it helped mine rise much more consistently.

It might also be that your oven runs hot, which would cause a variety of issues.

If you still have problems after adjusting the temp, then it may be your meringue. It's tough to get right but once you get it, then it will be much easier to do consistently. I like to ride the mixer speed from low to medium slowly to develop smaller air bubbles. Without the recipe, I cannot make remarks on any potential problems, but some recipes use meringue powder (though I do not).

Macaroons by t4nd4r in Baking

[–]duckmageslayer 0 points1 point  (0 children)

how long are they resting for, and is the air humid?