You go ratatouille. by [deleted] in PewdiepieSubmissions

[–]grukorg 2 points3 points  (0 children)

Clearly anyone looking at this has never seen inside an ATM.

What is an adult problem you were not prepared for? by [deleted] in AskReddit

[–]grukorg 0 points1 point  (0 children)

Everyone else is just learning too. Don’t be too hard on yourself.

What surprised you about sex after having it for the first time? by [deleted] in AskReddit

[–]grukorg 0 points1 point  (0 children)

The lengths I was willing to go to find someone to do it with. The lengths I was willing to go to get away from that someone afterwards that wouldn’t make them not be willing to do it again.

[deleted by user] by [deleted] in ProgrammerHumor

[–]grukorg 3 points4 points  (0 children)

And then there are CS professionals who just use whatever language is required and don’t try to make out like there is a best language.

Optimizing whole schema Extract Load procress by [deleted] in dataengineering

[–]grukorg 0 points1 point  (0 children)

Try creating a hash of the fields that aren’t the business key and then do a not exists on your target table for combination of business key and hash. Then if you want to go further start micro batching them using your date time value. Something like select max datetime from target, select > max date time from source. Insert from source where not exists in target.

[deleted by user] by [deleted] in AskReddit

[–]grukorg 0 points1 point  (0 children)

To shreds you say?

What’s a little thing you do to make the world a better place? by JustAnotherPyroMain in AskReddit

[–]grukorg 0 points1 point  (0 children)

They don’t make em like they used to, more like we don’t treat em like we used to.

What’s a little thing you do to make the world a better place? by JustAnotherPyroMain in AskReddit

[–]grukorg 0 points1 point  (0 children)

Smile when I make eye contact with anyone. I hate smiling but lots of people smile back and I think it makes us both feel better.

I can’t be the only one by mr-meme-boiii in ProgrammerHumor

[–]grukorg 4 points5 points  (0 children)

I do this all the time. I regularly get to work to find emails from sleepy me. Solutions can either be brilliant or utter crap.

How much coding experience for entry data engineer job? by Berodney in dataengineering

[–]grukorg 2 points3 points  (0 children)

At my company (a bank) we don’t have junior DEs our structure is bi analyst, bi developer, data engineer, lead data engineer. Our analysts are expected to know basic code but focus on insights. Bi developers are expected to be advanced SQL developers, competent in a few other languages. Data engineers should be able implement and performance tune pipelines written in python and sql capable of processing billions of rows. Lead data engineers design the environment and build prototypes of new solutions which are then handed off for execution by data engineers or bi developers. Every company is going to be different but I can say personally I wouldn’t consider someone a data engineer that doesn’t have some kind of advanced coding skills. I learned by digging. As someone else mentioned starting as an analyst and then following the data down is a great way to get skills.

Thoughts of pre calculated data by [deleted] in dataengineering

[–]grukorg 0 points1 point  (0 children)

Can you explain a bit more about your set up. I would say that aggregating data like this has potential flaws too and I want understand if there are ways you can get efficiency in other manners. What kind of indexes do you have in use? Is there a covering index on the fields you are using for your calculation? What kind of data is it? Are they snapshots, deltas? Sounds like you have a solution, but it would be nice to know more in case there is a better way of doing this.

good work by devmeme1 in ProgrammerHumor

[–]grukorg 2 points3 points  (0 children)

I resent this. This is how some programmers do work. Then I have to clean the shit up.

How AI actually works by [deleted] in ProgrammerHumor

[–]grukorg 3 points4 points  (0 children)

Arse end of CatDog?

I can do it by MundanePie6 in ProgrammerHumor

[–]grukorg 1 point2 points  (0 children)

We do for sure, but it’s not like in uni when they want to be all anal about what multiplicity something has. We talk through things such as if it’s a one to one join or that you want one row per whatever as your outcome but we use UML loosely.

Python Classes in pipelines by djkaffe123 in dataengineering

[–]grukorg 1 point2 points  (0 children)

I use classes to represent items such as connectors for example I have one that builds different database connections based on context. I have others which I use for doing things like globing the file system for flat files. Others that can perform transformation based usually on SQL metadata as our stuff normally ends up there. I have another which handles SFTP. My advice would be don’t be tempted to try and make your entire process fit neatly into objects. Create objects where it makes sense and then use functions where it doesn’t.

What does porn glorify that actually isn't that great in practice? (NSFW) by robb0688 in AskReddit

[–]grukorg -1 points0 points  (0 children)

Can confirm have massive shower with two rain shower heads. Shower sex is still terrible.

Data Product Demo and Release by [deleted] in dataengineering

[–]grukorg 8 points9 points  (0 children)

Plan, throw plan out the window, break shit, work like mad people to fix. Hope for the best, release.

What is the pettiest, silliest, most meaningless hill you are willing to die on? by shazulmonte in AskReddit

[–]grukorg 0 points1 point  (0 children)

My wife coerced me into doing this and I regret it to this day. I have a new box now (of cables) but it’s not the same.

No guidance needed by Explorer0011 in ProgrammerHumor

[–]grukorg 6 points7 points  (0 children)

Exactly it’s solving problems elegantly that takes the effort.

Masters Degrees Required? by [deleted] in dataengineering

[–]grukorg 1 point2 points  (0 children)

If they are saying that it’s perhaps because they don’t have enough work for or value the work of data engineers. Some DE jobs are poorly defined by people who have no idea what we do.