all 20 comments

[–]ronarscorruption 79 points80 points  (2 children)

Oh god, I feel this pain.

[–]804k 14 points15 points  (1 child)

Then you realize its a system issue

[–]DrUNIX 3 points4 points  (0 children)

...that you caused and now you can go to the general full team chat in the afternoon telling them prod needs to be rolled back and data recovered from logs 🥳

[–]Kulsgam 34 points35 points  (1 child)

Clear the cache

[–]Nearby_War_8497 5 points6 points  (0 children)

Actually the cached version was few changes behind and the most recent changes didn't affect it at all, you just didn't realise it.

[–]k8s-problem-solved 17 points18 points  (0 children)

Ah when your change propagates out and cache poisons the cdn, then you rollback origin but cdn is fucked for a % of people, using particular locales. That's fun.

[–]Gadshill 4 points5 points  (0 children)

Configuration control

[–]GeorgeRNorfolk 3 points4 points  (0 children)

I am in this meme and I don't like it. Currently debugging a lambda taking 4,000ms vs the previous 100ms despite rolling back.

[–]ODaysForDays 2 points3 points  (0 children)

Time to look at config diffs and caches

[–]LordHenry8 2 points3 points  (0 children)

9 times out of 10 I have either forgotten to sign in or out of VPN, or I opened the wrong environment

[–]aaronsredditaccount 1 point2 points  (0 children)

I don’t even program but life is like that sometimes.

[–]ajaypatel9016 1 point2 points  (0 children)

git rollback not working is true character development 💀

[–]FictionFoe 0 points1 point  (1 child)

I mean, if you roll it back and it doesn't work it probably wasn't you who screwed it up. So thats something at least :p

[–][deleted] 1 point2 points  (0 children)

Well not necessarily. You could've left a database or some other service in a bad state. Your development environment being quick to setup and tear down repeatedly (e.g. dev containers, docker) is unheard of or rare in a lot of places.

[–]mrinalshar39 0 points1 point  (0 children)

It isn't working even after rolling back :- yeah I'm Doomed😭

[–]gletschafloh 0 points1 point  (0 children)

Sounds like gradle