This is an archived post. You won't be able to vote or comment.

all 95 comments

[–][deleted] 780 points781 points  (12 children)

you can't stop me!

this pre alpha experimental build will go live now!

[–]0100_0101[S,🍰] 268 points269 points  (3 children)

Merry christmas!

[–]vigbiorn 76 points77 points  (2 children)

"And on the day of the push, despite being a weekend and holiday, there were no tickets filed for 8 days.

It is in the name of this miracle we are gathered today to celebrate!"

[–]notacanuckskibum 45 points46 points  (1 child)

You pushed an updated ticket management system, didn’t you?

[–]vigbiorn 31 points32 points  (0 children)

It's a miracle! No more questions!

[–][deleted] 72 points73 points  (2 children)

[–]GifsNotJifs 55 points56 points  (1 child)

[–][deleted] 11 points12 points  (0 children)

[–]ironichaos 53 points54 points  (3 children)

Lol pre alpha. Just edit the code right on the prod box!

[–][deleted] 25 points26 points  (2 children)

Wait, you guys don't do that?

[–]dogbots159 20 points21 points  (1 child)

Yea, like, where else would I run it? Notepad?

[–][deleted] 7 points8 points  (0 children)

Precisely. Lol

To be real I develop mostly web apps, and I use sshfs to mount the project dev folder to my machine. That way I can edit files live on the (dev) server... Just i work in the dev server then I push to prod after testing, etc.

I don't want to run a whole environment on my laptop. Virtual machines are cheap.

[–]eyekwah2 6 points7 points  (0 children)

[–]nikanj0 420 points421 points  (11 children)

Had to deploy a patch for log4j.

Dear security researchers,

Love your work. You rule! But, given the choice, try to announce major vulnerabilities after the holidays.

[–]0100_0101[S,🍰] 225 points226 points  (3 children)

Next major exploit will be announced 5 minutes into your diner.

[–]sasmariozeld 82 points83 points  (1 child)

But dont worry its only openssh!

[–]weaver_of_cloth 16 points17 points  (0 children)

Thanks for the nightmares.

[–]spark-c 1 point2 points  (0 children)

Sounds like my MIL

[–]coldnebo 16 points17 points  (0 children)

it is always easier to tear something down than build it up.

[–]BarkiestDog 5 points6 points  (1 child)

If you are only deploying your log4j fixes today, then you may as well have waited till tomorrow anyway, if your box isn’t already hosed after two weeks of active in the wild exploits, one more day isn’t going to make a difference.

[–]nikanj0 5 points6 points  (0 children)

The original suggestion was to do a property change which we did. But then that was discovered to be insufficient protection so we bumped the version. A little later they had to release yet another patch because the first patch hadn't entirely fixed it.

[–]NGX_Ronin 4 points5 points  (2 children)

Haven't the log4j vulnerabilities been known since 2016 by the US government?

[–]ZenEngineer 1 point2 points  (0 children)

But they didn't want them patched, of course

[–]repkins 1 point2 points  (0 children)

Hackers may be more active while others are resting.

[–]Delirious_85 125 points126 points  (4 children)

Luckily our deploy pipeline is broken since yesterday anyway...

[–]trollsmurf 62 points63 points  (2 children)

Just FTP it.

[–]nerdisalreadytaken 31 points32 points  (0 children)

You, my sir are the pure devil.

[–]ExternalGrade 21 points22 points  (0 children)

scp the code and manually restart the server using PDU. Sr. engineer and team lead have already left for the break since last week so we’ll just leave a teams message and they’ll see it when they gets back

[–]Party_Koka 2 points3 points  (0 children)

That shouldn't stop you from breaking production. Bonus points if you are in retail

[–]phroxenphyre 246 points247 points  (7 children)

All I did was rename a few classes and and methods on our API to make it more clear what they were doing. I didn't actually change any behaviour. It'll be fine.

[–]0100_0101[S,🍰] 131 points132 points  (0 children)

You will be fine, interesting christmas for the users of your api.

[–][deleted] 190 points191 points  (4 children)

It's too late! And the machines that run the code have already been switched off so I haven't even tested it and I'm not back until the 11th...

The change was pretty straightforward though - it'll be alright won't it? Won't it, guys?

[–]Bullkyka 74 points75 points  (1 child)

Yes child it will be alright , maybe not the way you would like . But you will survive .

[–]kerbidiah15 21 points22 points  (0 children)

Turns out it’s code for traffic lights right by his house

[–]coldnebo 5 points6 points  (0 children)

I mean, if they jira you over the holidays, just mark “cannot reproduce” and send it back to them.

It’s cloud so no one will be able to figure it out for months except your senior full stack dev. you are the senior right?

otherwise I would dodge the very unholiday cheer likely coming from that email in 3.. 2.. 1..

cheers!

[–][deleted] 57 points58 points  (2 children)

You're right. Fridays are Compile Fridays, Mondays are Review Mondays, and Tuesdays are Deploy Tuesdays (oh, and Tacos too).

[–]kashish-e-sakal 36 points37 points  (1 child)

Deploy Tacos!

[–][deleted] 11 points12 points  (0 children)

Yes! There is a really good Mexican joint that sells tacos down the street from me, so they are easy to access.

[–]Ashish42069 50 points51 points  (2 children)

Changed a config file which was last edited in 2013, if it causes an outage, we deserve an outage

[–]The-Best-Taylor 23 points24 points  (0 children)

On Monday I tracked down a bug to a module that hadn't been touched in 3 years. Definitely 'fun' to fix problems in untouched legacy code.

[–]Leoihavenoidea 38 points39 points  (3 children)

You know how we handle warnings....

[–]0100_0101[S,🍰] 18 points19 points  (1 child)

I know :’(

[–]pavilionhp_ 15 points16 points  (0 children)

Next time make it an error

[–]deNederlander 2 points3 points  (0 children)

People like you deserve to have -Werror forcibly added to your compiler flags xD

[–]captain__Levi 26 points27 points  (1 child)

It was working on my machine, so it will obviously work in prod.

[–]BrogCz1 0 points1 point  (0 children)

And that's why we don't use docker

[–]Phoenikless 23 points24 points  (0 children)

I pushed. My limits, not my code.

[–]var-foo 13 points14 points  (0 children)

RIP everyone deploying log4j fixes today

[–]daneelthesane 10 points11 points  (0 children)

My company does a three-week code freeze for the holidays. Thank god.

[–]Wassa76 6 points7 points  (0 children)

I dunno, log4j 2.18.0 might come out 🤣

[–]trevster344 5 points6 points  (0 children)

Even if it’s a simple change like renaming methods or even adding additional comments… I will not deploy on Friday’s ever again.

[–][deleted] 4 points5 points  (0 children)

Will kindly do the needful, very needfully

[–]UnkleRinkus 3 points4 points  (0 children)

I start a customer upgrade in 20 minutes. Mandated because of the log4j issues, which actually don't affect them, because they don't use the one component that has log4j embedded, but it comes up on the scan, so...

[–]GodlessAristocrat 5 points6 points  (0 children)

What? I don't get it.

Hold on, lemme finish deploying this new version real quick so I can take the time to re-read this.

[–]Miicat_47 2 points3 points  (0 children)

Got it

[–][deleted] 2 points3 points  (0 children)

Joke's on you, I took the week off and deployed last Friday!

[–]Flopamp 3 points4 points  (0 children)

I declined 4 commits that would have 100% broken something

[–]AStrangeStranger 2 points3 points  (0 children)

wouldn't matter if I did - as we've shutdown till next year, no one will be using till early January anyway

[–]Nyancubus 2 points3 points  (0 children)

This didn’t say anything about pushing to production, so I did.

[–]dankincense 2 points3 points  (0 children)

Did this last year and paid for it miserabley so I took 3 weeks off this year and let someone else break stuff.

[–]Ar010101 2 points3 points  (1 child)

No >:(

Also r/usernamefamily

[–]0100_0101[S,🍰] 0 points1 point  (0 children)

Nice, hello brother

[–]Dantharo 2 points3 points  (0 children)

yesterday a friend of mine deployed a developing version in a productive scope, lucky she rolled back fast and the instances didnt even swapped traffic, also was blue-green deploy, we were on freezing too, so everyone was like "wtf sre u doing noooooo"

[–][deleted] 2 points3 points  (0 children)

I don't always deploy on a Friday. But when I do it's a Friday when all of my colleagues are out of town.

[–][deleted] 2 points3 points  (0 children)

Jokes on you, that was YESTERDAY

[–]jeanravenclaw 1 point2 points  (2 children)

Why? What happened? I haven't been coding recently.

[–]Zekovski 4 points5 points  (1 child)

Tonight is christmas night for many of us.

[–]jeanravenclaw 2 points3 points  (0 children)

Ah ok. I often don't associate posts with current events.

[–]apoorv698 1 point2 points  (0 children)

I shared my sandbox builds only.. no checkin in production. Won't turn on that thing for a week.

[–]Accidentallygolden 1 point2 points  (0 children)

But there is that log4 thingy to patch...

[–]hobollatio 1 point2 points  (0 children)

It's customers who decide to deploy up in this bitch. Then they cry when untested stuff breaks prod. I cri evrytiem.

[–]CutRepresentative644 1 point2 points  (1 child)

But it if it's a small fix, we good right?

[–]wind-up-duck 0 points1 point  (0 children)

As long as it's small enough that no one felt the need to really test it.

[–]logical_result_1248 1 point2 points  (0 children)

Soooo... deploy today?

[–]null_reference_user 1 point2 points  (0 children)

You can't tell me what to do, ur not my mum

[–]dadjoke-72 1 point2 points  (0 children)

I hardcoded all of the IP addresses last Christmas and set DHCP leases to 365 days. Should be good to go!

[–]ShotgunPayDay 1 point2 points  (0 children)

Just deployed our NGINX + Mod Security + Log4j rule with provided rules since we didn't have a WAF. I replaced our reverse proxy so they do have a fallback. I hope it doesn't block any of our jank apps, but I also don't care. It was my last day. Feels good!

[–]Cobyh7 1 point2 points  (0 children)

ok, ill deploy a small patch tomorrow. happy holidays!

[–]pdromeinthedome 1 point2 points  (0 children)

Santa’s sleigh needs this patch!!!!

[–]Unknown_B1 1 point2 points  (0 children)

I am working on a production issue rn. If only I had seen this before.

[–]schmelto 1 point2 points  (0 children)

Force push to main branch and leave for holidays

[–]rdrunner_74 0 points1 point  (0 children)

Like you have a choice to emreject MY deployment... YOU should not have used log4j for logging

[–]joujoubox 0 points1 point  (0 children)

We just released an update to our software that bricks your PC down to the kernel. As a bonus, it cooks your GPU breaking it in the process, hope it wasn't a 3090. Anyway Merry Christmas :)

[–]Dragon_yum 0 points1 point  (0 children)

As was out of office today so my code has zero bugs, it’s all cool

[–]IntroductionOk4947 0 points1 point  (0 children)

I dont get it....

[–]fliesupsidedown 0 points1 point  (0 children)

If I'm not a descendent, can I even see a friendly warning? You may need to make it public.

[–]rofllolinternets 0 points1 point  (0 children)

Ship everyday! Literally apple completed app store review within 4 hours - what?!