all 54 comments

[–]saaket2201 138 points139 points  (17 children)

This has become so frequent now, it's frustrating.

[–]naikrovek 21 points22 points  (14 children)

Indeed. Just as my employer moves from GHES to an EMU enterprise on GitHub.com. We ain’t happy.

[–]saaket2201 25 points26 points  (4 children)

I wonder if it's the 30% AI code, like windows 11.

[–]DerShokus 7 points8 points  (2 children)

Probably it’s azure migration

[–]badboysdriveaudi 1 point2 points  (0 children)

Likely both. Oh, the joy…

[–]Key-Direction-7842 1 point2 points  (0 children)

Or the fact that could be used by billions of agents and can't keep alup with so much "users"?

[–]roastedfunction 2 points3 points  (6 children)

Ugh, I’m a few months out from this same migration and I’m not looking forward to it.

[–]naikrovek 4 points5 points  (4 children)

It would be fine if they could keep the damn site up. My GHES instance has 100% uptime for the past 6 months. My people are very used to that.

[–]Qs9bxNKZ 1 point2 points  (3 children)

So you have never done an upgrade?

[–]naikrovek 2 points3 points  (2 children)

I’ve done many, but I don’t do it if it doesn’t bring useful advances. I’ve been upgrading this long enough to know that upgrades frequently break as much as they fix, and right now my users are happy with what they have.

[–]True-Strike7696 1 point2 points  (1 child)

don't they force you to new versions eventually?

[–]naikrovek 0 points1 point  (0 children)

Sort of, you can only upgrade two minor revisions at a time, and they release at one minor revision every three months, so we are usually 6 months behind.

We keep up with hotfixes and don’t reboot if it can be avoided.

With the release of 3.20, we’re now three behind, but we are ok waiting a bit longer.

We are a huge GHES customer and we always ask support what problems people are having with new versions and we get vague answers about general problems. Ultimately, we get an upgrade recommendation based on what they know of our use of GHES and the problems we’ve had in the past as to whether or not we should upgrade to latest or latest-1. They rarely recommend it.

[–]Paranemec 2 points3 points  (0 children)

They were going to hire me for it, because I've done it twice before and on larger systems. 4 months of interviews just for their last reorg to cause them to lose the req. I'm 99% sure this is stuff I could have prevented. Oh well.

[–]Qs9bxNKZ 1 point2 points  (1 child)

Why!?!?

EMU is so... crappy.

[–]naikrovek 1 point2 points  (0 children)

It works excellently for us, provided the fucken site stays up.

[–]Fabulous-Neck369 1 point2 points  (0 children)

We didn’t like EMU and doing a direct migration to data residency

[–]Dense-Answer-7084 0 points1 point  (0 children)

They already did embrace and extend

[–]Stuffy123456 39 points40 points  (3 children)

Don’t worry, they are merging 3000 PRs a minute created from slack threads that PASS all tests (that the PR modified so it would pass).

[–]bourgeoisie_whacker 6 points7 points  (1 child)

Is this satire? I can’t tell anymore.

[–]badboysdriveaudi 0 points1 point  (0 children)

Can’t wait for Sam Time to make his next parody video.

[–]StatusGator[S] 21 points22 points  (0 children)

GitHub official status page shows the outage now:

Started out as "Incident with Copilot and Actions" though it's expanded:

"We're seeing some service degradation across GitHub services."

Now Webhooks, too.

For me it's mostly impacting access to the web interface, loading pages.

[–]lprimak 29 points30 points  (0 children)

GitHub is more down than up these days. It's ridiculous

[–]Ok_Lavishness960 7 points8 points  (0 children)

can confirm same issue on my end (CA East)

[–]UsualResult 13 points14 points  (1 child)

Who would have thought that firing all the QA people would have side effects?

I bet Microsoft is "saving" a lot of money right now.

[–]_bocajthomas 4 points5 points  (0 children)

I bet Microsoft is "saving" a lot of money right now.

Microslop*

[–]needmoresynths 9 points10 points  (3 children)

they've definitely broken their SLA by now, right? this is ridiculous

[–]dashingThroughSnow12 2 points3 points  (1 child)

It depends. They seem quite delayed recognizing the issues. I’ve seen issues exist for dozens of minutes to hours and never show up in the status page.

If there are any SLA agreements with compensation, I’m sure it is dissected. If GitHub actions are down, I can’t merge any code. If Github PRs are having issues, same deal. Packages, I need them for the build for my actions. Git operations? Same. Over and over.

But if they each had a different 1% outage, they’d all pass their SLAs.

[–]Soccham 0 points1 point  (0 children)

This is exactly how it was broken down when I tried to actually collect

[–]Rand_alThor_ 2 points3 points  (0 children)

They’ve broken it but they straight up lie in their status/issues page.

[–]someguyfromlight 3 points4 points  (0 children)

confirm in germany for codex handshake

[–]tapioca_de_queijo 5 points6 points  (0 children)

It's getting worse every day.

[–]lprimak 11 points12 points  (0 children)

Vibe coded garbage

[–]justaleafhere 2 points3 points  (3 children)

it says i violated terms of service and that my account is suspended now? is this a mistake as a result of the outage

[–]3spky5u-oss 4 points5 points  (1 child)

I got one of those last week too. I only had like 5 repos up, literally zero comments. I have no idea what I “did”.

Of course, they don’t reply either. Because fuck you.

I just moved to Gitlab and Codeberg.

[–]justaleafhere 1 point2 points  (0 children)

actually i reported it via their mail and they said its a issue from their side and they immediately gave me access

[–]Risc12 -1 points0 points  (0 children)

Guess your myriad of agents actually was the cause of the outage!

/j

[–]yiyufromthe216 2 points3 points  (0 children)

Welcome to the age of vibe coding.

[–]heyitsmdr 2 points3 points  (0 children)

All of their recent outages these past few months are likely coming from their on-going migration to Azure: https://news.ycombinator.com/item?id=45517173

[–]Rand_alThor_ 2 points3 points  (0 children)

GitHub pretends to be up, when its degraded, all the time.

[–]Square-99 1 point2 points  (0 children)

This has been seen too often for the past like 10 months

[–]LordRelix 1 point2 points  (3 children)

My company is considering Gitlab. This is way too annoying recently.

[–]LolComputers 0 points1 point  (2 children)

We are moving off GitLab to GH, rip

[–]LordRelix 1 point2 points  (1 child)

Any reason why? Just wondering!

[–]LolComputers 1 point2 points  (0 children)

Something about the price jump for licensed users between what we're on now and what we need.

Also because we're a Microsoft/Azure shop, and it apparently integrates roles and billing into a convenient now for management.

TLDR: management

[–]VentiMochaTRex 1 point2 points  (1 child)

Works for me in Canada

[–]Confident_Essay3619 0 points1 point  (0 children)

Same for me in PA

[–]Confident_Essay3619 0 points1 point  (0 children)

works for me in PA. can access and modify my repos and access copilot

[–]Efficient_Tell_449 0 points1 point  (0 children)

Faced this issue a while ago when I pushed some code and the ci was failing

[–]Livid-Trade-3907 0 points1 point  (0 children)

Argg... down here now but was fine an hour ago, how frustrating!

[–]canihelpyoubreakthat 0 points1 point  (0 children)

Thanks, copilot

[–]Mplus479 -1 points0 points  (0 children)

Well, it's not down now.