Hacker News new | past | comments | ask | show | jobs | submit

GitHub Actions was down

https://www.githubstatus.com/?today
My action failed with "Unexpected error fetching GitHub release for tag refs/heads/master: HttpError: Sorry. Your account was suspended"

Which certainly made me shit myself, briefly.

loading story #48280789
loading story #48278732
loading story #48278828
loading story #48279418
Not reflected on GitHub Status: most of the frontier models disappearing from most people's subscriptions:

https://www.reddit.com/r/GithubCopilot/comments/1toa9tf/mode...

loading story #48281702
loading story #48281574
As an Indy hacker I want to see GitHub succeed, but I ditched actions years ago - (shocking) false economy. Spend entire nights pushing to actions over and over only for complains about weird/niche dependency issues and other oddities - the cycle time's just too slow and the DX is no fun (my pain doesn't even factor in outages; just the feature itself as it's intended to be experienced). I want to spend time talking to users and building features, not debugging weird syntax or dependency issues on a remote machine non-interactively.

So why are Actions so unreliable anyway? Occam's Razor would probably suggest the domain is inherently complex/difficult; but other providers show that reliability is possible. What would Occam's Razor suggest next? Poor management..?

loading story #48281659
Wasn’t my fault this time! I haven’t started work yet.

https://news.ycombinator.com/item?id=47237377

loading story #48278883
loading story #48278620
loading story #48281054
loading story #48278974
loading story #48279291
loading story #48278804
loading story #48278766
Wasn't my fault! People flipped out couple weeks ago and thought I was gonna bring down Actions when I posted Ghostbox CLI - a tool to quickly configure and spin up runner machines for dev yer work.

The thread was insane - people totally misunderstanding and just snowballing in misrepresentative panick - what happened then was commenters lost it entirely when I posted what https://ghost.charity actually was, they couldn't accept they'd been wrong - they still believed it would "bring down GH actions", and projected that ghost was reselling Actions free minutes, and doing DDoS on Actions, when in reality was just configuring workflows on yours to make your own hybrid agent/human dev work clean and fast.

The panicked commenters were sure they were saving GitHub/MS and flagged the repo dozens of times until GitHUb auto-disabled it, and looks like GitHub/Microsoft still hasn't actually looked at it - so it's still autodisabled. Anyone work at GitHub?

So Actions goin' down - ain't my fault - despite HN's surety ghost was bad - it was, and is good! Embrace the agentic future!

The last two projects I built I did the CI/CD manually with a small win32 service that polls git and builds+deploys the main service locally. It's barely 200 lines of code. Not much to go wrong. "dotnet publish" is not difficult to wrap.

The latest language models have enabled this sort of thing for me. I can integrate a mini Jenkins into every project within a 5-10 minute prompting session. This sort of code isn't hard. It's just tedious, and the LLMs absolutely rock at boring repetitive stuff. Having a win32 service start up successfully on the very first try is something I haven't experienced until 2026.

loading story #48280700
loading story #48281012
Insane, we have to come up with contingency plans now for long-duration GitHub outages because we can't safely do deployments. For a service we're paying thousands of $ per year for even though we host runners ourselves...
loading story #48280668
loading story #48280129
loading story #48278684
loading story #48278998
loading story #48278736
loading story #48280381
loading story #48280547
loading story #48278627
loading story #48278679
loading story #48278990
loading story #48279928
We’ve had GitHub actions for long enough, it’s time for GitHub consequences.
loading story #48281629
loading story #48280901
loading story #48280889
Incredible how reliable the heuristic of "something seems off - probably github being down" has gotten these days
loading story #48278768
loading story #48279469
I moved a while back to Forgejo -> https://forgejo.org couldn't be happier. Highly recommended.
loading story #48279465
I've been against self hosting internal tools for a long time mainly because of the devops and other overhead. But AI based devops makes it so easy now to spin up whatever you want now that I'm reconsidering that. I use a lot of ansible for several of our deployments. At this point, most of that is managed via codex.

For Git, all you technically need is ssh access and some backup strategy for your server. It would be bare bones but workable. And there are of course plenty of OSS things that are a lot nicer than that.

I'm still using gh and gh actions and we are mostly below the freemium layer with that. But it is kind of slow and honestly a dedicated vm plus some high CPU/memory workers we can spin up on a need to have basis might be a lot faster. With GH outages becoming more common, my hand might be forced a bit.

In recent weeks, I've spun up listmonk (mailing list solution), matrix (as a slack alternative), and a few other things specific to our software stack. A github alternative would be more of the same. We don't need a lot.

The main objection is that with more moving parts to worry about, the workload for me also increases. Things need updating, monitoring, backups, alerting (and responding to alerts), etc. That sucks up my time and that is scarce.

Another reason for self hosting these days is that with agentic AI tools, self hosted things are a lot easier to integrate into agentic systems. If it is self hosted, you don't have to worry about API limitations, rate limitations, walled gardens, etc. All the traditional SAAS silos are becoming a problem from that point of view. The more locked down it is, the bigger the motive for moving away from it. That's why we ditched Slack for Matrix. Slack is hopelessly locked down and tedious to deal with. Matrix is super easy for this.

loading story #48281124
> For Git, all you technically need is

Technically Dropbox is just rsync.

Also https://xkcd.com/1319/ but for maintenance.

Is it about funds? Why Github is not catching up with the traffic? I know there's a mass rush on Github recently specially due to Claude Code leading users to use Github. sometimes even persuasive.
loading story #48280690
Why do they go down so often? Is it true that the reason is that they've incorporated too much AI without human review?
It's (a) they're under massively increased load because everyone's vibing up new projects these days, (b) they've been in a weird frankenstein "on azure but also we have our own control plane" state for years and they're pushing to no longer have that be the case.

I don't think vibecoding at Github has much to do with it.

Ah, yes. A lot more repos, commits, and most importantly huge PRs.

That makes sense. Thank you!

loading story #48278748
I started using an agent (Codex) on my repo and it went from a a few dozen clones to thousands (3383 this week). I dunno what the agents are doing to clone the repo so many times -- I'm not running 3000 agents or prompts, maybe 10 or so this week. But if this is typical, a 1000x increase in usage across the board can't be good on the system.
loading story #48281157
The instability started well before vibecoding, in around 2018-2019, shortly after the Microsoft acquisition.

https://damrnelson.github.io/github-historical-uptime/

https://news.ycombinator.com/item?id=47591928

This gets posted every time GitHub is down. This chart is not accurate. It is based on data scraped from GitHub's status page and that data is missing historical incidents from the pre-Microsoft era.
Yeah, it’s not even consistent with their own incident history. I spot checked it and consistently found incidents with downtime/elevated error rates in months listed as 100.00000% uptime on that chart.
The unofficial and offical charts are both lying. The GitHub one ignores actual outages and the unofficial ones count minor display bugs in minor features as a “github outage”.
The unofficial one has done that for years though so it’s useful for comparison. If you go back a few years it was regularly at 99.9% uptime.
Microsoft has boasted 30% of their code written by AI.[1] However we could only guess if AI generated code is the issue or something else, or a combination of things.

That being said there was a noticeable trend starting around 2022.[2] That being said they’ve also been doing a big migration to Azure. It’s likely a combination of things.

1: https://www.cnbc.com/2025/04/29/satya-nadella-says-as-much-a...

2: https://www.reddit.com/r/sysadmin/s/LOMPaSv3wY

GitHub had a blog post about this recently. They reported a significant uptick in volume (repos created, PRs, etc.), which they attribute to AI usage and tooling.
Do you really believe their competition hasn’t seen the same increase? Because their competition certainly hasn’t seen the same instability issues.
loading story #48279166
loading story #48280607
loading story #48279160
loading story #48280496
I personally trigger github actions approximately 50x more than I did prior to AI-driven developer coding and I'm not alone.
Totally agree. There's days (or even afternoons) where I trigger more actions than I would have done in a month.
Okay so the recent outages are also likely due to increased load due to AI assisted development speeding up workflows.
It could be many things. Microsoft mismanaging stuff. Azure. Vibe-coded Github. So much AI slop being committed it adds an extra burden on the servers, etc.
Whilst you're waiting for it to come back, try out AGENT-CI (which is a project I built.), which runs GitHub Actions on your machine: https://agent-ci.dev. (Open source, etc.)

No, it's not like "act," because it uses the standard Github runner, the difference is that the control plane is an emulation of api.github.com, because of this we can do all kinds of nice things:

Caching in ~0 ms. Pause on failure, so you can let your AI agent fix it and retry without pushing.

loading story #48279383
loading story #48278782
loading story #48278882
loading story #48282235
I recently switched from GitHub Actions to Buildkite + self-hosted runners.

Setting it all up would have been tediously annoying eight months ago (Buildkite requires setting up GitHub webhooks for each repo).

Last week I just had codex set up everything, ephemeral vm runners and all, using a couple of low-spec refurb mac minis, Buildkite’s API, a short-lived API token, and migrate my repositories one by one.

So far so good, it’ll pay for itself within two to three months, and following today’s outage I suggested at work that we experiment with the same set up.

They’re considering it.

If you want an alternative to GitHub Actions, you could self-host Forgejo Actions, but I'm not that happy with the design.

I much prefer Woodpecker CI, which is an open source fork of Drone.io. It supports multiple Git backends like GitHub, Gitea, Forgejo, Gitlab, Bitbucket. It supports running jobs locally, on Docker, and on Kubernetes. And there's autoscalers built in for AWS, Hetzner, Linode, Vultr, and Scaleway. There's a bunch of 3rd party plugins (https://woodpecker-ci.org/plugins) for custom integrations. The UX is also very simple, with OAuth used not only for authentication/authorization but also setting up & accessing repos. The system architecture is great, with separate components that run stateless connected to a database, and a custom plugin is any program that takes environment variables and does stdio. The config file is a good balance of ugly YAML and convenience syntax like shell-style parameter expansion variables.

It probably takes less than 15 minutes to install, set up, and run WoodpeckerCI for a small team, so it's not a big investment to try out or host. With the autoscaling plugins it lets you scale your workload up to whatever size. Honestly you could run it on a laptop since it's written Go.

(to clarify for beginners: the config file docs are found in a section called "workflow syntax" (https://woodpecker-ci.org/docs/usage/workflow-syntax) and variable parameter expansion is buried deep in an environment variables page called "string operations" (https://woodpecker-ci.org/docs/usage/environment#string-oper...). poorly organized docs aside, the system itself works well)

Are there any GitHub Actions-compatible CI services out there that don't rely on their infrastructure? I know of depot's but no others; are these resilient to these outages or do they still lose functionality? I imagine the latter but I don't know.
loading story #48278805
loading story #48278874
loading story #48278743
loading story #48278811
loading story #48282290
Someone said GitHub is racing to the mythical "zero nines of availability" and I love it
loading story #48278853
Yeah I'm getting an error where it says account has been suspended. They really are becoming an embarassment
loading story #48279057
Aws made a very big mistake to stop their CodeCommit service. They could have eaten Githubs lunch if they had continued to build it out
What problem is github solving that has led it to become critical infrastructure for so many? Is it that everyone is remote and VPNs are too much of a hassle to give everyone access to a build server? Is the serving as the authoritative auth for development services? Does it provide better compliance reporting? It just isn't apparent to me what github offers that you can't get elsewhere with at the same cost and effort. I've been in some pretty large orgs with distributed personnel, but this just hasn't ever been a problem.
loading story #48280645
loading story #48280688
loading story #48281014
It's crazy to us how Github Actions have these issues but Azure DevOps never has these hiccups for us even though we hear they're on the "same infra". We're happy to stick with DevOps.
loading story #48281853
If you would like less dependence on GitHub for issues and PRs, please check out GitSocial, it stores everything in git itself, making them portable and offline-first.
How to kill a business 101. The brand damage to business and owner is incalculable.
Had to figure out it was Github and not my AI Agent... Sad it got scoldings for being lazy on waiting for CI checks! What a waste of tokens!
This is outrageous. Someone go create a Polymarket.
loading story #48279333
If you don't want to self-host Gitea/Forgejo, I recommend SourceHut for private repos and Codeberg for public ones. Happy to answer any questions you might have for either based on my experience!
At this point, GitHub should rename itself downhub.
I initially thought it was because I ran out of action minute, and was about to upgrade my plan Lucky I came here before hitting the confirm payment button
I switched to GitLab a while ago and then spun it up locally.

Something’s wrong when my own infrastructure is more reliable than Microsoft’s.

loading story #48279912
Just post here when its up. Its easier...

"Microsoft’s GitHub was positioned to win the AI coding race. Outages got in the way" - https://www.cnbc.com/2026/05/22/microsoft-was-positioned-to-...

Going to need to make an isitup website for it soon enough
I've started spending each github outage planning our move to an alternative. I guess I'm not alone. Where are you all moving?
loading story #48279048
free service is down again, let's everyone that use the service for free complain again!!! (sorry for the sarcastic comment but i find it crazy how people feel they are entitled when it's free)

EDIT: sorry i meant this rant at the one complaining for the free service not for the paid customers (which is unacceptable)

loading story #48279339
loading story #48279980
loading story #48279619
loading story #48279466
loading story #48279336
loading story #48279970
GitHub Actions outage sparked direct-action, class-action, mass non-action, and widespread dis-satis-faction.
It's so weird because github used to be known for rock solid stability and now the entire reputation has changed.
loading story #48279435
What's that? You're still using microsoft products? Guess that's your own fault.
loading story #48282294
In my mind there's no doubt Github datacenters can't handle the recent load that came after agentic AI. They just need to get new servers. It's simple as that.
loading story #48281565
What could be the cause of GitHub issues from an engineering perspective?
This is great because I finally set up Actions yesterday for a new project of mine and of course it’s failing today and thinking I screwed up the yaml.
Microsoft is really working hard to kill off GitHub now. That's quite amazing.

We have already seen this in the last some weeks, but now this has become a meme that keeps on giving. GitHub down! GitHub up again. GitHub Down! GitHub ... ...

Hey at least Copilot AI Model Providers have 100% uptime, so there's that
loading story #48278792
Shout out to all my SF 5am crew checking if their overnight prs passed CI. Real 597 “member of technical staff” energy. I guess we should expect this, it is a Tuesday!
I don't understand anyone still using github for anything unless they have to or have payed for it. Move literally anywhere else
{"deleted":true,"id":48279035,"parent":48278374,"time":1779799529,"type":"comment"}
Not to shill myself, but I'm sick and tired of this and been sick and tired for the last month. Decided to quit my job to work on https://harmont.dev
{"deleted":true,"id":48279002,"parent":48278374,"time":1779799358,"type":"comment"}
I wonder if these github failures are just systematic incompetence or MS cutting budget on purpose to promote its own cicd tools
loading story #48279372
The main operating model with git is going to go back to decentralized. Setting up and managing something like https://forgejo.org/ is a way better experience than constant interruptions by a faulty service that can't meet demand.

The open source contribution model as we once knew it is dead; you're not going to accept patches from random agents. The risk is way too high. And you can see that increasingly "AI Slop" makes it difficult to be a maintainer of any semblance of a popular repo.

So what's the value? A durable place to store work? hah.

Discovery? That part of Github has always been shitty.

So that leaves.. Github Actions? The thing that is down every other day and has been the subject of a few ~rug pulls~/attempted price hikes that are almost surely coming back?

Will more copilot usage fix this? We should try more copilot.
loading story #48280471
This is your periodic reminder that Github is growing at ~14x (1400%!) annually. This would be incredible growth for a young, unprofitable, VC-funded startup, even Uber never achieved more than ~3x AFAIK. For a widely-established company that was already very well known and a market leader in its niche for many years? Absolutely unprecedented.

This is a conservative estimate assuming linear growth, the actual number is likely going to be higher. Much higher.

It's not too hard to grow 14X YoY if you start from a hundred customers. If you have hundreds of millions? Yeah, not so easy.

[1] https://x.com/kdaigle/status/2040164759836778878

loading story #48281522
And it is bypassing mandatory GHA Pipeline check and giving green. So be careful when merging/reviewing your PRs cause.
LoL they added "Copilot AI Model Providers" in githubstatus and it has 100% up time.

Thanks for pointing out that nobody is using that thing

List of things "DoS"d by AI:

- GitHub

- Hiring budgets

- RAM (/personal computing in general)

- Electricity

- Media/Content

- Truth

I started an open source Git platform. Can be self hosted. I would call it beta at this point if you are interested in trying it. https://velogit.com
loading story #48280137
I think we should start betting if GitHub will be down on Polymarkets or something at this point.
loading story #48278637
'Degraded' should be banned in status pages. It sounds just irresponsible, like "Yeah, it can be slow or something sometime. Whatever. Who cares"
loading story #48278872
loading story #48279069
loading story #48278992
No way - everyone tells me the AI adoption is going great?
oh man spent so much time trying to debug what's going on. I have a complex setup with GitHub Actions and self hosted runners so I thought it's something broken in my CI setup
loading story #48278630
Does anyone use any good alternatives to GitHub Actions?
loading story #48279065
At this point it's as if the team there went "fuck it, let's just watch it all burn down" or something.

With all the recent negativity – how are they not even TRYING to fix the damn thing?

How's the AI generated code running for ya?
Has anyone actually moved off? If so where?

I like being able to vote with my (teams) wallet and I'm tired of staying out of convenience

loading story #48279278
Contingency action plan: Codeberg. Engage.
My first time using GH Actions was last week. GH was so flaky that pulling a submodule failed >50% of the time. I had to write a script to retry pulling the submodule in a loop.

I've done some hacky shit in CI scripts, but none made me more mad than that one.

i still can't see many pull requests in a bunch of repositories... it's been over a month
Tell Claude to fix it, simple.
here all is ok, 3 actions without problem
When is it up?
loading story #48278761
Super odd make productivity useless
Feels like Github Actions is UP should on the front page (when it happens) at this point. Down is no longer front page worthy
Too many DEI hires? Or maybe H-1Bs? Or maybe it's a vibe coding problem.
loading story #48281452
This has become so typical that we've started working on a modern Github alternative called Plain.

Perfect timing that we post https://www.jxd.dev/writing/building-plain just as this latest incident started.

It should be up again
Stop relying on Github.

Self hosted Gitlab with self hosted (or AWS) runners running your pipelines.. We only use Github as a mirror for our public repositories.

With the increasing challenges from bots and ai agents created with toddler level clarity, Self hosting is going to continue to work.
my work is totally stop. cry
Zero Nines. Bogus.
microsoft github should work at restoring interop with noscript/basic HTML browsers...
loading story #48278829
Too many times we've been bitten by this - it has been an issue too many times to count.

This is why we don't use Github Actions, kids.

Seriously, its a proprietary build service that puts the keys to the kingdom in someone elses' control. Just: No!

Print this status page to PDF so you've got it handy next time someone castigates you for not using Github Actions, folks.

So, what do you use?
Another outage at GitHub with actions and pages not working thanks to the AI agents Copilot and Tay.ai creating more issues. Last time this happened was 6 days ago. [0]

This time today it was caused by friendly fire by the automatic suspension of the GitHub Actions bot which is now a "Ghost" user. Since there is no CEO of GitHub to contact it we are just going to see more [1] of this again.

You might need to push a critical change soon, but now you cannot. You won't get any of these issues if you self hosted as I said 6 years ago...[2]

[0] https://www.githubstatus.com/incidents/g6ffrm0rfvz9

[1] https://news.ycombinator.com/item?id=48085501

[2] https://news.ycombinator.com/item?id=22867803

loading story #48282371
https://github.blog/changelog/2026-05-15-github-app-installa...

I'm guessing related to this? The blog post is dated 11 days ago but I just noticed a blue banner on my actions page today.