Hacker News new | past | comments | ask | show | jobs | submit

What AI did to stackoverflow in a graph

https://data.stackexchange.com/stackoverflow/query/1953768#graph
Any social organization needs to carefully consider their inclusion-exclusion curve with intentionality.

I think a lot of people might balk at the word "inclusivity" today, but StackExchange had ridiculously high barriers to participation, making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions. They slowly killed the site in this manner.

The community might have survived this folly, even with AI, because it was still the best place for people with qualms about AI to ask questions... Except until StackOverflow management alienated those users, too, by shoving AI down their throats in every facet of the site.

Even I had internalized the vagaries and neuroses of the SO community but I had heavy reticence to ask questions, knowing I'd have to consider all the ways a bully eager to use their powers might misunderstand me. I can't imagine asking a question there without having had lurked for longer than a typical Bachelor's + Masters program.

Peak at 207K, minimum at 588. That might be an incomplete date point, so using the next most recent value 1226, StackOverflow has lost 99.41% of its activity.

loading story #48959058
loading story #48959433
loading story #48962101
If it wasn't so controlled it'd might as well have just been reddit.

I agree there's a balance, and maybe they edged over the line, but I was consistently happy to have the following be the outcomes

1. Answers were reasonably close to correct, usable, informative (teaching)

2. Your site score came to mean something -- I once had a hiring CTO say "Oh you have some popular answers on the techs we use"

3. Progressive unlocks helped guide the path of participation -- it was clear what to start with, and what to do next as you were taught their culture and ways. It's not very popular to say in 2026, but not every culture is good and it's important to curate culture and teach newcomers the culture of the space.

loading story #48962387
loading story #48962152
loading story #48960945
loading story #48959582
loading story #48958532
loading story #48959241
loading story #48959970
loading story #48959144
loading story #48959145
loading story #48959916
loading story #48959136
loading story #48960087
loading story #48958886
loading story #48959878
loading story #48957661
loading story #48959648
loading story #48958922
loading story #48958721
loading story #48958251
loading story #48959026
You know, there's a lot of really good data on Stack Overflow, regardless of all the issues.

I hope somebody saves it all.

Perhaps not what you intended, but most of it is stored in various models' weights.
Up until a few years ago, SO published full dumps onto the Internet Archive. There has been a community effort which has picked up the torch and is continuing to do the same on a ~monthly cadence.
For better or for worse, the contents of Stack Overflow are literally the reason LLM coding has taken over the world.
loading story #48959449
loading story #48958259
loading story #48959403
loading story #48958198
loading story #48959216
loading story #48960012
SO did that all to themselves when they decided they didn't want a community to form and that only question and answers mattered. The moment something else allowed to have a better way to get your answers, there was no reason to go there, because there was no community.

I still don't understand why anyone would go with that whole "no conversation please"

loading story #48957672
loading story #48957361
loading story #48957276
loading story #48958533
loading story #48957545
loading story #48957666
loading story #48957419
loading story #48957903
loading story #48957556
loading story #48957626
I don't have the time to, but I'm surprised there aren't a lot of comments on the decline before chatGPT was released, but after SO was sold to Prosus [1][2]

Even the curious growth spike in activity happened just before the acquisition. I wish I had time to do this analysis a bit deeper, but you can look for SO activity up until when chatGPT was released, it is really noticeable.

---

[1] Stack Overflow acquired by Prosus for $1.8 billion: https://techcrunch.com/2021/06/02/stack-overflow-acquired-by...

[2] Prosus to acquire Stack Overflow for US$1.8 billion https://www.prosus.com/news-insights/2021/prosus-to-acquire-...

loading story #48958803
loading story #48958670
The graph actually peaked in 2014. That's a decade before AI became a thing while the Software engineering workforce grew a lot since then.

I think Stackoverflow was the last incarnation of romanticized old-school Q&A forums where you first had to earn your badges before being treated with respect. Luckily today's new projects have much better documentation, issue tracker's etc. And apparently AI is able to work with that by now...

I never had an LLM tell me my question was already answered and imply I was stupid for not finding it. SO dug its own grave and jumped in.
loading story #48958471
loading story #48962521
The collapse into a ghost town is striking.

Not sure I would blame it all on AI though, the incentives of SO only worked while there were worthwhile questions to answer and make you feel smart about. After that well dried up, the only thing left was the stuff AI can do with a prompt; ironically AI got a leg up by scraping SO.

This is similar to the evolution of Wikipedia, except the format of WP allowed it to transform into a feudal dictatorship of nerds who feel like they are deciding what's true, and they can get off on that.

SO did not have that kind of incentive to keep the nerds around.

loading story #48959126
loading story #48957907
loading story #48957445
loading story #48957371
loading story #48960180
Looks like SO was already dying since 2017.

I think other helpful places like reddit, discord, web forums etc might be what hit SO 2014-15 onwards.

AI seems to have given it a blow of mercy to end the misery.

loading story #48957740
loading story #48957447
loading story #48962806
Stackoverflow did it to themselves by having incredibly unhelpful users
loading story #48957271
loading story #48957281
loading story #48957279
Seing a bell curve and singling out a factor that appears only for the 15% of the total time demonstrates some pretty extreme tunnel vision

Edit: https://postimg.cc/n9nZGLmb

loading story #48957383
loading story #48957358
loading story #48957327
loading story #48957299
loading story #48957482
Peaked in 2014. That coincides with my experience. Something went wrong:

* Moderation went bad. I stopped moderating/flagging after it was deemed unhelpful?! I know it's hard to moderate a platform like that, but giving me a slap in the face when I volunteer my valuable time is not the way to do it.

* Questions closed because they weren't "programming questions", but obviously about tools devs use every day. Again and again, they were the TOP google results. You'd click on it and found a old question closed because it was considered off topic. As a business, you seriously need to ask yourself some hard questions when you fend off users like that.

loading story #48958281
loading story #48961801
It’s pretty sad though. Like many developers, I used Stack Overflow a lot when I was starting out, and it helped me solve countless early programming problems

A lot of what we have today was built with help from that community

loading story #48958736
loading story #48961951
So... nothing that it wasn't already doing to itself? There's no one drop where "AI got into the market", SO had been declining steadily for years. I actually expected this post to be about how SO survived by selling its internal organs to AI.

Now do a graph for the money.

https://www.wired.com/story/google-deal-stackoverflow-ai-gia...

loading story #48957459
loading story #48961770
loading story #48962465
loading story #48961543
Some of the pre-ai decline in questions might just be that they had filled out of alot of the question space. What might be more interesting is the traffic graph as it would be possible to have a decline in questions but still have traffic rising to the existing ones.

Today I'd expect even when someone is googling and a question is relevant that most people will just read the AI overview.

The stackoverflow moderation is the reason I do not post on it. You have middle party with no competence on the technology trying to do useless moderation.

Instead I directly go on the project github page and ask the question directly to the mainteners.

loading story #48959986
The graph starts falling shortly after 2020. AI certainly contributed but Stack Overflow was dying without it.
Interesting that you can see COVID in the graph
loading story #48961765
The hostile moderators killed stack overflow.
loading story #48958298
loading story #48962582
I miss Joel Spolsky's writings especially in this dark age of AI.
loading story #48961282
Pretty sure they did it to themselves with terrible policies and moderation. AI was merely the final nail in the coffin.

Interesting to compare with MathOverflow which has distinctly different policies (only research-level questions) and professional community: https://data.stackexchange.com/mathoverflow/query/1953768/st... - also falling lately, but by a factor of 2-3x from peak rather than 1000x.

AI might've delivered the final blow, but Stack Overflow was in decline LONG before LLMs came on the scene.

I read a great article not long ago outlining the full series of events and changes that led to its downfall. I wish I could find that article, but I've forgotten where it was.

I never understood the point if having the unfathomable churn of thousands of new questions per day. The value of SO to me was always a knowledge base with reputation mechanics, and that did not change. I still default to searching before asking AI.
loading story #48959855
I’m surprised the site had that little activity, relatively, around 2010. That’s when I was using it the most. It seemed plenty large to me at the time… I can’t imagine the experience was that great a few years later. I wasn’t really paying attention by the time it reached the peaks later that decade.

I always found the format of the side obtuse and the culture not very welcoming. My most popular answer ever was something about JavaScript from 2008 or 2009, and to this day, people come in and say “this isn’t the way to do it, this is outdated“. No kidding, but every new question about that gets closed as a duplicate.

loading story #48959717
Looking at that chart, AI seems to have not done much of anything at all to Stack Overflow. They were already in sharp decline before LLMs became widely available.
loading story #48958286
Good riddance. The graph peaked in 2014 and started to gradually go down in 2017, with the release of LLMs only adding fuel to the fire. They did this all to themselves with their way of how people are treated there.

Funnily enough, there's now a "StackOverflow for Agents": https://agents.stackoverflow.com/recent

loading story #48959548
There's no need (or reason) to blame AI. Between the culture of discouraging new questions as seen in the comments on this thread, and the fact that Google can easily find existing answers, the value of asking new questions has clearly gone way down.
loading story #48959791
Can it please do the same to reddit?
loading story #48958130
My propensity to participate was definitely decreased when I would always see others editing and nitpicking my contributions. The value and character of my contribution was unchanged, but now it was “shared” with someone else who edited it…
loading story #48961173
While I never posted much to Stackoverflow I have fond memories of it as a sole developer, finding other people with similar issues and the quality solutions offered that often got me out of a jam.
Step 1: Here emerges a platform where everyone can ask, answer, or discuss questions on software development.

Step 2: The platform becomes the ultimate knowledge base with community-curated answers on virtually any question related to software development.

Step 3: Another company scraps the community-driven database to train its model.

Step 4: The model is so efficient that people start asking questions of the model, killing in the process any traffic to the platform that helped to create it in the first place.

Step 5: Profit. People who spent years asking, answering, and curating programming knowledge for free are now paying for that knowledge repacked in the model weights. The original knowledge base is essentially dead.

Question: What programming knowledge base will be used to train future models?

Are we at the Skynet moment where people will be totally cut out of the loop from now on?

loading story #48959121
ChatGPT was released in Nov 2022, and frankly wasn't very good originally. The SO decline started occurring almost two years ahead of that, and was already on a sharp decline before ChatGPT shipped, and certainly before ChatGPT actually became good.

This is revisionist history. People told SO that they were leaving for YEARS because of how incredibly toxic it had become. It was already giving outdated answers before ChatGPT shipped, because new questions/potentially updated answers were [Closed] [Dupe] immediately.

Their answer was essentially "We aren't a Q&A site, we're trying to be a knowledge base! So closing all questions on a Q&A-stylized site, and extremely abrasive moderation, is working as intended."

They entirely did this to themselves. The community was toxic, their policies were toxic, and they didn't listen when warned as such repeatedly - just doubled down.

loading story #48957330
loading story #48957366
The site looks like it was actually dying since 2014 and AI just turned off the life support.

It was such a hostile environment. It always seemed like you basically had to already know the answer to ask a question.

I think Ai is not the issue here. SEO on the other hand very much. It’s not like any one ever went to stackoverflow to find a solution, it was just that they were the google results for a lot of things
I've only posted one question to SO, and it was enough to dislike the whole platform. LLM didn't kill it. SO killed itself with the broken community structure.
loading story #48959627
I will miss their yearly developer survey. Otherwise I won’t miss them. What a frustrating experience it was.
loading story #48960049
AI was the final nail but SO was already on a downward trajectory imo. Too much angry rule setting and confident jerks.
Honestly SO helped me a lot in Uni 10 years ago. However I was banned 5+ times for just asking a normal question with attempts at answering. Can’t say I’m surprised. It was not welcoming, massively exclusive and had a rude community. RIP
loading story #48959742
loading story #48962272
Did they cry about it? No right? Don't apply your own standard then judge them about it, petty people.

Stackoverflow aimed to be a knowledge base. And knowledge base has a ceiling limit. They simply reached the point that almost all questions (regarding the knowledge) were asked for them. You can argue that newer or niche libraries or languages knowledge is still lacking there, but I have never seen them getting closed, just not answered.

loading story #48959061
AI and ridiculously aggressive moderation. If it had been a more welcoming place it probably would have lasted longer.
When an ecological shoes company pivot to AI, I wonder why StackOverflow executives don't pilot for AI now.
loading story #48959279
loading story #48957518
loading story #48960494
Perhaps the harshest lesson of stackoverflow is that it represented what happens when you give programmer-types unfettered control of a culture. A bitter pill indeed.
As others said it wasn't just AI but their excessive moderation
Honestly, I think that's a good thing. A lot of questions were either duplicates of existing questions, or close derivatives of them. If I had to guess, probably 90% of SO questions already had a solution somewhere on SO. AI surfaces these solutions much quicker, so you don't have to ask. Novel questions or bugs that can't be answered or fixed by AI still get asked, and mods have less spam to deal with. I fail to see the issue here.
SO's downfall started way before AI. A decade or so ago it was always full of interesting questions, people were giving detailed answers, there was sometimes some debate in the answers, etc

And then it started being stupid questions. People who clearly had barely tried anything and just rushed to SO with a half baked question. Answers were just pointing to another thread that already provided the answer. It definitely started before LLMs. I think it lined up with the aggressive "learn-to-code" push.

Should read what Google did to remove sites from search results.
AI didn't start the decline, it just finished it.
loading story #48959662
loading story #48961002
loading story #48959723
loading story #48960404
no wonders, this will keep going on same trend
They had a good run!
Slightly accelerated their decline. You have a drop around chatgpt release then the slope returns to its previous pace of decline.
Except for covid, it seems the decline was already there.
loading story #48957261
loading story #48957272
loading story #48957243
loading story #48957246
loading story #48959761
The site for lazy code monkeys is dead.
Finally, something good done by AI against these modern-day dictators and pharaohs.
loading story #48957335
What I like about AI is that it doesn't close my chats as "duplicate" and link to something unrelated. It doesn't refuse to tell me how to do something just because there's another way to do something else that I am not interested in age didn't ask for.
Hehe, I'm so glad I blew the lid on this thing some time ago.

Mods were so shitty I always wanted to have my schadenfreude on them.

StackOverflow was a pretty toxic and hostile place. I'm surprised they did nothing to fix it. And I'm not speaking of rainbows and unicorns, it was really easy to stop punishing people for asking questions - it was a web-site for asking questions after all.

Then they forbid using AI to answer questions - another huge miss. They could have leveraged AI as a great cool gig on their web-site - they didn't. Too bad.

I don't think it was AI, I seem to remember that google broke search or SO SEO broke to the point where it wouldn't even point at the right SO article. There used to be a lot of commotion on the forums about how broken google search became for them.
loading story #48960245
By now I’m more and more starting to wonder how this graph looks for Google itself
joining the space and getting to know this site in 2015ish it was toxic af, well deserved
same story for blogs
that must be depressing to the owners and the investors.
loading story #48960782
If there is not allowed to be duplicate questions isn't it by design that as the site and industry matures the number of posts go down.
The company my friend works for has a slack channel for help with code, like an internal stackoverflow. It’s almost inactive now.

I asked to see one of the questions from 2024 - it could have been solved with one LLM search.

We have eliminated a whole genre of peer to peer communication.

loading story #48957438
loading story #48960425
loading story #48960229
loading story #48959994
loading story #48959585
Stackoverflow deserved to die
This is IMO wrong. StackOverflow died way before AI - and way before 2020 too. I think it had a peak time of only 3 or 4 years. It was created in 2008, and I would reason it took a few years, say, up to 2011; then it was semi-okish up to about 2015, roughly. Then it declined.

It still has some value today, as sometimes you can find useful information on SO, but its peak days are long over and I don't see how it can manage to come back, with or without AI slop. It would basically require a lot of re-design and some things that never worked, such as the karma system, should be changed. Also moderators - they kill sites. That happened to reddit - I gave up after censor-mods constantly restricted everyone.

loading story #48957483
loading story #48959959
Wikipedia seems to be going the same way.
Picking on SO and the mods in particular is a popular HN pasttime. I'd like to add that I interacted a bit with SO (1k points) and never really had any problems with them. I must be lucky...