Hacker News new | past | comments | ask | show | jobs | submit

Nobody ever gets credit for fixing problems that never happened (2001) [pdf]

https://web.mit.edu/nelsonr/www/Repenning=Sterman_CMR_su01_.pdf
loading story #48503442
I've been in those companies where "struggling departments" ended up getting all the praises and raise in budgets the following quarter because of the heroic saves they did, and raising awareness on how important they are... For stuff they totally caused on themselves.

Meanwhile, my perfectly purring department was struggling to keep the lights on.

It's a serious problem in this industry due to the disconnect between non-technical management (who understands how to double click) and engineering (who holds the company standing).

<insert IBM story about IT department cost cuts>

I'm not sure how we solve this, other than having management come from engineering.

loading story #48499841
loading story #48502222
loading story #48501680
loading story #48499335
loading story #48502269
loading story #48502018
loading story #48503408
loading story #48503685
loading story #48499131
loading story #48502528
loading story #48500439
loading story #48500213
loading story #48499055
loading story #48499437
loading story #48501020
loading story #48501537
loading story #48500198
loading story #48504614
loading story #48500472
loading story #48498993
loading story #48499100
loading story #48499967
loading story #48500055
loading story #48499535
loading story #48499497
loading story #48502521
loading story #48501237
loading story #48505503
There are a lot of things like this.

My favorite is how elegant solutions often look simple in retrospect. So if you noodle on a problem for a while and then come up with a clever solution: once you explain it to someone they'll be like, "yeah, of course."

Meanwhile the guy next to you that overcomplicates the problem ends up getting kudos for building something so difficult :D

loading story #48499220
loading story #48499017
loading story #48499451
loading story #48499052
loading story #48500438
loading story #48500400
loading story #48501299

  > elegant solutions
My favorite is how people will yell at you about how elegance doesn't matter, that they "just care that it works", and "keep it simple". I'm certain all the sayings repeated in industry are metastasized variants of actually good practices repeated by those who can't be bothered to understand what they mean.

And of course that's true. We push for speed, absent of direction, while praising velocity. To be honest, at this point I'm disappointed the engineers gave up and just started becoming business people.

loading story #48498930
I began migrating from network/hardware/IT work and into marketing after nearly 2 years of heavy lifting getting ready for Y2K. In the end, "nothing happened," so all that time and money was wasted, according to nearly every company I worked with. Even had one demand a full refund. I agreed as long as I could revert all the work that I had done. They agreed, and the next day after that their entire system collapsed.

I couldn't even get my own dad to pay for network support for his company since he would never pay my rate for anyone no matter what. After 2 other people failed to solve his problem I fixed it in 15 minutes and then he "really" didn't want to pay because it only took 15 minutes.

I was very good at what I did but got no appreciation for keeping things from breaking, only for fixing things after they broke. Marketing paid better, and I could point at real world numbers daily and justify my pay. I don't like it anywhere near as much, but at least it gets more respect than any other IT work I did.

loading story #48500397
loading story #48500652
loading story #48500556
Ian Rush said it best: "It's best being a striker. Miss five, score the winner, you're a hero. The goalkeeper plays a blinder, lets one in, and he's a villain."

Every place I've worked rewards the firefighter over the person who made sure nothing ever caught fire. And the worst part is the math is obvious to everyone except the people who set the incentives.

loading story #48500507
loading story #48506542
This is how people get promoted at work. They break something, it escalates and gets visibility, emails sent to executives. Now, they 'fix' it, many thank yous from everyone for a job well done. Another version of this is delay the work you are supposed to do a long time back and let it gain visibility. Executives are blind, they can't see work being done by people who take ownership and get shit done before it becomes a problem. However, executive will remember the name of the person who breaks shit and 'saves' the day.
loading story #48501858
loading story #48504509
We all learned this back in first grade. The kids that behaved in class and did their homework did not command most of the teacher's time and effort. It was the problem children who refused to follow the rules and needed constant praise for every bit of actual effort that they put into their studies; that got the teacher's attention.
loading story #48500050
You'll see capability traps everywhere once you learn about them.

Sterman, Repenning and other collaborators wrote several papers after this one. All fascinating and almost entirely depressing.

Especially since MIT's Sloan school, where system dynamics first became a discipline, is just around the bend from Harvard Business school, where system dynamics first became ignored.

loading story #48499169
loading story #48503483
I never gave credit to my electricity company for delivering electricity to me. I only get mad when there is an outage.
loading story #48499926
loading story #48501748
loading story #48499868
loading story #48499464
loading story #48499540
loading story #48500109
I'm looking for some data -- if anyone has it -- on the fraction of companies that are led (CEO) by a technical person, over the years/decades. I have the (anecdotal) impression that this fraction has been falling (stories like Boeing), but it would be cool to support or refute this with hard data. Anyone know where to find/assemble something like this? Also, if this trend is true, then why?
loading story #48499414
loading story #48499413
Two significant prior discussions:

https://news.ycombinator.com/item?id=8940820 - 24 Jan 2015, 50 comments

https://news.ycombinator.com/item?id=39472693 - 22 Feb 2024, 434 comments

There is something I saw on a reddit post of all places, about how every manager who doesn't predict a baseline of "3 annoying problems every month, 1 awful problem every 3 months" is essentially a bad manager. The reasoning being that, if your number of problems is under that threshold, then someone is doing a 'good job'.
This is exactly the problem with the nature prevention. When it's well done, it seems like nothing was done.
loading story #48499545
loading story #48503357
Article published in the Summer 2001 edition of California Management Review, yet it never mentioned Y2K, the first thing I thought of when I read the line "fixing problems that never happened". Perhaps it was actually written in 1999 and took a while to get published, because otherwise that seems a very strange omission. The Y2K problem was very much over-hyped by the American news media at the time (no, at no point would airplanes have been falling out of the sky — I literally heard someone say that would happen once — even if no effort had been put into fixing the bug).

But in recent years I have seen people (elsewhere, not on HN) claim that Y2K was a big nothingburger, and all the money spent on fixing the bug was wasted. No, that's not true either. All the money spent on fixing the bug was why it turned into a big nothingburger. Sure, some of that money was wasted, by executives who wanted an "official" Y2K-certified certificate, issued by a consulting firm that had nothing "official" about it except their own say-so. And so they spent $2 million learning what their own employees could have told them for $2,000. THAT money was wasted. But a lot of banks were running old COBOL code that used 2-digit years, and needed to be fixed. The fact that in January 2000, everyone's bank interest was still calculated correctly, and not calculated as if it was January 1900? THAT was entirely due to the vast amounts of money spent paying old COBOL coders to come out of retirement and fix the 2-digit years.

The lesson I learned from that is that it's possible for a problem to be overhyped, even massively overhyped, and yet still be a serious problem. The other lesson I should have learned is that people rarely get credit (I won't go so far as the article authors and say "nobody ever gets credit") for fixing problems that never happened.

loading story #48498812
loading story #48498854
loading story #48500413
loading story #48498916
loading story #48500045
loading story #48504171
Its really hard to measure effectiveness, problem becomes even harder when a non-engineering person has the job to measure effectiveness of a engineering person.

On other hand. for software engineering some of the signals that can be used to measure such a management itself can be

1. On call requirement, outages and team burnout - A well written software should not require on-calls from the dev team

2. Ask them about the "concrete" roadmap for next 6 months to a year - Absence of concrete items is a bad sign

loading story #48505764
I feel obliged to point out Stanslav Petrov, who absolutely got credit for fixing a problem that never happened. Granted it's a very extreme case.
I remember finding a comment in the first codebase I ever worked on professionally in my first ever job.

It read "This fixes a bug that hasn't happened yet".

It seemed really smart at first, but later I learned that the developer that added that code also had a pattern of appending spaces to the start and end of user input and comparing the length to 2 to determine whether the value was empty or not...

So I'm fairly sure "that hasn't happened yet" was probably more a case of "that I personally haven't introduced unnecessarily yet" :)

Pendatically speaking, people do get credit for fixing problems that never happened.

E.g. if the problems are quantifiable and there's a record, like dropping homicides from 100 per year to 20 per year in a city. Those extra homicides "didn't happen", but the improvement is understood.

For an one-off problem, it depends on how clear the path to the problem is. An electrician doing an inspection and noticing and fixing big electrical issues in the installation, would be appreciated, even if the accidents didn't happen.

Like nobody gets credit for avoiding problems or unnecessary things/complexity altogether. In fact the opposite may happen.
This is especially nice in the age of AI. I (the graybeard senior developer) does all the risky refactoring. I can take a performance issue and turn it into six regressions in half a day ($100). Then everyone is impressed when I let Opus fix these regressions in 20 minutes and $2 worth of AI.

No one notices when you cut 20% of some expensive process but cause no regressions.

And people often get credit for fixing issues they partially created.

Human groups work on shallow signalling and distributed confusion.

Couldn't help noticing:

In other words, it’s not just a tool problem, any more than it’s a human resources problem or a leadership problem. Instead it is a systemic problem [...]

Shades of an LLMism, a bit padded, a quarter of a century ago. These days someone could easily give it a stink-eye. I'm sure that training has ingested this along with countless similar examples.

loading story #48500482
Since Covid nearly everyone in Germany knows this saying: "There is no glory in prevention."
This is why I'll never be a fire protection engineer
Depends on the business.

When everyone is technical to some degree, I find that credit for technical rescue is forthcoming.

Avengers get the glory, preventers get no story.
"Titanic effect" - No captain gets credit for preventing a disaster!
People do get credit for making things that "just work".
loading story #48505833
So let's create moments or days of observance to make people aware of preventative measures taken
loading story #48499594
loading story #48499352
{"deleted":true,"id":48501612,"parent":48498385,"time":1781254482,"type":"comment"}
I'd guess a lot of people here consider this "reality" at this point. Has anyone come up with a response—not a fix for the company or leaders behaving this way, but a response for their own path?

Did you change from a quiet diligent one to manipulating and playing the game (now that you know the game)? Did you go from quiet and diligent to quiet and not diligent (why do good work when meh work does the trick)? Another path?

loading story #48500773
loading story #48499796
People don’t get credit for fixing problems that do happen. Maybe possibly in a sales scenario where your fix unblocked the sale. Otherwise nada.
Prevention is hard to sustain because the success is invisible : nobody notice the defects delays or crises that never happened
This is the real problem with performance reviews in companies, which then feeds into opportunities, promotions and compensation. It's just a popularity contest. And this is particularly harmful to people who are neurodivergent, particularly if they're on the autism spectrum, because neurotypical people, who end up making all these decisions, view such people negatively for literally no reason.

You could spin up a team of 6 engineers and have them go away and try some greenfield project. They could come up back in 6 months having shipped nothing. Which of these descriptions fits the facts?

1. The team learned a lot and ultimately decided there was no product-market fit and decided it was best to reallocate resources elsewhere. The learnings from that project will help a whole bunch of other projects across the division; and

2. They failed to ship and get subpar performance ratings for having no impact.

The answer is... both. Or either. How you are treated will depend on how you are viewed by your management chain and that's a social function. We've all encountered people who never shut up about how hard their job is. Often they end up solving problems that they created, often by not listening to anyone that those problems would occur. And they get credit for it.

You could say to people who anticipate problems to stop because it gets you nowhere. Let people fail. If only it worked that way. Instead you'll get blamed for not seeing a problem someone else created because you're viewed as competent but you aren't liked through no fault of your own.

Google seems to be the posterchild for a company that briefly solved this problem and then forgot what made them successful. I am referring to Project aristotle [1], which ultimately determined that psychological safety was the key ingredient in a team's success.

Now amplify all of this with constant rounds of layoffs where the environment isn't just for pay bumps and opportunities but where the cost of failing is losing your income. What you've created is an environment where office politics is everything.

[1]: https://psychsafety.com/googles-project-aristotle/

Human civilization runs on personal sacrifices but money bags will never care about that.
loading story #48499064
This is very true and applies for everything in life.
Very true! Along with it comes with peace/quietness at work so it’s not too bad.
loading story #48504126
Two counter-examples:

- Arnold bought a fleet of mobile hospitals that would have been perfect for covid response, but the next governor didn’t want to pay 1% the fleet cost per year to maintain it, so he scrapped it.

- Under Obama, SARS v1 was stopped by US health workers that Trump fired because it was a “bad deal”. In the absence of that team, we got SARS v2, which was renamed to COVID 19.

There’s also the related category of “never blamed for fixing problems poorly, creating even bigger problems”.

Thanks to 9/11, plane cockpits can now be locked from the inside. Now, we have examples of commercial passenger airline pilots locking the doors and committing mass-murder-suicide by plane crash.

For some reason, these stories don’t make the news.

loading story #48498879
Its called doing your job.
We know that the squeaky wheel is the one that gets oiled, and we don't want the wheels to come off, so we need the wheel to squeak loud enough to be heard ;)
But the same person can get paid for it. So there is an incentive to create, or at least pretend problems.
The jokes around Y2K being a nothing burger always annoy me. Nothing happened because a lot of talented people worked their asses off fixing it.
sounds like my day to day job experience.
Making critical decisions without oversight is just as bad, or maybe worse.

If you frame it this way in a meeting, you will get the attention you want. Don't say I didn't warn you because that comes with a lot of scrutiny you might not want.

> The combined expenditure of U.S. companies on management consul- tants and training in 1997 was over $100 billion

erhm, if this figure is close to true i can see what market ai companies is after.

loading story #48498757
loading story #48504610
loading story #48505224
Related. Others?

Nobody ever gets credit for fixing problems that never happened (2001) [pdf] - https://news.ycombinator.com/item?id=39472693 - Feb 2024 (424 comments)

Nobody Ever Gets Credit for Fixing Problems That Never Happened (2001) [pdf] - https://news.ycombinator.com/item?id=8940820 - Jan 2015 (50 comments)