Hacker News new | past | comments | ask | show | jobs | submit
Your comment is very astute. A structure is like a shell. It can only protect what is within. It does not cause what's within to be vital, healthy, or unhealthy. But if you think that the courage that Dario has regularly shown would be possible with a conventional "best practices" structure, I think you're kidding yourself.
> But if you think that the courage that Dario has regularly shown would be possible with a conventional "best practices" structure, I think you're kidding yourself.

With respect to OP (who has a unique vantage from inside), I do agree with this on principle. When there are uncommon outcomes, there must be uncommon structure imho. A "good structure" is like oxygen, water, or peace: When it's well-maintained and well-distributed, one might not even notice it's there, nor spend much time being grateful for it. It's banal, but "what do you mean? isn't this just how things would always have been?" is both beautiful and tragic.

Imho if we could figure out how to have a "loud peace" (in all the ways that this might mean), we'd have figured out an important way of sustaining the world and ourselves.

The structure requires maintenance and that is done by an individual or individuals. The real reasons a good company stays good is because the leadership stays good. When the leadership begins to disengage or leaves or changes in some way then the structure will begin to break down. You can't fix it with a "better" structure. It will decay over time unless someone is actively maintaining it.
What you say is true, but there is more to it. Decay is not the only thing that can happen to a structure. It also can be actively destroyed from the outside. Rather than ask whether a structure is right or wrong, good or bad, we instead need to learn to ask whether it is strong or weak.
This framing I agree with.
I think I agree..!

I get the sense you were feeling at odds with my framing? I wonder if it's that you're picking up that I believe "structure" is above any one person or set of people. In my conception, leadership is just part of structure, a key maintainer. Leadership are pieces of the structure, but subordinate in scale. They sometimes seek outside help in shaping structure (e.g., ppl like eries), and the structure becomes like another passive actor, not simply "leadership's doing". Leadership are key players taking care of the structure, but they are just one set of players, and in some structures, non-leadership employees play an outsized role (often because leadership knew enough to step back). Sometimes the role of leadership if "fucking right off" in certain domains. Regardless, the structure then guides behaviour of all within it, and hopefully the structure also maintains us, at least as much as we maintain it.

I'm stating the above as if it's universally true, but it's just my take. I'd be curious to know if any parts give you strong YES or NO feelings, if you are open to share your gut reaction. Blunt responses welcome

(Fwiw I lean heavily on the ideas of Christopher Alexander -- the Pattern Language guy -- in regards to my beliefs on "structure": https://dorian.substack.com/p/at-any-given-moment-in-a-proce... )

I think it's more that I was putting emphasis on a different piece of the puzzled than you and less that we disagreed.
Zaphod, is that you???

In all seriousness, yes, individual leadership at the top has to be willing to steelman controversial issues and potential changes of direction, as well engage in unapologetic gatekeeping. At this point we've seen this over and over in tech when observing corporate successes and failures.

{"deleted":true,"id":48480897,"parent":48480495,"time":1781117272,"type":"comment"}
> If you think that the courage that Dario has regularly shown would be possible with a conventional "best practices" structure, I think you're kidding yourself.

Is there something that happened which you don't think would have come to pass with a standard PBC/C-Corp (without the LTBT)? I'm trying to think of one, but nothing is coming to mind.

I think the structure attracted many people to Anthropic (e.g. an RSP that could only be overridden by the LTBT), but I'm not sure it has demonstrated a practical impact.

As an aside, I think a lot about this problem too! But the answers that don't reduce to something like "the people, and the people to whom they give power" seem to break down when I look closely.

Do you think their dispute with the Department of Defense would have gone the same way? We didn't see that at OpenAI or Google.

(Although it does remind me a bit of Google pulling out of China back in the day.)

I was at Google when it pulled out of China. GP's post reminds me a lot of early Google - it wasn't evil because there were people in high places, who were critical to its operations, who cared deeply about doing the right thing, and as a result other people who cared about doing the right thing felt like they had cover, and people who were willing to do the wrong thing to hit a short-term number found that they were marginalized. It changed slowly, one departure at a time, as the wrong people got into positions of power and started providing cover to people willing to do the wrong thing. A lot of it also had to do with declining market power: when Google was universally on top, they felt like they could do the right thing without serious negative consequences, but when they were fighting for control of a market, they felt they had to make compromises lest some other firm (being honest: Facebook) would end up in power and do the wrong thing anyway.

Unfortunately there doesn't really seem to be a cure for institutional decay. Once unethical people get in power, they hire other unethical people, and then you're just stuck in Game of Thrones. You have to go quit and found another company, and single-mindedly keep all those people away, kinda like Anthropic did when they left OpenAI.

> A lot of it also had to do with declining market power: when Google was universally on top, they felt like they could do the right thing without serious negative consequences, but when they were fighting for control of a market, they felt they had to make compromises lest some other firm (being honest: Facebook) would end up in power and do the wrong thing anyway.

I would argue it's not a real value if you are not willing to lose something in order to hold on to it. It is admirable to want to do the right thing when you can get away with doing the wrong thing. It is only a true value if you are willing to do the right thing when you cannot get away with doing the right thing.

> I would argue it's not a real value if you are not willing to lose something in order to hold on to it. It is admirable to want to do the right thing when you can get away with doing the wrong thing. It is only a true value if you are willing to do the right thing when you cannot get away with doing the right thing.

I don't think it's that simple.

For example, let's say your desire is to minimize harm in Area X. While you're on top and in control of Area X, then you can do that easily enough. Suddenly a competitor comes whose values show they're willing to do lots of harm to Area X. And if they beat you in the capitalistic marketplace and gain more control, they'll be able to do lots of harm. In order to beat them, you may have to do a little bit of harm to Area X, which goes against your values. But in doing so, you retain control, and prevent even greater harm to Area X. Is that not a "real" value?

Would it be a "real" value to staunchly refuse to do a little harm to Area X, even if you know that this will result in greater harm in the long run?

This is why I distrust simple ideologies. The world is not simple.

Your logic doesn't hold up well to simple escalation logic.

Company A founds itself on doing 0 harm to Area X. Competitor B shows up and starts finding success doing 10 harm to Area X, so Company A makes a "moral" decision: If we do 9 harm to Area X, we are preventing 1 entire harm. Isn't that real value? then Company C shows up and starts finding success doing 100 harm to Area X, so Company A changes it's moral stance to "unless we do 99 harm to Area X ..."

I know an old lady who swallowed a fly kind of logic going on here.

I mean, your proposed logic seems to be quite consistent from a basic game theory perspective. Defecting in a prisoners dilemma and races to the bottom are both well observed phenomena.
We have 10,000+ years of human civilization at this point. There must be some other active ethical maxim operating other than "choose the lesser of two evils" to explain why there is so much cooperation amongst humans. Evidence is not on the side of the preeminence of races to the bottom.

You should investigate the repeated prisoners dilemma.

> You should investigate the repeated prisoners dilemma.

Well aware. Obviously, the entirety of human civilization is a bit more complicated than a prisoners dilemma, iterated or not. Yet prisoners dilemma's and races to the bottom still exist, and it makes no sense to argue against them in the abstract.

I think we are very disconnected on the topic of conversation here. Somehow you've confabulated my point with an attack on the prisoners dilemma or races to the bottom?

The person I was responding to made the point that if you want to minimize evil in the world, sometimes you have to add evil to a lesser degree. As in my example, if I do 9 points of evil but prevent 10 points of evil then according to OP I've added value to the world in the form of the 1 point of evil I have reduced.

I responded that this can lead to an escalation trap. This assumes that we would all prefer less evil in the world, right? So how do we get out of the escalation trap? Repeated application of the maxim "always do a bit less evil than the worst possible competitor" will not lead to a minimization of evil overall, only a creeping increase in the total amount of evil in the world.

How are you equating this to me arguing against the existence of races to the bottom?

Sometimes being evil will make you win - but only what money can buy.
> It is only a true value if you are willing to do the right thing when you cannot get away with doing the right thing.

In reality, neither corporate nor personal values are binary, all-or-none propositions. They are more like springs that push you in the right direction. But if something pulls hard enough in the wrong direction, a spring can be overpowered.

I don't know, man. There seem to be enough exceptions in the world to make me at least curious about whether this is really true. For what it's worth, the story of Google and "Don't Be Evil" is in the book.
Yeah, I lean towards the structure not being the cause of the outcome here (i.e. if you rotated the governance structure of Anthropic and OpenAI, I think the decisions at each would likely stay the same).

If they made that decision and it destroyed revenue, I could see an alternate timeline where a standard C-Corp + board with non-founder control may have ousted leadership. But that wasn't the situation for OpenAI or Google either, and their leadership still made a different decision.

I just like to ask one little question: Who chose the structure in the first place? It's kind of a chicken and egg situation.
Sure, but their question was whether different structure/governance would have changed that decision.