One big problem was that there was no cooperation inside Sun. Groups in Sun kind of viewed HP as a competitor, kind of viewed SGI as a competitor, but the real competitor to be destroyed was that other group in Sun. The leaders of the project I worked on spent most of their time in political battles, trying to acquire or outmaneuver the other teams working on similar projects.
Another problem was that the main parts of Sun had conflicting strategies. The Solaris/SunSoft division wanted to run on SPARC, x86, and Power PC for the largest market. The SPARC division, of course, wanted none of that. The hardware division wanted to make expensive servers, but the other teams saw cheaper hardware as the right direction. The market ended up moving to cheap rack-mounted Linux x86 servers, so nobody at Sun won in the end.