Hacker News new | past | comments | ask | show | jobs | submit

We were wrong about GPUs

https://fly.io/blog/wrong-about-gpu/
> The biggest problem: developers don’t want GPUs. They don’t even want AI/ML models. They want LLMs. System engineers may have smart, fussy opinions on how to get their models loaded with CUDA, and what the best GPU is. But software developers don’t care about any of that. When a software developer shipping an app comes looking for a way for their app to deliver prompts to an LLM, you can’t just give them a GPU.

I'm increasingly coming to the view that there is a big split among "software developers" and AI is exacerbating it. There's an (increasingly small) group of software developers who don't like "magic" and want to understand where their code is running and what it's doing. These developers gravitate toward open source solutions like Kubernetes, and often just want to rent a VPS or at most a managed K8s solution. The other group (increasingly large) just wants to `git push` and be done with it, and they're willing to spend a lot of (usually their employer's) money to have that experience. They don't want to have to understand DNS, linux, or anything else beyond whatever framework they are using.

A company like fly.io absolutely appeals to the latter. GPU instances at this point are very much appealing to the former. I think you have to treat these two markets very differently from a marketing and product perspective. Even though they both write code, they are otherwise radically different. You can sell the latter group a lot of abstractions and automations without them needing to know any details, but the former group will care very much about the details.

loading story #43054638
loading story #43054527
loading story #43060630
loading story #43054426
loading story #43054476
loading story #43054422
loading story #43056882
loading story #43054487
loading story #43054784
loading story #43055972
loading story #43057021
loading story #43054581
loading story #43054974
loading story #43066338
loading story #43060217
loading story #43054694
loading story #43058491
loading story #43058722
loading story #43057306
loading story #43058206
It’s not about wanting, it’s about what the job asks for. As a self employed engineer I am paid to solve business problems in an efficient way. Most of the time it just make more business sense for the client and for me to pay to just have to git push if there is no performance challenges needing custom infrastructure.
loading story #43057105
loading story #43054588
loading story #43058409
loading story #43058062
loading story #43057154
loading story #43054565
loading story #43055115
loading story #43054854
loading story #43059834
loading story #43059093
loading story #43058276
loading story #43062374
loading story #43061623
loading story #43054832
loading story #43054867
loading story #43055382
loading story #43098481
loading story #43068816
loading story #43055624
loading story #43066399
loading story #43057208
loading story #43055991
loading story #43067347
loading story #43065613
loading story #43068674
loading story #43055455
loading story #43056346
loading story #43069178
loading story #43071565
loading story #43066651
loading story #43054465
loading story #43054917
loading story #43054486
loading story #43054241
loading story #43054144
loading story #43054331
loading story #43054686
loading story #43057256
loading story #43054033
loading story #43053985
loading story #43054998
loading story #43056366
loading story #43054005
loading story #43054074
loading story #43056861
loading story #43054641
loading story #43054146
loading story #43054184
loading story #43054771
loading story #43054834
loading story #43057985
loading story #43054425
loading story #43054345
loading story #43056081
loading story #43062931
loading story #43056623
loading story #43058324
loading story #43055431
loading story #43059730
loading story #43061212
loading story #43058430
loading story #43054280
loading story #43056262
loading story #43055023
loading story #43061224
loading story #43054367
loading story #43054293
loading story #43085239
loading story #43054118
loading story #43054235
loading story #43092450
loading story #43054456
loading story #43061443
loading story #43054924
loading story #43056612
loading story #43054877
loading story #43063461
loading story #43057940
loading story #43054154
loading story #43054115
loading story #43054213
loading story #43054337
loading story #43054082
loading story #43054291
loading story #43057862
loading story #43058008
loading story #43054935
loading story #43054292
loading story #43054061
loading story #43054042
loading story #43059133
loading story #43054733
loading story #43054502
loading story #43054169
loading story #43062832