Hacker News new | past | comments | ask | show | jobs | submit
hypfer | on: Anthropic IPO
> Switching LLM providers as a company is not, once all your employees have it integrated with GitHub, their IDE, etc.

I'm not so sure about this. I guess it depends on how well people did their job there.

Ideally, whatever people built is loosely coupled to that third-party resource, meaning that switching cost will stay low.

After all, it's probably just prompts + an API layer. Unless one micro-optimizes their prompts for claude (which then breaks once a new checkpoint drops, hence is a bad idea regardless), pointing them towards a different API endpoint should be doable.

starfallg | parent | next
Currently we are building agentic systems for various business functions like Legal and Finance. How these models perform in those tasks is paramount, and things like cost per run is only a part of the equation. It can become very subjective, and things like brand recognition comes into play. The cost of a counsel or a VP finance overshadows the savings you get by micro-optimizing for a cheaper model. We tend to use the best-in-breed LLM for the various tasks - mainly Claude and Gemini, and sometimes GPT.
stymaar | root | parent | next
> How these models perform in those tasks is paramount,

Then you have no choice but to use your own hosted model because that's the only way you can be sure the model isn't going to be removed or quantized/nerfed behind your back.

If your system can widstand the fluctuations of closed models over time, then it can most likely support switching between multiple providers in the first place.

loading story #50467377
DeepSeethe | root | parent | next
If you ever need to scale to millions of customers, then cost per task is paramount. If it’s a one-off vibe coded custom project for one client, then best-in-breed is mandatory without it falling apart.
gloryjulio | root | parent | next
Ur case actually strength the argument for open weight self hosted model. You would have precision control over not only the technical issues, but also the legal issues.

Once the open weight models are good and cheap enough, there is no reason not to use them

axus | root | parent
Spending money in the most effective places is smart... and then there are the stupid businesses.
0c3ca83 | parent
> I guess it depends on how well people did their job there.

Given that the goal of the whole project is outsourcing the work, what are you expecting here?