Hacker News new | past | comments | ask | show | jobs | submit
Can a model be stripped off anything not relevant to coding and get a lot lighter? Or is that impossible?

Just like we have professors with specialisation wondering if AI models can also be so.

You can... but the trick is to do so without killing performance. Turns out a lot of random things help make coding performance good.
Does this desideratum make any sense? The whole point is that you write to it in English or Urdu, and it writes the specified code. If you cut off everything but the code writing, you cut off everything.
loading story #49153186
loading story #49152723
no, apparently, otherwise we'd already have specialized models. every bit of meaningful human-generated data appears to improve the overall capability of the model.
loading story #49151549
Kind of yes, but this be get you are pretty stupid autocomplete yuo can probably avhieve without an LLM at all.

>we have professors with specialisation

Yes, but any professor with a specialisation is an erudite with vast knowledge across the board.

I'd argue we can have a meaningful BIG model with a specialisation but not vice versa.

PS: all of this is about a model that is expected to be able to execute development tasks on a human level. Obviously we can have small models that are very capable in things like TTS or STT.

I guess it can but it will be useless. After all the model superpower is awareness and ability to guess and infer some stuff. Right now a model saves you time not only by coding faster, but that it can figure out some stuff about the shape of the data and its purpose.

If you throw general purpose model at a codebase - it will look at the table and data logical connections beyond what is explicitly declared. It will figure out on its own that Salaries should be displayed on SalariesTable.php and it will "know" that your prices should include vat and so on.

A human knows that VAT and price go together and are related, full size LLM does too, stripped one - doesn't.

Yes, look up REAP.
loading story #49154791