Hacker News new | past | comments | ask | show | jobs | submit

  >abliterated models where the superficial instructions like not describing Taiwan as independent are burned off
Does this help with issues like including security vulnerabilities when you say you're in Tibet? I understood that this was burned in at the training level, not just a layer of censorship added at the last minute.

https://www.crowdstrike.com/en-us/blog/crowdstrike-researche...

It could, but it's an inexact science. A little bit like tampering with the brain. Even a surgical procedure removing a tiny tumor can interfere with critical pathways. Usually abliterated models end up almost exactly as capable in benchmarks, but it requires the person doing the abliteration to anticipate or know about the censorship. In the case of Chinese model censorship it is believed that it is post-training, so the underlying data input is not the issue. It's how the model has been trained to use that data. Specifically, abliteration usually targets the refusal behaviour. I would guess that this example could be significantly improved, but I have not seen any abliteration attempts re this specifically.