Hacker News new | past | comments | ask | show | jobs | submit
Time to invest a few tokens into an unneuthered model
Is there anyone serving such inference? I can't fit anything usable on my hardware.
https://abliteration.ai/

But also if you're working on a local device, any Chinese model will agree to it most of the time.

loading story #50231168
Just look for "Heretic"-ed models on Huggingface.

Basically all Qwen models got un-neuthered.

Even the big ones (Deepseek, etc.) got their protection layer ablated.

I believe Mistral models are fairly capable at cybersecurity tasks, but I don’t think you could get anything useful out of anything smaller than Mistral Large 4.