Hacker News new | past | comments | ask | show | jobs | submit
Ablated models are not any more inherently knowledgeable about "forbidden" topics, either. Since such topics are not generally trained for, you just get weird creative hallucinations.