Backdooring Open-Weight AI Models

Created: Last edited:
Syndicated · Original source
Backdooring Open-Weight AI Models This is a problem: Any open model whose weights have been edited can carry a backdoor, whether it’s a task-specific fine-tune, a merged adapter or an abliterated build. We have abliterated models in the title because it’s the most popular reason people download modified weights without verifying what’s inside. Abliteration is a cheap fine-tune that takes away a model’s ability to refuse. You find the direction in the weights that carries “no” and subtract it. The model then answers things a safety-tuned version would turn down. It began as a resear

https://www.schneier.com/blog/archives/2026/10/backdooring-open-weight-ai-models.html

Views: 1

Categories: Digital Preservation & Internet History [c47]

Manage / Login

Salvaged Goods of the Internet