Offshore

1 view15:56

God of Prompt
RT @rryssf_: ICLR 2025 just gave an Outstanding Paper Award to a method that fixes model editing with one line of code 🤯

here's the problem it solves:

llms store facts in their parameters. sometimes those facts are wrong or outdated. "model editing" lets you surgically update specific facts without retraining the whole model.

the standard approach: find which parameters encode the fact (using causal tracing), then nudge those parameters to store the new fact.

works great for one edit. but do it a hundred times in sequence and the model starts forgetting everything else. do it a thousand times and it degenerates into repetitive gibberish.

every edit that inserts new knowledge corrupts old knowledge. you're playing whack-a-mole with the model's memory.

AlphaEdit reframes the problem.

instead of asking "how do we update knowledge with less damage?" the authors ask "how do we make edits mathematically invisible to preserved knowledge?"

the trick: before applying any parameter change, project it onto the null space of the preserved knowledge matrix.

in plain english: find the directions in parameter space where you can move freely without affecting anything the model already knows. only move in those directions.

it's like remodeling one room in a house by only touching walls that aren't load-bearing. the rest of the structure doesn't even know anything changed.

the results from Fang et al. across GPT2-XL, GPT-J, and LLaMA3-8B:

> average 36.7% improvement over existing editing methods
> works as a plug-and-play addition to MEMIT, ROME, and others
> models maintain 98.48% of general capabilities after 3,000 sequential edits
> prevents the gibberish collapse that kills other methods at scale

and the implementation is literally one line of code added to existing pipelines.

what i find genuinely elegant: the paper proves mathematically that output remains unchanged when querying preserved knowledge. this isn't "it works better in practice." it's "we can prove it doesn't touch what it shouldn't."

the honest caveats:

largest model tested was LLaMA3-8B. nobody's shown this works at 70B+ scale yet. a follow-up paper (AlphaEdit+) flagged brittleness when new knowledge directly conflicts with preserved knowledge, which is exactly the hardest case in production. and the whole approach assumes causal tracing correctly identifies where facts live, which isn't always clean.

but as a core insight, this is the kind of work that deserves the award. not because it solves everything. because it changes the question.

the era of "edit and pray" for llm knowledge updates might actually be ending.
tweet

1 view15:56