A Reddit user experimented with MIT's "weight-space programming" technique on Gemma 4 12B, modifying eight neurons to alter how the model translates the Italian trapassato prossimo tense. Inspired by MIT CSAIL's demonstration of GPT-6 Astra manually editing Qwen3.5-0.8B weights to fix math looping without retraining, the user applied similar targeted weight edits to address a specific translation behavior in a larger model. The intervention successfully changed the model's output for past perfect continuous constructions without any fine-tuning.

Read original