A researcher demonstrated building a harness-specific LLM backdoor in hours on local GPU hardware, highlighting security risks in downloaded model weights. The experiment draws parallels between running unverified model weights and executing untrusted .exe files from the early 2000s. Existing research confirms LLMs can be poisoned with backdoors that are difficult to detect, and the author implemented a trigger that activates only under specific evaluation harness conditions.

Read original