Researchers have identified the "Knowing--Using Gap," a phenomenon where fine-tuned LLMs memorize new facts but fail to apply them to downstream reasoning tasks. The study explores this failure by analyzing the temporal lag between memorization and generalization using a novel intervention technique to monitor internal spatial permeation dynamics.
Read original
huggingface/daily-papers