Researchers have introduced RefineEdit, a training-free, prompt-to-prompt image editing framework that leverages the inherent editability of Generative Refinement Networks (GRN). Unlike traditional diffusion-based editors that rely on imprecise spatial controls or autoregressive editors constrained by fixed decoding orders, RefineEdit utilizes the global refinement of binary image codes to couple edit localization with content generation. The methodology employs a "bit routing" technique, which identifies editable positions and specific bits by calculating signed probability differences between two branches starting from an intermediate source state. To ensure stability during this iterative process, the framework incorporates two specialized mechanisms: adaptive spatial freezing, which prevents the editing region from expanding unnecessarily, and finite bit locking, which preserves recent bit activations to facilitate continuous refinement. This approach eliminates the need for additional training, external masks, or complex attention control mechanisms. Evaluated against nine categories in the PIE-Bench benchmark, RefineEdit demonstrated superior performance, achieving state-of-the-art background-preservation scores across PSNR, LPIPS, MSE, and SSIM metrics. Furthermore, the model outperformed existing methods in both whole-image and edited-region CLIP scores, proving its effectiveness in executing precise textual edits while maintaining the integrity of unrelated source content.
Read original
huggingface/daily-papers