Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models

Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models

From Daily Paper Cast by Jingwen Liang, Gengyu Wang

April 30, 2026 · 23 min · Episode 1814

About this episode

This episode discusses a novel framework for image refinement in unified multimodal models, focusing on conditional image regeneration.

🤗 Upvotes: 22 | cs.CV Authors: Jiayi Guo, Linqing Wang, Jiangshan Wang, Yang Yue, Zeyu Liu, Zhiyuan Zhao, Qinglin Lu, Gao Huang, Chunyu Wang Title: Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models Arxiv: http://arxiv.org/abs/2604.25636v1 Abstract: Unified multimodal models (UMMs) integrate visual understanding and generation within a single framework. For text-to-image (T2I) tasks, this unified capability allows UMMs to refine outputs after their initial generation, potentially extending the performance upper bound. Current UMM-based refinement methods primarily follow a refinement-via-editing (RvE) paradigm, where UMMs produce editing instructions to modify misaligned regions while preserving aligned content. However, editing instructions often describe prompt-image misalignment only coarsely, leading to incomplete refinement. Moreover, pixel-level preservation, though necessary for editing, unnecessarily restricts the effective modification space for refinement. To address these limitations, we propose Refinement via Regeneration (RvR), a novel framework that reformulates refinement as conditional image regeneration…

People in this episode

Hosts: Jingwen Liang, Gengyu Wang

Topics covered

  • image refinement
  • unified multimodal models
  • text-to-image tasks
  • conditional image regeneration
  • semantic alignment
  • modification space

Keywords

  • image refinement
  • unified multimodal models
  • text-to-image
  • semantic tokens
  • editing instructions
  • modification space
  • conditional regeneration

More episodes of Daily Paper Cast

Explore listener stats, chart rankings, contacts and more on the Daily Paper Cast podcast page.