Memes expose a difficult weakness in multimodal image editing: the picture and caption form a single semantic unit, so changing either one can destroy the joke. A new benchmark called MER-Bench asks image editors and multimodal generators to turn negatively framed memes into constructive versions while preserving the original scenario, entities, and layout.
The researchers call the task Meme Reappraisal, drawing on the psychological technique of changing an event’s emotional interpretation. Applied to memes, reappraisal resembles emotion-level style transfer under strict visual and textual constraints. The output must express a new emotional frame while remaining recognizably derived from the source.
A small edit with tight constraints
Conventional image editors can repaint scenes, replace objects, or apply visual styles, while multimodal generators can create captioned images from prompts. Meme reappraisal requires several capabilities to work together:
- The caption must remain readable and fit the existing text region.
- The characters, objects, and underlying scenario must survive the edit.
- Single-panel or multi-panel geometry must remain coherent.
- The rewritten text and edited image must express the target emotion together.
A broad instruction such as make this meme positive can trigger extensive regeneration, producing a different scene or template. MER-Bench measures whether a model can make the narrower emotional change without semantic drift, broken text, or disrupted composition.