[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-82317-en":3,"doc-seo-82317-105":29,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},82317,1374391974564,"Clementine","https://ap-avatar.wpscdn.com/avatar/14000253aa45c000a9e?x-image-process=image/resize,m_fixed,w_180,h_180&k=1779874745381141002",8,"Research & Report","Simon-SR Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution","Single Image Super-Resolution (SISR) reconstructs high-quality images from low-resolution inputs, but existing approaches can produce overly smooth results and remain sensitive to incorrect priors and costly annotations. Simon-SR introduces a multi-modal framework that treats text as latent, learnable semantic variables. It combines Contrastive Prompt Learning with Prompt-Guided Spatially Adaptive Refinement for robust text-image fusion and improved multi-modal alignment. Experiments show state-of-the-art gains, reaching up to 0.50 dB in PSNR, 0.0133 in SSIM, and 0.0695 in LPIPS.","arXiv :2607 .09351v1 [ cs .CV] 10 Jul 2026  \nSimon-SR: Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution  \nH. Cheng† X. Li† Z. Cui† L. Tan and C. Wang  \nCollege of Electronic Science and Engineering, Jilin University, Changchun China  \n{chenght9923, yxli1923, cuizj1923, tanrl1923, [cywang1923}@mails.jlu.edu.cn](cywang1923}@mails.jlu.edu.cn)  \nAbstract  \nSingle Image Super-Resolution (SISR) reconstructs high-quality images from low-resolution inputs. While recent multi-modal methods improve perceptual quality, they remain sensitive to erroneous priors and require expensive annotations. To address these issues, we propose Simon-SR, a multi-modal SISR framework leveraging learnable prompts for efficient semantic mining and robust text-image fusion. Our approach combines Contrastive Prompt Learning with Prompt-Guided Spatially Adaptive Refinement to enhance multi-modal alignment. Experiments demonstrate that Simon-SR surpasses state-of-the-art methods, achieving maximum improvements of 0.50 dB in PSNR, 0.0133 in SSIM, and 0.0695 in LPIPS. Code-will-be-released  \nCCS Concepts  \n• Computing methodologies → Reconstruction; Image processing; • Theory of computation → Design and analysis of algorithms;  \n1. Introduction  \nSuper-Resolution (SR) aims to reconstruct high-quality images from low-resolution inputs. While deep learning has significantly improved SR performance, the ill-posed nature of SR often yields overly smooth outputs, especially at extreme downsampling rates (e.g., ×16) . To enhance perceptual quality, existing single-modal methods are typified by adversarial architectures [WYW∗18] while the multi-modal ones generally leverage textual semantics as priors [QYZ∗24] .  \nRecent breakthrough of pre-trained multi-modal large language models reveals the potential of textual semantics for image restoration [QYZ∗24] . However, they suffer from sensitivity to erroneous priors and substantial annotation overhead. Moreover, existing multi-modal methods struggle with insufficient attention to critical details due to semantic biases during text-image fusion, as demonstrated in Figure 1(b) .  \nTo this end, we propose a novel multi-modal super-resolution framework termed Spatially Adaptive Modulation and Visual Prompt Adaptation (Simon-SR) . Existing text-driven SR methods assume texts as ground-truth semantic priors, whereas Simon-SR treats texts as latent, learnable semantic variables jointly optimized with image restoration. As illustrated in Figure 1 (c), our method efficiently extracts textual features with minimal computational overhead while adaptively modulating image features.  \n† Equal Contribution  \nFigure 1: (a) Existing single-modal methods fail at extreme downsampling rates (e.g., ×16). (b) Existing multi-modal models suffer from sub-optimal fusion strategies and text bias. (c) The proposed learnable prompts for textual semantic mining reduce annotation cost, mitigate prior bias, and enhance detail recovery.  \nIn summary, our contributions are threefold:  \n(1) We propose a learnable prompt-based approach for SR that extracts textual semantics from unannotated images, effectively  \n© 2026 The Author(s) .  \nProceedings published by Eurographics-The European Association for Computer Graphics.  \nThis is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.  \n2 of 5 H. Cheng & S. Behnke / EG LATEX Author Guidelines  \nFigure 2: Overview of Simon-SR framework. Given the input low-resolution image ILRx and pre-trained prompts, two stages operate sequentially. (a) Contrastive Prompt Learning extracts learnable textual semantics from unannotated images based on frozen CLIP encoders. Then, the optimized prompts are passed to (b) Prompt-Guided Spatially Adaptive Refinement, where text–image fusion is conducted via PTRBlocks. Spatially adaptive affine ","cbCaitRTcmJVwsqZ","https://ap.wps.com/l/cbCaitRTcmJVwsqZ","pdf",813380,1,5,"English","en",105,"# Introduction\n## Related Works\n### From Single-Modal to Prior-Guided Multi-Modal\n### Text-Driven Super-Resolution\n# Proposed Methods\n## Overview","[{\"question\":\"What problem does Simon-SR address in single image super-resolution?\",\"answer\":\"Simon-SR targets the ill-posed nature of super-resolution that often yields overly smooth outputs, especially under extreme downsampling, and the sensitivity of multimodal methods to erroneous textual priors and annotation cost.\"},{\"question\":\"How does Simon-SR use textual information differently from prior text-driven SR methods?\",\"answer\":\"Instead of treating text as fixed ground-truth semantic priors, Simon-SR models text as latent, learnable semantic variables jointly optimized with image restoration to reduce bias.\"},{\"question\":\"What are the two main stages of the Simon-SR framework?\",\"answer\":\"The first stage, Contrastive Prompt Learning, extracts learnable textual semantics from unannotated images using frozen CLIP encoders. The second stage, Prompt-Guided Spatially Adaptive Refinement, performs text-image fusion through PTRBlocks with spatially adaptive affine refinements during iterative improvement.\"}]",1784179567,13,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":27},"simon-sr-spatially-adaptive-modulation-and-visual-prompt-adaptation-for-text-reinforced-super-resolution","",{"@graph":35,"@context":84},[36,53,67],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/simon-sr-spatially-adaptive-modulation-and-visual-prompt-adaptation-for-text-reinforced-super-resolution/82317/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":61,"encodingFormat":60,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-16",true,{"@type":64,"interactionType":65,"userInteractionCount":4},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"What problem does Simon-SR address in single image super-resolution?","Question",{"text":74,"@type":75},"Simon-SR targets the ill-posed nature of super-resolution that often yields overly smooth outputs, especially under extreme downsampling, and the sensitivity of multimodal methods to erroneous textual priors and annotation cost.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"How does Simon-SR use textual information differently from prior text-driven SR methods?",{"text":79,"@type":75},"Instead of treating text as fixed ground-truth semantic priors, Simon-SR models text as latent, learnable semantic variables jointly optimized with image restoration to reduce bias.",{"name":81,"@type":72,"acceptedAnswer":82},"What are the two main stages of the Simon-SR framework?",{"text":83,"@type":75},"The first stage, Contrastive Prompt Learning, extracts learnable textual semantics from unannotated images using frozen CLIP encoders. The second stage, Prompt-Guided Spatially Adaptive Refinement, performs text-image fusion through PTRBlocks with spatially adaptive affine refinements during iterative improvement.","https://schema.org",{"og:url":51,"og:type":86,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":88,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":91},[92,96,100,104,108,113,118,121,126,129,133],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":101,"show_sort_weight":102,"slug":103},"Exam",70,"exam",{"id":21,"doc_module":4,"doc_module_name":45,"category_name":105,"show_sort_weight":106,"slug":107},"Comic",60,"comic",{"id":109,"doc_module":4,"doc_module_name":45,"category_name":110,"show_sort_weight":111,"slug":112},6,"Technology",50,"technology",{"id":114,"doc_module":4,"doc_module_name":45,"category_name":115,"show_sort_weight":116,"slug":117},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":119,"slug":120},30,"research-report",{"id":122,"doc_module":4,"doc_module_name":45,"category_name":123,"show_sort_weight":124,"slug":125},9,"Religion & Spirituality",20,"religion-spirituality",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":127,"show_sort_weight":124,"slug":128},"World Cup","world-cup",{"id":130,"doc_module":4,"doc_module_name":45,"category_name":131,"show_sort_weight":130,"slug":132},10,"Lifestyle","lifestyle",{"id":134,"doc_module":4,"doc_module_name":45,"category_name":135,"show_sort_weight":21,"slug":136},19,"General","general"]