[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-134460-en":3,"doc-seo-134460-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},134460,2336474466712,"Quinn Holloway","https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd",8,"Research & Report","Sketching without Worrying - Noise-Tolerant Sketch-Based Image Retrieval","Sketching enables image retrieval applications, but users often fail to sketch due to the fear-to-sketch problem (“I can't sketch”), especially in fine-grained SBIR where irrelevant details can strongly hurt ranking. This work introduces a noise-tolerant pre-processing module that helps users sketch without worry by detecting and removing noisy strokes. A stroke subset selector trained with reinforcement learning quantifies stroke importance via reward from retrieval ranking, yielding 8–10% gains over baselines. The selector integrates plug-and-play with existing sketch applications.","Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrieval  \nAyan Kumar Bhunia 1 Subhadeep Koley 1,2 Abdullah Faiz Ur Rahman Khilji* Aneeshan Sain 1,2  \nPinaki Nath Chowdhury 1,2 Tao Xiang 1,2 Yi-Zhe Song 1,2  \n1 SketchX, CVSSP, University of Surrey, United Kingdom.  \n2iFlyTek-Surrey Joint Research Centre on Artificial Intelligence.  \nfa.bhunia, s.koley, a.sain, p.chowdhury, t.xiang, [y.song](y.songg@surrey.ac.uk)[g](y.songg@surrey.ac.uk)[@surrey.ac.uk](y.songg@surrey.ac.uk)  \nAbstract  \nSketching enables many exciting applications, notably, image retrieval. The fear-to-sketch problem (i.e., “I can't sketch”) has however proven to be fatal for its widespread adoption. This paper tackles this “fear” head on, and for the first time, proposes an auxiliary module for existing retrieval models that predominantly lets the users sketch without having to worry. We first conducted a pilot study that revealed the secret lies in the existence of noisy strokes, but not so much of the “I can't sketch”. We consequently design a stroke subset selector that detects noisy strokes, leaving only those which make a positive contribution towards successful retrieval. Our Reinforcement Learning based formulation quantifies the importance of each stroke present in a given subset, based on the extent to which that stroke contributes to retrieval. When combined with pre-trained retrieval models as a pre-processing module, we achieve asignificant gain of 8%-10% over standard baselines and in turn report new state-of-the-art performance. Last but not least, we demonstrate the selector once trained, can also be used in a plug-and-play manner to empower various sketch applications in ways that were not previously possible.  \n1. Introduction  \nThanks to the convenience of interactive touchscreen devices, sketch-based image retrieval (SBIR) [11, 12, 14, 38] has emerged as a practical means of image research that is complementary to the conventional text-based retrieval [25] . Although initially developed for a category-level setting [42, 36, 59], of late SBIR has undertaken a fine-grained shift to better reflect the inherent fine-grained characteristics (pose, appearance detail, etc) of sketches [46, 56, 7] .  \nDespite great strides made [3, 33, 10], the fear-to-sketch has proven to be fatal for its omnipresence – a “I can't sketch” reply is often the end of it. This “fear” is predominant for fine-grained SBIR (FG-SBIR), where the system dictates users to produce even more faithful and diligent  \n*Interned with SketchX  \nFigure 1: (a) While the average ranking percentile increases as the sketching proceeds from starting towards completion, unwanted sudden drops have been noticed for many individual sketches due to noisy/irrelevant strokes drawn. (b) The same thing is visualised with number of samples in the third axis to get an overall statistics on QMUL-Shoe-V2 dataset.  \nsketches than that required for category-level retrieval [11] . In this paper, we tackle this “fear” head-on and propose for the first time a pre-processing module for FG-SBIRthat essentially let the users sketch without the worry of “Ican't”. We first experimentally show that, in most cases it is not about how bad a sketch is – most can sketch (even a rough outline)– the devil lies in the fact that users typically draw irrelevant (noisy) strokes that are detrimental to the overall retrieval performance (see Section 3) . This observation has largely inspired us to alleviate the “can't sketch”  \nproblem by eliminating the noisy strokes through selecting an optimal subset that can lead to effective retrieval.  \nThis problem might sound trivial enough – e.g., how about considering all possible stroke subsets as training samples to gain model invariance against noisy strokes? Albeit theoretically possible, the highly complex nature of this process (i.e., O(2N )) quickly renders this naive solution infeasible, especially when the number of strokes in freehand sketches can range from an avera","cbCaimEvSXcyaeUA","https://ap.wps.com/l/cbCaimEvSXcyaeUA","pdf",6876646,1,10,"English","en",105,"# Abstract\n# 1. Introduction\n# 2. Method Overview\n# 3. Noisy Stroke Analysis\n# 4. Reinforcement Learning for Stroke Selection\n# 5. Experimental Results and Performance Gains\n# 6. Plug-and-Play Applications","[{\"question\":\"What problem does the paper address in sketch-based image retrieval?\",\"answer\":\"It addresses the fear-to-sketch problem, where users reply “I can't sketch,” limiting adoption. It targets fine-grained SBIR by reducing the negative impact of irrelevant/noisy strokes drawn by users.\"},{\"question\":\"How does the proposed method handle noisy strokes?\",\"answer\":\"It introduces a stroke subset selector that detects noisy strokes and keeps only strokes that positively contribute to successful retrieval. The selector outputs a binary decision per stroke to form an optimal subset.\"},{\"question\":\"Why is reinforcement learning used for training the stroke selector?\",\"answer\":\"Rasterization is non-differentiable, preventing direct gradient-based optimization. The method uses reinforcement learning (actor-critic PPO) with reward computed using a pre-trained retrieval model’s ranking.\"}]","Sketching without Worrying - Noise-Tolerant Sketch-Based Image Retrieval | PDF",1787262803,25,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"sketching-without-worrying-noise-tolerant-sketch-based-image-retrieval","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/sketching-without-worrying-noise-tolerant-sketch-based-image-retrieval/134460/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-20",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the paper address in sketch-based image retrieval?","Question",{"text":75,"@type":76},"It addresses the fear-to-sketch problem, where users reply “I can't sketch,” limiting adoption. It targets fine-grained SBIR by reducing the negative impact of irrelevant/noisy strokes drawn by users.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the proposed method handle noisy strokes?",{"text":80,"@type":76},"It introduces a stroke subset selector that detects noisy strokes and keeps only strokes that positively contribute to successful retrieval. The selector outputs a binary decision per stroke to form an optimal subset.",{"name":82,"@type":73,"acceptedAnswer":83},"Why is reinforcement learning used for training the stroke selector?",{"text":84,"@type":76},"Rasterization is non-differentiable, preventing direct gradient-based optimization. The method uses reinforcement learning (actor-critic PPO) with reward computed using a pre-trained retrieval model’s ranking.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":21,"slug":133},"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]