[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-82473-en":3,"doc-seo-82473-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},82473,1099513958607,"Jiven","https://ap-avatar.wpscdn.com/avatar/100002390cf8733938c?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778829742770036399",8,"Research & Report","FRAME: Learning the Adaptation Domain with a Mixture of Fractional-Fourier Experts","Parameter-efficient fine-tuning (PEFT) uses small trainable updates, but existing approaches effectively hard-code a single representation domain: LoRA constrains updates in the spatial domain, while spectral adapters constrain updates in the Fourier domain. This work treats the domain choice as a learnable design variable. FRAME (Fractional-Fourier Mixture of Experts) routes tokens to fractional-Fourier experts with trainable orders that interpolate between spatial and Fourier endpoints, improving task and layer specialization with minimal added cost.","FRAME: Learning the Adaptation Domain with a  \nMixture of Fractional-Fourier Experts Tom Saliencro1 , Maya Lindqvist1 , Rohan Desai2 , Priya Nair1 , Daniel Whitmore2  \n1University of California, Irvine  \n2University of Washington  \n[saliencro@gmail.com](saliencro@gmail.com)  \narXiv :2607 .00162v1 [ cs .LG] 30 Jun 2026  \nAbstract  \nParameter-efficient fine-tuning (PEFT) reparameterizes weight updates in a fixed basis:  \nlow-rank adapters operate in the spatial domain, while a recent line of spectral methods operates in a fixed Fourier domain. We argue that the choice of domain is itself a design degree of freedom that should be learned, and that no single basis is optimal across tasks, layers, or tokens. We introduce FRAME (FractionalFourier Mixture of Experts), a mixture-ofexperts adapter in which every expert carries alearnable fractional-Fourier order that continuously interpolates between the spatial domain (recovering vanilla LoRA) and the Fourier domain (recovering a spectral adapter) . Routing tokens through experts that occupy different points on this spatial–spectral continuum lets the model place each low-rank update in the domain where it is most compact, and—because fractional-Fourier operators of different orders are mutually incoherent—makes the experts naturally decorrelated, which reduces interference and improves multi-task composition. The order is a single scalar per expert, trained with a separate optimizer, and the transform is computed with an O (dlog d) chirp–FFT surrogate, so FRAME adds negligible cost over standard MoE-LoRA. Across commonsense, mathematical, code, and knowledge benchmarks on LLAMA-3 . 1-8B and QWEN2. 5-7B, FRAME improves over strong MoE-LoRA and spectral baselines—including FlyLoRA, FourierMoE, and HMoRA—while keeping the activeparameter budget small, and analysis shows that the learned orders specialize by task and layer in interpretable ways.  \n1 Introduction  \nParameter-efficient fine-tuning (PEFT) adapts a frozen foundation model by training a small number of additional parameters (Houlsby et al., 2019 ; Li and Liang, 2021 ; Lester et al., 2021) . Lowrank adaptation (LoRA) is the dominant instance:  \nit writes the weight update of a linear layer as a product of two low-rank matrices and has become a default for instruction tuning and domain specialization (Hu et al., 2022 ; Dettmers et al., 2023) . A natural way to increase the capacity of a single adapter without inflating its active parameter count is to turn it into a mixture of experts (MoE), routing each token to a few specialized low-rank modules (Dou et al., 2023 ; Li et al., 2024 ; Wu et al., 2024 ; Tian et al., 2024) .  \nAlmost all of these methods share a hidden assumption: the update is parameterized in the spatial (canonical coordinate) domain, where the low-rank prior is imposed directly on the weight matrix. A separate and growing line of work instead parameterizes the update in the Fourier domain, learning a sparse or low-rank set of spectral coefficients and mapping them back with an inverse transform (Gao et al., 2024 ; Borse et al., 2024 ; Bilican et al., 2025 ; Zhang et al., 2025) . Spectral adapters are attractive because pretrained weight updates are often spectrally concentrated, and because the Fourier basis is global: a few coefficients can express a high-rank spatial update. The most recent spectral method even builds a mixture of frequency-band experts with a frequency-aware router (Jiang et al., 2026) .  \nThis leaves the field with two camps—spatial and spectral—and an implicit, unexamined choice between them. We make that choice explicit and ask a different question: in which domain should an adapter be low-rank? Our answer is that the domain should not be fixed at all. The spatial and Fourier bases are merely the two endpoints of a one-parameter family of unitary transforms, the fractional-Fourier transform (FrFT), whose order a rotates a signal continuously in the time–frequency plane: a=0 is the identi","cbCaiuh0ZkFNclgJ","https://ap.wps.com/l/cbCaiuh0ZkFNclgJ","pdf",975057,1,15,"English","en",105,"# Abstract\n# Introduction\n## Parameter-efficient fine-tuning and LoRA\n## Spatial vs. Fourier adapters\n## Fractional-Fourier as a continuous domain\n## FRAME method overview\n# Results and analysis","[{\"question\":\"What problem does FRAME address in PEFT methods like LoRA and spectral adapters?\",\"answer\":\"FRAME addresses the implicit assumption that the adaptation domain should be fixed. It argues that neither the spatial domain nor the Fourier domain is universally optimal across tasks, layers, or tokens.\"},{\"question\":\"How does FRAME combine spatial and Fourier representations?\",\"answer\":\"FRAME uses a mixture of experts where each expert applies a low-rank update in a fractional-Fourier domain with a learnable scalar order. Setting the order to 0 recovers LoRA (spatial), and setting it to 1 recovers a Fourier-domain spectral adapter.\"},{\"question\":\"Why does FRAME claim its experts are less interfering during multi-task composition?\",\"answer\":\"Experts with different fractional-Fourier orders are described as mutually incoherent, which naturally decorrelates them. This reduces interference and improves the composition of multiple tasks.\"}]",1784180725,38,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"frame-learning-the-adaptation-domain-with-a-mixture-of-fractional-fourier-experts","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/frame-learning-the-adaptation-domain-with-a-mixture-of-fractional-fourier-experts/82473/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does FRAME address in PEFT methods like LoRA and spectral adapters?","Question",{"text":75,"@type":76},"FRAME addresses the implicit assumption that the adaptation domain should be fixed. It argues that neither the spatial domain nor the Fourier domain is universally optimal across tasks, layers, or tokens.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does FRAME combine spatial and Fourier representations?",{"text":80,"@type":76},"FRAME uses a mixture of experts where each expert applies a low-rank update in a fractional-Fourier domain with a learnable scalar order. Setting the order to 0 recovers LoRA (spatial), and setting it to 1 recovers a Fourier-domain spectral adapter.",{"name":82,"@type":73,"acceptedAnswer":83},"Why does FRAME claim its experts are less interfering during multi-task composition?",{"text":84,"@type":76},"Experts with different fractional-Fourier orders are described as mutually incoherent, which naturally decorrelates them. This reduces interference and improves the composition of multiple tasks.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":45,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":45,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]