[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85310-en":3,"doc-seo-85310-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85310,1099514068365,"Aurelia","https://ap-avatar.wpscdn.com/avatar/10000253d8d9f28188e?_k=1776742907772140068",8,"Research & Report","Calibrated e-CUSUM Decoding for Quantized Reasoning Models: Why Token Log-Probability Is the Wrong Observable for Decoding Monitors","Low-bit quantization makes small reasoning models cheap to deploy but degrades their chain-of-thought, motivating decoder-side monitoring to intervene when generation goes wrong. A martingale based on token log-probabilities is analyzed and shown to be an incorrect observable: its increments form a mean-zero martingale under the model’s own sampling law, remaining blind to confident repetition and failing to trigger useful sequential alarms. A training-free controller uses a degeneration-aware repetition score and a calibrated e-process CUSUM-style detector, improving selective detection on GSM8K while highlighting non-termination as a dominant failure mode.","arXiv :2607 . 1 13 17v 1 [ cs .AI] 13 Jul 2026  \nCalibrated e-CUSUM Decoding for Quantized Reasoning Models:  \nWhy Token Log-Probability Is the Wrong Observable for Decoding Monitors  \nEl Hassane Ettifouri [eettifouri@novelis.io](eettifouri@novelis.io)  \nNovelis Research, Paris, France  \nORCID: [https: // orcid. org/ 0000-0001-5299-9053](https: // orcid. org/ 0000-0001-5299-9053)  \nAyoub Belfatmi [abelfatmi@novelis.io](abelfatmi@novelis.io)  \nNovelis Research, Paris, France  \nORCID: [https: // orcid. org/ 0009-0005-4010-794X](https: // orcid. org/ 0009-0005-4010-794X)  \nMahaman Sanoussi Yahaya Alassan [syahaya@novelis.io](syahaya@novelis.io)  \nNovelis Research, Paris, France  \nORCID: [https: // orcid. org/ 0009-0006-0825-4701](https: // orcid. org/ 0009-0006-0825-4701)  \nWalid Dahhane [wdahhane@novelis.io](wdahhane@novelis.io)  \nNovelis Research, Paris, France  \nORCID: [https: // orcid. org/ 0000-0001-5387-3380](https: // orcid. org/ 0000-0001-5387-3380)  \nAbstract  \nLow-bit quantization makes small reasoning models cheap to deploy but degrades their chain-of-thought, and a recurring folk remedy is to monitor the decoder and intervene when generation “goes wrong”. A natural candidate for such a monitor is a martingale built from token log-probabilities, controlled by a concentration inequality. We show, both analytically and empirically, that this observable is the wrong basis for a decoder monitor: the increment log p(wt ) + Ht is a mean-zero martingale by construction under the model’s own sampling law, so it is blind to exactly the failure it is meant to catch—confident repetition—and, when naively checked throughout generation, it does not provide a useful sequential alarm.  \nWe replace it with a training-free decoding controller built on two ingredients that are individually standard but, to our knowledge, not previously combined for this purpose: (i) a degeneration-aware alarm score that fuses token uncertainty with an explicit verbatimrepetition signal, and (ii) a calibrated e-process-based sequential detector. The raw product process is Ville-valid under a conditional-mean null; the deployed CUSUM-floored statistic is treated more cautiously as an empirical change detector because the alarm score is history-dependent and autocorrelated. On GSM8K with DeepSeek-R1-Distill-Qwen-1.5B, the controller reduces the observed verbatim-degeneration signals in this pilot and, once calibrated, becomes a selective detector of failing traces (ϕ ≈ 0 .3, precision ≈ 0.6 versus a 0.38 base rate) rather than firing on 93% of generations as the uncalibrated version does. Wereport a positive but statistically inconclusive accuracy trend (INT4: 63% → 69%, paired McNemar p = 0 . 18 at n=100), an honest token-budget cost of +28%, and the observation—counter to the motivating intuition—that on GSM8K the dominant failure of these models is non-termination, not looping. We release the decoder, the calibration and re-scoring tools, and all traces. This is a preliminary study whose main contribution is methodological:  \na clear account of why a tempting token-level observable is inadequate, and a calibrated, honestly-evaluated replacement.  \n1 Introduction  \nDistilled reasoning models such as DeepSeek-R1-Distill (DeepSeek-AI, 2025) put competitive mathematical reasoning within reach of commodity hardware, and 4-bit post-training quantization pushes them further, onto a single consumer GPU or even a CPU. The price is well documented: low-bit quantization degrades mathematical reasoning disproportionately, inflating method and execution errors and lengthening chains of thought, with errors that tend to appear early and cascade (Li et al., 2025; Liu et al., 2025) . This points to a different intervention point. Rather than waiting for a finished answer and re-ranking it, one can act while the reasoning trace is still being generated. Because a handful of early tokens is often enough to send a quantized model down a bad path, a decoder-side monitor ma","cbCaiqnXHPzYDFYz","https://ap.wps.com/l/cbCaiqnXHPzYDFYz","pdf",340569,1,10,"English","en",105,"# Abstract\n# Introduction","[{\"question\":\"Why is token log-probability an inadequate observable for decoding monitors?\",\"answer\":\"Centering token log-probability under the model’s own sampling law yields a mean-zero martingale whose signal reflects self-consistency of sampling, not trajectory correctness. As a result, confident repetition produces near-zero increments, leaving the monitor silent when it should act.\"},{\"question\":\"What replacement mechanism does the paper propose for monitoring decoding failures?\",\"answer\":\"It proposes a training-free decoding controller that combines a degeneration-aware alarm score fusing token uncertainty with an explicit verbatim-repetition signal, with a calibrated e-process-based sequential detector. The deployed CUSUM-floored statistic is treated as an empirical change detector due to history dependence and autocorrelation.\"},{\"question\":\"What experimental findings are reported about decoder failures under quantization?\",\"answer\":\"On GSM8K with DeepSeek-R1-Distill-Qwen-1.5B, the controller reduces verbatim-degeneration signals and, after calibration, becomes a selective detector of failing traces. The study also reports that the dominant failure mode is non-termination rather than looping on this benchmark.\"}]",1784202401,25,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"calibrated-e-cusum-decoding-for-quantized-reasoning-models-why-token-log-probability-is-the-wrong-observable-for-decoding-monitors","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/calibrated-e-cusum-decoding-for-quantized-reasoning-models-why-token-log-probability-is-the-wrong-observable-for-decoding-monitors/85310/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why is token log-probability an inadequate observable for decoding monitors?","Question",{"text":75,"@type":76},"Centering token log-probability under the model’s own sampling law yields a mean-zero martingale whose signal reflects self-consistency of sampling, not trajectory correctness. As a result, confident repetition produces near-zero increments, leaving the monitor silent when it should act.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What replacement mechanism does the paper propose for monitoring decoding failures?",{"text":80,"@type":76},"It proposes a training-free decoding controller that combines a degeneration-aware alarm score fusing token uncertainty with an explicit verbatim-repetition signal, with a calibrated e-process-based sequential detector. The deployed CUSUM-floored statistic is treated as an empirical change detector due to history dependence and autocorrelation.",{"name":82,"@type":73,"acceptedAnswer":83},"What experimental findings are reported about decoder failures under quantization?",{"text":84,"@type":76},"On GSM8K with DeepSeek-R1-Distill-Qwen-1.5B, the controller reduces verbatim-degeneration signals and, after calibration, becomes a selective detector of failing traces. The study also reports that the dominant failure mode is non-termination rather than looping on this benchmark.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":21,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":21,"slug":133},"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]