Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.LG Yubo Huang, Yushe Cao, Zixi Wang et al. · Oct 22, 2026

Gradual domain adaptation (GDA) tackles large distribution shifts by splitting them into ordered intermediate steps, but existing methods often suffer from error accumulation and unstable adversarial training. This paper proposes FlowGDA, a flow-matching framework that models gradual adaptation as continuous transport on a statistical manifold in a representation space, using time-dependent velocity fields learned via a simulation-free regression objective. By coupling local left-to-right transport with a source-anchored semantic consistency loss, the method aims to avoid the error accumulation and adversarial instability of discrete stepwise GDA methods.

Large distribution shifts remain a primary obstacle for domain generalization and unsupervised adaptation. Although gradual domain adaptation alleviates this difficulty by introducing ordered intermediate domains, most existing approaches still operate in a discrete, step-wise manner, which can accumulate errors and often relies on unstable Min--Max optimization. We propose \textbf{FlowGDA}, a flow-matching framework that models gradual adaptation as \emph{continuous} transport on a statistical manifold in a representation space. FlowGDA learns time-dependent velocity fields that induce smooth domain trajectories, using a simulation-free regression objective rather than adversarial training. To prevent semantic drift, we couple left-to-right transport between consecutive domains with a source-anchored transport and a semantic consistency loss, and we further stabilize learning via a two-stage sequential optimization scheme. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques, validating flow matching as an effective alternative for domain adaptation.
0
cs.LG Chenhao Zhou, Chao Zhang, Wensong Bai et al. · Oct 22, 2026

Representation learning has improved sample efficiency in unconstrained MDPs, but extending it to constrained settings with unknown dynamics remains largely open. This paper studies low-rank constrained MDPs with continuous states where latent transition features must be learned online while controlling cumulative constraint violations. The authors propose two primal-dual algorithms that combine maximum-likelihood feature learning, uncertainty bonuses, and decaying $\epsilon$-greedy auxiliary probing to obtain the first sublinear regret and violation guarantees for this setting, with an explicit tradeoff between return-policy optimality and the safety cost of exploratory execution.

Representation learning has substantially improved the efficiency of unconstrained continuous-state Markov Decision Processes (MDPs), but its extension to Constrained MDPs (CMDPs) is difficult because the transition representation must be learned while constraint violation is controlled. In this paper, we study representation learning for low-rank CMDPs with continuous state spaces, and propose REP-PD-TEG for the soft cumulative-violation setting. In the feature learning period, the algorithm interacts with the environment using a decaying-$\epsilon$-greedy mixture execution policy, and uses the collected samples to learn transition features by maximum likelihood. Based on the learned features, it constructs uncertainty bonuses and plans with an optimistic Lagrangian objective to obtain the return policy. We prove regret and soft-violation guarantees for the return policies, and quantify the influence of the decaying-$\epsilon$-greedy exploration. In particular, REP-PD-TEG achieves the optimal $\widetilde O(\sqrt K)$ return policy bound, and gives a $\widetilde O(K^{3/4})$ overall sample bound when exploratory actions are charged. For the stricter hard cumulative violation, where feasibility must be verified episode by episode, we propose REP-PD-H-TEG. It plans under a bonus-corrected lower-confidence utility certificate with the learned representation, and performs a stabilized dual search to obtain the return policy, yielding regret and hard-violation bounds. Together, these results give the first theoretically guaranteed representation-learning method for low-rank continuous-state CMDPs with both soft cumulative guarantees and certified hard-violation control.
0
cs.AI Huiting Liu, Jinsong Wu · Oct 22, 2026

Autoregressive sequence models can suffer hidden future-token leakage when auxiliary operations—such as pooling, routing, or normalization—broadcast full-sequence summaries outside the causal attention mask. This paper audits these violations through prefix-invariance checks, a LeakScore metric, and layer-wise FirstLeakLayer localization, demonstrating that such leakage can produce false architectural gains: a CDR-AttnRes checkpoint drops teacher-forced validation loss from roughly 3.6 to 1.43 while its free-running generation perplexity explodes from under 20 to about 700. The core lesson is that teacher-forced validation loss must be paired with whole-model causal audits and open-ended generation diagnostics before claiming progress.

Hidden future-token leakage can create false architectural gains: an autoregressive model may appear substantially better under teacher-forced evaluation while its free-running generation deteriorates. We investigate this failure in an adaptive residual-routing decoder whose sequence-level routing summary exposes prefix positions to future tokens despite a correct causal attention mask. An anomalous 24-layer checkpoint reduces validation loss from the baseline's 3.5958 to 1.4259, yet it fails a prefix-invariance audit and has substantially higher reference-model perplexity during generation. Layer-wise diagnostics and implementation inspection trace the violation to a full-sequence summary broadcast through the dynamic routing-query path. Two independently trained 12-layer causal repairs eliminate detectable leakage and return validation loss and reference perplexity to the control scale, removing the large apparent advantage. As diagnostic tools, we use the established prefix-invariance contract, maximum prefix-output discrepancy (LeakScore), complementary behavioral metrics, and layer-wise profiles. Supporting experiments cover six synthetic implementation pairs spanning five module families, clean pretrained controls, controlled fault injection, and cache consistency across numerical precisions. These results illustrate how hidden future-token access can produce misleading claims of architectural progress and why lower teacher-forced loss should be interpreted together with whole-model causal checks and free-running evaluation.
0
cs.LGcs.AI Jo\~ao Kenji Suwa, Jo\~ao Pedro Silveira e Silva, Bruno Iochins Grisci · Oct 22, 2026

This paper adapts the Feature Selection Layer (FSL) into a post-hoc interpretability tool for pre-trained neural networks on tabular data. Instead of training an embedded feature weighting layer jointly with the network, the authors freeze the pre-trained model and insert a lightweight diagonal scaling layer that learns per-feature weights via fine-tuning. The approach aims to let practitioners retrofit already deployed models to obtain feature importance scores without retraining from scratch, bridging embedded feature selection and post-hoc attribution methods.

The interpretability of complex neural networks remains a critical challenge, especially for models already deployed in high-stakes domains. To address this, we adapted the Feature Selection Layer (FSL) to optimize feature weights post-training, a variant we term post-hoc FSL. Our approach reframes the FSL as a lightweight, trainable module that integrates with already frozen pre-trained models on tabular datasets to highlight the features the original model considers most important. This post-hoc FSL learns feature relevance by fine-tuning its weights based on the original model's learned outputs. Crucially, this process is non-invasive, operating without altering the original model's architecture or its learned parameters. We conducted our experiments using both statistical and visual metrics, including accuracy, F1 score, recall, precision, weighted t-SNE and silhouette score, and also analyzed the stability of the post-hoc FSL on high-dimensional synthetic and real-world tabular datasets. We compared the post-hoc FSL feature weighting method using these metrics against the original embedded FSL and other post-hoc interpretability methods, such as Integrated Gradients, Noise Tunnel, DeepLIFT, Gradient SHAP, and Feature Ablation. Experimental results demonstrate that the post-hoc FSL feature weighting method successfully identified relevant features across the different datasets, maintaining the predictive power of the original neural network while enhancing its interpretability.
0
cs.SEcs.AIcs.MA Atharv Chandratre, Jai Datar · Oct 22, 2026

Feature flags become technical debt once fully rolled out, yet manually cleaning them at scale is prohibitively expensive. This paper describes a multi-agent LLM system deployed at DoorDash that automates stale flag removal by querying live rollout data via MCP, coordinating parallel cleanup agents in isolated git worktrees, and producing merge-ready pull requests. Evaluated on 50 stale flags across hundreds of repositories, the system produced usable PRs for 90% of cases at an average cost of $4.79 and 13.8 minutes per cleanup, offering one of the first quantitative industrial benchmarks for LLM-driven feature flag cleanup.

Feature flags are runtime configuration mechanisms used for gradual feature rollouts, experimentation, and kill switches. Once a feature is fully rolled out, the flag and its gated code become technical debt and can introduce operational risk through inadvertently enabling dormant code paths. At DoorDash, over 56,000 feature flags span 623 repositories, with 1,659 currently stale as of May 2026, with internal estimates of one to two hours per manual cleanup. Existing rule-based cleanup tools proved insufficient in DoorDash's codebases. Our contribution is an end-to-end automated LLM-based feature flag cleanup system that integrates querying live feature flag rollout data using MCP, Jira ticket processing, and end-to-end pull request creation. Our system successfully produced engineer-approved flag removal PRs for 45 (90%) of the 50 stale flags it was evaluated on, proving the system's operational viability at scale with each cleanup averaging only $4.79 and 13.8 minutes. We evaluated the system's quality and reliability boundary based on success rates, cost per cleanup and time metrics. Furthermore, we discuss our lessons learned when architecting this system, to provide practical guidance for developing similar multi-agent systems.
0
cs.AI Dezhao Luo, Daniel Beechey, Derek Yuen et al. · Oct 22, 2026

GUI agents struggle in long-horizon mobile tasks because they must repeatedly re-discover intermediate workflows from scratch. This paper proposes a subgoal-aware memory graph that segments past trajectories into contiguous action sequences sharing a single intent, then merges visually similar boundary screenshots into shared graph nodes and attaches annotated subgoal transitions as directed edges. The core claim is that this intermediate granularity is more reusable than either raw actions or full trajectories, which the authors test on a challenging mobile benchmark.

GUI agents aim to automate complex user tasks by interacting with mobile interfaces, but ef- fective decision-making in long-horizon set- tings requires reusing prior experience rather than relying solely on the environment ob- servations. Existing memory-based methods typically store experience either at the single- action level or as entire trajectories. Single- step actions are often too fine-grained to carry meaningful semantics, since the success of an individual action does not necessarily imply progress towards the overall goal. In contrast, whole trajectories are often too coarse-grained and difficult to reuse across different tasks. We propose a subgoal-aware memory graph that distils past trajectories into structured, reusable evidence at the level of subgoals. We define a subgoal as consecutive actions shar- ing a single intent, the granularity at which progress toward the task becomes meaning- ful. To reduce redundancy and support cross- task reuse, we organise subgoal experiences as nodes in a graph, where related memories can be merged, extended, and retrieved based on the environment observation. On SPA-Bench, our method improves success rate by 11.11% over the baseline.
0
cs.LGq-bio.BM Zhou Zhang, Hanqun Cao, Minghao Sun et al. · Oct 22, 2026

RiboBridge addresses the challenge of designing RNA molecules that bind to target protein structures when neither the native RNA sequence/structure nor the binding interface is known. Its core idea is to separate RNA conformation generation in a pretrained discrete structural space (RiboSphere) from protein-relative assembly via predicted cross-frame interaction geometry and rigid placement. This decomposition matters because high-quality protein–RNA complex data are scarce and existing methods entangle conformational sampling with interface discovery.

Designing RNA molecules that bind to target protein structures requires generating both an RNA conformation and its bound complex geometry, without assuming a predefined binding site. Existing approaches generally model these coupled processes within a unified representation, entangling RNA conformation generation with protein-relative placement. In this work, we introduce RiboBridge, a structure-first framework that separates RNA conformational generation from protein--RNA assembly through cross-frame interaction geometry. RiboBridge first proposes multiple candidate RNA-binding interfaces on the protein surface, generates canonical RNA conformations within a pretrained RNA structural latent space (RiboSphere), and then predicts protein--RNA interaction constraints to bridge the independently defined RNA and protein coordinate frames. The resulting interaction geometry is converted into a geometrically consistent protein-relative pose through rigid placement. We evaluate RiboBridge on a temporally split, sequence-filtered, and redundancy-controlled benchmark of 124 protein--RNA complexes. Under post-hoc interface-correspondence evaluation, where native information is used only after generation to select among already generated predicted-pocket candidates, RiboBridge achieves the highest fNAT and DockQ and the lowest interface and ligand RMSDs among compared methods. Component ablations and stage-wise diagnostics further characterize the contributions of RNA conformational generation, interaction prediction, and rigid placement, identifying the main sources of complex-recovery error.
0
cs.LGcs.AI Gabriele Dominici, Teague McMillan, Fazl Barez et al. · Oct 22, 2026

CausalCoT addresses the problem of unfaithful chain-of-thought reasoning in LLMs, where dense attention allows models to bypass their own generated rationales and exploit global context instead. It enforces procedural causal dependence by decomposing queries into a directed acyclic graph of sub-questions and evaluating each node in an isolated context containing only its direct parents. The framework promises more faithful explanations and precise test-time steerability via local interventions.

Chain-of-thought (CoT) prompting elicits step-by-step rationales that appear to explain model predictions, but there is no guarantee these steps causally drive the final answer. In standard autoregressive generation, dense attention allows each reasoning step to attend to the full context, enabling the model to derive answers through direct lookup while generating plausible-sounding but post-hoc justifications. We introduce CausalCoT, an inference framework that enforces causal transparency by decomposing problems into a directed acyclic graph of atomic sub-questions, evaluating each node in an isolated context containing only its direct causal parents. This Markovian structure removes attention pathways to non-parent content, making downstream predictions sensitive to local reasoning rather than global context leakage. Across a diverse suite of reasoning benchmarks, CausalCoT preserves competitive predictive performance while improving explanation faithfulness, increasing causal sensitivity of intermediate reasoning steps by an average of 12 and up to 21 percentage points over the strongest baseline. The structured dependency graph additionally enables test-time interventions in which local corrections propagate predictably through downstream reasoning.
0
cs.AI Liang He, SiYuan Ma, Qishi Zhan et al. · Oct 22, 2026

Tree-based speculative decoding wastes target-model compute when large retrieved candidate trees contain many low-quality branches. ValuSpec addresses this by introducing a plug-and-play verifier-side filter that scores branches with a lightweight model, calibrates a threshold $\tau_{\mathrm{tr}}$ from the target model's greedy trajectories without any parameter training, and prunes low-value candidates before expensive verification. This preserves exact greedy output identity and yields up to $2.38\times$ speedup, showing that candidate supply and verifier-side valuation are complementary optimization stages.

Tree-based speculative decoding accelerates large language model inference by verifying multiple candidate branches in parallel. However, in practical serving scenarios, similar requests repeatedly induce overlapping candidate branches. While retrieval-based methods mitigate this by reusing historical drafts, the resulting candidate trees often contain many low-quality branches as the candidate tree grows, which reduces verification efficiency and wastes target-side computation. To address this, we propose ValuSpec, a plug-and-play candidate valuation mechanism that filters low-quality branches from a supplied candidate tree before expensive target-side verification. ValuSpec introduces transfer-based supervision to align filtering with the target model's behavior. A filtering threshold is estimated from the target model's greedy trajectories on a calibration split, without any parameter training. The target model then verifies the filtered tree under the output-identical greedy rule, so accepted tokens are guaranteed to match standard autoregressive decoding exactly. Experimental results on HumanEval, GSM8K, Dolly, and SpecBench show that, in our main evaluation, ValuSpec achieves up to 2.38x end-to-end speedup in retrieval-based tree settings. Furthermore, integrating ValuSpec into the EAGLE-3 dynamic tree framework yields up to 2.78x end-to-end speedup without modifying its tree construction strategy, demonstrating that ValuSpec serves as a generally applicable and plug-and-play candidate valuation module.
0
cs.DLcs.AI Bastien Le Guellec, Su Hwan Kim, Raphael Bentegeac et al. · Oct 22, 2026

Peer review is buckling under submission volume, and LLM assistance is gaining traction. This paper asks how four current LLMs treat 200 already-published articles from top-tier journals such as Nature, Science, and Cell. The authors find that model recommendations are overwhelmingly harsh and starkly inconsistent: $605$ of $800$ reviews ($75.6\%$) recommended major revision or rejection, yet the rate for any single model ranged from $17.5\%$ to $100\%$ ($p < 0.001$). The takeaway is that LLM editorial signals are too variable to replace human judgment, though convergent criticisms may still be useful.

With the growth of scientific output, the peer review system is approaching a breaking point: reviewers are increasingly hard to secure, and turnaround times lengthen accordingly. LLM-assisted or LLM-generated peer review has been proposed as a remedy, but how such models would treat manuscripts already published in top-tier journals, the closest thing the current system has to a gold standard of scientific validity, is not known. Here we assembled a corpus of 200 articles, each released under a CC BY 4.0 license and published in 2026, from 20 general-science, life-science, and clinical-medicine journals including Nature, Science, and Cell, and asked four current LLMs (two proprietary, two open-weight) to produce independent peer-review reports of each one under a blinded protocol. Their decisions were overwhelmingly harsh and starkly inconsistent with each other: 605 of 800 reviews (75.6%) recommended major revision or rejection, but the rate at which any single model did so ranged from 17.5% to 100% (p < 0.001), disagreement on manuscripts that had, by construction, already survived real editorial review at the journals in question. When the same manuscripts were doctored with one deliberately planted, field-specific methodological or statistical flaw, detection rates varied from 17.0% to 60.5% across models (p < 0.001). Recommending revision for papers that had already passed editorial review (low specificity) while missing flaws deliberately placed in front of them (low sensitivity), these models produce output that should be read for what it is: an uneven, framing- and model-dependent signal.
0
cs.AIcs.LG Thanh Q. Tran, John Russell Himawan, Arun Verma et al. · Oct 22, 2026

DIAL tackles the challenge of fine-grained control over instruction adherence—how strongly an LLM should follow instructions like "Keep it short." The core idea is to distill classifier-free guidance (CFG) into a lightweight, text-conditioned steering adapter that edits hidden states at a single layer. This matters because it promises scalable, efficient, adjustable adherence across diverse instructions without requiring labeled responses or per-instruction fitting.

When a user says &#34;Keep it short&#34;, how short should the LLM's response be? More generally, users and applications require different levels of instruction adherence, but prompting does not reliably provide fine-grained control over them. We therefore study &#34;steerable language models&#34; that provide fine-grained numerical control over the degree to which models follow general instructions specified in text. However, existing approaches do not jointly offer fine-grained control, efficiency, and scalability across diverse instructions. To address this gap, we introduce DIAL (Distilled Instruction-Adherence Levels) to achieve all three properties. For fine-grained control, we perform classifier-free guidance (CFG) with a frozen LLM to provide training signals for on-policy distillation of instruction adherence at different levels. For efficiency, we design a lightweight steering adapter that uses a classifier over the LLM's hidden states to compute a closed-form steering edit. The classifier adaptively sets the steering magnitude at each token based on the target adherence level, while accounting for the geometry of the LLM's hidden states to preserve response coherence. For scalability, the classifier is text-conditioned, allowing a shared adapter to support new instructions without per-instruction fitting, and training requires only instruction and request text. Evaluation across multiple LLM families shows that DIAL achieves a competitive balance between concept expression and response fluency, with concept scores increasing monotonically across adherence levels. We introduce SteerIF, an instruction-only dataset of 98, 625 concept, persona, verifiable, and descriptive instructions. When trained on SteerIF, DIAL provides fine-grained control over personas and, when combined with prompting, improves verifiable instruction following.
0
cs.GTcs.LG Luis F. Paul Tosta, Quinn Arnold, Gianluca Brero · Oct 22, 2026

Iterative combinatorial auctions require many costly rounds to discover clearing prices. This paper proposes FastCombo, an offline deep RL method that learns a recurrent graph policy to post sequential item prices with a single neural-network forward pass at deployment. The core insight is that maximizing immediate clearing probability can be arbitrarily suboptimal in expected rounds, so formulating the task as a POMDP and training over complete auction trajectories lets the policy acquire information that speeds up later clearing. Results show competitive clearing on standard CATS benchmarks with 300–900× lower online computation than a Bayesian baseline, though consistent round savings remain elusive outside a controlled one-item domain.

Iterative combinatorial auctions are used in spectrum allocation, transportation, and industrial procurement, but rounds are costly. We introduce FastCombo, a deep reinforcement learning approach to sequential price discovery. Bayesian pricing has sharply reduced auction rounds even against subgradient benchmarks tuned with hindsight for each instance, but relies on a one-step objective and repeated online inference and optimization. We prove that greedily maximizing immediate clearing probability can require arbitrarily more rounds in expectation than an informative policy, even with the true valuation distribution known. FastCombo learns price policies offline, assigning credit to queries for the future decisions they enable and producing each online price update with a single neural-network forward pass. We formulate the objective of minimizing expected rounds to clearing in single-minded auctions as a partially observable Markov decision process and train a recurrent bidder-item graph policy over complete auction trajectories. In a one-item experiment, all five trained policies learn an informative opening, reducing expected rounds from 1.85 to 1.65 relative to the tested Bayesian one-step rule. Across four domains from the Combinatorial Auction Test Suite, FastCombo achieves competitive clearing while reducing measured online price-selection time per auction by a factor of roughly 300-900 relative to the standard Bayesian baseline. These results demonstrate the value of learning sequential price policies for both information acquisition and online computational efficiency.
0
cs.LGcs.AI Bar{\i}\c{s} Alparslan, Sandy Tanwisuth, Caleb Petterson · Oct 22, 2026

Instrumental convergence predicts that capable agents develop power-seeking subgoals, but it is unclear whether reinforcement learning with verifiable rewards (RLVR) monotonically increases such behavior in language models. This paper evaluates OLMo-3-7B-Think across sixteen post-training checkpoints using InstrumentalEval and finds a nonmonotonic trajectory: instrumental-like outputs rise during early RLVR, peak near step 200, and then fall below the SFT baseline by the final checkpoint. The result challenges simple "more RL equals more convergence" narratives and shows that checkpoint-level monitoring can reveal dynamics hidden by endpoint comparisons.

Instrumental convergence is often invoked as a general reason to expect capable agents to acquire or express power-seeking subgoals: self-preservation, resource acquisition, deception, or resistance to oversight which poses an important threat to the society. For LLMs, reinforcement learning is the first stage of post-training that directly optimizes behavior against an objective; therefore, it is the stage where convergent instrumental behavior, on IC grounds, likely to appear. Does reinforcement learning with verifiable rewards (RLVR) make a model more likely to express instrumental-convergence behavior, or does this depend on the training regime, evaluation frame, and stage of post-training? We study this question as a checkpoint-conditioned behavioral trajectory rather than as a single before/after safety score. Using InstrumentalEval, we evaluate OLMo-3-7B-Think across SFT, DPO, 13 intermediate RLVR checkpoints, and the final RLVR model. The trajectory is nonmonotonic: instrumental rate rises from 25.0% at SFT to 46.1% near RLVR step 200, then falls to 11.8% at the final checkpoint. Paired item-level tests and step-wise regression support the final SFT-to-RLVR reduction. Prompt framing does not explain this pattern: a harmful-prompt indicator combined with other framing effects explains only 15% of within-checkpoint score variance on average, and Iterative Null-space Projection (INLP) removes a detectable framing direction without changing the SFT-to-final-RLVR gap. Together with preliminary 32B endpoint results (35.53% SFT to 22.37% RLVR final), these findings indicate that RLVR does not monotonically increase instrumental behavior in this setting: the rate rises early, then falls below the SFT baseline. The result is specific to this model family and benchmark, and judge agreement is moderate, so absolute rates should be read cautiously.
0
cs.NEcs.AIcs.LG Ze-Yu Peng, Qing-Yu Lan, Zhan-He Wang et al. · Oct 22, 2026

AgenticEvolve replaces the one-shot LLM variation operator in evolutionary program search with a persistent agent that edits code, runs self-designed experiments, and commits candidates for formal evaluation. By letting the agent test hypotheses locally between expensive evaluations, the framework aims to improve sample efficiency and final program quality on tasks ranging from online bin packing to symbolic regression. The authors report gains over a matched No-analysis ablation and over OpenEvolve, while noting that cost trade-offs depend heavily on model pricing.

Evolutionary program search with large language models keeps the structure of an evolutionary algorithm and uses the model as its variation operator. Typically, the model generates each candidate program in a single request from parent programs and their scores. We present AgenticEvolve, an evolutionary program search framework in which each island is run by a persistent large language model agent. Between evaluations, the agent designs and runs experiments on the candidate program. To measure the contribution of experimentation, we compare AgenticEvolve with No-analysis, an otherwise identical configuration with experiments disabled. On two heuristic design tasks with three large language models, AgenticEvolve produces better programs than No-analysis and OpenEvolve on both hidden and unseen instances. It reaches the baselines' final quality with far fewer evaluations and comparable cost. On twelve equation discovery problems, it recovers the ground-truth structure of more equations than No-analysis and existing language-model and genetic programming baselines.
0
cs.LG Victor Li, Owen Tucker, Michael S. Hughes et al. · Oct 22, 2026

This paper challenges how digital twins for type 1 diabetes are evaluated. Instead of the standard practice of scoring models by glucose trajectory error (RMSE), the authors propose measuring decision quality: whether a twin's simulated trajectories correctly rank candidate insulin treatments. They benchmark six methods on 30 virtual patients and show that a model can predict glucose accurately yet rank treatments no better than random, while a population-average baseline that ignores individual data ranks surprisingly well. The result is a convincing argument that clinical decision-support models need decision-aware evaluation.

A digital twin (DT) for type 1 diabetes (T1D) can predict how an individual's blood glucose will respond to different insulin treatments without actually trying them. For each treatment, downstream statistics of predicted glucose trajectories, such as glycemic risk, can be computed to guide clinical decisions. However, the quality of DTs is usually measured by the accuracy of their predicted glucose trajectories, which may not reflect the quality of the downstream treatment decisions they inform. In this work, we directly evaluate DTs by this decision quality on downstream treatment ranking, i.e., whether a DT predicts glucose trajectories that can be used to rank candidate treatments as the real patient would. We present an evaluation protocol over 30 virtual patients from the FDA-accepted UVA/Padova model, each simulated under 21 different basal-bolus treatments. For each patient, a DT is fitted under one treatment and then produces glucose trajectories for the remaining 20 treatments. Our results show that prediction accuracy and decision quality disagree. A baseline that models the average patient, never seeing the individual's glucose data, has the lowest prediction accuracy of all six methods (RMSE: 63.6 mg/dL) but ranks treatments with the second-highest mean Spearman (0.766), while a black-box neural network that predicts glucose nearly twice as accurately (RMSE: 32.9 mg/dL) ranks them no better than a random ordering of the 20 treatments (0.049 Spearman). Therefore, selecting a DT based on prediction accuracy alone can prefer one that recommends treatments at chance, and decision quality must be evaluated directly rather than assumed to follow from prediction accuracy.
0
cs.LGphysics.chem-phphysics.optics Jihwan Kim, Jaeseong Heo, Yujin Kim et al. · Oct 22, 2026

Standard deep learning for spectroscopy treats spectra as fixed-grid intensity vectors, which makes models brittle when sampling grids, spectral ranges, or instruments change. This paper proposes to supply each spectral point as a pair of intensity and physical wavenumber, computing Transformer positional encodings directly from the wavenumber coordinate rather than the array index. Evaluated on in-house bacterial Raman spectra and a public 30-isolate benchmark, the approach improves robustness under partial spectral observation and on sampling grids never seen during training.

Machine-learning models for spectroscopy usually treat a spectrum as a fixed-grid intensity vector, leaving the physical coordinate implicit in the array index. Such models are tied to a single sampling grid, spectral range and resolution, which limits their use when measurement conditions change. Here we represent each spectral point as a pair of intensity and wavenumber and compute Transformer positional encodings from the wavenumber itself. On Raman spectra of three bacterial species and their synthetic mixtures, this representation remained robust to noise, sparser sampling and partial spectral coverage across convolutional, residual and Transformer networks. In controlled comparisons, wavenumber-based encoding outperformed index-based and learned encodings under partial observation and retained its performance on sampling grids never seen during training, where index-based encoding degraded. These findings were reproduced on a public 30-isolate bacterial benchmark. Explicit physical coordinates offer a simple route to robust spectral analysis under variable measurement conditions.
0
cs.CLcs.AI Miguel Mochizuki Silva, Samuel Ismael, Mateus C. Dias et al. · Oct 22, 2026

Retrieval scores for clinical RAG are often computed against a single annotated chunk per query, conflating retriever quality with the completeness of the ground-truth annotations. This paper introduces RAG-MAMA, a breast-lesion question-answering system, and proposes mapping canonical evidence spans to all containing chunks so that overlapping segments with equivalent facts are not scored as competing candidates. The authors report nearly perfect retrieval metrics ($\text{Recall}@3 = 0.94$) on an 18-query development set and cautiously frame the work as a small methodological baseline, though the narrow scale and lack of independent validation severely limit its conclusions.

Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrieval-augmented generation (RAG) system over breast lesion management literature, addressing the dependence of retrieval scores on annotation coverage. Methods: An 18-document corpus and an 18-query development benchmark, with one Yes/No or WH-question per document, were used. Retrieval combined dense embeddings, BM25, and cross-encoder reranking. Chunk sizes of 128 to 1024 tokens, overlaps of 0 to 20%, and four retriever configurations were evaluated. Relevance was defined by evidence spans mapped to all containing chunks, treating overlapping chunks with equivalent evidence as relevant. Retrieval was evaluated using R-Precision, Recall@K, MRR, and nDCG@K. Separately, generation was assessed on a 512-token index at K=1 to 5 using DeepEval claim-level metrics, with deepseek-v4-pro as the LLM judge, and BLEU/ROUGE metrics. Results: The selected hybrid retriever, using 384-token chunks and 20% overlap, retrieved accepted evidence in the top three results for 17 of 18 queries. Recall@3, R-Precision, MRR@3, and nDCG@3 each reached 0.94. Ground-truth curation increased evidence spans from 25 to 37 and accepted chunk targets from 36 to 51 without changing retrieval rankings. Conclusion: Cross-encoder reranking achieved the highest retrieval scores. Expanded relevance annotations increased recognized evidence without changing rankings, highlighting annotation sensitivity. The small development set and retrieval-informed curation require independent validation, including radiologist assessment of evidence sufficiency.
0
cs.AI Gouki Minegishi, Jingyuan Feng, Hiroki Furuta et al. · Oct 22, 2026

Multi-agent LLM systems are becoming common, but it is hard to predict which model steers the group when agents disagree. This paper designs a minimalist naming game with meaningless labels to isolate consensus dynamics from pretrained knowledge or correctness. Across seven model families, the authors find that larger, more capable models dominate the final convention even when no answer is right, and they explain this with a simple energy landscape in which bigger models carry larger assertion weights.

Multi-agent LLM systems are increasingly used in practice, but their behavior is complex and hard to understand. We design a simple task to ask which model has the most influence on the final consensus when several models are mixed in one system. Experimentally, across seven model families, we find that the opinions of the other models are absorbed into the opinion of the stronger model, the one with more parameters. This happens even though the task requires no pretraining knowledge and has no correct answer. To understand this phenomenon, we interpret the agents as weighted particles moving on a simplex. Larger models carry a larger weight and therefore occupy a deeper well in the energy landscape. A large weight means strong in-context learning: a model with a large weight amplifies the majority of its context. Larger models are generally better at in-context learning, and this is what makes the larger model the influencer. We hope that this work helps to interpret multi-agent systems, whose behavior is becoming too complex for humans to understand.
0
cs.SEcs.AI Mohammad Mehdi Gholinejad · Oct 22, 2026

The paper defines superintelligent software engineering as the discipline of building software with agents that exceed human reviewers, arguing that raw capability is necessary but insufficient without governance that scales mechanically. It proposes that correctness depends on decisions and contracts outside the code, that such knowledge decays, and that once agent throughput $r$ outstrips fixed human review capacity $c$, the share of stale-built changes caught by reading falls toward zero. An exploratory snapshot of 452 popular GitHub repositories finds widespread stale agent context files, and the paper introduces OSTEON, a released discipline of governed knowledge repositories, mechanical gates, and decay control. The author commendably marks OSTEON's unmeasured claims as opinion and frames a falsifiable research agenda.

Software agents are being trained to exceed human engineers; we argue that capability alone does not produce better software engineering. We define superintelligent software engineering as the discipline of building and evolving software with agents whose capability exceeds that of human engineers, in which governance (gates, contracts, decisions and decay control) scales with capability. The argument rests on three claims. First, correctness in a project rests on decisions and contracts that the code does not carry. Second, knowledge decays. Third, once an agent outpaces its reviewers, reading catches a shrinking share of the changes built on stale knowledge. A simple model shows that, past a fixed review capacity, escaping changes grow linearly with throughput while the share that reading catches falls toward zero; governance can lower the slope, capability alone cannot. An exploratory snapshot of 452 of the most-starred public GitHub repositories finds a root-level or .github agent context file in 48.67% (95% confidence interval 44.1 to 53.3); in the median file that names repository paths, 9.5% to 22% of those paths do not resolve, depending on how a reference is read. We then present OSTEON, a discipline for the regime, released with a DOI (10.5281/zenodo.23436020): each project gets a governed knowledge repository of decisions and contracts, every change is checked mechanically against it, and the knowledge itself is checked for decay at every session start; planning is gated, and sessions record what they learn without writing rules. We report no measured effect of OSTEON, mark claims about its mechanisms as opinion and the author's practice heuristics as design rationale, and state the questions that would falsify the thesis.
0
cs.AIcs.CL Zehao Lin, Erenkai Zhu, Helan Hu et al. · Oct 22, 2026

This paper develops a decision-theoretic framework for valuing memory in language agents, treating memory not as raw information but as a resource whose worth depends on future decisions, access costs, and revision capabilities. The core idea is to track value from original history through retained state to realized output, using avoided task loss as a common unit and introducing risk-cost frontiers for recovery and revision under uncertain demand. This matters because current memory architectures optimize proxy metrics like relevance or compression ratio without guaranteeing that retained distinctions actually improve downstream decisions.

Memory enables language agents to carry useful distinctions from past experience into future decisions. Its value depends on which distinctions survive, whether a bounded agent can use them, and what can be recovered or revised as demands evolve. We develop a decision-theoretic framework that follows this value from raw history through persistent state, operational use, and costly recovery and revision. Original and retained value are expressed in units of avoided task loss; risk-cost frontiers describe attainable recovery and preservation across uses. Unknown demand yields value profiles, while interactive feedback changes the distribution of future work. A cost-aware simulation condition and five minimal counterexamples expose the roles of information timing, retrieval access, component interaction, feedback and demand uncertainty. In particular, a pointer with zero mutual information about the answer can still reduce the cost of exact recovery. Diagnostics on LoCoMo, a two-project update task and longitudinal cases exhibit failures of preservation, use and measurement. At fixed retrieved evidence, a saved ledger changes subsequent answers; at fixed agent outputs, an evaluator revision changes scores. The framework connects these distinctions to operational risk bounds and testable principles for allocating memory, preserving recovery options and revising evidence dependencies.