Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.LG Bin Hu, Yingbo Xiao · Oct 22, 2026

KV cache compression for multimodal LLMs usually evicts visual tokens once at prefill, but this one-shot selection breaks down during long-form generation because the model's attention drifts as the description unfolds. The paper proposes Rate-Controlled Refresh (RCR), which uses a low-rank drift detector to decide when and where to refresh the cached tokens, while a per-sample rate controller decides how often, ensuring low-drift samples are not starved of refreshes. The core claim is that a single configuration transfers across models and tasks, outperforming per-step retrieval baselines at comparable CPU-GPU traffic.

KV cache compression for multimodal LLMs usually selects the visual tokens to keep once, at prefill, and reuses that selection for the whole generation. We show that this one-shot selection is severely limited on long-form generation: on detailed image description, even an oracle that selects with the attention of the uncompressed answer reaches only 0.44-0.52 ROUGE-L agreement with the uncompressed output, because the evidence the model reads moves as the description unfolds. Re-selecting whenever attention drifts out of the kept set is the natural remedy, but we find that a fixed drift threshold fails systematically: drift magnitudes are not comparable across samples, so low-drift samples are almost never refreshed although they benefit the most. We propose Rate-Controlled Refresh (RCR), which lets drift decide when and where to re-select while a per-sample controller regulates how often, combined with a low-rank drift detector, candidate-restricted re-selection, and a decision that stays on the GPU. With one setting for all models and tasks, RCR outperforms the per-step retrieval method InfiniGen by 1.6-3.8 ROUGE-L points on five of six model-task settings with no significant difference on the sixth, while staying within 1.7 points of exact per-step re-selection, with comparable estimated data movement per step and a 4x smaller GPU-resident detector. On DetailCaps, drift-chosen timing beats random timing at the same refresh rate and periodic timing even at a higher rate, by 2.0-5.0 points. On pre-registered video description, where drift is homogeneous across samples, RCR is on par with InfiniGen on Qwen2-VL and exceeds it on Qwen3-VL but no longer beats a fixed threshold at the nearest tested rates, consistent with the diagnosis; object-level evaluation shows that RCR achieves higher object F1 against the uncompressed output than InfiniGen on two of three models.
0
cs.LG Yaohong Yang, Gauri Pradhan, Qi Chen et al. · Oct 22, 2026

Privacy auditing without retraining is essential for auditing deployed or third-party models, but available non-members often come from a different distribution than the training data, causing standard membership-inference attacks to conflate membership with domain shift and severely overestimate leakage. This paper proposes shift-aware score transport: the auditor learns how membership-inference scores depend on pretrained data representations from the available out-of-distribution non-members, transports that conditional relationship to the in-distribution covariate space implied by known members, and then corrects the estimate via controlled internal calibration tasks. The core contribution is a practical way to recover stable, relatively tight empirical lower bounds on $\mu$-GDP when the auditor cannot retrain, insert canaries, or control data inclusion.

Privacy auditing empirically assesses privacy leakage by using membership inference attacks to establish lower bounds on privacy loss. We consider an observational auditing setting in which the auditor cannot insert canaries, control data inclusion, or retrain the target model, and must instead rely on fixed sets of known members and non-members. This setting is relevant for large deployed models or when retraining is restricted by computational or access constraints. In this case, non-members available for auditing may differ in distribution from the training data, causing membership-inference scores to be skewed due to the distribution shift. We address this problem by estimating the counterfactual in-distribution non-member score distribution using the available out-of-distribution (OOD) non-members. Our proposed method learns the relationship between data representations and membership-inference scores from OOD non-members and transports it to the target covariate distribution. Because this transport may become unreliable under extrapolation or imperfect conditional invariance, we further introduce a conservative correction calibrated directly to the nominal transported privacy level. We construct controlled calibration tasks from the available non-member data to estimate how representation-space displacement inflates the audit, and use this estimate to correct the transport-induced audit error. Across multiple datasets with distribution shifts, our method yields substantially more stable privacy estimates while retaining tighter lower bounds than baselines.
0
cs.CLcs.SD Firoj Paudel · Oct 22, 2026

Nepali–English code-switched ASR suffers from script confusion and switch-point fragility, yet human annotated conversational audio is costly. This paper curates a 15.45-hour spontaneous podcast benchmark and adapts a 1.2B-parameter multilingual encoder–decoder model using only 0.95 hours of synthetic dual-engine TTS data. The core finding is that supervised fine-tuning drives almost all cross-domain transfer, while subsequent GRPO and script-aware rewards add only marginal, hard-to-disentangle gains. The released data and the cautionary ablation make the work practically useful.

Nepali-English code-switched conversational speech presents severe challenges for automatic speech recognition (ASR), chiefly through script confusion (inappropriate mixing of Devanagari and Latin orthography) and elevated error rates at language switch points. Supervised fine-tuning (SFT) can adapt multilingual foundation models, but human code-switched audio is expensive to collect and annotate. We curate a new benchmark of 13,044 spontaneous podcast utterances (15.45 h total; 10,214 test, 2,830 dev), audited and verified to eliminate machine translation leakages and acoustic loops. We investigate a two-stage synthetic-to-real adaptation framework: Stage 1 applies SFT on 0.95 h of speech synthesized via a multi-speaker, dual-engine TTS pipeline; Stage 2 explores Group Relative Policy Optimization (GRPO) with transcription and script rewards. We find that synthetic SFT provides the primary cross-domain transfer to spontaneous human speech, reducing Mixed Error Rate (MER) from 23.40% to 21.52% (-1.88 pp) and switch-point error rate (SPER) from 35.89% to 28.77% (-7.12 pp). Subsequent GRPO yields small, statistically significant adjustments on 173 test utterances (1.69%), driving English script confusion (SCR_en) from 6.45% to 6.36% (p <= 0.001) and SPER to 28.70% (p = 0.022 clustered). Crucially, ablation reveals that in this SFT-converged encoder-decoder setting, an auxiliary script reward term yields performance identical to MER-only optimization because rollout candidate groups exhibit near-zero script variance on synthetic data. On monolingual benchmarks, SFT improves Nepali MER by 2.71 pp (stabilizing at 18.42% after GRPO, a 2.38 pp gain over baseline) while preserving English lexical WER (3.38% vs. 3.33%). Verified transcripts, timestamps, episode metadata, and reconstruction scripts are publicly released.
0
cs.SEcs.AIcs.CY Robin Qu\'eriaux, Solveig Bachellery, L\'ea D\'el\'eris et al. · Oct 22, 2026

Regulated institutions must produce technical evidence for LLM deployments under the EU AI Act, yet existing benchmark suites are engineer-facing command-line tools while accountable reviewers are non-technical managers. VERA is an open-source, self-hosted dashboard that closes this workflow gap by letting reviewers select a model, run public benchmarks, and read requirement-level scores—with decomposable evidence and run-level energy consumption—in a browser. Its core contribution is wrapping raw measurement into a review and filing process designed for institutional approval.

Institutions that deploy large language models in regulated settings often need technical evidence of responsible AI practices before approving a deployment. COMPL-AI provides a technical interpretation of the EU AI Act that organises this evidence under six principle groups and eighteen technical requirements, twelve of which current benchmarks can measure. The benchmark suites that produce this evidence are typically operated from a command line, while the staff who approve deployments are non-engineers. We present VERA, an open-source self-hosted dashboard deployed to facilitate responsible AI processes within a large European bank. A reviewer selects a model and runs public benchmarks against it. VERA scores the twelve requirements that current benchmarks can measure and instruments the energy consumed by each evaluation, adding run-level evidence for environmental impact. We run four served open-weight models through the requirement pipeline, and the dashboard displays a score for each measurable requirement. A within-subject study then compares how participants read these benchmark results: from the raw output files in one condition, and through the VERA dashboard in the other. The dashboard reduced the time needed to perform the responsible AI assessment, reducing the time required from 56 seconds using raw files to 30 seconds using our dashboard, on average. Our dashboard scored highly (4.36 out of 5) on usefulness in the survey conducted within the organization. The dashboard and the study material are released publicly to promote replicability and reproducibility in different organisational contexts.
0
stat.MLcs.LG Rui Qiu, Fang Yao, Zhou Yu · Oct 22, 2026

Conformal prediction for non-Euclidean responses is underdeveloped because conventional scores require residuals or densities that assume a vector-space structure. This paper introduces the conditional expected local radius, $R_\beta(\omega|x)=\frac{1}{\beta}\int_0^\beta Q_x(\omega,\tau)\,d\tau$, as a nonconformity measure in general metric spaces, and estimates the conditional distance profile, the CELR, and its conditional distribution from a single metric distributional random forest. The result is a computationally cheaper alternative to the conditional profile score method of Zhou and Müller (2025) with uniform consistency and asymptotic conditional validity guarantees.

We introduce the conditional expected local radius (CELR) and develop a new conformal prediction method for non-Euclidean responses in general metric spaces. CELR measures local conditional probability concentration, allowing prediction sets to accommodate heterogeneity and multimodality without requiring densities or a vector space structure. Its conditional distribution yields a nonconformity score that is comparable across covariate values and avoids costly transport comparisons between distance profiles. We further adapt a metric distributional random forest that handles multivariate covariates and nonlinear interactions, while a single forest fit supplies all score components, reducing computation by eliminating repeated local fitting. We establish uniform consistency of the estimators and asymptotic conditional validity under suitable regularity conditions, together with finite-sample marginal coverage under exchangeability. Numerical studies demonstrate effective uncertainty quantification across different metric spaces and substantial computational savings over the conditional profile score method.
0
cs.CL Fei Ding · Oct 22, 2026

Coding-agent benchmarks increasingly grade agents against upstream test suites that are paired with natural-language specifications, yet those tests often require unstated names, module paths, or literals the specification never gives. This paper formalizes that mismatch as the specification–oracle gap and implements a fast, model-free static audit for five languages, then shows that on SWE-Milestone roughly a quarter of graded milestones contain hard hidden dependencies that can block entire build units. The finding matters because it reveals that many benchmarks inadvertently measure whether agents reproduce upstream implementation details rather than whether they satisfy the stated requirements.

Coding-agent benchmarks often describe a task in natural language but grade it with tests taken from the upstream project. Passing those tests can require information the description never states: a constant's name, a module path, an exact message. We call this a specification-oracle gap: where it exists, a benchmark also measures whether an agent reproduces upstream implementation details. We formalise the gap, including the inconsistencies that chains of dependent tasks add, and build a static audit for five languages that classifies every name-, path- and literal-level dependency of every scored test (held-out precision 89.2%, recall 92.9%). On SWE-Milestone (98 graded milestones, 35 published runs), 25 milestones contain a test that depends on an unstated, non-inferable name or path. Build units with such a dependency fail in 80.6% of runs, against 48.4% for comparable units without one, and withholding a single hidden name from the reference stops its unit's tests from compiling in 126 of 128 cases. The leaderboard's ranking is robust to removing the affected tests, but they shift scores within repositories and favour agents that reproduce upstream names. Across four further benchmarks, prevalence appears to follow construction: a third or more of the tasks are affected where specifications are release notes or LLM summaries, almost none where tasks are screened or written for their tests; how much a gap costs depends on how the harness grades. We release the audit, corrected filter lists and specification addenda.
0
cs.LG Jinwei Gan, Zifeng Cheng, Zhiwei Jiang et al. · Oct 22, 2026

Diffusion large language models introduce a bidirectional infilling mechanism that poses a distinct jailbreak surface compared to autoregressive generation. This paper proposes RMT-Jailbreak, which first elicits a harmful response from a source autoregressive model using existing jailbreak methods, then converts that response into a sparsely masked template and feeds it to a target diffusion model to reconstruct the harmful content. The key finding is that query-specific harmful responses provide more effective reconstruction cues than generic attack scaffolds, yielding strong cross-paradigm transferability.

Diffusion large language models (dLLMs) enable flexible masked generation through bidirectional context modeling, but this capability also introduces a distinct jailbreak attack surface. We find that a harmful response to a given query naturally serves as an effective jailbreak template: simply masking a subset of its tokens can induce a dLLM to reconstruct harmful content. Based on this observation, we propose RMT-Jailbreak, a general framework that transfers existing autoregressive (AR) jailbreak attacks to dLLMs through their induced harmful responses. RMT-Jailbreak converts an AR-generated harmful response into a high-mask-ratio template using uniform token retention, and further applies prompt-based safety filtering to mask any remaining visible harmful content. The refined template is then provided to the target dLLM for bidirectional reconstruction. Extensive experiments across multiple AR jailbreak methods and target dLLMs demonstrate the effectiveness and generality of RMT-Jailbreak, revealing strong cross-paradigm transferability of jailbreak attacks.
0
cs.CLcs.AIcs.CY Miguel Fernandez-de-Retana, Unai Zulaika, Ruben Sanchez-Corcuera et al. · Oct 22, 2026

The paper tests whether open LLMs that a hospital could self-host are ready for clinical use, evaluating four models (8–27B parameters) on the Spanish MIR residency exam under its real scoring and ranking rules. The authors go far beyond headline accuracy to probe calibration, the value of abstention under a wrong-answer penalty, the soundness of clinical reasoning, and whether vision models actually use the images they receive. Their headline message is that a model can rank high enough to choose almost any specialty while remaining overconfident, correct for the wrong reasons, and blind to the clinical plates it is shown.

Accuracy on medical examinations is common evidence offered for the clinical use of language models, yet a health system that intends to run an open model on its own hardware needs to know considerably more: whether the model recognizes when it is likely to be wrong, whether medical fine-tuning improves this ability, whether its correct answers rest on sound clinical reasoning, or whether it actually uses the images it is given. We examine these questions for four open models of 8 to 27 billion parameters on the Spanish MIR residency examination, scoring 1,552 questions from eight editions under the exam's own rules. Answering every question, the three larger models would rank among roughly the first 600 to 3,000 candidates, with 41 to 43 specialties still open to them. Abstention, however, never pays, because even their least confident answers are right more often than the 25% break-even. Medical fine-tuning reduced overconfidence at the cost of accuracy, without improving how well confidence separates right from wrong answers. Moreover, 13-38% of correct answers rejected a distractor for a clinically unsound reason that confidence did not reflect, and removing or swapping the provided contextual images left accuracy unchanged.
0
cs.LG Brama Seta Putra Satria, Dwi Sunaryono, Misbakhul Munir Irfan Subakti et al. · Oct 22, 2026

QuaNAS tackles query-efficient neural architecture search by treating a library of earlier searches as explicit but uncertain knowledge. Its core idea is to encode design decisions as additive main-effect priors that seed a Gaussian process, letting every new evaluation re-weight trust in transferred knowledge and fall back on zero-cost proxies when the library is uninformative. The paper tests this under a frozen, self-preregistered protocol on 12 held-out datasets spanning images, time series, text, and tabular data.

Neural architecture search (NAS) on a new dataset often affords only tens of short training runs, so what the search knows before its first evaluation decides its efficiency. Yet most NAS methods start from scratch, guided at best by zero-cost proxies that are unreliable across tasks. QuaNAS treats a library of earlier searches in the same search space as explicit knowledge of uncertain reliability. Main effects of design decisions learned from this library and, secondarily, zero-cost proxies become priors over candidate architectures without any label of the new dataset. A Gaussian process starts at the prior optimum and re-estimates after every evaluation how far each prior is trusted. Under a protocol frozen before any confirmation data were seen, QuaNAS was evaluated once on 12 new image, time-series, text and tabular datasets. It lowered anytime regret on the short-training objective 2.7- to 3.9-fold relative to five pre-specified NAS baselines that start from scratch (Holm-adjusted p = 0.0012 each). Its final models matched (non-inferiority margin 0.5 pp) or exceeded matched-recipe reference models on nine datasets, as did the prior optimum, selected without a single evaluation. Post-hoc comparisons with established transfer methods given the same library trace the gain to the library: without it, the same Gaussian process had over twice the regret. They also show where each transfer mechanism works best: the pooled main effects of QuaNAS for weakly transferable tabular tasks, per-task surrogates for image, time-series and text tasks and for small or mismatched libraries. Finally, the main effects make the transferred knowledge inspectable.
0
cs.LG Shijie Li, Yilin Gao, Tieyuan Chen et al. · Oct 22, 2026

Complex reasoning training hinges on two supervision modes—sparse RL rewards and dense distillation—but combining them naively causes optimization conflicts.
GIFT introduces a token-level geometric filter that decomposes the teacher gradient into a conflict-measuring parallel component ($a_i$) and a novel-guidance orthogonal component ($b_i$), then progressively anneals which tokens receive distillation.
This yields consistent improvements on hard math and logic benchmarks, with relative gains reaching 9.5% on the most difficult tasks.

Training large language models for complex reasoning tasks relies on two complementary signals: sparse, outcome-grounded reinforcement learning (RL) for correctness, and dense, token-level distillation for guidance. However, complementarity in supervision does not guarantee compatibility in optimization; imitation-focused distillation can conflict with the outcome-driven RL objective, and existing hybrids lack a principled resolution. We propose \textbf{GIFT} (\textbf{G}radient-\textbf{I}nformed \textbf{F}il\textbf{T}ering for Distillation-Augmented Reasoning RL), a novel method that directly addresses the allocation problem of which teacher updates to apply. GIFT performs a token-level geometric analysis, decomposing the distillation gradient into a component \textbf{parallel} to the RL gradient, which measures first-order conflict and provides a \textbf{safety} filter, and a component \textbf{orthogonal} to it, which quantifies novel directional guidance and provides a measure of \textbf{value}. This decomposition yields a principled scoring rule to rank token-level guidance. We combine this with a progressive \textbf{coverage annealing} schedule that shrinks the budget of tokens receiving distillation, ensuring that the most conflicting updates are discarded first while the most complementary ones are retained at full strength. This facilitates a smooth transition from dense, geometrically-filtered guidance to a pure, outcome-grounded objective at convergence. Extensive experiments on mathematical and logical reasoning benchmarks show that GIFT consistently outperforms strong baselines across multiple model scales, achieving relative gains of up to 9.5\% on difficult mathematical reasoning tasks. Code: https://github.com/lilifree/GIFT
0
cs.LGcs.AIstat.ML Erik Bodin, Lisa Maria Kreusser, Donney Fan et al. · Oct 22, 2026

SABLE tackles expensive optimisation in the high-dimensional latent spaces of pretrained generative models — a regime where latent dimension $D$ can reach $40{,}500$ while the evaluation budget $N$ is orders of magnitude smaller. The core idea is to use a Bayesian affine surrogate on the characteristic-radius sphere, decoupling acquisition into a data-sized in-span component and a scalar off-span norm that is prescribed by a finite-horizon schedule rather than left to expected improvement. Together with a fast recompression scheme that bounds model-refitting cost to $\mathcal{O}(M^{2}D+M^{3})$, the method achieves tens-of-millisecond decisions and strong sample efficiency on synthetic and scientific benchmarks.

Complex objects such as engineering designs and proteins are often difficult to optimise because their design spaces exhibit high-dimensional structure and objective evaluations are expensive. Generative models provide continuous latent representations, but their latent spaces can have thousands to tens of thousands of dimensions, creating a regime where the latent dimension $D$ greatly exceeds the evaluation budget. We introduce SABLE, a Bayesian optimisation method for high-dimensional latent spaces with an isotropic distribution and limited budget. SABLE uses a Bayesian affine surrogate for prediction and acquisition, treating higher-order structure as surrogate discrepancy. After $N$ observations, the slope update has dimension at most $N-1$, yielding a decomposition of each query into an in-span component optimised by expected improvement (EI) in at most $N$ dimensions and an off-span component governed by a scalar norm. We show that the off-span norm implicitly selected by affine EI can lead to underexploration, and SABLE instead prescribes it using a finite-horizon schedule, without restricting search to a learned subspace. A recompression scheme reduces information to $\mathcal O(M)$ pseudo-observations, bounding refitting cost by $\mathcal O(M^2D+M^3)$ while keeping parameter inference, prediction, and acquisition decisions to tens of milliseconds. Across synthetic benchmarks and latent-space optimisation tasks, SABLE achieves high sample efficiency and reduces decision time by several orders of magnitude at large budgets.
0
cs.LGq-fin.PM Bolin Song (Cornell University), Surui Xiang (United Nations) · Oct 22, 2026

This paper studies how to handle aging textual signals in weekly portfolio allocation: keep stale news with explicit timing information, or filter out reports older than a fixed threshold. A frozen LLM extracts ternary $z_{i,t} \in \{-1,0,1\}$ signals from SEC disclosures, then either a Double DQN RL policy or the same LLM selects portfolios for a ten-stock US universe. The core finding is that filtering old signals outperforms retaining them with age metadata for the LLM agent, yet nearly none of the return differences are statistically significant. The work matters because trading costs make signal timeliness practically relevant, but its claims of superiority rest on noisy, short-sample evidence.

Financial news can influence investment decisions long after publication. Timely news may reach an investor before prices fully adjust, whereas older news may already be reflected in prices. We examine two ways to handle aging signals: retain them and give a portfolio policy timing information, or filter them out before portfolio selection. A fixed large language model (LLM) extracts signals from public SEC disclosures. We compare these treatments in reinforcement learning (RL) policies and LLMs that choose portfolios directly. We evaluate returns after trading costs in historical tests over 2023-2025. RL choices respond to timing information in a controlled test, but historical returns show no consistent benefit from adding it. For the LLM, filtering old news produced the highest average net return, reaching 18.43% per year when news delivery was delayed by four weeks. This exceeded the returns of all RL strategies that used news.
0
cs.LGecon.GNq-fin.EC Amirreza Zeinali, Jon Saad-Falcon, Avanika Narayan et al. · Oct 22, 2026

Existing AI evaluations treat economic value and energy consumption separately, leaving a critical gap in understanding whether more capable systems actually deliver better returns per watt. This paper formalizes Net Value per Joule ($NVJ$) and Time Saving per Joule ($TSJ$), pairing judged professional output quality with end-to-end energy measurement across 220 real-world tasks. The work matters because it shows rankings of occupations and models shift dramatically once energy is accounted for, challenging the assumption that raw capability or dollar cost alone guide efficient deployment.

An AI system can produce more economically valuable work while delivering less value for the energy it consumes. We therefore ask: How much economic value does an AI system create per unit of energy consumed? We formalize economic value in two ways: (1) net dollar value, the output's dollar value minus AI-system execution cost, and (2) time saving, the expert's completion time minus the AI system's completion time. Dividing each by measured end-to-end energy yields Net Value per Joule (NVJ) and Time Saving per Joule (TSJ), reported in USD/MJ and hours/MJ. We study 220 public GDPval tasks across 44 occupations, serving five open-weight models locally and evaluating four accelerator types. First, the occupation groups where AI systems succeed most often, deliver the greatest dollar value, or save the most time do not necessarily provide the greatest economic return per joule. For example, among the tested tasks, engineering work delivers about 10% more net dollar value per task than software development. Yet software development delivers about 27% more net value per joule. Second, GLM 5.2 delivers the highest average net dollar value, at $72.27 per task using 0.430 MJ, equivalent in energy to about four hours of active laptop use. By contrast, Gemma 4 31B delivers 56% of that net dollar value using just 23% of the energy, achieving approximately 2.5 times the NVJ and 2.8 times the TSJ. Third, across four single-accelerator deployments, Qwen3.6-27B's NVJ varies by a factor of 4.32 and TSJ by 9.27, with B200 leading both. Additionally, one and eight H100s deliver similar net dollar value, but eight reduce completion time by 22% at 3.24 times the energy. Our framework makes output value and expert time saving under an energy budget explicit objectives for improving models, accelerators, and software, while offering a new basis for assessing AI's potential economic effect on occupational work.
0
cs.LG Bahavathy Kathirgamanathan, Gennady Andrienko, Natalia Andrienko et al. · Oct 22, 2026

Different XAI methods frequently contradict one another, yet most tools show only one explanation at a time. XALIGN is a visual analytics workflow that places rule-based explanations and three feature attribution methods side by side for a single Random Forest model. Its goal is to let domain experts spot agreements and contradictions, calibrating trust rather than accepting a single explainer's story.

Explainable AI (XAI) methods are usually evaluated for technical properties such as faithfulness and robustness. In high-stakes application domains, experts also need to check model predictions against established knowledge. Different explanation methods often disagree, and this disagreement is hard to see when each method is inspected separately. We propose XALIGN, a visual analytics workflow and interface that shows rule-based explanations and several feature attribution methods (TreeSHAP, KernelSHAP, and LIME) side by side for the same Random Forest model. Agreements and contradictions between the methods become visible signals that users can explore and compare with domain knowledge. We apply XALIGN in two case studies: the German Credit dataset and a meteorological dataset, in which events derived from ICON model output and Cloudnet observations are classified. In both, the views reveal discrepancies between the rule-based explanation and the attribution methods that a single method would not show. In an expert evaluation with three specialists, participants found XALIGN useful for identifying influential features and for avoiding over-trust in predictions. Linking rules to attributions was harder for the participant without an XAI background.
0
cs.LGcs.AI Zhaoyi Zhou, Akshayaa Magesh, Jeongyeol Kwon et al. · Oct 22, 2026

Tool selection across corpora of tens of thousands of APIs is a critical bottleneck for LLM agents, because standard retrievers rank by relevance without knowing which tools a multi-step instruction actually requires. This paper post-trains small open Qwen3 models (1.7B to 8B parameters) via supervised fine-tuning and reinforcement learning to decompose a request and select tools through a lightweight Plan–Retrieve–Select workflow. The headline result is that an 8B checkpoint outperforms a 402B-parameter Llama-4-Maverick on ToolBench and transfers zero-shot to unseen tool domains and retrievers, suggesting that tool selection can be compressed into a small, locally hostable policy rather than delegated to massive proprietary models.

As LLM agents operate over corpora of more than ten thousand tools, selecting the right tool for a complex multi-step user instruction becomes a central bottleneck. Tool descriptions cannot all fit in context, and relevance-based retrievers only rank tools without knowing which are actually needed. Recent work instead leverages proprietary commercial LLMs like Claude or ChatGPT to drive a retriever, decomposing the instruction and selecting over retrieved candidates. We show that a small, open model can be trained via reinforcement learning to perform the same functionality. On ToolBench, a Qwen3-8B model post-trained with our recipe outperforms Llama-4-Maverick (402B). In addition, the trained model transfers directly to different retrievers and generalizes to new tool corpora in different domains.
0
cs.LG Jonas Fingerhut, Lukas Koller, Matthias Althoff · Oct 22, 2026

Formal verification of neural networks usually requires expensive set propagation whose error accumulates with depth and input size. This work introduces a mixed-monotone architecture built as the difference of two monotone subnetworks, reducing tight output enclosure to just two forward passes at opposite interval corners. Because the enclosure size is a closed-form differentiable function of the weights, it can be minimized directly during training, yielding orders-of-magnitude speedups and near-optimal tightness without sacrificing predictive accuracy.

Most formal verification approaches for neural networks conservatively enclose the output set of the neural network. However, computing a tight output enclosure is in general computationally hard. We sidestep this challenge with a novel neural network architecture that realizes mixed-monotone functions as the difference of monotone subnetworks. By utilizing the theory on mixed-monotone systems, this reduces the computation of a tight output enclosure from complicated set propagation to two simple forward passes of opposite corners of an input interval. Moreover, because the size of the resulting enclosure is a closed-form function of the weights of the neural network, we can directly minimize it during training. We prove a lower bound on the size of any such enclosure, given by the total variation of the represented function generalized to several inputs, which makes it possible to compare the tightness of the enclosure against the optimum. Our evaluation on regression and dynamical-system benchmarks demonstrates that our training reduces the enclosure size to within 0.5% of the lower bound without sacrificing prediction accuracy. Computing our enclosure is orders of magnitude faster than CROWN and $\alpha$-CROWN and on deep networks it is also tighter than zonotope propagation and CROWN, while its size exceeds that of $\alpha$-CROWN by only 5.1%.
0
cs.SDcs.LGeess.AS Shreya Sajid, Fabrizio Julian Piva, Hiram Rayo Torres Rodriguez et al. · Oct 22, 2026

This paper tackles the underexplored problem of token sparsification in audio transformers, where self-attention cost grows quadratically with input length. The authors systematically compare pruning and merging strategies across model sizes and datasets, and propose frequency-aware heuristics—Spectral Flatness (SF) and Low-Frequency Energy (LFE)—to score token importance. Their core finding is that audio-specific spectral cues consistently outperform generic attention-only methods in post-training settings, offering a practical path to faster inference on spectrogram-based models.

Transformer-based models have shown strong performance across diverse tasks, but their reliance on self-attention mechanisms often leads to high computational costs. Token sparsification, which reduces the number of tokens processed in transformer layers, offers a promising solution to maintain performance while improving efficiency. However, although widely studied in the vision and language domains, token sparsification remains underexplored in audio, with existing work often limited to a single method, model size, or dataset. This work presents a comprehensive evaluation of token sparsification techniques for audio transformers. We assess a range of token pruning and merging strategies across multiple datasets and model sizes, under both post-training and fine-tuning settings. Furthermore, we introduce a novel sparsification approach that combines attention scores with spectral cues derived from the frequency content of token embeddings. Our experiments show that frequency-aware approaches, particularly those based on spectral flatness and low-frequency energy, consistently outperform attention-only methods. We also find that sparsification based on spectrogram patch intensity is especially effective for longer audio inputs. These results highlight the value of incorporating frequency-domain and input-specific information into sparsification strategies to enhance performance in audio tasks.
0
cs.AIcs.HC Deepthika S, Pawni Yadav, B. Sankar · Oct 22, 2026

The paper asks who adapts to whom when a confident LLM is wrong. In a within-subjects experiment, 32 participants learned science topics from GPT-5-mini assistants whose briefings were covertly falsified at 0%, 25%, 50%, 75% or 100%. The study finds that learners absorbed roughly two-thirds of stated falsehoods regardless of overall assistant reliability, while their confidence and trust ratings failed to track accuracy. By reframing trustworthiness as a property of the human-AI pair and introducing a Human Deference Index, the work argues that sycophancy evaluation must measure human-side deference as well as model-side compliance.

Research on sycophancy asks whether large language models (LLMs) bend towards what their users want to hear. We ask the reverse question: when an LLM is confident, consistent, and wrong, do users bend towards it? In a within-subjects experiment, 32 participants learned up to five science topics by chatting with five assistants built on the same model (GPT-5-mini). Unknown to participants, each assistant's briefing had 0, 25, 50, 75, or 100% of its facts replaced by plausible falsehoods, and every assistant spoke with full confidence. A surprise quiz after each topic offered the correct fact, the planted falsehood, and two distractors, with a confidence rating for every answer. Across 104 quizzes and 1,040 answers, scores fell from 7.4 to 2.9 out of 10, and the planted option was chosen on 60% of falsified items against 11% of correctly taught ones (odds ratio 12.5). Transcript coding showed that whenever the assistant stated a falsehood, it was adopted about 65% of the time at every falsification level. Absorbed falsehoods were held with high confidence (8.4/10), the modeled confidence advantage of right over wrong answers vanished, and the discrimination of confidence for correctness fell from an AUROC of 0.70 to chance, while post-task trust ratings barely moved. Participants tended to return to the chat more when the assistant was worse, but returning went with more absorption, not less, and 30% of all turns pasted quiz questions back to the source being checked. The assistant itself was almost never sycophantic and never conceded under pushback. We introduce a baseline-corrected Human Deference Index to quantify this human-side sycophancy and argue that trustworthiness is a property of the human-AI pair, that sycophancy evaluations should measure both directions, and that learning interfaces must make reliability legible claim by claim.
0
cs.LGstat.ML Ruijia Zhang, Soufiane Hayou · Oct 22, 2026

This paper studies whether width and depth limits commute not just at initialization, but during training, for linear residual networks with $1/\sqrt{L}$ branch scaling and $\mu$P width scaling. Its core result is that under clipped gradient descent, the trained output converges in $\mathbb{L}_2$ as $\min\{n,L\}\to\infty$ for any fixed number of steps, proving the order of limits does not matter. Without clipping, commutativity holds only in probability, because the second moment can diverge with depth even after a single gradient step. The finding matters because it rigorously characterizes joint scaling limits in a tractable deep-learning model and isolates gradient clipping as a key enabler of stable infinite-depth training.

Recent work established that the infinite-width and infinite-depth limits of residual networks commute at initialization when residual branches are scaled by $1/\sqrt{depth}$. In particular, the network output converges to the same limit whether width and depth tend to infinity sequentially or jointly. We extend this commutativity result to training in linear residual networks. Under the same $1/\sqrt{depth}$ residual-branch scaling (Depth-$\mu$P) and the $\mu$P width parameterization, we prove that, for any fixed number of gradient-descent steps with gradient clipping, the network output converges in $L^2$ along every joint width--depth growth path as both width and depth tend to infinity. Consequently, the infinite-width and infinite-depth limits commute throughout any finite training horizon. Without gradient clipping, the corresponding $L^2$ convergence does not hold in general, but we establish the weaker convergence in probability.
0
cs.LG Xiaobao Wang, Renda Han, Zhiliang Xia et al. · Oct 22, 2026

GraphRAG usually assumes a centralized knowledge graph, which clashes with real-world settings where sensitive data is siloed across organizations that cannot share raw graphs due to privacy or ownership constraints. This paper proposes FedGRAG, a federated framework that routes queries to relevant clients using lightweight semantic prototypes and then reconstructs abstracted evidence subgraphs on a central server to enable cross-client reasoning. The problem is practically important because legal and competitive barriers prevent the global construction and indexing required by standard GraphRAG pipelines.

Graph Retrieval-Augmented Generation (GraphRAG) leverages centralized knowledge graphs to enhance large language models with structured knowledge retrieval. However, real-world knowledge is inherently distributed across multiple organizations rather than being centrally accessible. Privacy constraints further prohibit sharing entire local knowledge graphs, preventing GraphRAG from effectively retrieving and utilizing distributed knowledge. To this end, we propose Federated GraphRAG (FedGRAG), a unified framework for distributed graph retrieval and knowledge-enhanced generation over multiple clients with knowledge graphs. Specifically, we address two fundamental challenges in federated GraphRAG. First, the absence of a global knowledge graph makes unified retrieval impossible. To address this, we develop a Federated Knowledge Routing mechanism that efficiently identifies relevant clients through lightweight knowledge indices without exposing local graph structures. Second, local graph memory cannot be shared directly because it contains sensitive entities and knowledge information. We therefore propose a controlled-disclosure evidence construction method. It extracts retrieved evidence subgraphs and converts them into an evidence abstract, enabling evidence conversion and reconstruction on the server. Extensive experiments demonstrate that Federated GraphRAG consistently outperforms existing baselines in both retrieval and downstream generation tasks, establishing a new paradigm for deploying GraphRAG in federated environments.