Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.CRcs.AI Yifan Wang, Dongliang Xu, Xiaoyong Li et al. · Oct 22, 2026

SecLog-Bench introduces a benchmark for post-detection cybersecurity log reasoning that requires LLMs to infer attack progress from scaffolded multi-source evidence and produce structured, evidence-referenced reasoning chains. The authors construct 29 reproducible attack scenarios spanning CVE exploits and multi-hop attacks, aligning host audit logs, application logs, and network traffic into stage-labeled evidence windows. Evaluation of eight mainstream LLMs reveals modest attack-stage prediction (best accuracy 44.44%) and unreliable reasoning (best SRF1 54.87%), demonstrating that final-label accuracy alone misrepresents true model capability.

Large language models (LLMs) have shown strong potential for cybersecurity, leading to growing interest in LLM-based automated cybersecurity log analysis. However, current datasets (1) are limited in scale; (2) rely mainly on single-source evidence; and (3) have only binary or multi-class attack labels, without dense annotations of the reasoning process. To address these limitations, SecLog-Bench has three key features. First, we build an extensible simulation platform that covers 29 attack scenarios, supports repeated execution and the integration of new scenarios, and enables scalable generation of cybersecurity logs with attack-stage labels. Second, we use multi-source logs, including audit logs, application logs, and network traffic, to jointly analyze cyber attacks. Third, we annotate each sample with the essential context for cybersecurity log reasoning and a structured step-by-step evidence chain. We evaluate eight mainstream LLMs on this benchmark for post-detection attack-progress reasoning. Results show that, when provided with scaffolded evidence, current LLMs exhibit modest capability in attack-progress reasoning, with the best model achieving only 44.44% accuracy and 45.07% Macro-F1. Their reasoning remains unreliable; i.e., the highest Stage Reasoning F1 (SRF1) score is only 54.87%. Moreover, even correct predictions may be accompanied by flawed reasoning, and reasoning quality is often misaligned with prediction accuracy.
0
cs.CLcs.AIcs.CY Avrile Floro, Tamara Dhorasoo, Nils Holzenberger et al. · Oct 22, 2026

This paper introduces a ground-level dataset of 121,536 ground–reasons pairs extracted from 86,464 French civil cassation rulings spanning 2016–2025. Using a deterministic, rule-based pipeline, the authors pair each legal complaint with the Court’s response and classify the pair into established doctrinal families, producing a descriptive grammar of civil cassation. The resource enables quantitative analysis of which grounds succeed, which legal texts are cited, and how both evolve over time, alongside an interactive consultation tool.

This paper presents a dataset of 121,536 ground-reasons pairs across 86,464 rulings of the five civil chambers of the French Court of Cassation (2016-2025). An appeal on points of law cannot itself be appealed and often decides a case for good. Understanding how the Court rules is thus crucial and can help lawyers who draft those appeals. Inside a ruling, every ground of appeal (a distinct legal complaint against the appealed decision) has its own answer from the Court. This answer is called the reasons and it belongs to one of a few doctrinal families. Using a deterministic pipeline, we pair each ground with its reasons and attach the pair to its family, according to the established French taxonomy. We obtain a descriptive grammar of civil cassation that shows which grounds succeed, which legal texts they refer to, and how both evolve over the decade. We release the dataset, the code and an interactive consultation tool.
0
cs.AI Deng Pan, Xue-Jian Gao, Junyi Fan et al. · Oct 22, 2026

Writing efficient kernels for Huawei Ascend NPUs is notoriously hard because AscendC code is scarce in LLM training data and operator deployment requires coordinating host-side tiling with device-side kernels. CANNBot-CAKE presents a full-stack agentic workflow that turns a natural-language request into a compiled, packaged, and benchmark-validated CANN custom operator. Its key ideas are a multi-DSL router that uses an item-response model to choose among four code-generation tracks, an evolution mode that iteratively refines kernels under a roofline model, and a cross-operator wiki (CAKE Book) that accumulates verified experience. On 53 CANN-Bench operators on Ascend 950PR, CAKE reports 100% standard-case and 98.28% hidden-case pass rates, with a mean score of 78.63/100.

Efficient custom operators are essential for modern deep learning workloads, yet developing high-performance kernels for Ascend NPUs remains slow, expert-intensive, and difficult to automate. Although AI agents now approach expert performance on GPU kernel benchmarks, current models remain less capable of generating AscendC kernels for NPUs, potentially reflecting the relative scarcity of relevant training data. We thus present CAKE, a CANN-native system for deployable custom operators that combines adaptive multi-DSL routing, separate Generation and Evolution modes, and reviewed knowledge reuse through CAKE Book and a Self-Evolving Agent. On 53 CANN-Bench v1.1 operators on Ascend 950PR, CAKE's aggregated results achieve $100\%$ case pass rate on the standard set (1,060/1,060) and $98.28\%$ on the hidden set (4,167/4,240), with an overall mean score of 78.63 out of 100 and an average performance speedup of $1.334\times$ over the baseline. Evolution then pushes correct operators further: EngramGateFusion cuts aggregate device time by $46.6\%$ over 20 rounds and roughly halves the mean roofline gap. These results offer a practical path toward closing Ascend's AI-for-kernel capability gap.
0
cs.GTcs.AIcs.DS Junhua Liu, Zhicheng Liang, Zejun Zhang et al. · Oct 22, 2026

LLM-native advertising introduces new auction-design challenges because an ad’s click-through rate depends on its context passage and earlier ads steal clicks from later ones under a first-click cascade. This paper studies truthful mechanism design when the LLM answer and its passage order are fixed before bidding, showing that a constant-factor welfare approximation is compatible with truthfulness even under this editorial-order restriction. The authors propose click thinning—randomly omitting earlier ads to equalize click services across positions—which turns welfare maximization into a tractable linear-fractional matching problem and yields an elegant optimal tradeoff between approximation, truthfulness, and computational efficiency.

Generative AI assistants are becoming an advertising medium, embedding sponsored content in their answers. This setting departs from classical position auctions in two ways: an ad's click-through rate depends on the passage that hosts it, and because users stop at their first click, earlier ads take clicks from later ones. This competition for clicks makes truthfulness delicate: a higher bid can reshape the allocation and put a competitor ahead of the bidder, reducing the bidder's clicks. Existing mechanisms either attain a constant fraction of the optimal welfare (advertisers' total click value) but are not known to be truthful, or are truthful but their welfare guarantee degrades as the number of passages grows. We achieve both even when the answer and its editorial order are fixed before bidding. Assuming each ad's click-through rate when reached is known and unaffected by omitting other ads, we give a computationally efficient mechanism that is truthful in expectation and attains at least half the optimal welfare under free reordering. Our key idea, click thinning, omits ads at random, showing earlier ads less often so that each ad's overall click probability no longer depends on the order of the ads. Welfare maximization then reduces to a tractable matching problem, and solving it exactly with VCG-style payments makes truthful bidding optimal in expectation. Characterizing the click probabilities that omission can achieve sharpens the approximation factor from $2$ to $2-(1-\delta)^{K-1}$ when at most $K$ ads are shown and each click-through rate is at most $\delta$. This factor is the best possible for any order-preserving rule, even one that ignores incentives and computation, so truthfulness and computational efficiency incur no additional worst-case loss.
0
cs.AI Prajvi Saxena, Sabine Janzen, Wolfgang Maass · Oct 22, 2026

The paper diagnoses a critical split in how LLMs handle Theory of Mind: explicitly recognizing an agent's belief versus applying that belief to predict behavior or evaluate actions. It argues that aggregate ToM benchmarks conflate these skills and hide severe applied deficits, then tests whether the gap reflects a capacity limit or merely latent competence that can be recovered via prompting, in-context learning, or lightweight parameter adaptation. The work is motivated by the deployment of LLMs in socially sensitive roles where surface-level mental-state recognition is insufficient for trustworthy interaction.

As large language models are deployed in high-stakes roles such as therapy, education, and personal assistance, their social cognition must be assessed reliably. Current Theory of Mind (ToM) benchmarks report aggregate scores that conflate two distinct competencies: explicit ToM (recognizing what someone believes) and applied ToM (using that belief to predict behavior). Building on this distinction, we investigate the gap and its recoverability using four structurally diverse benchmarks. Aggregate reporting obscures uneven competence: on SimpleToM, Llama-3.1-8B scores 51.5 percent overall while recognizing mental states at 99.4 percent and predicting behavior at only 28.9 percent. To assess recovery, we compare structured prompting, matched in-context learning, and our proposed Belief-State Test-Time Training (BSTTT), which adapts lightweight parameters on answered support questions through action reconstruction. Across Qwen2.5-7B, Llama-3.1-8B, and GPT-oss-20B, recovery depends on the model, task, and intervention. On SimpleToM, reminders combined with BSTTT improve Llama's behavior prediction by 40.8 percentage points; reminders account for most of the overall improvement, with BSTTT adding 1.3 to 5.5 points beyond reminders across models. Contextual examples often outperform weight updates, while BSTTT remains stronger in specific model-benchmark settings. Temporal belief tracking remains difficult despite partial recovery. These findings show that aggregate ToM scores can overstate applied competence while hiding performance recoverable through targeted assistance. We recommend decomposed reporting of explicit and applied accuracy alongside intervention comparisons that establish which failures are recoverable and under what conditions.
0
cs.AI Ricardo Maia Avelino, Mennatallah El-Assady, Tom Van Mele et al. · Oct 22, 2026

Early-stage structural design is an iterative, creative process that balances form, force, and material. This paper proposes a proof-of-concept workflow connecting a large language model agent to a COMPAS-based structural modeling API via a Model Context Protocol (MCP) server, enabling natural-language generation and editing of semantic building elements. By producing explicit graph-based artifacts rather than generic meshes, the work aims to reduce modeling friction and move toward human-AI co-design in structural engineering.

Recent advances in large language models and agentic workflows offer a new paradigm to early-stage structural design translating design intent into structural models. Although text-to-3D approaches have demonstrated that natural language can be used to produce visual, mesh-based geometric models, structural design requires domain-specific geometric arrangements and semantically rich data types. This paper introduces a proof-of-concept workflow for prompt-to-structure generation using an AI agent connected to a COMPAS-based structural modelling API through a Model Context Protocol (MCP) server. Through controlled modelling operations, the agent creates and modifies a graph-based structural data model composed of explicit building elements. The resulting artifacts can be inspected, modified, serialised, and further connected to downstream AEC workflows. The approach is demonstrated through selected prompt-to-structure examples and by progressive and editable design sequences that resemble typical iterative structural design workflows. The results are preliminary, but demonstrate the possibility of combining natural language, agentic workflows, and domain-specific structural data structures as a first step toward AI-assisted structural co-design.
0
cs.AIcs.CL Wenjie Zhang, Zhichao Shi, Xuhui Jiang et al. · Oct 22, 2026

ColaBench tackles the problem of evaluating how personal agents use long-term interaction history to guide the acquisition and application of external knowledge. The core idea is a traceable benchmark built on an Evidence Graph $\mathcal{G}=(V,E)$ that links personal facts to their disclosures and to supporting documents, paired with MemKB, a retrieval method that connects state summaries and memory-document links. This matters because current benchmarks test memory recall and retrieval in isolation, leaving open whether agents can jointly recover historical conditions and apply newly retrieved rules to a specific user's situation.

Personal agents need to draw on long-term interaction history to retrieve and apply external knowledge suited to a user's current request. Even an answer grounded in relevant documents can be unsuitable when it overlooks the user's circumstances. This creates two connected challenges: using historical conditions to identify the knowledge needed for a new request, and applying that knowledge to the user's situation. Existing benchmarks advance memory recall, personalized retrieval, and memory-guided action, while the joint evaluation of these two challenges remains underexplored. We introduce ColaBench, a synthetic benchmark in health and daily living, with 349 tasks across 10 Profiles and a knowledge base of 13,033 documents. Its Evidence Graph connects personal conditions to their disclosures across public interaction sessions, records prior document exposure, and links answer requirements to personal and newly acquired document evidence. We also introduce MemKB, which uses state summaries to inform queries and rule application, and memory-document links to retrieve knowledge associated with the user's history. MemKB achieves 86.25% Accuracy with an average of 4.07 interaction rounds per task. Task-level analysis finds larger gains on tasks integrating information across multiple historical Facts; error analysis further identifies unsupported personal assumptions and rule misapplication as obstacles to using retrieved evidence. ColaBench provides traceable tasks and an evaluation framework for studying how memory guides knowledge acquisition and rule application.
0
cs.CLcs.AIcs.LG Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov et al. · Oct 22, 2026

Document-level LoRA adapters are pitched as modular knowledge units for retrieval and merging, yet standard open-book evaluation cannot tell whether an adapter has memorized a document or merely learned to read it well. This paper introduces a cloze probe that withholds the source text and finds that open-book scores are almost entirely generic reading behavior: a random adapter recovers 82% of a specialist's open-book advantage but only 2% of its cloze gain. The findings argue that adapter-bank evaluation needs a closed-book probe alongside open-book scores, and the authors' candid disclosure of four silent errors is a model of experimental hygiene.

Single-document LoRA adapters have been proposed as units of knowledge to be merged and retrieved; yet open-book scoring, with the document in the prompt, can credit a document's own adapter (its specialist) for reading that document as readily as for holding it. Training one adapter for each of 150 Wikipedia articles on Llama-3.1-8B-Instruct, we find that open-book scores mostly measure a reading behaviour every adapter shares: a random adapter trained on another document recovers 82 % of the specialist's open-book advantage over the base model but only 2 % of its advantage on a cloze probe that asks for the same document's facts without providing the source text, a share we cannot distinguish from zero. Content does reach the weights, since the specialists beat the base model in cloze recall by 0.094, and the geometry of their updates follows the documents they read; yet, in a test of 30 queries, adapters chosen by weight-space proximity or text embedding are not distinguishable from random ones on either probe, although that test cannot exclude an advantage of about four fifths of what a query's own adapter gains over a random one. At 16 documents or more, correctly scaled merges recover 87 % to 89 % of the specialists' open-book advantage but only 12 % to 16 % of their cloze advantage, with intervals that run from below zero to at most 32 %, against 94 % for joint training.We also report four silent errors, each of which produced a clean, wrong result.
0
cs.ROcs.AI Miguel Sousa, Luis Ramos Pinto, Jo\~ao P. Matos-Carvalho · Oct 22, 2026

Natural-language robot control requires mapping user requests to predefined tool subsets without inventing new capabilities. This paper frames tool routing as bounded multi-label selection over a fixed catalog and compares three ChromaDB retrieval policies against a cloud-hosted 120-billion-parameter LLM. The core finding is a clean quality-latency trade-off: clause-aware retrieval (CDBv3) runs locally in milliseconds but lags the LLM in routing accuracy, making it suitable for connectivity-constrained or privacy-sensitive deployments.

Natural-language interfaces allow users to command robotic systems without interacting directly with mission planners or robotics middleware. Their reliable use depends on robot tool routing, defined here as the selection of the smallest complete subset of predefined executable capabilities required to satisfy a request. This task is particularly difficult for compound instructions, where incomplete selection may omit necessary sensing or monitoring capabilities, while excessive selection may expose irrelevant tools. We compare four routing strategies: three progressively refined ChromaDB-based methods - fixed-threshold retrieval, relative-distance retrieval, and clause-aware aggregated retrieval - and a cloud-hosted 120-billion-parameter language-model baseline. The methods are evaluated on 164 manually annotated prompts organised into three complexity levels, from direct single-tool requests to compound requests requiring at least three tools. Using exact-match accuracy, completeness, precision, a completeness-weighted composite score, and routing latency, CDB-v3 achieves the best macro-average score among the retrieval-only methods, with 0.7822, compared with 0.8869 for the large-model baseline. Although the LLM provides higher routing quality, CDB-v3 exhibits substantially lower latency and can be deployed locally without requiring cloud connectivity. These results identify a quality-latency trade-off between direct large-model selection and clause-aware semantic retrieval for privacy-sensitive, connectivity-constrained, and resource-constrained robotic systems.
0
cs.AI Valentino Maiorca · Oct 22, 2026

Neural networks trained independently on similar tasks often learn compatible semantic structure but express it through incompatible coordinate systems. This doctoral thesis proposes that semantic correspondence—identifying which elements refer to the same meaning across systems—is a fundamental primitive for revealing shared intrinsic geometry. It unifies fourteen methods spanning vision, language, reinforcement learning, and neuroscience under a single framework, distinguishing correspondence-parallel operators (independent semantic projections) from correspondence-coupled operators (direct cross-model maps). The work enables zero-shot transformation and model stitching without joint training, yet explicitly disclaims formal theoretical guarantees, positioning itself as a systematic empirical demonstration.

Just as different languages express the same concept through different words, neural networks express similar functions through incompatible coordinate systems. Different architectures, random initializations, and optimization trajectories produce incompatible parameterizations in extrinsic coordinates, obscuring functional relationships between independently trained models. When models independently solve similar tasks on related data, do their learned representations share exploitable structure despite incompatible coordinates? This thesis shows that semantic correspondence is a fundamental primitive revealing shared geometric structure beneath incompatible parameterizations. By identifying which elements refer to the same semantic content, correspondence breaks the symmetry of arbitrary implementation choices, anchoring incompatible systems to a shared semantic frame and revealing the intrinsic geometry that enables zero-shot transformation between independently trained models. Building on this principle, fourteen contributions explore correspondence-based alignment across zero-shot model stitching, cross-modal translation, policy transfer, activation steering, and neural decoding. They span domains (vision, language, reinforcement learning, neuroscience), architectures (CNNs, Transformers, graph networks), and scales (from small supervised models to billion-parameter generative systems). Each exploits different geometric properties (angular, metric, spectral, sparse, or distributional), yet all instantiate the same principle. It extends beyond artificial systems: fMRI data show that different human brains processing identical stimuli exhibit alignable geometric structure. By revealing intrinsic geometric structure beneath extrinsic parameterization, semantic correspondence transforms model isolation into interoperability.
0
cs.ROcs.AI Keshu Wu, Hao Zhang, Rui Gan et al. · Oct 22, 2026

LAST-V2X addresses the problem of testing how delayed, missing, or corrupted V2X messages compromise safety-critical driving decisions. Its core idea is a framework that translates natural-language test descriptions into executable CARLA scenarios, then causally verifies whether any observed violations are actually due to degraded communication rather than ordinary traffic risk. This matters because existing adversarial methods perturb only the physical world, whereas V2X failures propagate from the information layer and must be isolated through paired counterfactual execution.

Vehicle-to-everything (V2X) communication enables connected vehicles to make safety-critical decisions, but delayed, missing, or incorrect information can compromise driving safety. Systematically testing such failures is challenging because traffic interactions, communication conditions, and application responses must be jointly configured to produce meaningful scenarios. This paper presents LAST-V2X, a language-driven, adaptive framework for automated scenario synthesis and safety testing of V2X applications. LAST-V2X leverages large language models (LLMs) to translate natural-language test descriptions into executable scenarios grounded in roadway geometry, V2X communication semantics, and vehicle behavior. The framework integrates physical traffic simulation with spatially aware communication modeling and message-level fault injection to evaluate how information degradation affects vehicle decisions. To establish whether an observed safety failure is caused by communication rather than the underlying traffic conditions, LAST-V2X employs matched executions under degraded and ground-truth information. Furthermore, an execution-guided refinement mechanism combines parameter search and LLM self-reflection to identify ineffective test configurations, improve scenario effectiveness, and produce minimal reproducible failure cases. Experiments across diverse CARLA environments and V2X safety applications demonstrate the framework's ability to generate reliable scenarios, distinguish communication-induced failures from unrelated safety violations, and substantially improve failure discovery through adaptive refinement. These results establish LAST-V2X as a systematic approach to language-driven, causally verified, and adaptive safety testing for connected vehicle systems.
0
cs.AI Jianghan Zhu, Jianan Zhou, Fei Liu et al. · Oct 22, 2026

PRS tackles automatic heuristic design by making diversification an explicit generation-level operation rather than an emergent property of population management. The framework factorizes heuristic transformation into three semantic directions—expansion, compression, and steering—and rewrites perturbed ideas into executable code via LLMs within a breadth-first search with adaptive operator control. This matters because existing evolutionary frameworks mutate code without directly controlling the semantic trajectory of change, which often leads to premature convergence.

Large language models (LLMs) have demonstrated strong potential to automate heuristic design for NP-hard combinatorial optimization (CO) tasks without human intervention. Recent methods predominantly rely on evolutionary computation (EC) frameworks, where heuristic diversification is mainly induced through EC-like operators or downstream selection, while the direction of heuristic transformation remains largely unharnessed. In this paper, we propose a multi-directional Perturbation-Rewrite Search (PRS) framework for automatic heuristic design that factorizes heuristic transformation through directional search primitives at the generation level. Specifically, PRS operates on heuristic ideas through three complementary directions: expansion toward richer and more expressive designs, compression toward simpler and less specialized designs, and steering for fine-grained refinement, together enabling broader and more sustained exploration of diverse regions in the heuristic design space. PRS further organizes candidate exploration within a breadth-first search-based process with adaptive operator control, which ensures thorough candidate utilization and sustained exploration, and maintains strong search dynamics while preventing premature convergence. Extensive empirical results across diverse CO tasks show that PRS consistently discovers high-quality heuristics, demonstrating the effectiveness and generality of explicitly directional exploration design.
0
cs.AI Mohammad Talaei, Mohammad Goudarzi, Maille Todd et al. · Oct 22, 2026

This paper addresses the cold-start forecasting problem for land-restoration sites, where physical models need site-specific hydraulic parameters and traditional data-driven models require months of per-site training data. The core idea is to evaluate TimesFM, a 500M-parameter time-series foundation model, in strict zero-shot mode on 15-minute in-situ telemetry from 27 soil-moisture and temperature sensors across three management regimes. The work matters because it systematically maps where zero-shot foundation models win and lose against classical and tree-based baselines, and quantifies the inference cost on commodity CPU hardware for operational deployment.

Soil moisture and temperature govern plant-water availability and microbial activity, making them key indicators for evaluating land-restoration efforts on degraded landscapes. However, the physical and data-driven models normally used to forecast them both need information that a newly instrumented restoration site does not yet have: hydraulic parameters for the former and months of per-site training data for the latter. We evaluate TimesFM 1, a 500M-parameter time-series foundation model, zero-shot on 15-minute telemetry from 27 sensor stations across three land-management regimes (Control, Treatment, Scald) at a semi-arid restoration site, forecasting 5 cm and 30 cm soil moisture and enclosure temperature at seven lead times from 1 h to 168 h. Using gap-aware rolling-origin evaluation across sensors, we find that TimesFM beats the best rule-based statistical forecasting baselines (persistence, seasonal-naive, or 7-day climatology) by 21-76% at sub-daily lead times but loses by 6-79% beyond a day, a pattern explained by a diurnal-alignment mechanism that holds for both soil-moisture depths and temperature. A CatBoost baseline trained walk-forward on the same origins with full history and weather covariates never wins overall, and we show that its weakness is partly a cold-start effect specific to short deployments. We additionally quantify the inference cost of zero-shot forecasting on commodity CPU hardware. Our results highlight a practical trade-off between zero-shot forecasting capability, predictive performance, and computational efficiency.
0
cs.AI Gabriel Manalu, Saad Wazir, Thao Do et al. · Oct 22, 2026

Autonomous driving vision–language–action (VLA) models promise explainable decisions by generating natural-language reasoning before predicting trajectories. This paper subjects that promise to a rigorous causal test via counterfactual interventions: the authors perturb model-generated reasoning text and photorealistically remove visual objects that the reasoning cites, measuring whether trajectories actually track these changes. Their findings across four state-of-the-art models indicate that the stated reasoning is weakly coupled to the resulting driving actions, raising serious concerns about the reliability of such explanations in safety-critical deployment.

Driving vision-language-action (VLA) models bring an appealing form of explainability to a safety-critical domain, since a system that can state the reasons for its maneuvers offers the transparency that deployment and public trust in autonomous driving demand. These models read the world into language before they act on it, describing the scene and reasoning over it in text that ranges from chain-of-thought to multi-stage question answering on the way to a trajectory. That framing quietly assumes two separable properties, namely that the trajectory follows the generated reasoning and that the generated reasoning tracks the causes that actually produce the trajectory. To thoroughly investigate these properties, we apply causal, counterfactual interventions to four driving VLAs across different benchmarks. First, we perturb the models' own reasoning and show that altering its meaning produces small trajectory changes relative to blanking the same models' camera inputs, a pattern that persists across benchmarks and model architectures. We then construct scene-level counterfactuals through photorealistic removal of key objects named in the models' reasoning and analyze whether the generated reasoning and trajectories track these changes. Overall, our findings indicate that the reasoning these models present to account for their resulting driving behavior is weakly coupled to that behavior itself, pointing to limits on the explainability these systems are intended to provide.
0
cs.SEcs.AI Abhijit Chakraborty · Oct 22, 2026

When agents share a tool catalog and pool their usage experience, adding that usage to the retrieval index boosts tools with usage but can push unused tools out of the top results. This paper shows that folding usage examples into the index severely lowers held-out Hit@5 on two of three catalogs, and proposes Synapse, which scores documentation and usage as separate z-normalized fields before combining them with a learned weight. The finding matters because multi-agent systems risk silently failing on rarely-used tools unless the combination rule explicitly protects them.

Agents that call tools from a shared catalog can pool what they learn about which tool serves which request. We measure what pooled usage examples do to tool retrieval, reporting separately the held-out tools, for which no agent has usage, and all other tools. Adding usage examples to the index as extra entries for used tools raises Hit@5 (whether a gold tool is in the top five) for those tools and lowers it for held-out tools, by a large margin on two of three catalogs and with both embedders we tested. Giving used tools the same number of equally long entries filled with other tools' text lowers held-out Hit@5 about as much, but gives little or none of the gain. We call our method of scoring usage as its own field SYNAPSE. On StableToolBench, the held-out gold tool appears in its top five more often than with a router that reserves slots for usage (0.785 against 0.683), and this held-out lead holds on all three catalogs with both embedders. This protection persisted when we replaced each tool's usage with other tools' text, and a constant score offset for tools with usage gives similar held-out Hit@5 in most settings. The gain for tools with usage, in contrast, needs usage about the right tool. The router keeps more of the gain on labeled queries on TOUCAN with both embedders and on ToolRet with one, so the better choice depends on the workload. Splitting the usage among ten simulated agents shows that pooling helps exactly as much as giving one agent the same records.
0
cs.AI Qiuyu Kong, Zanxi Ruan, Marco Cristani et al. · Oct 22, 2026

Long-text image-text alignment underpins fine-grained scene understanding, yet existing models suffer from saliency collapse: they over-rely on visually prominent text while neglecting informative non-salient context. This paper proposes RoSA, a finetuning framework that decomposes image-text pairs into complementary salient and contextual views and enforces auxiliary contrastive objectives over both. By treating saliency as a multimodal training prior with no inference overhead, RoSA improves retrieval robustness when salient cues are weakened or removed.

Long-text image-text alignment is essential for fine-grained scene understanding, yet existing methods mainly focus on extending context length or improving local alignment. We identify an overlooked failure mode, saliency collapse, where models over-rely on text that features visual prominence while underutilizing non-salient context. Consequently, retrieval performance degrades sharply when salient content is reduced, despite that the non-salient context remains informative. To address this, we propose RoSA, a saliency-aware finetuning framework that decomposes image-text pairs into complementary salient and contextual views, enabling joint learning of prominent and contextual semantics. We propose a modality-independent decomposition strategy to combine object-level visual saliency estimation with LLM-based text decomposition to bridge vision and language. We employ auxiliary objectives to explicitly align these views, ensuring robust representation with both salient and contextual features. RoSA greatly improves long-text retrieval and demonstrates strong robustness to saliency collapse across benchmarks. Moreover, our auxiliary objectives are plug-and-play, bringing consistent gains to existing tuning methods. Code and checkpoints are available at: https://github.com/intelligolabs/RoSA
0
cs.AI Shidong Cao, Jing Ma, Wenhao Chai et al. · Oct 22, 2026

Diffusion language models decode many tokens in parallel, making schema enforcement harder than in autoregressive models: two locally valid tokens can be jointly incompatible. DConstrain compiles schemas into context-parameterized transition programs that precompute local grammar steps while leaving the runtime stack and field history as unbound parameters, resolving them only during warm compilation. This factorization avoids the exponential blow-up that forces prior exact decoders to fix property order, yielding large gains in compilation coverage, decoding latency, and task accuracy.

Diffusion language models (DLMs) decode multiple tokens in parallel, so individually valid tokens can be incompatible together under a schema. Exact joint inference over a grammar graph enforces compatibility, but it requires token-labeled successors across many hypothetical parser configurations. Encoding stacks and field histories in compiled states can cause exponential growth, which forces prior exact decoders to fix property orders and exclude valid outputs. We present DConstrain, which compiles schemas into context-parameterized transition programs. Cold compilation specializes token consumption to local grammar states while retaining context-dependent stack operations, environment guards, and caller-dependent deferred parsing symbolically. Tracking field histories as runtime values supports arbitrary property order without enumerating field subsets offline. At runtime, warm compilation binds reached configurations to these programs to construct exact successors, overlapping with the model forward pass because graph construction requires no model scores. Furthermore, token-effect grouping merges tokens with identical compiled effects before runtime contexts are bound, so groups are reused across stacks and environments even when concrete successors differ. Objective-specific score aggregation and token restoration provably preserve both the Viterbi optimum and the token-labeled path distribution of ungrouped inference. Across three benchmarks and two DLM families, DConstrain compiles 100% of BFCL schemas under arbitrary property orders, whereas an optimized finite-state baseline compiles only 71.30-85.81%. Under arbitrary property order, it reduces BFCL end-to-end decoding latency by 6.65-46.26 times with 100% schema validity and raises DiffusionGemma's BFCL accuracy from 37.27% under fixed order to 81.56%.
0
cs.LGcs.AI Hyunwoo Yu, Jongbeom Lee, Hyunbin Kim et al. · Oct 22, 2026

Sparse attention must approximate the long tail of unseen KV-cache tokens, yet discarding it biases the output and random sampling misses heavy hitters at extreme sparsity. OpenAttention folds the tail into a few count-aware mean proxies discovered via query-geometry clustering, achieving 99% of dense accuracy while reading only 1% of the cache. The accompanying Triton kernel delivers a 10× speedup in the decode attention stage, making ultra-low-density attention practical for long-context inference.

Sparse attention reads only a small subset of the key-value cache, and how to treat the unread tail remains a key challenge. Discarding the tail biases the output, and sampling it as previous approaches do fails at reads of 5% and below, where the tail likely holds heavy hitters the selector missed. Our key observation is that the simplest possible proxy, one token that folds the entire tail into its count-aware mean, already yields lower output error than a sample at every read behind a practical selector. We further show in closed form that at low reads sampling nearly doubles the weight error of discarding while a single proxy stays below it. Building on these findings, we explore approximating the dense attention distribution with a few proxies that target the tail. We propose OpenAttention, a pipeline of clustering, ErrorGate and top-k selection followed by a count-aware mean proxy. To implement clustering and selection both efficiently and effectively, we design training-free Query-Geometry Clustering (QGC) and a Query-Geometry Selector (QGS), which compress the keys while respecting the query directions. Additionally, unlike prior methods that rank clusters by centroid alone, ErrorGate allocates the exact read by the estimated weight error of each cluster. On RULER-32K HARD with Llama-3.1-8B, OpenAttention retains 99% of dense accuracy at a 1% read. It also achieves state-of-the-art accuracy across models, context lengths and datasets. Our customized attention kernel, OpenAttention.flash, runs the decode attention stage 10$\times$ faster than dense attention at a 1% read.
0
cs.CLcs.AI Bo Liu, Lianyu Wang, Meng Wang et al. · Oct 22, 2026

RetiJev tackles the latency, cost, and privacy barriers of autoregressive LLMs in point-of-care ophthalmic decision support. The authors introduce RetiJev-Data, a 128k-question source-grounded corpus, and a family of 0.8B–9B compact models that score predefined candidate answers in a single pass instead of generating free-form text. This yields sub-200 ms inference per case on one GPU while reportedly surpassing a 27B LLM and a commercial decision model on guideline grading and clinical-action accuracy.

Ophthalmic clinical decision support requires fast, accurate, and privacy-preserving inference, yet autoregressive large language models (LLMs) incur substantial latency and computational overhead for decisions among predefined actions. We therefore investigate a decision-oriented alternative to generative reasoning. Specifically, we first introduce RetiJev-Data, a source-grounded ophthalmology corpus comprising 78,158 clinical-decision and diagnosis questions derived from articles in PubMed Central and a MeSH vocabulary covering 531 eye diseases, and 50,074 guideline-grading questions spanning 11 grading systems, along with a 24,662-question evaluation benchmark. Based on this, we develop RetiJev, a family of 0.8B-9B decision models that directly score candidate answers without autoregressive decoding. Across all model sizes, RetiJev outperforms both a 27B LLM and the commercial Jev 1.13 decision model on guideline grading by 10.4-23.0 points. RetiJev-9B further achieves the highest accuracy on clinical decisions, improving over both baselines by 5.4-6.5 points while matching them on diagnosis. It answers a case in 158 ms on one GPU, 3.5x faster than LLM generation and 470x faster than reasoning. Models are released at https://github.com/Awenbocc/RetiJev.
0
cs.AI Yunxiang Luo, Xin Xu, Tianhao Chen et al. · Oct 22, 2026

This paper tackles the challenge of translating natural-language optimization problems into correct, executable solver programs using frozen LLMs. It introduces OptiCycle, a lightweight inference harness that iterates code generation, execution, and repair in a persistent Python state, and OptiState, which adds an explicit five-element revisable formulation. Across nine benchmarks spanning 2,634 problems and 11 Qwen variants, execution-guided revision produces broad accuracy gains and outperforms heavier multi-agent workflows and post-trained specialist models without any parameter updates, though the extra formulation structure helps only some backbones.

Large language models (LLMs) can translate natural-language optimization problems into solver programs, but reliably producing correct formulations and implementations remains challenging. Existing approaches improve optimization modeling through agentic workflows or task-specific post-training. This raises a practical question: can a lightweight harness using a single model role achieve competitive performance without additional training? We introduce OPTICYCLE and OPTISTATE, two lightweight inference harnesses for optimization modeling, and evaluate them on nine benchmarks comprising 2,634 problems using 11 Qwen variants spanning 0.6B-27B parameters. Our results show that execution-guided revision consistently improves macro accuracy over direct generation for all evaluated models, with gains of up to 49.46 percentage points. Despite their simplicity, both harnesses outperform six adapted agentic workflows in same-model comparisons and four evaluated post-trained optimization models at comparable model sizes, without additional training. Explicit formulation state provides further but model-dependent improvements, suggesting that additional structure is not universally beneficial.