Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.AIcs.RO Diyuan Shi, Yiqi Tang, Hongyin Zhang et al. · Oct 14, 2026

Vision-language-action models enable instruction-conditioned robot manipulation, but they typically cannot improve from experience after deployment. This paper proposes VLRLA, a framework that equips frozen VLA models with in-context reinforcement learning by conditioning action generation on a recurrent memory of past observations, actions, rewards, and termination signals. Using algorithm distillation on constructed learning histories, VLRLA aims to gradually improve task success during deployment without updating network parameters.

Vision-language-action (VLA) models connect visual perception and language understanding with robot control, providing a foundation for instruction-conditioned manipulation. However, conventional pretrained VLA policies lack a mechanism for gradual adaptation through accumulated interaction experience during deployment. We therefore propose VLRLA, a general framework that equips existing VLA models with \textit{in-context reinforcement learning} capabilities for deployment-time adaptation. Our approach augments a VLA model with a reinforcement learning module that learns from historical observations, actions, rewards, and termination signals. During deployment, the policy gradually refines its action generation and progressively improves task success while keeping model parameters fixed. Our approach is also designed for general applicability and compatibility with diverse learning history construction strategies and model training pipelines. Finally, through extensive experiments, we systematically investigate the learning properties of VLRLA in simulation and demonstrate its ability to adapt to unseen scenarios during real-world deployment.
0
cs.SEcs.AI Jiahao Zhang, Yifan Zhang, Yu Huang · Oct 14, 2026

Coding agents consume substantial tokens as they repeatedly decide where to look, what to try, and when to stop during automated repair. This paper asks which of these decisions can be offloaded to a cheap probabilistic judge that answers fixed questions without generating explanations. The authors introduce JevCoder, a workflow built around the proprietary Jev judge to recommend initial code snippets, guide action types during repair, and trigger submission. On 400 SWE-bench tasks across three repair models, the system cuts repair-model token use by $21.6\%$–$50.6\%$ while raising observed repair rates.

A coding agent repeatedly makes decisions as it repairs code. These decisions shape repair trajectories and affect the token cost of successive model requests. We ask which repair decisions can be delegated to a low-cost probabilistic judge to reduce token use while maintaining repair quality. The judges answer questions with probabilities over predefined answers, without generating explanations. We evaluate judgment quality across repair stages and test how individual interventions change subsequent repair work. We compare these interventions with unguided repair, which uses no judge, and with the same workflow using the repair model itself as the judge. The benefit depends on the work an intervention changes, rather than the cost of the judgment alone. Based on these studies, we propose JevCoder, a workflow built around Jev, a low-cost probabilistic judge. It combines code-snippet recommendations with action-type guidance and uses judgments to determine when to submit. We evaluate three repair models, each on the same 400 tasks: 200 from SWE-bench Verified and 200 from SWE-Bench Pro Verified. Compared to unguided repair, JevCoder reduces mean repair-model token use by 21.6%-50.6%, with higher observed repair rates across all three models.
0
cs.AIq-bio.QM Ashish Acharya, Aman Al Amin, Hong Qin · Oct 14, 2026

This paper tackles the problem that agentic scientific workflows can finish without crashing yet still emit scientifically invalid results due to silent faults, stale inputs, or contaminated shared ancestors. The core idea is a directed acyclic graph harness that treats trust as a release decision: it enforces mandatory checks, contains failures to affected branches, and uses a fixed risk model plus optional validators to decide whether a deliverable may be released. Language-model agents operate inside this layer, choosing corrective actions and reviewing releases, but cannot override it. On two synthetic workflows with injected faults, the authors decompose which harness component supplies which property, finding that structure, not the LLM, drives reliability.

An agentic scientific workflow can run to completion and still release wrong results: a silent numerical error, a stale input, or a defect in a shared upstream step can contaminate several outputs while a sibling branch stays correct. We treat trust in such results as a release decision. A harness around the workflow's directed acyclic graph (DAG) decides which outputs may be used: it enforces mandatory checks, contains failures to the affected branch, recomputes from tracked versions, adds validators, and releases a result only if a risk model estimates its probability of being invalid as low. Language-model agents work inside the harness, choosing corrective actions and reviewing releases, but cannot override it. On 60 held-out paired instances of two workflows with injected faults, we switched components on and off. Each supplied a different property. Containment and recovery raised the number of correct results. Validation supplied safety: fixed rules without validation released 37 invalid results, while validating every candidate released none. Risk estimation supplied efficiency, matching that safety with 31% fewer validators at somewhat lower yield, although better targeting than random validation was not shown. Lineage evidence helped on one workflow. The language model added no measurable benefit: whether invalid results escaped depended on the harness, not the model. This proof of concept points to a practical path: placing agents inside explicit release-control structure can keep released scientific results trustworthy, and it gives more capable agents a measurable baseline to improve on.
0
cs.AI Xin Li, Liang Hu, Duoqian Miao et al. · Oct 14, 2026

MemCode targets the long-term memory bottleneck in LLM agents by arguing that standard continuous vector retrieval misses logically related but lexically distant facts. It proposes retrieval-oriented atomic memory units (AMUs) and indexes them with a learned discrete codebook via isomorphic semantic quantization (ISQ), enabling dual-path retrieval that combines dense vectors with associative codebook topology. On LongMemEval-S and LoCoMo, it reports the best overall accuracy and a construction runtime roughly $3\sim21\times$ faster than strong baselines.

Long-term memory remains a fundamental bottleneck for large language model (LLM) agents across sessions. Existing systems typically adopt a write-then-retrieve paradigm, storing context-dependent dialogue fragments and retrieving them via nearest-neighbor search in a continuous embedding space. This design yields unstable access units and systematically misses logically related but lexically distant evidence. We propose MemCode, a long-term agent memory framework that couples retrieval-oriented writing with discrete associative retrieval. MemCode rewrites dialogue into self-contained atomic memory units (AMUs), maps AMUs into a learnable codebook with isomorphic semantic quantization (ISQ), and uses codebook co-occurrence topology as a retrieval path complementary to vector search. For long-term memory stores, MemCode separates online atomic writes from asynchronous offline consolidation. On LongMemEval-S and LoCoMo with GPT-4o-mini and Qwen3-30B-A3B-Instruct-2507 backbones, MemCode achieves the best overall accuracy while keeping per-dialogue memory construction within roughly 40~130 seconds, making it 3~21 times faster than LightMem and over an order of magnitude faster than A-MEM and MemoryOS.
0
cs.CLcs.AI Ruilin Shang, Shilong Hou, Zi Long et al. · Oct 14, 2026

Data augmentation for document-level NLP risks breaking inter-sentential coherence and invalidating sentence-aligned labels. This paper proposes an LLM-driven discourse parsing framework that preserves sentence order, count, and rhetorical relations $R_{i,j}$ while replacing key phrases $\mathbf{K}_i$ to generate augmented documents $\mathbf{D}'$. By keeping the $n$-sentence structure fixed, labels such as summary indices or QA spans can be transferred without expensive LLM relabeling.

Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse-level coherence and logical flow, which are essential for complex tasks dependent on inter-sentential relationships. In this paper, we propose a structure-preserving document-level data augmentation framework based on large language models (LLMs) and document-level discourse structure parsing. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined-data training across the evaluated tasks. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation.
0
cs.CLcs.AI Yi Ding, Mengyu Wang, Min Zhou et al. · Oct 14, 2026

Language models frequently derail on multi-step reasoning because a single early error propagates through the rest of the generation. REWIND attacks this by treating token-level entropy as a diagnostic: it traces backward from high-entropy peaks to the sharpest local gradient jumps, uses those positions as cut points for suffix regeneration, and filters proposals with a likelihood-based acceptance rule. The result is a targeted, test-time repair loop that requires no fine-tuning or external verifier and that the authors show improves accuracy across multiple model families and reasoning benchmarks.

An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sampling multiple generations, but their effectiveness can be limited by randomly selecting where to regenerate. On MATH500 with Qwen2.5-Math-7B, we find that incorrect responses have substantially higher mean token entropy than correct responses, with an average within-question relative increase of approximately 112%, suggesting that entropy can signal reasoning errors. Motivated by this finding, we introduce REWIND, a training-free controller that uses entropy dynamics to propose targeted suffix regenerations. Across three model families and five benchmarks, REWIND outperforms all baselines, with gains of 0.51-10.00 percentage points over the strongest baseline. These results demonstrate the effectiveness of targeted, uncertainty-guided trajectory repair across models and tasks. Our code is available at https://anonymous.4open.science/r/rewind-D310.
0
cs.AIcs.CL Rishitosh Kumar Singh, Amir Saeidi, Shamanthak Hegde et al. · Oct 14, 2026

Existing agent benchmarks generally assume cooperative, emotionally stable users, overlooking a major source of real-world failure. This paper introduces τ-Emotion-Bench, a ten-domain benchmark that evaluates tool-calling agents under controlled emotion-conditioned user interactions, together with Tracer, a pipeline that collects training trajectories through an interaction-aware harness where dissatisfied users can terminate inefficient exchanges. It matters because it reveals large reliability gaps in frontier models and shows that small models can be trained to substantially improve interaction consistency with far less data than prior methods.

In long-horizon tool-calling tasks, LLM agents can fail not only because of tool-use errors, but also because of ineffective interaction with users. Yet existing benchmarks largely assume cooperative and behaviorally stable users, leaving the effect of emotional variation on agent reliability underexplored. We introduce $\tau$-Emotion-Bench, a ten-domain benchmark for evaluating tool-calling agents under controlled emotion-conditioned user interactions while preserving the underlying task objective. To scale both benchmark construction and agent training, we introduce Tracer, a scalable agentic data-generation pipeline that constructs grounded, policy-valid tasks and collects trajectories through an interactive agent--user--environment harness. By allowing dissatisfied users to terminate inefficient interactions, the harness provides an interaction-aware signal that filters trajectories with excessive user dependence and favors effective tool use. Experiments with two user simulators show that frontier agents remain unreliable, with substantial gaps between average task success and consistent task completion. Tracer-generated supervision consistently improves Qwen3 models across scales, generalizes to unseen domains, and transfers to $\tau$-Bench and $\tau$-Trait. Behavioral analyses further show that higher task success is associated with a better balance between tool execution and necessary user follow-up. Overall, $\tau$-Emotion-Bench and Tracer provide a scalable framework for evaluating agent reliability under diverse user behaviors and improving tool-calling agents through interaction-aware supervision.
0
cs.AI Shuai Li, Shengyuan Liu, Fan Qi et al. · Oct 14, 2026

PFedMA tackles reliable multi-round collaboration in Federated Multi-Agent Systems by jointly adapting agent selection and heterogeneous privacy rules as reasoning unfolds. Its core idea is a closed-loop orchestration that feeds response reliability and capability signals back into an RL-trained router, while a bidirectional local-global mechanism co-evolves privacy rules without overriding personalized constraints. This matters because existing approaches either select agents without historical accountability or enforce static privacy rules that cannot adapt to changing information needs across rounds, leading to error propagation and rigid privacy-utility trade-offs.

Federated Multi-Agent Systems (FedMAS) offer a promising paradigm for collaborative reasoning among LLM-based agents while keeping raw client data decentralized. However, reliable multi-round collaboration remains challenging. Agent selection must take into consideration evolving task requirements and the agent's historical reliability, while privacy rules must adapt to changing collaboration contexts and meet the client's personalized needs. To address these challenges, we propose PFedMA, a federated multi-agent framework for feedback driven multi-round collaboration under heterogeneous privacy requirements. Across rounds, PFedMA maintains historical capability and reliability states to guide agent selection, evaluates task responses before aggregation, and refines subsequent queries according to accumulated collaboration feedback. PFedMA enables bidirectional local to global and global to local private rule evolution across heterogeneous clients. Clients generalize locally updated privacy rules and selectively incorporate globally maintained rules, thereby facilitating cross-client privacy rule evolution while preserving personalized constraints. Extensive experiments across reasoning, privacy sensitive, and adversarial settings show that PFedMA improves task performance, reduces measured privacy leakage, and improves system robustness.
0
cs.LGcs.AI Aditya Radhakrishnan, Maxwell A. Xu, Wanting Mao et al. · Oct 14, 2026

TEX-MEX attacks the central challenge in time-series contrastive learning: how to define similarity when semantic-preserving augmentations are scarce or unreliable. It unifies structural and temporal similarity by letting the encoder grade windows by cosine similarity, then pulling an anchor toward the time-shifted versions of similar batch windows and pushing it away from those of dissimilar ones. The result is a graded, efficient objective that learns what typically accompanies a physiological pattern in time, and it powers a 560K-parameter PPG foundation model that beats architectures roughly 50× larger.

Contrastive learning for time series depends on deciding which pairs of inputs should be treated as similar and dissimilar. Because few augmentations reliably preserve meaning in time series, prior methods have relied on two disjoint notions of similarity between windows: structural similarity, which relates windows with similar morphology, and temporal similarity, which relates windows that occur close together in time. We introduce TEX-MEX, to our knowledge the first approach to unify the two into a single relationship. Given a random batch of windows drawn across the dataset, TEX-MEX uses the encoder to identify which windows are structurally similar or dissimilar to each other. It then pulls each window toward the temporally shifted versions of similar windows and pushes it away from those of dissimilar ones, learning what typically accompanies similar windows in time. Across PPG, EEG, ECG, accelerometry, and continuous glucose monitoring, TEX-MEX broadly achieves state-of-the-art performance against contrastive, reconstructive, JEPA-based, and modality-specific approaches, establishing it as a strong general SSL objective. We further train a 560K-parameter PPG foundation model that achieves state-of-the-art performance across a broad range of downstream benchmarks while being roughly 50x smaller than the next-best unimodally pretrained PPG foundation model in our evaluation. We will release this foundation model open-source and open-weight to the community to support future work and practical applications.
0
cs.LGcs.AI Armaan Sandhu, Abhijeet Sinha, Dianbo Liu · Oct 14, 2026

Standard expected-reward RL suffers from mode collapse, concentrating probability on a few outcomes even when tasks require many distinct, high-quality solutions. MIPS tackles this by estimating marginal outcome probabilities through a learned trajectory-conditional model, avoiding frequency-based estimation that breaks down when the outcome space is much larger than the rollout group. Using the identity $P_\theta(o) = P_\theta(\tau) / P_\theta(\tau|o)$, it scales rewards by inverse estimated probabilities within a standard GRPO update. On enumerable Hypergrids, molecular synthesis, and phylogenetic inference, MIPS maintains reward-aligned diversity where group-count IPS collapses.

Expected-reward maximization in reinforcement learning concentrates probability mass on a few outcomes, even in tasks that require many distinct, high-quality solutions, a failure known as mode collapse. Inverse Probability Scaling (IPS) counters this in group-based policy gradients such as GRPO by dividing each reward by the outcome's probability, estimated from its frequency within the sampled group. When the outcome space is large relative to the group, outcomes rarely repeat and these estimates become uninformative. Since an outcome can be constructed along many trajectories, its probability is a sum over all of them, and computing it directly is intractable. We propose Marginal IPS (MIPS), which performs marginal evaluation by combining the sampled trajectory with a learned model of the trajectories that lead to each outcome. On Hypergrids, where the exact sampling distribution is computable, MIPS stays near the reward-distribution target as the outcome space grows relative to the rollout group, while frequency-based IPS degrades. In molecular synthesis and phylogenetic inference, MIPS sustains diverse, high-quality sampling where GRPO and frequency-based IPS collapse, showing that MIPS serves as a reliable solution to mode collapse in RL.
0
cs.AIcs.IRcs.MA Tianzhu Hu, Hang Yu, Zeyuan Zhao et al. · Oct 14, 2026

Advertising delivery still relies heavily on manual coordination across budgeting, bidding, and diagnosis, limiting scale and performance. AdCoEvo automates this pipeline by assigning Planner, Optimizer, and Inspector roles to an 8B-parameter language model and updating their LoRA adapters in rotation using settled business feedback, so the agents mutually adapt during continuous simulated delivery. The authors report gains of roughly 14% in advertiser value and 7% lower cost per acquisition over rule-based baselines in the AuctionNet simulator.

Digital advertising is an important means for platforms to reach potential users and drive business growth. Advertising delivery is the core link between marketing objectives and actual returns. Existing methods have achieved partial automation in individual tasks such as bidding and budget allocation, but they still rely on human operators for overall coordination, making it difficult to support large-scale operations. They also often fail to achieve optimal performance, and individual experience remains difficult to turn into reusable operational capabilities. In addition, as advertising markets change, advertising delivery systems need timely strategy updates to remain effective in dynamic markets. To automate the entire advertising operations process and improve adaptability to market changes, we propose AdCoEvo, a co-evolving multi-agent advertising delivery system. Specifically, the system connects delivery decisions across different timescales and operational granularities through role specialization. Diagnostic results guide account planning and strategy adjustment in the next period. The multi-agent system updates its model parameters based on actual delivery outcomes and continually improves delivery strategies through mutual feedback among planning, adjustment, and diagnosis, thereby achieving co-evolution. Experiments show that, relative to the rule-based operational baseline (Rule), AdCoEvo increases advertiser value by 14.02% while reducing cost per acquisition by 7.07%. Compared with a multi-agent system with fixed parameters, AdCoEvo increases advertiser value by 3.96% and reduces cost per acquisition by 1.24%, indicating that co-evolution can yield greater delivery returns.
0
cs.ROcs.AI Yiquan Li, Aidan Bradshaw, Chenfeng Gao et al. · Oct 14, 2026

Wrist-worn IMUs power everything from gesture recognition to clinical motor assessment, yet most prior benchmarks evaluate each task in isolation, leaving unclear whether a single pretrained representation can serve all of them. This paper introduces IMU-Bench, a unified evaluation of ten tasks spanning kinematic estimation, semantic retrieval, activity recognition and Parkinson's assessment, and proposes InrtlWrist, a masked autoencoder pretrained on recorded and simulated wrist motion. The core finding is that pretraining yields broadly useful features—leading on nine of ten frozen-probe tasks—but that supervision from one downstream task rarely helps unrelated ones, distinguishing universal representation quality from task compatibility.

Wrist-worn inertial measurement units (IMUs) provide a common sensing modality for tasks ranging from activity and gesture recognition to pose estimation, inertial odometry and clinical motor assessment. Existing wearable benchmarks evaluate performance across multiple tasks, but leave open how supervision for one task affects transfer to others and whether these tasks benefit from a shared representation. We present IMU-Bench, a benchmark of ten tasks from eight datasets for studying IMU multi-task performance and cross-task transfer. We compare six self-supervised methods pretrained on unlabeled recorded and simulated wrist motion, evaluating classification, pose and velocity estimation, and IMU-language retrieval. We find that our masked autoencoder, InrtlWrist, achieves the best or joint-best frozen-probe performance on nine of ten tasks, and fine-tuning improves on training from scratch on nine of ten tasks, including full-body pose, odometry and retrieval. Across transfer and joint-training experiments, supervision that benefits one target can reduce performance on others, with supervised sources transferring within kinematic estimation while, under frozen probing, none approaches the pretrained encoder on language retrieval, and joint-training gains that come at a cost to the paired task. These findings distinguish broad downstream usefulness from complementary task supervision. Code, task cards and a leaderboard are publicly available.
0
cs.AI Dingyi Rong, Yue Shi, Chaofan Ma et al. · Oct 14, 2026

SERO attacks a core problem in long-horizon agentic RL: outcome-based credit assignment cannot teach behaviors that never appear in the policy's own rollouts. The idea is to restore snapshots of states actually reached by the current policy, let a training-only oracle continue interacting with the real environment, and distill the resulting executable multi-step trajectories into the learner via an auxiliary reachability-weighted loss. This extends the supervision horizon as the policy improves and remains compatible with existing group-based RL algorithms, providing dense grounded guidance without touching the base estimator.

Long-horizon agentic RL is constrained by the futures visited by the current policy. When rollouts fail to reach useful behaviors, improved credit assignment cannot provide supervision for states and actions that were never encountered. On-policy distillation (OPD) introduces teacher guidance on policy-induced states, and recent multi-turn variants improve how this guidance is scheduled, replayed, refined, or validated. However, they do not directly use the oracle-controlled future itself as the training trajectory. We introduce \textbf{State-Rooted Executable Rollout Optimization (SERO)}, which augments on-policy agentic RL with executable oracle continuations. SERO restores a state actually reached by the current policy and lets a training-only oracle continue interacting with the real environment, making the downstream observations and oracle actions themselves available for learning. It then applies \textbf{policy-reachability weighting}, which weights each oracle step by the frozen behavior policy's compatibility with the preceding oracle actions. This allows deeper supervision to become effective as the policy becomes more compatible with the oracle branch. The oracle loss is optimized separately from the base RL estimator and no oracle is used at inference time. We evaluate SERO on two challenging interactive-agent benchmarks, ALFWorld and WebShop, using Qwen2.5-1.5B-Instruct and Qwen2.5-7B-Instruct. On ALFWorld, learning the full executable continuation is substantially more effective than supervising only the root oracle action, while policy-reachability weighting further improves out-of-distribution performance.
0
cs.AI Sarthak Gupta, Priyanka Tembey · Oct 14, 2026

The paper tackles the ambiguity in prompt-injection detection: internal-state probes may detect injection presence rather than actual behavioral compromise. It evaluates five adapted methods on the same structured prompts for two models, stratifying by attack success, and finds that attention- and role-based signals correlate more strongly with successful attacks than presence- or recognition-based probes.

Several recent studies propose detecting prompt injections from a language model's internal state. However, these methods do not measure a single security property. Residual-stream probes, attention scores, role projections, exposure probes, and concept readouts may capture injection presence, recognition, information routing, or behavioral influence. It is therefore unclear what differences in prompt-injection detection performance reveal about the internal signals these methods read. We study how five representation-reading methods vary under a common structured indirect prompt-injection setup on Qwen3.6-35B-A3B and Gemma-4-26B-A4B-it. We evaluate each method by how well it distinguishes injected prompts from benign controls. We then further analyze each detection method's ability to detect attacks in cases where they are successful and in cases where they are not. This helps us better assess what properties each detection method might rely on. Methods trained to detect injection presence or attack-related concepts generally separate unsuccessful injections more strongly from benign inputs, whereas attention diversion, exposure, and role-confusion-based methods separate successful injections more strongly on both models. Attention Tracker provides the strongest consistent successful injection separation, reaching 0.949 AUROC on Qwen and 0.887 on Gemma. These results suggest that signals closer to response formation may better encode information about an attack's success, and that detection performance can depend strongly on the prompt template. We share the data associated with this study at https://anonymous.4open.science/r/paper-evaluation-data-7877
0
cs.AI Tonglong Wei, Zheng Yuan, Lingshuai Lin et al. · Oct 14, 2026

Infectious disease surveillance is hampered by fragmented data sources, uneven evidence availability across regions, and manual processing delays. EpiGuard proposes an autonomous LLM agent that proactively monitors surveillance feeds, dynamically selects forecasting strategies across absent, sparse, and abundant evidence regimes, and accumulates reusable standard operating procedures from successful warnings. The platform promises faster, more reliable early warning for over 50 diseases, but its experimental validation covers only 15 time series and never tests the absent or sparse branches it advertises.

Infectious disease outbreaks often spread rapidly before signs of widespread transmission become apparent, leaving a big challenge for rapid response and effective intervention. However, current infectious-disease early-warning systems face three major challenges: fragmented epidemiological evidence across diverse surveillance sources, highly uneven data availability across diseases and geographic regions, and delayed warning procedure caused by manual data collection, analysis, and reporting. To address these challenges, we present EpiGuard, an autonomous, continually self-improving agentic platform for timely and reliable early warning of more than 50 infectious diseases across different regions. EpiGuard proactively monitors and captures newly released official surveillance records, using the latest available evidence for risk assessments. It dynamically adjusts its analytical strategy across three evidence availability regimes, enabling reliable risk assessment under diverse data conditions, ranging from the absence of historical observations to sparse and abundant evidence. Moreover, EpiGuard learns from the successful execution process by preserving effective data-acquisition and analytical procedures as reusable standard operating procedures, enabling it to progressively generalize to previously unseen diseases and regions. We use officially released infectious-disease surveillance data from the China CDC and the United States CDC to evaluate EpiGuard's effectiveness. Experimental results demonstrate that EpiGuard outperforms state-of-the-art forecasting systems, improving forecasting performance by 9.68% and 14.04% on the China CDC and U.S. CDC datasets, respectively.
0
cs.AI Calder Johnson, Robin Cohen · Oct 14, 2026

Recommendation systems are opaque black boxes that curate feeds for billions of users, raising serious assurance risks. xLightGCN targets the popular LightGCN architecture and turns its linear graph propagation into an exact accounting of which user and item neighbors most influence a prediction. The result is a compact, inspectable subgraph plus a quantitative fidelity score that tells auditors how much of the score that subgraph actually explains—an idea that matters because interpretability alone does not guarantee the explanation covers the model’s reasoning.

Recommendation systems, systems that predict a user's preference for items in order to curate that user's feed, are a ubiquitous and central feature in online social networks. While they are a central piece of our modern digital infrastructure, many modern approaches are opaque black boxes, making them difficult to audit, understand, and assess the trustworthiness of. In this paper we present an exact, graph-based approach for generating explanations for decisions made by recommendation systems. We argue that in the risk-sensitive sociotechnical context of user-facing AI such as recommendation systems, explainability is a key pillar for establishing the trustworthiness of models and validating their effectiveness. We propose a technique built on LightGCN like architectures, an influential and popular class of recommendation models. We describe our approach and argue that it provides an appropriate assurance mechanism for these AI systems leading to specific advantages, including interpretable explanations and a theoretically guaranteed measure of explanation fidelity. We conclude by discussing limitations and directions for future research.
0
cs.AI YingQiao Wang, Eric Bigelow, Tomer Ullman et al. · Oct 14, 2026

This paper tackles physical reasoning in multimodal language models by asking when chain-of-thought (CoT) suffices and when physics-grounded video simulation is necessary. The authors propose Hybrid Simulation and Reasoning (HSR), a small MLP-based router that dynamically assigns questions to either CoT or a video diffusion simulator, aiming to balance accuracy against computational cost. The core claim is that this resource-rational tradeoff improves performance while allowing a 4B-parameter model to control routing for much larger base models like Gemini 3 Pro.

Multimodal language models often need to reason about the physical dynamics of the world in order to answer questions appropriately. Various methods have emerged for solving physical reasoning tasks, and in particular, two leading approaches are Chain-of-Thought reasoning and physics-grounded simulation. However, relatively little is known about which particular problems can be solved by each approach. Some tasks may benefit from computationally expensive generative video simulations, whereas others may be solved equally well (or even better) with language-based reasoning. Our work addresses this by systematically comparing simulation and language reasoning across a variety of multimodal tasks involving physical reasoning, such as answering questions about fluid dynamics and elasticity. We draw a parallel with this to resource-rational theories of human cognition, which propose that people optimally trade off simulation and reasoning depending on task demands. We present a novel cognitively-inspired hybrid model which optimally trades off simulation and reasoning to improve model performance and computational efficiency. Our model is able to decide the appropriate method to solve a physical reasoning problem at test time, and finds an optimal balance between accuracy and cost. Further, our model can be trained on a smaller vision-language model that is only 4B parameters and deployed to improve performance on much bigger base models with $>$3T parameters like Gemini 3 Pro.
0
cs.AI Qianhong Guo, Wei Xie, Xiaofang Cai et al. · Oct 14, 2026

Static benchmarks for LLM agents saturate and face contamination, making it hard to measure true progress over time. EvoProbe tackles this by evolving cybersecurity CTF tasks in a closed loop: generate executable tasks, diagnose solver trajectories with multi-judge scoring and phase-level subtask outcomes, and feed distilled bottlenecks back into task regeneration. Its core premise is that fine-grained diagnostics—not just aggregate pass rates—should dictate what the next benchmark probes.

Static benchmarks for large language model (LLM) agents face saturation and data contamination risks, motivating continual updates to evaluation tasks. However, aggregate scores and success rates offer limited insight into specific problem-solving bottlenecks and provide limited guidance for subsequent task design. We propose EvoProbe, an evaluation-driven benchmark evolution framework that integrates task generation, diagnostic evaluation, and feedback-driven regeneration into a closed loop. It combines verifiable subtask outcome scoring with evidence-supported multi-judge trajectory evaluation and distills phase-level bottlenecks, success patterns, and failure patterns into diagnostic feedback for generating new executable tasks. Across two rounds of cybersecurity experiments, evaluations of eight models on 66 tasks reveal phase-level performance differences and common failure patterns beyond aggregate scores. In a cross-round comparison with the Examiner model set and solver configuration held fixed, all eight models achieve lower Outcome scores on the updated tasks, with relative decreases of 11.8\% in mean Outcome and 40.0\% in mean Pass\textasciicircum{}3. These results support using fine-grained diagnostics to guide iterative task updates and probe agents' current capabilities and limitations.
0
cs.AIcs.CE Lingfei Qian, Yan Wang, Xueqing Peng et al. · Oct 14, 2026

Cross-lingual financial analysis requires models to both recognize shared accounting concepts across languages and exhaustively recover all corresponding numerical facts. This paper introduces MultiFinGround, a benchmark built from real FY2025 ESEF reports in English, French, and Greek, aligned through the IFRS Accounting Taxonomy. The core finding is that strong concept recognition does not imply complete evidence grounding: even top models reach near-perfect recognition accuracy while missing target facts in over a quarter of correctly recognized cases. This matters because benchmarks that only test recognition can obscure critical failures in numerical evidence completeness.

Comparing financial disclosures across languages requires identifying shared accounting concepts and recovering all numerical facts that express them. Existing benchmarks evaluate aspects of these capabilities, but provide limited insight into whether both succeed on the same multilingual evidence. In particular, it remains unclear whether language models can recognize these concepts across languages and exhaustively recover their corresponding numerical evidence from the same contexts. We introduce MULTIFINGROUND, a benchmark designed to investigate this recognition-grounding gap in multilingual financial reports. Constructed from FY2025 disclosures of 90 issuers in English, French, and Greek, MULTIFINGROUND aligns independently authored reports through a shared accounting taxonomy and provides traceable fact-level annotations. The benchmark evaluates financial fact identification, concept recognition, exhaustive fact selection, and concept discrimination without candidate labels. Across 15 evaluated models, eight API and open-weight reference models achieve 97.3-99.4\% concept recognition accuracy, yet miss at least one target fact in 26.6-41.9\% of correctly recognized groups. Further analyses reveal substantial variation in concept discrimination and limited gains from the evaluated finance-specialized models. Our findings demonstrate that strong concept recognition can coexist with incomplete evidence recovery, highlighting the importance of evaluating semantic recognition and evidence completeness together.
0
cs.CLcs.AI Shuyuan Zheng, Yun-seo Lee, Xing Gao et al. · Oct 14, 2026

Legal reasoning is not merely the mechanical application of rules to facts; it is shaped by a judge's underlying legal philosophy. This paper introduces LePhilBench, the first benchmark to test whether LLMs can both understand jurisprudential tendencies and apply them to predict judicial outcomes. It pairs jurisprudential profiling with philosophy-aware judgment prediction and grounds the tasks in a dataset of 220 annotated U.S. Supreme Court opinions, offering a rigorous new lens on models' legal reasoning capabilities.

Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal practice, this reasoning is shaped by legal philosophy: a judge's view of the nature and sources of law guides how legal materials are interpreted and applied, so judges working from the same statutes and precedents can reach different judgments. Existing research has largely overlooked whether LLMs can understand legal philosophy and apply it in legal reasoning, an ability we call \textit{legal-philosophical reasoning}. To fill this gap, we introduce LePhilBench, a benchmark for evaluating the legal-philosophical reasoning of LLMs that comprises two benchmarking tasks and a dataset. The two tasks evaluate how well LLMs understand legal philosophy and how well they apply it in legal reasoning, respectively. The dataset is manually and meticulously constructed. Its test set contains 220 U.S. Supreme Court opinions. A law professor designed fourteen annotation questions on legal philosophy, and three law-trained annotators with formal training in jurisprudence answered all fourteen questions for every opinion, yielding 9,240 legal-philosophical labels. LePhilBench takes the first step toward exploring legal-philosophical reasoning in LLMs.