Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AIcs.LGcs.LO Lu-Chin Chang, Suguman Bansal · Oct 1, 2026

Reinforcement learning for reachability specifications has been limited to model-based methods that explicitly estimate transition probabilities. This paper introduces Quasar, a model-free Q-learning variant that provably converges to optimal reachability policies on MDPs without non-terminal maximal end components, using only $O(|S||A|)$ memory. By replacing the missing discount factor with an intrinsic expected hitting time, the authors obtain a weighted contraction and demonstrate orders-of-magnitude sample improvements over the state of the art.

Reinforcement learning (RL) for reachability specifications is fundamental to sequential decision-making. Prior work establishes asymptotic convergence to optimal policies, but only through model-based methods that must explicitly estimate the transition probabilities of the underlying Markov Decision Process (MDP). We present Quasar, the first model-free algorithm with asymptotic guarantees for reachability on the fragment of MDPs free of non-terminal maximal end components (MECs), a building block to which every MDP reduces by the standard MEC quotient. Our algorithm follows the classical Q-learning approach, using temporal-difference updates to converge to an optimal policy without ever learning the transition probabilities. The resulting learner reduces the memory footprint from the O(|S|^2|A|) that model-based methods require to O(|S||A|). On the standardized Quantitative Verification Benchmark Set, our algorithm converges to the optimal policy with orders of magnitude fewer samples than the previous model-based state-of-the-art. Together these results are a concrete step toward the practical deployment of reachability learning and, with it, of specification-guided RL.
0
cs.CRcs.AIcs.LG Emmanuela Andam, Rana Shaaban, Emanuel Grant et al. · Oct 1, 2026

This paper addresses multi-class ransomware family classification by repurposing the Structured State Space Sequence (S4) model—designed for natural sequences—on static PE metadata. The authors reshape 71 tabular features into pseudo-sequences of length 32 and jointly train for binary detection and family classification, claiming S4 captures long-range dependencies in malware execution flow. They benchmark against CNN, LSTM, GRU, Transformer, and MLP baselines on the Ransomware Dataset 2024, reporting strong aggregate F1-scores. However, the study is limited to a single public dataset and single-run metrics, so its broader validity for IoT security remains unproven.

By 2030, Internet of Things (IoT) devices are projected to reach 40 billion, with fast-paced technological advancements in fields such as industry, healthcare, agriculture, automobiles, and building/home automation systems. This expansion has created a large attack surface for cybercrime, as the majority of these devices open the door for cybercriminals to exploit vulnerabilities, as they lack adequate built-in security. Cybercriminals launch malware attacks to compromise systems or steal sensitive data, and once a system is compromised, a ransom is typically demanded for its release. Current cybersecurity measures in place are being outpaced by the rapid growth of the IoT, which is accompanied by a subsequent growth in malware variants being created per day. Recognizing this pitfall, this research examines and proposes a novel approach to malware detection and classification to safeguard devices from further attacks and make IoT systems more robust and secure. The framework proposed utilizes a Structured State Space Sequence (S4) model, which discretizes sequences of malware samples in a sequence and captures long-range dependencies, essentially identifying the "cause" and "effect" hidden within malware execution flow. This study presents two novel contributions: the first empirical application of the S4 model for malware analysis, and a comprehensive comparison of its performance against other deep learning architectures, laying the stepping stone for future research in this new paradigm.
0
cs.LGcs.AI Loys Masquelier, Etienne Le Naour · Oct 1, 2026

Spatial climate downscaling aims to recover fine-grained meteorological fields from coarse-resolution inputs, but standard pixel-level metrics such as MAE can hide critical failures in variability or spatial structure. This paper benchmarks five downscaling methods—from a residual U-Net to optimal-transport and contrastive-retrieval approaches—using five complementary criteria that disentangle pointwise accuracy, spectral fidelity, spatial alignment, distribution match, and gradient sharpness. The central finding is that no single method dominates across all measures, and method rankings systematically reverse depending on whether the evaluator rewards smooth alignment or realistic fine-scale variability. This motivates the core message: robust climate downscaling assessment must be explicitly multi-metric and application-aware.

Climate downscaling aims to reconstruct fine scale spatial fields from coarse resolution inputs. Evaluating the quality of these reconstructions is challenging: low pointwise error can come at the cost of fine scale variability, while realistic spatial variability can be achieved with inaccurate local structures. The evaluation metric can therefore change which method appears to perform best. This work presents a multi metric benchmark comparing five spatial downscaling methods on ERA5 temperature, wind, and precipitation fields. Five criteria assess complementary properties: pointwise error, structural similarity, distribution error, spectral error, and gradient error. The results reveal a systematic trade off between spatial fidelity and fine scale variability. Some methods perform best on pointwise and spatially aligned metrics, but lose high frequency content, while others preserve substantially more spectral variability at the cost of less accurately positioned local structures. Consequently, method rankings change across metrics and variables. These results show that there is no single best downscaling method. Multi metric evaluation is therefore essential for assessing which properties of a climate field are preserved.
0
cs.LGcs.AI Feiyu Gavin Zhu, Xiaoyu Zhu, Jiqi Yang et al. · Oct 1, 2026

Multimodal search agents traditionally interleave observations, freeform reasoning, and actions, but small models often waste inference budget generating lengthy reasoning traces that provide little actionable guidance. This paper introduces Selection-based Structured Reasoning (SSR), which replaces open-ended reasoning generation with a discrete selection among a small set of reusable natural-language reasoning candidates. By scoring all candidates in parallel via teacher-forced prefill with a shared KV cache, SSR cuts per-turn reasoning latency by over 90% while maintaining competitive task performance across seven benchmarks with 2B and 4B models.

Multimodal agents commonly generate free-form reasoning before each action. For small models, limited model capacity can result in lengthy reasoning that provides little useful guidance for action generation while incurring substantial inference cost. To address this challenge, we introduce Selection-based Structured Reasoning (SSR), a framework that reformulates reasoning as selection instead of open-ended generation. SSR represents recurring high-level reasoning as pre-specified, reusable natural-language candidates. At each turn, the model selects from these reasoning candidates based on their likelihoods given the current context, without requiring an auxiliary task head. Using pre-specified reasoning traces enables parallel scoring, where teacher-forced prefilling computes token likelihoods concurrently within and across candidates using a shared context KV cache. We evaluate SSR on seven multimodal search benchmarks using 2B and 4B models. Across multiple reinforcement learning objectives and supervised fine-tuning, SSR delivers significant efficiency gains without sacrificing task performance. SSR achieves an average success rate competitive with leading search agents of the same scale, while reducing per-turn reasoning latency by over 90% and total per-question model inference latency by 28-54%. Project page: https://zfy0314.github.io/ssr-webpage/.
0
cs.ROcs.AIcs.LG Seungyeon Kim, Junhoo Lee, Baekseung Kim et al. · Oct 1, 2026

World Action Models (WAMs) jointly predict visual futures and robot actions, yet they often hallucinate locally plausible trajectories that never execute the critical state transition needed to finish the task. This paper identifies "task-incomplete imagination" as a failure mode arising from the mismatch between long-horizon video pretraining and short-horizon control generation, and proposes Completion Aware Guidance (CAG), a training-free sampling method that up-weights instruction tokens already attended to by the model. Across two WAM architectures, CAG boosts success rates and cuts incomplete-imagination failures, offering a lightweight inference-time fix for a structural objective mismatch.

World Action Models (WAMs) predict visual futures and robot actions, yet they remain susceptible to task-incomplete imagination, where plausible, action-consistent predictions omit the transition needed for task completion. In this paper, we show that this failure is not inherent to the world model backbone, but emerges when adapted for short-chunk control, which can repeatedly favor plausible local continuations over task-completing transitions. To address this, we introduce Completion Aware Guidance (CAG), a training-free sampling method that guides generation toward task completion. Across representative WAMs, CAG improves success from 64% to 70% on a RoboTwin 2.0 subset and from 69% to 75% in zero-shot simulation, while reducing task-incomplete imagination from 79% to 40%.
0
cs.LGcs.AI David Berghaus · Oct 1, 2026

Instead of hand-designing or training a neural network for time-series anomaly detection, this paper outsources the job to an LLM-driven autonomous research loop. The agent iteratively edits a short NumPy program, scoring candidates against synthetic anomalies in a held-out training slice, until it discovers compact spectral-Gaussian novelty detectors. The resulting univariate and multivariate programs reportedly top the TSB-AD benchmark while running on a single CPU, offering an unusual blend of accuracy, speed, and interpretability.

Time-series anomaly detection trades off predictive accuracy, computational efficiency, and interpretability. We use a large language model not as the detector but as the author of one: an autonomous research loop in which the model repeatedly edits a single short NumPy program under a leakage-free objective, keeping the best-scoring detector it finds. The loop discovers two compact detectors, one for univariate and one for multivariate series, that describe short windows by their local spectral features and compare them with the training-region distribution through a covariance-aware distance. On the TSB-AD benchmark these detectors lead the field across metrics, ahead of the strongest classical, deep, and foundation-model baselines including Time-RCD, yet they train no network and use no GPU, and the multivariate detector is faster than every similarly performing baseline. LLM-driven program search is thus a practical route to accurate, efficient, and transparent detectors.
0
cs.LGcs.AImath.OC Jakob Paul Zimmermann, Moritz Grillo, Andrei Balakin et al. · Oct 1, 2026

Understanding when neural-network loss landscapes contain spurious local minima is a foundational problem in deep learning. This paper studies shallow bias-free ReLU networks in a Gaussian teacher-student setting and proves that a learned linear skip connection eliminates all spurious local minima for planar teacher features with positive output weights once the student is at least as wide as the teacher. In contrast, without the skip, spurious minima can persist at every width—a striking separation between architectural bias and overparameterization.

Understanding loss landscapes is central to explaining neural-network training, yet their structure remains only partially understood even in simple models. We study the Gaussian population loss of shallow, bias-free ReLU networks in the teacher--student setting. This provides a simple model for studying essential aspects such as feature learning and overparameterization. For teacher networks with positive output weights and planar features, we show that including a learned linear skip removes all spurious local minima with non-negative student output weights once the student network is at least as wide as the teacher network. In contrast, without the skip, we construct a fixed teacher network with positive output weights and only three hidden neurons in input dimension two whose spurious local minima persist at every student width at least three. Thus, a learned linear skip can remove spurious minima that persist under arbitrary overparameterization. Furthermore, we show that a positive output weight student network always learns the subspace spanned by the teacher features: student features at local minima with non-negative student output weights lie in the span of the teacher features. For ReLU networks in two dimensions, even heavily overparameterized student networks have effective width controlled by the teacher width: every critical point with positive student output weights has at most twice as many distinct student feature directions as teacher neurons. Finally, we transfer the benignity result to empirical minima over parameter balls of any prescribed radius, with the required sampling accuracy depending on that radius.
0
cs.LGcs.AI Feiyu Gavin Zhu, Qi Xu, Zhifei Deng et al. · Oct 1, 2026

Existing methods for structured imitation learning rely on extensive human input or static LLM knowledge that can conflict with expert demonstrations. This paper proposes a closed-loop framework that treats policy development like software debugging: an LLM writes diagnostic analysis code to test semantic latents from tabular rollouts, identifies structure-demonstration misalignment, and iteratively edits the symbolic policy structure before re-fitting continuous parameters through imitation learning. The work matters because it automates refinement of interpretable policies and shows on two control tasks that it can outperform zero-shot LLM structures while using far less subsequent RL compute.

Structured policies improve efficiency, robustness, and interpretability in imitation learning by introducing task-specific inductive bias, but existing structure generation methods rely either on extensive human input or on static domain knowledge encoded in LLMs, which may be inconsistent with the expert demonstrations. We propose a closed-loop framework that iteratively refines structured policies using LLM-guided analysis of policy rollouts. By logging rollouts as semantically meaningful tabular data and prompting the LLM to generate diagnostic analysis code, our method identifies suboptimalities in the policy structure and iteratively corrects them without requiring human instruction. Experiments on car racing and door opening tasks show that our approach improves imitation learning performance by up to 15% over zero-shot LLM-generated structures and requires 75% less compute to achieve the same reinforcement learning performance. These results demonstrate that tabular rollout analysis provides an effective feedback signal to align LLM-generated policy structures with expert demonstrations, and we can utilize it to generate good policy structures automatically.
0
math.OCcs.AIcs.LG Jinhwan Sul, Alex Oshin, Evangelos A. Theodorou · Oct 1, 2026

Primal-dual hybrid gradient methods can solve large linear programs on GPUs, but their speed depends on delicately coordinated step sizes, restarts, and acceleration heuristics. GALLOP replaces these hand-tuned rules with a reinforcement learning policy that jointly picks continuous parameters and discrete restart decisions inside a generalized PDHG update. The approach is notable because the learned policy is dimension-agnostic and reportedly generalizes from small training instances to LPs hundreds of times larger without retraining.

Primal-dual hybrid gradient (PDHG) methods solve large-scale linear programs (LPs) using GPU-friendly matrix-vector products and projections, but their practical performance depends on coordinating algorithm parameters, acceleration, and restarts. We introduce GALLOP, which uses reinforcement learning to jointly learn continuous algorithm parameters and discrete restart decisions without differentiating through the solver. Its generalized accelerated PDHG update combines separate primal and dual extrapolation, history corrections, and restart anchoring with independently adjustable coefficients. We train a dimension-agnostic feedback policy using a groupwise proximal policy optimization objective that clips likelihood ratios separately for different control groups and excludes inactive acceleration controls on restart transitions. We evaluate GALLOP on six LP families and a public item-placement benchmark. On the main evaluation settings across the six families, GALLOP reduces iteration counts by factors of $1.9$-$5.6$ and achieves up to a $16.0\times$ speedup in algorithm wall-clock time over MPAX. With one policy trained per family, the learned policies generalize without retraining to within-family LPs $3\times$-$400\times$ larger than the largest training instances, including Transport LPs with $10.24$ million variables.
0
cs.AIcs.IRcs.LG Aleksei Medvedev, Alejandro Ariza-Casabona, Steven Derby et al. · Oct 1, 2026

Generative recommenders represent items as short discrete Semantic IDs (SIDs) that are decoded autoregressively, yet most prior work derives these codes by quantising isolated content embeddings. This paper argues that SID construction is fundamentally a recursive clustering problem over a collaborative item graph, and proposes GrIS, a framework that separates graph construction from hierarchical partition to balance semantic and behavioural signals. By exposing these two axes, the authors show that content-only tokenisers are merely empty-graph instances of a broader design space, and they demonstrate new instantiations that improve SID quality for downstream recommendation.

Existing work on Semantic IDs (SIDs) for generative recommendation treats SID construction as a representation learning problem: encode items into a quantised latent space and read off codes. We argue this view is incidental. SID construction is, at heart, a recursive clustering problem, and once stated this way the natural object to cluster is a graph whose nodes carry semantic content and whose edges carry collaborative signal; SID assignment becomes a hierarchical graph partition. This reframing yields a unified framework, Graph-Informed Semantic IDs (GrIS), that subsumes prior approaches rather than displacing them. RQ-VAE and RQ-KMeans are recovered as the special case where the graph is empty, exposing content-only quantisation as one corner of a larger design space along two so-far-collapsed axes: graph construction and recursive partition algorithm. We explore two contrasting instantiations: RecDMoN, which performs hierarchical assignment via differentiable graph pooling, and RQ-GAE, which extends RQ-VAE with graph-aware item representations and a graph reconstruction objective. On multiple real-world datasets, GrIS consistently improves over CF-aware SOTA, with gains of up to +52\% Hit@10. Because graph construction and partition are explicit, separately configurable components, improvements on either axis can be combined and evaluated systematically.
0
cs.LGcs.AIstat.ML Kabir Murjani, Nisarg Patel · Oct 1, 2026

This paper asks whether a fixed offline corpus generated by a behaviour policy can ever distinguish two candidate Regular Decision Processes (RDPs). It proves that when two candidates are $\pi$-observationally equivalent, their posterior odds remain frozen at the prior for any sample size (Theorem 6), gives an exact measure-zero characterization via the product-automaton blame language (Theorem 12), and derives PEC, a linear-time algorithm that certifies equivalence and names the missing experiment. The work matters because existing PAC offline guarantees for RDPs assume a distinguishability condition that was previously impossible to verify.

Non-Markovian environments are often modeled as Regular Decision Processes (RDPs), where dynamics depend on the interaction history through a finite automaton. Existing offline guarantees for RDPs rely on a distinguishability assumption on the behaviour policy but provide no means of verifying it. When the assumption is violated, distinct models may explain the data equally well. We study when data collected under a fixed behaviour policy can distinguish two candidate RDPs. We prove that the posterior odds between observationally equivalent candidates remain equal to the prior odds at every sample size, even when the policy visits every automaton state, and verify both results formally in Lean 4. We then characterize this equivalence exactly and derive PEC, an algorithm that decides it in time linear in the size of the product automaton. The distinguishability assumption of prior work fails on three of our four test environments, and the experiment identified by PEC restores it in each case.
0
cs.MAcs.AIcs.LG Andrea Iannoli, Ivan Zyrianoff, Angelo Trotta et al. · Oct 1, 2026

Unmanned aerial vehicle swarms operating with independent edge-deployed language models face a dual challenge: reasoning context degrades as interaction histories grow, and indiscriminate information sharing wastes limited bandwidth. This paper proposes a distributed architecture in which each UAV maintains structured atomic notes in bounded core, local, and peer-specific memory queues, coupled with a deterministic Interest-Aware Gossip Engine that forwards messages based on semantic novelty and recency. The work matters because it targets the practical gap between centralized LLM coordination, which introduces bottlenecks and single points of failure, and fully decentralized control, which risks context degradation and communication collapse.

Unmanned aerial vehicle (UAV) swarms increasingly rely on language-model agents to provide adaptive mission-level reasoning in uncertain environments. Fully distributed control, in which each UAV hosts an independent Small Language Model (SLM), removes reliance on a centralized coordinator but introduces an information-management problem: long-running interaction histories can degrade the reasoning context, while indiscriminate information dissemination increases communication and inference overhead. We address these challenges with a distributed UAV-agent architecture that enables continuous local SLM control through an event-driven reason-act-observe lifecycle. Runtime knowledge is represented as structured atomic notes and organized into core, local, and peer-specific memory. A deterministic interest-aware gossip engine selectively disseminates these notes according to recipient-specific semantic novelty and recency. We evaluate the architecture using ten UAVs in a simulated search-and-rescue mission. Our approach completes all experimental runs, whereas unrestricted flooding messages completes only 70-85\%, and delegating forwarding decisions to the SLM prevents mission completion in every run. Compared with unrestricted flooding, our approach approximately halves inference-token consumption, reduces transmitted data, and achieves lower survivor-count error.
0
cs.LGcs.AIcs.SD Constance Douwes, Paul Magron, Romain Serizel · Oct 1, 2026

Deep learning audio research hides a massive energy footprint behind the final training run. This paper develops a methodology to estimate the full development-phase cost of audio DL projects by mining job logs from the Grid5000 shared computing platform. By tracing thousands of individual jobs across four representative projects, the authors show that prototyping, debugging, and hyper-parameter search can consume $3 imes$ to $256 imes$ more energy than training the reported best models, calling for systematic lifecycle reporting.

The environmental impact of deep learning has attracted increasing attention over the past decade. Existing studies mainly focus on the energy and carbon emissions of model training and inference, while the whole development phase is often overlooked. Yet, architecture prototyping and intensive experiments are conducted during this stage, which is highly energy-demanding. In this article, we propose a methodology to estimate these costs, based on activity logs from the Grid5000 shared computing platform used by the LORIA laboratory. As a case-study, we focus on audio projects developed in the Multispeech research team. We evaluate the overall energy cost of four projects, and we compare them to those of training the reported models. Our results show that the energy required for the development phase is 3 to 256 times greater than that required to train the best-performing model alone. These results advocate for a more systematic reporting of energy consumption across the entire life cycle of deep learning-based audio projects.
0
cs.CVcs.AIcs.LG Yuzhou Wang, Emile Anand, Ijay Narang · Oct 1, 2026

Hob-VL introduces a diagnostic benchmark for visually grounded Boolean reasoning, asking vision-language models to evaluate ten-literal Boolean combinations over images and to identify objects satisfying Boolean descriptions. The core idea is to pair each expression with a mechanically verified De Morgan equivalent and to test both symbolic and natural-language presentations, isolating compositional reasoning from surface memorization. It matters because real-world visual queries—warehouse checks, agricultural monitoring, medical imaging—depend on reliably combining multiple visual facts under logical constraints.

Reliable visual reasoning requires composing multiple visual observations and returning consistent answers to logically equivalent questions. We introduce Hob-VL, a benchmark for visually grounded Boolean reasoning. Hob-VL comprises two tasks: (1) evaluating whether a Boolean rule holds in an image, and (2) identifying the (unique) object satisfying a Boolean description. Hob-VL contains 6,000 human-verified balanced Yes/No questions, each defined by a Boolean combination of ten visual statements, across 1,000 generated scenes and 46 diverse labeled photographs, along with 1,000 object-identification questions over the same photographs. Our question families are deliberately constructed to challenge reasoning through misleading local cues and nested logical operations, and include symbolic and structured natural-language presentations. Across eight model configurations with thinking disabled or minimized, Boolean accuracy ranges from 48.52% to 50.57%, while the identification accuracy reaches at most 43.0%. A thinking-enabled GLM configuration achieves uneven gains while retaining substantial errors and inconsistencies. Hob-VL exposes these failures through executable reference answers and matched evaluations.
0
cs.LGcs.AI Guy Amit · Oct 1, 2026

Decision models that score a variable-sized set of candidate actions from a serialized sequence are vulnerable to permutation sensitivity because standard causal attention lets later candidates attend to earlier ones and uses absolute positions. The paper proposes candidate-independent block-causal attention (CI), which blocks cross-candidate information flow and resets per-candidate positions so that each candidate is scored based only on the shared prefix and its own tokens. This matters for System 1 components inside generative systems, where runtime-dependent candidate order should not become a latent feature; the authors show that CI cuts flip rates by an order of magnitude across three backbones while preserving competitive accuracy.

Decision models often score a variable-sized set of candidate actions encoded in a single sequence. This setting is increasingly relevant for System 1 components inside generative systems, where candidates may be proposed or ordered differently across runs. Standard causal cross-encoding is expressive, but it can make a candidate's score depend on serialization order rather than on the underlying decision problem. We introduce candidate-independent block-causal attention, which preserves causal computation within the shared context and each candidate while blocking cross-candidate information flow and resetting candidate positions. We compare this architecture with standard causal attention and complementary invariant baselines across Gemma 3 1B, Qwen3 1.7B, and Qwen3 4B backbones. Candidate-independent attention consistently reduces permutation sensitivity while retaining competitive decision quality; ablations indicate that candidate isolation is the primary source of the effect, with position resetting completing the intended symmetry. A larger Qwen3-4B study further examines the behavior of the proposed architecture with substantially more training data. Code is available at the \href{https://github.com/guyAmit/ci-decision-models}{\textcolor{blue}{project repository}}, and the \href{https://huggingface.co/Guy-Amit/qwen3-4b-ci-decision-4096-poc}{\textcolor{blue}{Qwen3-4B model artifact}} is available on Hugging Face.
0
cs.LGcs.AI Alessandro Micheli, Andrea Zerio, Samir Bhatt · Oct 1, 2026

This paper extends one-step generative modeling to finite discrete spaces by replacing Euclidean drift with a discrete Wasserstein gradient flow. Using Maas geometry on a reversible Markov kernel, it defines a relative-KL flow that is realized at the particle level by Markov jumps and amortized into a neural generator. The result is a theoretically grounded analogue of continuous drifting that preserves one-step inference. The work is validated only on a small controlled torus, leaving real-world scalability as open future work.

We introduce a new framework for one-step generative modelling on finite state spaces. To extend drifting beyond continuous domains, we use discrete Wasserstein geometry to define a target-relative KL gradient flow over the transitions of a reversible Markov kernel. We realize this probability flow at the particle level through Markov jumps and amortize the resulting transport updates into a latent-conditioned generator, so that the iterative dynamics are required only during training while inference remains one-step. In a controlled setting where the underlying distributions and transport dynamics can be computed exactly, we verify KL dissipation, consistency between the particle dynamics and the probability flow, and the predicted numerical scaling. We further show that a finite-capacity neural generator can track these exact transport targets while retaining one-step generation. These results validate the basic construction and provide a foundation for scaling Discrete Drifting to structured discrete data.
0
cs.LGcs.AI Samuele Bortolotti, Weixin Chen, Han Zhao et al. · Oct 1, 2026

Neuro-symbolic predictors require hand-crafted logical constraints, which limits adoption by practitioners without formal-methods expertise. This paper asks whether LLMs can translate natural language into propositional constraints that plug into NeSy predictors, and introduces auto-nesy-bench—an 18-task benchmark that measures both formalization fidelity and downstream accuracy. The core finding is that frontier LLMs can generate formulas approaching expert quality, and when the formulas are syntactically valid they often preserve downstream predictor performance, suggesting a plausible path toward making reliable NeSy AI more accessible.

Neuro-Symbolic (NeSy) predictors incorporate prior knowledge into the prediction process of neural networks, ensuring that outputs satisfy specified constraints, making them particularly suitable for high-stakes applications where compliance with domain knowledge is essential. A key bottleneck in this paradigm is the acquisition of symbolic constraints: encoding domain knowledge into logical formulas remains a manual and expert-intensive process. In this work, we investigate the extent to which auto-formalization via LLMs can systematically translate textual knowledge into symbolic knowledge that can be plugged into NeSy predictors. To this end, we introduce auto-nesy-bench, a new benchmark for evaluating constraint formalization and its impact on downstream accuracy of NeSy predictors. Through an extensive evaluation across several domains, we find that LLMs can formalize constraints to a meaningful extent, generating formulas that are often similar to those provided by human experts. Moreover, when the generated formulas are syntactically valid, they can lead to high-quality downstream predictions. The code and benchmark are available at https://unitn-sml.github.io/auto-nesy-bench/.
0
cs.CLcs.AIcs.LG Nagham Omar, Mahmoud Jabarin, Maya Rozenshtein et al. · Oct 1, 2026

Most LLM benchmarks treat generalization as aggregate accuracy on fixed prompts, which can hide per-example fragility when the same user intent is rephrased. This paper reframes generalization as behavioral stability across semantically equivalent input variations and proposes SAGO, a per-prompt, multi-axis framework that tracks changes in generation consistency, internal activations, confidence/uncertainty, and response mirroring. By evaluating eleven open- and closed-source models across six datasets and three variation families, the authors show that instability is heterogeneous, axis-specific, and not resolved by scale, challenging the assumption that high benchmark scores imply reliable generalization.

Generalization in large language models (LLMs) is the ability to produce consistent and semantically stable outputs when the same input is expressed in different ways. Existing work typically evaluates generalization through aggregate accuracy on a single prompt format, task, or set of variations, which conflates robustness with overall benchmark performance. In this work, we show generalization evaluation at the level of individual examples, across multiple input variants, and across different aspects of model behavior, focusing on variability rather than reducing performance to a score that can be improved through narrow training or other ways that obfuscate generalization evaluation. Following this view, we introduce the Stability-Aware Generalization Objective (SAGO), a framework that measures how much model behavior changes for the same input under different variations and benchmarks, capturing variability across several dimensions including generation consistency, internal activations, confidence, and response mirroring. We show that many commonly used models exhibit statistically significant and consistent generalization instability: no model generalizes uniformly, behavioral axes capture independent failure modes, and cross-dataset variation can reverse model rankings.
0
stat.MLcs.AIcs.LG Yujie Zhu, Charles A. Hepburn, Matthew Thorpe et al. · Oct 1, 2026

This survey systematises the sprawling literature at the intersection of optimal transport and reinforcement learning through a four-question taxonomy: what role OT plays, which distributions are compared, which formulation is used, and how temporal structure is handled. By foregrounding the geometry-aware nature of transport-based discrepancies, the authors explain why OT can outperform $f$-divergences when learner and expert distributions overlap weakly—a common scenario in imitation learning, offline RL and robust control. The result is a broad methodological map spanning occupancy matching, trust regions, world-model learning and multi-agent settings.

Reinforcement learning (RL) algorithms frequently compare probability distributions, such as state visitation distributions induced by policies and experts, action distributions from learned policies and offline datasets, or transition distributions from learned models and environments. However, commonly used divergences may become ineffective when these distributions overlap weakly, which is frequently encountered in imitation learning, offline RL, and deployment under distribution shift. Optimal transport (OT) offers an alternative by measuring the cost of \emph{moving} probability mass from one distribution to another under a ground cost that encodes task geometry. This survey covers how OT is used inside RL objectives and algorithms. For each method, we identify: the role OT plays, the distributions compared, the OT formulation used, and the treatment of temporal structure. Beyond categorising existing methods, we discuss the motivations behind different OT choices, practical considerations such as cost design and computational challenges, and highlight open problems including scalable trajectory-level transport, principled handling of mass mismatch, and theoretical analysis for OT-regularised RL.
0
cs.AIcs.CLcs.LG Sidi Chang, Peiying Zhu · Oct 1, 2026

The paper argues that attributing model behavior to synthetic training data requires first recording how each item was generated, because a waveform-label pair alone erases upstream history. The authors introduce a structured provenance substrate that binds scenario seeds, generated content, audio waveforms, fact checklists, quality signals, and review lineage into an immutable manifest. They instantiate this in a five-pass audit of 113 synthetic Japanese care-handoff speech assets totaling 1.552 hours, finding that while versioned, seed-disjoint manifests support some downstream attribution research, exact upstream tracing is blocked by floating generator aliases and missing per-item TTS stamps. The work reframes data attribution as a two-stage problem: establish a typed, versioned generation path $z \longrightarrow x \longrightarrow m \longrightarrow r \longrightarrow b$ before attempting causal or contributive claims.

Attributing model behavior to synthetic training data requires knowing what produced each training item before estimating what that item caused. A waveform-label pair does not preserve this knowledge. We propose a generation-provenance substrate in which a synthetic research object binds source specification, generated content, waveform, target, fact requirements, quality signals, review lineage, and immutable manifest identity. Producer and selection mechanism determine evidentiary meaning; storage location and variable name do not. We audit this substrate in a private Japanese care-handoff pipeline. A 113-asset review population contains 1.552 hours of synthetic speech across six scenario families; all items have linked audio, transcripts, candidate notes, and fact checklists, but human evidence is selective and source-specific. Two faithful-only manifests are scenario-seed-disjoint and immutably versioned, while exact upstream attribution remains blocked by floating generator aliases, missing per-clip TTS and code stamps, and an unversioned checking prompt. We argue that generation provenance is necessary but not sufficient for behavior attribution: it defines the candidate causal graph and audit units, whereas contributive attribution still requires frozen training runs and intervention or influence evidence. The paper contributes a compact provenance contract, an audit protocol, and a bounded case study for synthetic-data attribution; controlled research access may be offered, but we do not claim causal training-data attribution, clinical validity, or unrestricted public release.