Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.CVcs.CL Olga Loginova, Oleksandr Bezrukov, Frank Keller · Oct 22, 2026

Procedural mistake recognition usually gets tangled up in temporal segmentation and low-level vision features. This paper introduces PRISM, a language-grounded framework that maps video steps to text, optionally structures them with semantic roles, and decodes sequences with a lightweight hidden Markov model trained only on correct executions. By assuming benchmark-provided step boundaries, it isolates the core reasoning problem of detecting deviations in step content and order through a unified edit-based taxonomy.

Procedural mistake recognition requires identifying deviations from valid multi-step activities. We study post-completion recognition from videos with benchmark-provided step boundaries. We introduce PRISM (Procedural mistake Recognition via Interpretable Semantic Modeling), which grounds video segments in language and maps their descriptions to procedural states using a lightweight hidden Markov model trained on correct executions. Reference alignment and semantic checks identify errors in step content and order. To support evaluation across heterogeneous benchmarks, we map dataset-specific annotations to four edit-based error types: insertion, deletion, substitution, and transposition. Across three benchmarks, we compare gold and VLM-generated descriptions in raw, semantic-role, and action-object forms. Decoder controls show consistent gains from the trained local decoder over nearest-candidate matching, with additional, dataset-dependent benefits from sequence decoding. Semantic role labeling improves Any-F1 in all six matched grounded comparisons, although the gains vary across datasets and do not translate into uniform improvements under separate configuration selection. These results establish language grounding as an effective interface for explicit procedural mistake reasoning and characterize the contributions of representation and decoding.
0
cs.LG Parnian Fazel, Mohammad M Maheri, Hamed Haddadi · Oct 22, 2026

The paper studies whether facts deleted from knowledge-graph embeddings stay deleted under ordinary continued training. It shows that standard approximate unlearners fail because entity embeddings are shared between forgotten and new facts, and proposes Kernel-Anticipated Unlearning (KAU), which uses the tangent kernel to predict and counteract this relearning inside the forgetting objective. This matters for the right to be forgotten in search, recommendation, and question-answering systems built on evolving knowledge graphs.

Approximate unlearning answers a deletion request on a knowledge-graph embedding by editing entity embeddings instead of retraining from scratch. These embeddings keep being updated as new facts arrive. Under this ordinary continued training, forgotten facts recover more than in the exact-unlearning baseline, a model retrained without them and given the same continued training. We trace this relearning to entity embeddings shared by forgotten and new facts. To our knowledge, this is the first study of relearning in knowledge-graph embeddings. Relearning-robust methods developed for deep networks do not account for the graph structure underlying this recovery. We propose Kernel-Anticipated Unlearning (KAU), which uses the tangent kernel to model how continued training changes forgotten facts' scores through these shared parameters. KAU expresses this first-order response in closed form and differentiates through it inside the forgetting loss. The objective steers edits toward directions that continued training reverses less. We compare KAU with state-of-the-art knowledge-graph unlearners and relearning-robust methods under identical continued training, measuring leakage beyond the exact-unlearning baseline. Across three backbones, KAU reduces the strongest knowledge-graph unlearner's leakage by 46-63% on FB15k-237 and 50-82% on CoDEx-L, at higher retained utility.
0
cs.CV Shiming Chen, Shuhuang Chen, Salman Khan et al. · Oct 22, 2026

The paper tackles Zero-Shot Domain Generalization (ZSDG), where a model must recognize unseen classes in unseen target domains without access to any source-domain images during training. The proposed Domain Prompt Learning (DoP) built on CLIP introduces a two-stage pipeline: Text Domain Learning (TDL) synthesizes diverse style tokens via text-space orthogonality and consistency losses, and Visual Domain Learning (VDL) refines the best-matching token per test image using self-supervised entropy minimization at test time. This matters because it removes the costly and often infeasible requirement to collect and annotate source-domain data, making domain generalization practical for new or scarce classes.

Domain generalization (DG) aims to improve the generalization of the model to any unseen domains. Targeting this goal, existing DG methods mainly focus on learning domain-invariant features or prompts from the given source domains. However, these methods rely on source-domain data, and collecting and annotating large-scale single- or multi-source datasets is often infeasible, limiting the practical applicability of DG. To tackle this challenge, we propose {\underline{Do}}main \underline{P}rompt Learning (DoP), a method built on a large vision-language model (e.g., CLIP) for zero-shot domain generalization, which recognizes unseen classes in unseen target domains without access to source-domain data. DoP essentially learns the target domain knowledge via prompt both in text and visual modalities to overcome the domain shift in text-visual modalities under the test-time adaptation formulation. Specifically, DoP first takes text domain learning (TDL) to simulate various distribution shifts by learning diverse style tokens implicitly in the text space with inter-style diversity loss and intra-style consistency loss. Subsequently, DoP employs visual domain learning (VDL) to further refine the target-domain-relevant style token generated by TDL by making use of the test visual data with self-supervised learning. Extensive experiments on popular DG benchmark datasets (e.g., PACS, VLCS, OfficeHome, and DomainNet) and ImageNet show that our DoP consistently outperforms the state-of-the-art DG approaches. Codes are available at: https://github.com/shiming-chen/DoP.
0
cs.CV Songlin Yang, Zhe Wang, Xiaotong Zhao et al. · Oct 22, 2026

Cinematic video generation demands both inferring plausible action and camera trajectories from sparse text or reference inputs, and independently controlling character, scene, action, and camera factors without unwanted side effects. The authors argue that simply feeding MLLM features into a Video DiT fails because the DiT can bypass those latents via native text-encoder and VAE-reference pathways. Factor-Aware Predictive Learning (FAPL) fixes this with a three-stage curriculum—latent-only grounding, factor-span replacement, and fixed-generator predictive learning—to force the DiT to rely on MLLM representations and, in turn, teach the MLLM to output generation-compatible latents.

Cinematic video generation requires both temporal inference from limited inputs (i.e., sparse rather than frame-by-frame guidance) and factor-aware control of character, scene, action, and camera. Multimodal large language models (MLLMs) offer useful priors for both capabilities, but their representations are not automatically actionable for video generation: a Video Diffusion Transformer (DiT) may bypass them through native conditioning pathways, and using them does not ensure either factor-aware control or generation-compatible temporal prediction. We propose Factor-Aware Predictive Learning (FAPL), which establishes effective MLLM latent use as a shared prerequisite and then targets the two capabilities with complementary learning signals. First, latent-only generator grounding trains the DiT with a frozen MLLM and connector, strengthening the DiT's use of MLLM latents for generation. Second, for factor-aware control, paired videos specify a target-factor change and non-target preservation, and factor-span replacement trains the DiT to realize this relationship in its output. Third, for temporal inference, text-only and text-plus-complete-video observations share a video target, and the trained DiT is then frozen while the MLLM and connector are optimized through it. This final stage trains limited-input representations for generation while retaining complete-observation reconstruction as a complementary training mode. Extensive experiments demonstrate our consistently better performance on three cinematic video generation tasks (i.e., sparse-to-video, factor-aware editing, and multi-shot generation) over baselines and validate FAPL's contributions to MLLM feature use, temporal control, and factor coordination.
0
stat.MLcs.LGstat.AP Ryan Heejoon Byun, Dayeon Yoon, Won Chang · Oct 22, 2026

Standard computer-model calibration focuses on parameter posteriors, not the predictive accuracy of the calibrated simulator. The authors propose a two-layer framework: a flow-matching model amortizes posterior inference, then conformal risk control tunes parameter sets so the simulator pushforward hits a target miscoverage on synthetic calibration data. This targets the quantity that actually matters downstream—predictive coverage—while exploiting amortization to avoid expensive per-observation MCMC. Experiments on synthetic and real epidemiological data show roughly 5× sharper bands than KOH–MCMC with near-nominal coverage.

Computer-model calibration is usually undertaken in service of prediction, yet neither Bayesian Kennedy-O'Hagan (KOH) calibration nor amortized simulation-based inference is built to control the predictive error of the calibrated simulator. When parameters are weakly identified or the data-model discrepancy is misspecified, the simulator-output bands induced by a nominal posterior level can be far from nominal. We propose a two-layer framework that targets predictive miscoverage directly. First, a conditional flow-matching model learns an amortized posterior for the calibration parameters, trained on simulator outputs perturbed with Gaussian-process discrepancies of varying structure. Second, conformal risk control arranges posterior draws for the target observation into nested candidate sets and selects the smallest one whose fixed-rank pointwise bands attain a prescribed time-averaged miscoverage on a synthetic calibration sample. Under exchangeability of calibration and target observations, the bands control expected miscoverage in finite samples. In a synthetic benchmark, the proposed bands are roughly 20% the width of KOH-MCMC bands with miscoverage near the 10% target. In calibrating an age-structured SEIR model to the 2010 Malawi measles outbreak, they are again sharper and near-nominal, and the weeks they fail to cover coincide with the asymmetric epidemic decline, exposing structural inadequacy of the mechanistic model.
0
cs.CL Marek \v{S}uppa, Ivan Vykopal, Jaroslav Kop\v{c}an · Oct 22, 2026

Multilingual web-corpus pipelines such as FineWeb2 apply one recipe across thousands of languages, leaving individual languages’ failure modes unexamined. This paper proposes treating an LLM as a one-time debugger rather than a classifier: a budgeted, tool-using agent explores the Slovak slice of FineWeb2 through a read-only API and compiles each finding into a cheap executable test validated by a native speaker. The work matters because it replaces a linear, manual audit with a reusable test suite that scans 26.5M documents in under a second without a GPU.

Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leaving the failure modes of individual languages unanticipated. We use an LLM once, as a corpus debugger rather than a classifier: a tool-using agent explores the corpus through a read-only, budgeted API and compiles each finding into an executable test, which a native speaker then validates. On the 26.5M-document Slovak portion of FineWeb2, three runs costing \$2.21-\$2.84 each found seven findings over four phenomena. The largest is a machine-generated content farm of 1,408,437 documents (5.32%) that passed the pipeline's filters, 86.6% of it passing even stricter thresholds. Blinded labels support 6 of the 7 findings (defect rates .53-1.00 against .08 in a random control) and do not support one. The compiled suite scans the full corpus in 0.7 s of wall-clock time without a GPU, against \$12k-\$90k per LLM classification pass. The best static sampling baseline validates more selectors than any agent run, at under half the cost. The agent contributes exact prevalence, a precision estimate checked against sampled documents, an account of why the pipeline missed each slice, and a reusable test. We release the framework, Slovak test suite, validation data and agent trajectories.
0
cs.CV Zhaolu Kang, Tailong Luo, Lei Wei et al. · Oct 22, 2026

World models are increasingly used to reduce environment interaction when post-training vision-language-action (VLA) policies, yet they are typically trained to minimize next-frame pixel error rather than to produce useful policy gradients. DRILL introduces a bilevel framework that trains the world model to maximize the policy's downstream return after an imagined GRPO update, instantiated as both a lightweight signed surrogate (DRILL-VWI) and a full meta-gradient method (DRILL-IMG). The work matters because it empirically decouples pixel fidelity from policy utility, showing that a world model with substantially worse pixel MSE can yield far better downstream policies.

World models are increasingly used to reduce environment interaction when post-training vision-language-action (VLA) policies with reinforcement learning. Yet they are typically trained to predict pixels one step ahead, even though their role here is not merely to render visually faithful videos but to produce learning signals from imagined rollouts that improve the policy. We show that this mismatch is substantial: lower pixel MSE can produce worse policy gradients, and a world model trained for policy utility can yield better downstream policies despite 17% higher pixel MSE on the next frame. We propose the Downstream-Return Imagination Learning Loop (DRILL), a bilevel framework that updates the world model to maximize the policy's return after an inner GRPO update on imagined rollouts. DRILL has two instantiations. DRILL-VWI is a closed-form surrogate, requiring no additional simulator rollouts, that reweights prediction errors by policy visitation, the group-relative GRPO advantage, and model confidence. DRILL-IMG is a full meta-gradient method that differentiates through the inner update using truncated Hessian-vector products. We show that DRILL-VWI recovers the local one-step component of the DRILL-IMG meta-gradient under score-compatibility and small-residual assumptions. Across five manipulation simulators and two VLA backbones, DRILL-IMG raises mean success rate by 13.1 points over WMPO and 7.9 points over RLVR-World, and complements RLVR pretraining rather than competing with it. More broadly, we believe video world models for VLA reinforcement learning can be productively trained by the policy gradients they produce, not only by pixel-level prediction.
0
cs.CL Weiran Wang, Wenjuan Qin, Haitao Liu · Oct 22, 2026

Do people who speak different languages organize concepts in similar ways? The authors extract word embeddings from multilingual transformers (mBERT and XLM-R-large) to compare how 196 basic concepts relate to one another across 81 languages. Their core finding is that sociocultural meanings are more aligned across languages than nature and motion meanings, a domain-sensitive pattern that recurs across encoders and concept groupings. The work connects computational linguistics to cognitive science, though its inferences about human conceptual organization remain indirect because they rely entirely on neural network representations rather than behavioral or neural data from speakers.

Do people who speak different languages organize concepts in similar ways? This question lies at the heart of the Sapir--Whorf hypothesis and debates about linguistic relativity. Shared basic meanings, however, need not imply shared relations among them. We compared relations among 196 basic concepts across 81 languages, using word embeddings from two multilingual models to quantify conceptual structure expressed in language. Cross-language correspondence was greater for sociocultural meanings than for meanings concerning nature and motion, a contrast recurring across models and classifications. Within the sociocultural domain, relational differences increased with geographic separation; less closely related languages differed more across all domains. These findings suggest that universality and relativity are interwoven across conceptual domains. They inform an account in which shared cognitive resources interact with linguistic and local experience, and predict greater cross-language correspondence in human semantic judgments for sociocultural than for nature and motion meanings.
0
cs.CL Yiqi Wang, Zizhi Zeng, Jiaqi Zhang et al. · Oct 22, 2026

Persistent web agents improve over repeated tasks only if they know user preferences that history alone cannot reveal. This paper formalizes Active Preference Acquisition (APA), where an agent decides which missing attributes to ask about by estimating their Prospective Personalization Value: the expected cumulative utility gain across future tasks minus asking and privacy costs. The core insight is that many preferences are worth acquiring only when reused across many later tasks, since no single booking or purchase may justify the cost of asking.

Web agents increasingly serve the same user across repeated online tasks such as booking travel, shopping, and scheduling, so their long-term usefulness depends on how well they know the user's preferences. Passive memory and personalization methods cannot obtain preferences the user never reveals, and clarification methods that value a question by its benefit to the current task overlook the benefit of reusing the answer in later tasks. We study Active Preference Acquisition (APA): which missing preferences are worth the cost of asking? We define the Prospective Personalization Value (PPV) of a missing preference as its expected cumulative utility gain over future tasks minus the effort and disclosure-risk cost of asking, and select questions under a per-interaction budget. We characterize when cumulative reuse justifies acquisition despite insufficient single-task benefit, and evaluate this regime with an initial-profile diagnostic. APA computes the counterfactual gain of each candidate preference on public task prototypes with the agent's own task solver and aggregates it by the expected reuse of each task family. We evaluate it on ActiveWebPref, a controlled longitudinal benchmark with hidden but queryable user profiles and exact task utilities. At a horizon of 20 tasks, 34.4% of budget-feasible valuable missing preferences are amortization-dependent; APA acquires 80.3% of them, whereas current-task value of information acquires 5.1%. Under per-user asking-cost caps matched to APA's realized expenditure, APA achieves higher net utility than four heuristic selection baselines. In our cost setting, asking about every unknown preference yields lower net utility than not asking, while APA recovers 84.2% of its utility gain with 27.6% of its questions. The value of acquiring a user preference should account for its reuse across future tasks, not only its benefit to the task at hand.
0
cs.CL Abderrahmane Issam, Irene E. Winther, Stefan L. Frank · Oct 22, 2026

Monolingual language models predict native reading times well but miss how a reader's first language shapes second-language processing. This paper investigates whether bilingual GPT-2 models sequentially trained on an L1 and then English can capture human cross-linguistic influence during L2 reading. The authors evaluate 55 models---monolingual and bilingual with varying steps of L1 exposure---against eye-tracking data from 12 L1 backgrounds, showing that L1-matched bilingual surprisal improves prediction of late-stage reading measures and peaks for intermediate-proficiency learners. The work is significant because it provides a computational bridge between multilingual NLP and psycholinguistic theories of non-native sentence processing.

While monolingual language model (LM) surprisal is widely established as a predictor of reading times, it cannot capture the non-native (L2) reading dynamics that are shaped by the reader's first language (L1). In this work, we investigate whether the cross-lingual transfer within bilingual models aligns with human L1-driven biases during L2 reading. We evaluate bilingual models on eye-tracking data of readers from 12 diverse L1 backgrounds reading English texts. To isolate L1-specific transfer, we compare bilingual models trained on an L1 that matches the readers' L1 background to both a monolingual English baseline and bilingual models trained on other L1s. We demonstrate that matching the readers' L1 improves the prediction of L2 reading times. This predictive advantage is concentrated in late-stage eye-tracking measures, modulated by L1-L2 script overlap, and peaks among intermediate-proficiency readers. These findings provide evidence that bilingual LMs capture aspects of cross-linguistic influence, and that such influence is present in L2 reading behavior.
0
cs.LG Ihsan Ul Haq (1, 2), James Brusey (1) et al. · Oct 22, 2026

The paper tackles occupational activity recognition for construction workers using wearable IMUs. It shows that headline ~99% accuracies on the VTT-ConIoT benchmark collapse to ~77% mean under strict leave-one-subject-out evaluation, with a 27pp per-subject spread. The work systematically maps how sensor placement, window length, classifier choice, augmentation, and personalised calibration affect true subject-independent performance.

Wearable inertial measurement unit (IMU) systems for construction worker human activity recognition (HAR) routinely report aggregate accuracies above 95 %, rarely under genuine subject-independent (leave-one-subject-out (LOSO)) evaluation, masking the per-individual variance that determines real-world deployment performance. Using the VTT-ConIoT benchmark, we conduct, to our knowledge, the first systematic configuration sensitivity analysis of this dataset: six classifiers across five sensor placements and three window sizes under a single LOSO protocol, a personalised-calibration pilot, and a validated comparison of tabular GAN-based and standard time-series augmentation. Per-subject LOSO accuracy for the main multi-sensor, 16-class configuration ranges from 61.9 % to 88.7 % (mean 77.5 %), a 27 pp spread, though all data are laboratory-collected. Multi-sensor fusion and longer windows both improve accuracy; standard augmentation gives small, consistent gains, while Conditional Tabular GAN (CTGAN) augmentation actively harms accuracy with a demonstrated distributional-fidelity mechanism; and personalised calibration recovers 16.8 pp for the weakest participants from just 30 % of their own data. These findings provide evidence-grounded configuration guidance for scaling occupational body sensor networks towards field deployment
0
cs.CVcs.CLcs.IR Yufei Tong, Guanjie Cheng, Tianle Wu et al. · Oct 22, 2026

This survey tackles long-document visual question answering, where answers require locating and integrating evidence scattered across many pages and modalities including charts, tables, and fine-grained layout. Rather than grouping papers by model architecture, the authors decompose the task into four functional components: document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. The core argument is that task bottlenecks—visual fidelity, evidence dispersion, and budget limits—should drive taxonomy design, not just technical novelty. This reframing matters because the field has grown explosively since 2024 and prior surveys have organized literature by approach rather than by the functional requirements that long documents impose.

Visual document understanding is essential for acquiring knowledge from visually rich documents and is attracting growing research interest. Existing surveys emphasize architectures or technical approaches, with limited attention to how task bottlenecks shape technical choices and research priorities. We present a task-centric survey that decomposes long-document visual question answering (VQA) into four components: document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. For each, we develop a fine-grained taxonomy and trace motivations, technical responses, and cross-component connections. We focus on explicit retrieval while covering direct reading. Our temporal analysis traces expanding priorities from multimodal content understanding to sufficient, high-fidelity evidence acquisition and sustained evidence management. We outline future directions in evidence sufficiency, verifiable and correctable understanding, and budget-aware coordination, with an outlook on continual document understanding.
0
cs.LG Zhaoyi Zhou, Frank Wu, Andrea Zanette · Oct 22, 2026

Masked diffusion models freeze tokens once revealed, making decoding errors irreversible and bounding compute by sequence length. This paper reformulates MDM inference as a Markov chain over the clean sequence space via a remask-denoise kernel, derives a KL contraction bound that disentangles timestep schedule from model error, and proposes Random Remask-Denoise (R2D) inference and Trajectory Correction Training (TCT). The result is a reward-free, finetuning-free test-time scaling procedure that reports near-log-linear accuracy gains on hard Sudoku and 3-SAT and modest improvements on a coding benchmark.

Masked diffusion models (MDMs) generate sequences by progressively unmasking tokens, but errors introduced during decoding are typically irreversible. Recent work has shown that iterative correction can improve sample quality, yet existing theory fails to explain this given a learned, imperfect denoiser model. We re-formulate MDM inference as a Markov chain on the clean sequence space, defined by a remask-denoise kernel that randomly re-introduces masks and then denoises. This helps us analyze the actual denoising trajectory towards the data distribution. The analysis motivates Random Remask-Denoise (R$^2$D) inference, a purely test-time, finetuning-free, reward-free procedure. To further improve performance, we propose Trajectory Correction Training (TCT), a denoiser-training procedure that exposes the model to its own errors along the generation trajectory. On logical tasks, our approach exhibits a striking near-log-linear test-time scaling, achieving over 97% accuracy on hard Sudoku puzzles and over 99% accuracy on 3-SAT. Our approach also applies to pretrained models on actual language tasks, beating iterative correction baselines and the official Q-mode accuracy of LLaDA2.1-mini on HumanEval+.
0
cs.CV Mijeong Kim, Suho Park, Junha Park et al. · Oct 22, 2026

AgentDreamer tackles text-controllable physics simulation by replacing ambiguous video diffusion priors with explicit 3D motion plans generated by an off-the-shelf multimodal agent. The agent reasons over scene geometry and text to produce dense parametric trajectories, which guide a differentiable MPM simulator toward physically feasible motion aligned with the instruction. A new metric, Motion-IG, isolates the information that simulated motion contributes to recovering masked text beyond the prompt alone. While the experimental scope is narrow, the framework offers a clean separation between semantic reasoning and physical grounding.

We propose AgentDreamer, an agent-guided optimization framework that aligns text instructions with simulated motion through explicit 3D motion planning. Given a text instruction and scene geometry, an off-the-shelf agent translates the instruction into a structured semantic motion prior, specifying what should move, in which direction, and in what temporal order. The agent represents this prior using parametric functions over a series of temporal chunks, yielding dense 3D trajectories. We then optimize the parameters of a differentiable MPM simulator such that its rollout best matches the prior while remaining constrained by the scene dynamics. This allows the agent to provide semantic guidance from language, while the simulator grounds it in physically feasible motion. We further introduce Motion-IG, an information-theoretic metric for text-motion alignment based on masked text recovery. By comparing the likelihood of recovering masked motion-related content with and without the simulated motion, Motion-IG measures the information contributed by the motion beyond that available from the remaining text and scene context. Experiments show that AgentDreamer improves text alignment over video-based guidance, producing simulations that more closely follow the requested physical behavior.
0
cs.CL Rumei Li, Xunliang Cai · Oct 22, 2026

ReflectPO tackles autonomous error recovery in long-horizon LLM agents, where early execution mistakes compound across sequential tool-use interactions and existing RL methods optimize task outcomes without teaching the policy when and how to self-correct. The core idea is to generate recovery trajectories from rollback snapshots, guided by reflection hints derived from branch differences across rollout trees and repeated loops within trajectories, and then optimize the policy with tree-structured credit assignment that captures both local decision effects and recovery gains. This matters because preliminary evidence shows that errors are nearly ubiquitous in natural trajectories yet agents autonomously recover in fewer than 15% of cases, leaving substantial headroom for training-based correction.

With external tools, large language models (LLMs) can tackle complex tasks through sustained environmental interaction. LLM-based agents are therefore increasingly used to tackle complex long-horizon tasks in real-world environments. However, these tasks involve sequential, interdependent decisions and changes in environmental states. Early execution errors affect subsequent interaction histories and environmental states, and their effects accumulate along the decision chain. To address this challenge, we propose Reflection-Guided Policy Optimization (ReflectPO), a reinforcement learning framework for autonomous error recovery in long-horizon tasks. ReflectPO comprises two core components. The first is Reflection-Guided Sampling. We use branch differences and repeated visits in interaction trajectories to construct hints for error recovery. The second is Tree-Structured Credit Assignment. We organize sampled trajectories into trees and assign action-level credit using parent--child reward differences and recovery gains. Experiments over two long-horizon tool-use benchmarks show that ReflectPO outperforms multiple existing baselines in most domains. It also achieves the best overall performance on average. Further analyses show that ReflectPO effectively improves agents' ability to recognize their own deviations, recover from erroneous states, and continue making progress toward task completion.
0
cs.CL Priyanka, Renaud Delbru, Souhail Bakkali et al. · Oct 22, 2026

Knowledge graph-to-text generation converts structured triples into fluent natural language, yet whether modern prompted LLMs can match task-specific fine-tuned models remains unclear. This paper benchmarks five recent model families—dense, mixture-of-experts, and encoder-decoder architectures—against a fine-tuned T5-large baseline on WebNLG and DART, using eight reference-based metrics together with a graph-grounded LLM judge validated by human annotation. The core finding is that prompted LLMs have nearly closed the gap on traditional metrics while exhibiting stronger faithfulness and fewer omissions on larger graphs, underscoring that surface similarity scores alone are no longer sufficient to assess generation quality.

Knowledge graph-to-text (KG-to-text) generation verbalizes a set of knowledge graph triples into fluent natural language. While fine-tuned encoder-decoder models have long been the standard approach, recent LLMs are becoming increasingly competitive. We benchmark recent LLMs against fine-tuned encoder-decoder models, using reference-based metrics and graph-grounded reference-free LLM-based evaluation validated against human annotations. We observed that recent LLMs substantially narrow, and in several settings close, the gap with fine-tuned models on reference-based metrics, while performing better on graph-grounded metrics. LLM-based evaluation scores show limited correlation with reference-based metrics, suggesting that the two approaches capture different aspects of generation quality. Graph-grounded evaluation reveals that prompted models produce fewer contradictions and triple omissions than fine-tuned models, and these errors increase more rapidly with graph size for fine-tuned models, highlighting differences between the two approaches that reference-based metrics may not fully capture.
0
cs.LG Angela Tang, Vishesh Anand, Gon\c{c}alo Paulo · Oct 22, 2026

Large language models can pick up hidden behavioral preferences—termed subliminal learning—when trained on data generated by other models. This paper investigates whether such transfer occurs in pretrained base models under hard-label and on-policy soft-label distillation, testing across different initializations, data orders, corpora, and architectures. By tracing how the abilities to transmit and receive a trait develop separately during pretraining, the authors challenge the notion that shared model origins are a prerequisite for unwanted preference transfer.

Large language models trained on data generated by other models can sometimes inherit traits unrelated to that data, a phenomenon called subliminal learning. We study both hard label distillation, where students train on numbers generated by a biased teacher, and on-policy soft label distillation, where students generate the data and the teacher's logits provide the learning signal. Using Pythia, PolyPythia, and DataDecide OLMo models, we find that transfer persists in both settings across differences in weight initialization, pretraining data order, pretraining corpus, model size, and architecture. Across pretraining checkpoints, the ability to transmit a preference and the ability to acquire one develop separately: some checkpoints are more effective teachers but weaker students, and vice versa. Consistent with this distinction, cross-model transfer can be strongly asymmetric in magnitude when teacher and student roles are reversed. To investigate what carries the preference signal, we construct synthetic number sequences that match the teacher's generated number frequencies but have no dependence on the prompt or preceding numbers and find that these still induce substantial transfer in the hard-label setting. In top-$K$ soft-label distillation, removing animal tokens from the loss reduces transfer, although not completely in the same-model setting. In our experiments, soft label distillation produces more consistent transfer with less extensive training than hard label distillation. The growing use of on-policy distillation in model post-training makes this a particularly relevant setting for assessing unintended preference transfer.
0
cs.LG Sophia Sklaviadis, Wu Lin, Andre Martins et al. · Oct 22, 2026

The paper attacks a structural restriction in the Bayesian Learning Rule (BLR): its reliance on KL geometry ties it to fixed-support exponential families, ruling out posteriors with adaptive tails or bounded support. The authors show that mixed-space Bregman discrepancies—specifically Fenchel-Young discrepancies—generalize the BLR while preserving its efficient additive canonical-coordinate updates. This matters because it yields a principled framework for scalable variational optimizers, such as $q$-VON, that use heavy-tailed or bounded-support $q$-Gaussian posteriors and can be implemented by modifying only a few constants in existing code.

The Bayesian learning rule (BLR) exploits the relation between Bayesian updating and the Kullback-Leibler divergence (KLD) to derive efficient additive updates for exponential family variational posteriors. The KL geometry is powerful but restrictive: combined with posterior families with parameter-dependent support it can lead to undefined objectives. We ask which non-KL geometries preserve the additive BLR computation. Previous works that use $f$-divergences suggest that this is only possible with the KLD. Here, we show that this is not true. We show that additive information-geometric optimization algorithms can be derived for the class of mixed-space Bregman or Fenchel-Young discrepancies. These discrepancies induce generalized maximum-entropy families, dual coordinates, and generalized-BLR canonical gradient updates, recovering the classical BLR. The generalized BLR leads to new algorithms that \textit{cannot} be derived from the KL-based BLR. For the Tsallis negentropy with quadratic statistics, the generalized BLR yields bounded-support and heavy-tailed $q$-Gaussian posteriors and an easy Newton-like implementation. Experiments up to CIFAR-100 illustrate controllable support and tail behavior and competitive performance.
0
cs.CL Giacomo Gonella, Stefano Menini, Marco Guerini · Oct 22, 2026

Crisis warning generation is currently English-centric, hampering emergency response in linguistically diverse Europe. This paper introduces CrisiLangs, a multilingual dataset extending 1,000 expert-reviewed English event-message pairs into Italian, Bulgarian, German, and Greek via professional native speakers. The authors benchmark the resource by jointly fine-tuning Llama-3.1-8B-Instruct across all five languages, showing gains over zero-shot baselines but also revealing that generation quality and the utility of in-prompt guidelines vary substantially by language.

Communicating with the public during an emergency entails issuing warning messages promptly. In Europe, it often requires producing them in more than one language. Recent work has shown that language models can be trained to generate warning messages as a crisis unfolds, but the available data covers only English. To fill this gap, we present CrisiLangs, a multilingual extension of CrisiText (an English dataset of crisis events paired with warning messages written according to expert communication guidelines) to Italian, Bulgarian, German, and Greek. Expert native speakers translated the warning messages of 1,000 events drawn from 411 scenarios, for a total of 5,000 event-message pairs across five languages. We test the resource to fine-tune a multilingual model on all five languages jointly, with and without the emergency guidelines in the prompt, and compare it with a zero-shot baseline. The fine-tuned models outperform the baseline on ROUGE-L, BLEU and BERTScore in every language and configuration. In a human preference study, low decoding temperatures receive the most preferences in all five languages and in both configurations, while the effect of the guidelines varies by language.
0
cs.CVcs.LG Yudhistira Arditya Pratama, Yi-Zeng Hsieh · Oct 22, 2026

GM-GReFEL attacks two coupled problems in dynamic facial expression recognition (DFER): the quadratic cost of self-attention in long clips and noisy crowdsourced labels. It replaces a spatiotemporal Vision Transformer with a Modulated GroupMamba backbone that scans six channel groups—four spatially and two temporally—at linear cost $\mathcal{O}(N)$, re-mixing them via a Channel Affinity Modulation gate. A geometry-aware reliability module blends the classifier output with trainable facial-landmark anchors, weighted by per-sample normalized entropy, to fall back on anatomy when the prediction is uncertain. The authors report best-fold results within 0.3 points of the top method on DFEW and ahead on MAFW, while openly noting that five-fold means are more mixed.

Recognizing facial expressions in unconstrained video suffers from two coupled problems: self-attention grows quadratically in cost with clip length, and crowdsourced labels are noisy. We present GM-GReFEL, a spatiotemporal state-space network with a geometry-aware decision stage. Its Modulated GroupMamba backbone replaces a spatiotemporal Vision Transformer. Six channel groups are scanned separately, four over the frame plane and two over time, so the cost grows linearly with sequence length ($\mathcal{O}(N)$); after each layer, a Channel Affinity Modulation gate mixes the groups again. On top of the backbone, a GReFEL reliability module turns the normalized entropy of each prediction into a mixing weight between the classifier output and a vote from trainable geometric anchors, so that facial geometry counts for more when the network is unsure. The model is initialized by static-to-dynamic weight transfer and trained with a Triple Loss. In five-fold cross-validation, the best fold scores 66.57\%/76.46\% UAR/WAR on DFEW, 0.3 points or less below the strongest compared method, and 45.66\%/62.27\% on MAFW, ahead of all compared methods; on FERV39k the mean over five splits, 42.30\%/52.66\%, is competitive. The five-fold means are 64.07\%/74.54\% on DFEW, on par with recent large pre-trained models, and 38.90\%/54.37\% on MAFW, below the best of them. A paired $t$-test on DFEW indicates a modest benefit of temporal modeling (+1.61 UAR points, one-sided $p=0.031$). Attention stays on plausible facial regions, and latency is close to a ViT-B/16 baseline (47.4 vs.\ 46.8 ms per clip). Code: https://github.com/ardiytama/GroupMamba-DFER.