Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
698 papers in cs.AI
Trending mixes fresh papers with community signal.
0
cs.AIcs.CL Wenjie Zhang, Zhichao Shi, Xuhui Jiang et al. · Oct 22, 2026

ColaBench tackles the problem of evaluating how personal agents use long-term interaction history to guide the acquisition and application of external knowledge. The core idea is a traceable benchmark built on an Evidence Graph $\mathcal{G}=(V,E)$ that links personal facts to their disclosures and to supporting documents, paired with MemKB, a retrieval method that connects state summaries and memory-document links. This matters because current benchmarks test memory recall and retrieval in isolation, leaving open whether agents can jointly recover historical conditions and apply newly retrieved rules to a specific user's situation.

Personal agents need to draw on long-term interaction history to retrieve and apply external knowledge suited to a user's current request. Even an answer grounded in relevant documents can be unsuitable when it overlooks the user's circumstances. This creates two connected challenges: using historical conditions to identify the knowledge needed for a new request, and applying that knowledge to the user's situation. Existing benchmarks advance memory recall, personalized retrieval, and memory-guided action, while the joint evaluation of these two challenges remains underexplored. We introduce ColaBench, a synthetic benchmark in health and daily living, with 349 tasks across 10 Profiles and a knowledge base of 13,033 documents. Its Evidence Graph connects personal conditions to their disclosures across public interaction sessions, records prior document exposure, and links answer requirements to personal and newly acquired document evidence. We also introduce MemKB, which uses state summaries to inform queries and rule application, and memory-document links to retrieve knowledge associated with the user's history. MemKB achieves 86.25% Accuracy with an average of 4.07 interaction rounds per task. Task-level analysis finds larger gains on tasks integrating information across multiple historical Facts; error analysis further identifies unsupported personal assumptions and rule misapplication as obstacles to using retrieved evidence. ColaBench provides traceable tasks and an evaluation framework for studying how memory guides knowledge acquisition and rule application.
0
cs.CLcs.AIcs.LG Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov et al. · Oct 22, 2026

Document-level LoRA adapters are pitched as modular knowledge units for retrieval and merging, yet standard open-book evaluation cannot tell whether an adapter has memorized a document or merely learned to read it well. This paper introduces a cloze probe that withholds the source text and finds that open-book scores are almost entirely generic reading behavior: a random adapter recovers 82% of a specialist's open-book advantage but only 2% of its cloze gain. The findings argue that adapter-bank evaluation needs a closed-book probe alongside open-book scores, and the authors' candid disclosure of four silent errors is a model of experimental hygiene.

Single-document LoRA adapters have been proposed as units of knowledge to be merged and retrieved; yet open-book scoring, with the document in the prompt, can credit a document's own adapter (its specialist) for reading that document as readily as for holding it. Training one adapter for each of 150 Wikipedia articles on Llama-3.1-8B-Instruct, we find that open-book scores mostly measure a reading behaviour every adapter shares: a random adapter trained on another document recovers 82 % of the specialist's open-book advantage over the base model but only 2 % of its advantage on a cloze probe that asks for the same document's facts without providing the source text, a share we cannot distinguish from zero. Content does reach the weights, since the specialists beat the base model in cloze recall by 0.094, and the geometry of their updates follows the documents they read; yet, in a test of 30 queries, adapters chosen by weight-space proximity or text embedding are not distinguishable from random ones on either probe, although that test cannot exclude an advantage of about four fifths of what a query's own adapter gains over a random one. At 16 documents or more, correctly scaled merges recover 87 % to 89 % of the specialists' open-book advantage but only 12 % to 16 % of their cloze advantage, with intervals that run from below zero to at most 32 %, against 94 % for joint training.We also report four silent errors, each of which produced a clean, wrong result.
0
cs.ROcs.AI Miguel Sousa, Luis Ramos Pinto, Jo\~ao P. Matos-Carvalho · Oct 22, 2026

Natural-language robot control requires mapping user requests to predefined tool subsets without inventing new capabilities. This paper frames tool routing as bounded multi-label selection over a fixed catalog and compares three ChromaDB retrieval policies against a cloud-hosted 120-billion-parameter LLM. The core finding is a clean quality-latency trade-off: clause-aware retrieval (CDBv3) runs locally in milliseconds but lags the LLM in routing accuracy, making it suitable for connectivity-constrained or privacy-sensitive deployments.

Natural-language interfaces allow users to command robotic systems without interacting directly with mission planners or robotics middleware. Their reliable use depends on robot tool routing, defined here as the selection of the smallest complete subset of predefined executable capabilities required to satisfy a request. This task is particularly difficult for compound instructions, where incomplete selection may omit necessary sensing or monitoring capabilities, while excessive selection may expose irrelevant tools. We compare four routing strategies: three progressively refined ChromaDB-based methods - fixed-threshold retrieval, relative-distance retrieval, and clause-aware aggregated retrieval - and a cloud-hosted 120-billion-parameter language-model baseline. The methods are evaluated on 164 manually annotated prompts organised into three complexity levels, from direct single-tool requests to compound requests requiring at least three tools. Using exact-match accuracy, completeness, precision, a completeness-weighted composite score, and routing latency, CDB-v3 achieves the best macro-average score among the retrieval-only methods, with 0.7822, compared with 0.8869 for the large-model baseline. Although the LLM provides higher routing quality, CDB-v3 exhibits substantially lower latency and can be deployed locally without requiring cloud connectivity. These results identify a quality-latency trade-off between direct large-model selection and clause-aware semantic retrieval for privacy-sensitive, connectivity-constrained, and resource-constrained robotic systems.
0
cs.AI Valentino Maiorca · Oct 22, 2026

Neural networks trained independently on similar tasks often learn compatible semantic structure but express it through incompatible coordinate systems. This doctoral thesis proposes that semantic correspondence—identifying which elements refer to the same meaning across systems—is a fundamental primitive for revealing shared intrinsic geometry. It unifies fourteen methods spanning vision, language, reinforcement learning, and neuroscience under a single framework, distinguishing correspondence-parallel operators (independent semantic projections) from correspondence-coupled operators (direct cross-model maps). The work enables zero-shot transformation and model stitching without joint training, yet explicitly disclaims formal theoretical guarantees, positioning itself as a systematic empirical demonstration.

Just as different languages express the same concept through different words, neural networks express similar functions through incompatible coordinate systems. Different architectures, random initializations, and optimization trajectories produce incompatible parameterizations in extrinsic coordinates, obscuring functional relationships between independently trained models. When models independently solve similar tasks on related data, do their learned representations share exploitable structure despite incompatible coordinates? This thesis shows that semantic correspondence is a fundamental primitive revealing shared geometric structure beneath incompatible parameterizations. By identifying which elements refer to the same semantic content, correspondence breaks the symmetry of arbitrary implementation choices, anchoring incompatible systems to a shared semantic frame and revealing the intrinsic geometry that enables zero-shot transformation between independently trained models. Building on this principle, fourteen contributions explore correspondence-based alignment across zero-shot model stitching, cross-modal translation, policy transfer, activation steering, and neural decoding. They span domains (vision, language, reinforcement learning, neuroscience), architectures (CNNs, Transformers, graph networks), and scales (from small supervised models to billion-parameter generative systems). Each exploits different geometric properties (angular, metric, spectral, sparse, or distributional), yet all instantiate the same principle. It extends beyond artificial systems: fMRI data show that different human brains processing identical stimuli exhibit alignable geometric structure. By revealing intrinsic geometric structure beneath extrinsic parameterization, semantic correspondence transforms model isolation into interoperability.
0
cs.ROcs.AI Keshu Wu, Hao Zhang, Rui Gan et al. · Oct 22, 2026

LAST-V2X addresses the problem of testing how delayed, missing, or corrupted V2X messages compromise safety-critical driving decisions. Its core idea is a framework that translates natural-language test descriptions into executable CARLA scenarios, then causally verifies whether any observed violations are actually due to degraded communication rather than ordinary traffic risk. This matters because existing adversarial methods perturb only the physical world, whereas V2X failures propagate from the information layer and must be isolated through paired counterfactual execution.

Vehicle-to-everything (V2X) communication enables connected vehicles to make safety-critical decisions, but delayed, missing, or incorrect information can compromise driving safety. Systematically testing such failures is challenging because traffic interactions, communication conditions, and application responses must be jointly configured to produce meaningful scenarios. This paper presents LAST-V2X, a language-driven, adaptive framework for automated scenario synthesis and safety testing of V2X applications. LAST-V2X leverages large language models (LLMs) to translate natural-language test descriptions into executable scenarios grounded in roadway geometry, V2X communication semantics, and vehicle behavior. The framework integrates physical traffic simulation with spatially aware communication modeling and message-level fault injection to evaluate how information degradation affects vehicle decisions. To establish whether an observed safety failure is caused by communication rather than the underlying traffic conditions, LAST-V2X employs matched executions under degraded and ground-truth information. Furthermore, an execution-guided refinement mechanism combines parameter search and LLM self-reflection to identify ineffective test configurations, improve scenario effectiveness, and produce minimal reproducible failure cases. Experiments across diverse CARLA environments and V2X safety applications demonstrate the framework's ability to generate reliable scenarios, distinguish communication-induced failures from unrelated safety violations, and substantially improve failure discovery through adaptive refinement. These results establish LAST-V2X as a systematic approach to language-driven, causally verified, and adaptive safety testing for connected vehicle systems.
0
cs.AI Jianghan Zhu, Jianan Zhou, Fei Liu et al. · Oct 22, 2026

PRS tackles automatic heuristic design by making diversification an explicit generation-level operation rather than an emergent property of population management. The framework factorizes heuristic transformation into three semantic directions—expansion, compression, and steering—and rewrites perturbed ideas into executable code via LLMs within a breadth-first search with adaptive operator control. This matters because existing evolutionary frameworks mutate code without directly controlling the semantic trajectory of change, which often leads to premature convergence.

Large language models (LLMs) have demonstrated strong potential to automate heuristic design for NP-hard combinatorial optimization (CO) tasks without human intervention. Recent methods predominantly rely on evolutionary computation (EC) frameworks, where heuristic diversification is mainly induced through EC-like operators or downstream selection, while the direction of heuristic transformation remains largely unharnessed. In this paper, we propose a multi-directional Perturbation-Rewrite Search (PRS) framework for automatic heuristic design that factorizes heuristic transformation through directional search primitives at the generation level. Specifically, PRS operates on heuristic ideas through three complementary directions: expansion toward richer and more expressive designs, compression toward simpler and less specialized designs, and steering for fine-grained refinement, together enabling broader and more sustained exploration of diverse regions in the heuristic design space. PRS further organizes candidate exploration within a breadth-first search-based process with adaptive operator control, which ensures thorough candidate utilization and sustained exploration, and maintains strong search dynamics while preventing premature convergence. Extensive empirical results across diverse CO tasks show that PRS consistently discovers high-quality heuristics, demonstrating the effectiveness and generality of explicitly directional exploration design.
0
cs.AI Mohammad Talaei, Mohammad Goudarzi, Maille Todd et al. · Oct 22, 2026

This paper addresses the cold-start forecasting problem for land-restoration sites, where physical models need site-specific hydraulic parameters and traditional data-driven models require months of per-site training data. The core idea is to evaluate TimesFM, a 500M-parameter time-series foundation model, in strict zero-shot mode on 15-minute in-situ telemetry from 27 soil-moisture and temperature sensors across three management regimes. The work matters because it systematically maps where zero-shot foundation models win and lose against classical and tree-based baselines, and quantifies the inference cost on commodity CPU hardware for operational deployment.

Soil moisture and temperature govern plant-water availability and microbial activity, making them key indicators for evaluating land-restoration efforts on degraded landscapes. However, the physical and data-driven models normally used to forecast them both need information that a newly instrumented restoration site does not yet have: hydraulic parameters for the former and months of per-site training data for the latter. We evaluate TimesFM 1, a 500M-parameter time-series foundation model, zero-shot on 15-minute telemetry from 27 sensor stations across three land-management regimes (Control, Treatment, Scald) at a semi-arid restoration site, forecasting 5 cm and 30 cm soil moisture and enclosure temperature at seven lead times from 1 h to 168 h. Using gap-aware rolling-origin evaluation across sensors, we find that TimesFM beats the best rule-based statistical forecasting baselines (persistence, seasonal-naive, or 7-day climatology) by 21-76% at sub-daily lead times but loses by 6-79% beyond a day, a pattern explained by a diurnal-alignment mechanism that holds for both soil-moisture depths and temperature. A CatBoost baseline trained walk-forward on the same origins with full history and weather covariates never wins overall, and we show that its weakness is partly a cold-start effect specific to short deployments. We additionally quantify the inference cost of zero-shot forecasting on commodity CPU hardware. Our results highlight a practical trade-off between zero-shot forecasting capability, predictive performance, and computational efficiency.
0
cs.AI Gabriel Manalu, Saad Wazir, Thao Do et al. · Oct 22, 2026

Autonomous driving vision–language–action (VLA) models promise explainable decisions by generating natural-language reasoning before predicting trajectories. This paper subjects that promise to a rigorous causal test via counterfactual interventions: the authors perturb model-generated reasoning text and photorealistically remove visual objects that the reasoning cites, measuring whether trajectories actually track these changes. Their findings across four state-of-the-art models indicate that the stated reasoning is weakly coupled to the resulting driving actions, raising serious concerns about the reliability of such explanations in safety-critical deployment.

Driving vision-language-action (VLA) models bring an appealing form of explainability to a safety-critical domain, since a system that can state the reasons for its maneuvers offers the transparency that deployment and public trust in autonomous driving demand. These models read the world into language before they act on it, describing the scene and reasoning over it in text that ranges from chain-of-thought to multi-stage question answering on the way to a trajectory. That framing quietly assumes two separable properties, namely that the trajectory follows the generated reasoning and that the generated reasoning tracks the causes that actually produce the trajectory. To thoroughly investigate these properties, we apply causal, counterfactual interventions to four driving VLAs across different benchmarks. First, we perturb the models' own reasoning and show that altering its meaning produces small trajectory changes relative to blanking the same models' camera inputs, a pattern that persists across benchmarks and model architectures. We then construct scene-level counterfactuals through photorealistic removal of key objects named in the models' reasoning and analyze whether the generated reasoning and trajectories track these changes. Overall, our findings indicate that the reasoning these models present to account for their resulting driving behavior is weakly coupled to that behavior itself, pointing to limits on the explainability these systems are intended to provide.
0
cs.SEcs.AI Abhijit Chakraborty · Oct 22, 2026

When agents share a tool catalog and pool their usage experience, adding that usage to the retrieval index boosts tools with usage but can push unused tools out of the top results. This paper shows that folding usage examples into the index severely lowers held-out Hit@5 on two of three catalogs, and proposes Synapse, which scores documentation and usage as separate z-normalized fields before combining them with a learned weight. The finding matters because multi-agent systems risk silently failing on rarely-used tools unless the combination rule explicitly protects them.

Agents that call tools from a shared catalog can pool what they learn about which tool serves which request. We measure what pooled usage examples do to tool retrieval, reporting separately the held-out tools, for which no agent has usage, and all other tools. Adding usage examples to the index as extra entries for used tools raises Hit@5 (whether a gold tool is in the top five) for those tools and lowers it for held-out tools, by a large margin on two of three catalogs and with both embedders we tested. Giving used tools the same number of equally long entries filled with other tools' text lowers held-out Hit@5 about as much, but gives little or none of the gain. We call our method of scoring usage as its own field SYNAPSE. On StableToolBench, the held-out gold tool appears in its top five more often than with a router that reserves slots for usage (0.785 against 0.683), and this held-out lead holds on all three catalogs with both embedders. This protection persisted when we replaced each tool's usage with other tools' text, and a constant score offset for tools with usage gives similar held-out Hit@5 in most settings. The gain for tools with usage, in contrast, needs usage about the right tool. The router keeps more of the gain on labeled queries on TOUCAN with both embedders and on ToolRet with one, so the better choice depends on the workload. Splitting the usage among ten simulated agents shows that pooling helps exactly as much as giving one agent the same records.
0
cs.AI Qiuyu Kong, Zanxi Ruan, Marco Cristani et al. · Oct 22, 2026

Long-text image-text alignment underpins fine-grained scene understanding, yet existing models suffer from saliency collapse: they over-rely on visually prominent text while neglecting informative non-salient context. This paper proposes RoSA, a finetuning framework that decomposes image-text pairs into complementary salient and contextual views and enforces auxiliary contrastive objectives over both. By treating saliency as a multimodal training prior with no inference overhead, RoSA improves retrieval robustness when salient cues are weakened or removed.

Long-text image-text alignment is essential for fine-grained scene understanding, yet existing methods mainly focus on extending context length or improving local alignment. We identify an overlooked failure mode, saliency collapse, where models over-rely on text that features visual prominence while underutilizing non-salient context. Consequently, retrieval performance degrades sharply when salient content is reduced, despite that the non-salient context remains informative. To address this, we propose RoSA, a saliency-aware finetuning framework that decomposes image-text pairs into complementary salient and contextual views, enabling joint learning of prominent and contextual semantics. We propose a modality-independent decomposition strategy to combine object-level visual saliency estimation with LLM-based text decomposition to bridge vision and language. We employ auxiliary objectives to explicitly align these views, ensuring robust representation with both salient and contextual features. RoSA greatly improves long-text retrieval and demonstrates strong robustness to saliency collapse across benchmarks. Moreover, our auxiliary objectives are plug-and-play, bringing consistent gains to existing tuning methods. Code and checkpoints are available at: https://github.com/intelligolabs/RoSA
0
cs.AI Shidong Cao, Jing Ma, Wenhao Chai et al. · Oct 22, 2026

Diffusion language models decode many tokens in parallel, making schema enforcement harder than in autoregressive models: two locally valid tokens can be jointly incompatible. DConstrain compiles schemas into context-parameterized transition programs that precompute local grammar steps while leaving the runtime stack and field history as unbound parameters, resolving them only during warm compilation. This factorization avoids the exponential blow-up that forces prior exact decoders to fix property order, yielding large gains in compilation coverage, decoding latency, and task accuracy.

Diffusion language models (DLMs) decode multiple tokens in parallel, so individually valid tokens can be incompatible together under a schema. Exact joint inference over a grammar graph enforces compatibility, but it requires token-labeled successors across many hypothetical parser configurations. Encoding stacks and field histories in compiled states can cause exponential growth, which forces prior exact decoders to fix property orders and exclude valid outputs. We present DConstrain, which compiles schemas into context-parameterized transition programs. Cold compilation specializes token consumption to local grammar states while retaining context-dependent stack operations, environment guards, and caller-dependent deferred parsing symbolically. Tracking field histories as runtime values supports arbitrary property order without enumerating field subsets offline. At runtime, warm compilation binds reached configurations to these programs to construct exact successors, overlapping with the model forward pass because graph construction requires no model scores. Furthermore, token-effect grouping merges tokens with identical compiled effects before runtime contexts are bound, so groups are reused across stacks and environments even when concrete successors differ. Objective-specific score aggregation and token restoration provably preserve both the Viterbi optimum and the token-labeled path distribution of ungrouped inference. Across three benchmarks and two DLM families, DConstrain compiles 100% of BFCL schemas under arbitrary property orders, whereas an optimized finite-state baseline compiles only 71.30-85.81%. Under arbitrary property order, it reduces BFCL end-to-end decoding latency by 6.65-46.26 times with 100% schema validity and raises DiffusionGemma's BFCL accuracy from 37.27% under fixed order to 81.56%.
0
cs.LGcs.AI Hyunwoo Yu, Jongbeom Lee, Hyunbin Kim et al. · Oct 22, 2026

Sparse attention must approximate the long tail of unseen KV-cache tokens, yet discarding it biases the output and random sampling misses heavy hitters at extreme sparsity. OpenAttention folds the tail into a few count-aware mean proxies discovered via query-geometry clustering, achieving 99% of dense accuracy while reading only 1% of the cache. The accompanying Triton kernel delivers a 10× speedup in the decode attention stage, making ultra-low-density attention practical for long-context inference.

Sparse attention reads only a small subset of the key-value cache, and how to treat the unread tail remains a key challenge. Discarding the tail biases the output, and sampling it as previous approaches do fails at reads of 5% and below, where the tail likely holds heavy hitters the selector missed. Our key observation is that the simplest possible proxy, one token that folds the entire tail into its count-aware mean, already yields lower output error than a sample at every read behind a practical selector. We further show in closed form that at low reads sampling nearly doubles the weight error of discarding while a single proxy stays below it. Building on these findings, we explore approximating the dense attention distribution with a few proxies that target the tail. We propose OpenAttention, a pipeline of clustering, ErrorGate and top-k selection followed by a count-aware mean proxy. To implement clustering and selection both efficiently and effectively, we design training-free Query-Geometry Clustering (QGC) and a Query-Geometry Selector (QGS), which compress the keys while respecting the query directions. Additionally, unlike prior methods that rank clusters by centroid alone, ErrorGate allocates the exact read by the estimated weight error of each cluster. On RULER-32K HARD with Llama-3.1-8B, OpenAttention retains 99% of dense accuracy at a 1% read. It also achieves state-of-the-art accuracy across models, context lengths and datasets. Our customized attention kernel, OpenAttention.flash, runs the decode attention stage 10$\times$ faster than dense attention at a 1% read.
0
cs.CLcs.AI Bo Liu, Lianyu Wang, Meng Wang et al. · Oct 22, 2026

RetiJev tackles the latency, cost, and privacy barriers of autoregressive LLMs in point-of-care ophthalmic decision support. The authors introduce RetiJev-Data, a 128k-question source-grounded corpus, and a family of 0.8B–9B compact models that score predefined candidate answers in a single pass instead of generating free-form text. This yields sub-200 ms inference per case on one GPU while reportedly surpassing a 27B LLM and a commercial decision model on guideline grading and clinical-action accuracy.

Ophthalmic clinical decision support requires fast, accurate, and privacy-preserving inference, yet autoregressive large language models (LLMs) incur substantial latency and computational overhead for decisions among predefined actions. We therefore investigate a decision-oriented alternative to generative reasoning. Specifically, we first introduce RetiJev-Data, a source-grounded ophthalmology corpus comprising 78,158 clinical-decision and diagnosis questions derived from articles in PubMed Central and a MeSH vocabulary covering 531 eye diseases, and 50,074 guideline-grading questions spanning 11 grading systems, along with a 24,662-question evaluation benchmark. Based on this, we develop RetiJev, a family of 0.8B-9B decision models that directly score candidate answers without autoregressive decoding. Across all model sizes, RetiJev outperforms both a 27B LLM and the commercial Jev 1.13 decision model on guideline grading by 10.4-23.0 points. RetiJev-9B further achieves the highest accuracy on clinical decisions, improving over both baselines by 5.4-6.5 points while matching them on diagnosis. It answers a case in 158 ms on one GPU, 3.5x faster than LLM generation and 470x faster than reasoning. Models are released at https://github.com/Awenbocc/RetiJev.
0
cs.AI Yunxiang Luo, Xin Xu, Tianhao Chen et al. · Oct 22, 2026

This paper tackles the challenge of translating natural-language optimization problems into correct, executable solver programs using frozen LLMs. It introduces OptiCycle, a lightweight inference harness that iterates code generation, execution, and repair in a persistent Python state, and OptiState, which adds an explicit five-element revisable formulation. Across nine benchmarks spanning 2,634 problems and 11 Qwen variants, execution-guided revision produces broad accuracy gains and outperforms heavier multi-agent workflows and post-trained specialist models without any parameter updates, though the extra formulation structure helps only some backbones.

Large language models (LLMs) can translate natural-language optimization problems into solver programs, but reliably producing correct formulations and implementations remains challenging. Existing approaches improve optimization modeling through agentic workflows or task-specific post-training. This raises a practical question: can a lightweight harness using a single model role achieve competitive performance without additional training? We introduce OPTICYCLE and OPTISTATE, two lightweight inference harnesses for optimization modeling, and evaluate them on nine benchmarks comprising 2,634 problems using 11 Qwen variants spanning 0.6B-27B parameters. Our results show that execution-guided revision consistently improves macro accuracy over direct generation for all evaluated models, with gains of up to 49.46 percentage points. Despite their simplicity, both harnesses outperform six adapted agentic workflows in same-model comparisons and four evaluated post-trained optimization models at comparable model sizes, without additional training. Explicit formulation state provides further but model-dependent improvements, suggesting that additional structure is not universally beneficial.
0
cs.CVcs.AI Haojun Xu, Jie Huang, Xin Lu et al. · Oct 22, 2026

Direct Forcing tackles few-step autoregressive text-to-video generation by eliminating the costly ODE initialization stage that prior distillation methods require. The authors propose a single-stage recipe that jointly learns causal continuation alignment and rollout distribution matching from reference videos, using maximum mean discrepancy and dynamic gradient balancing. Starting from a bidirectional Wan2.1-$1.3$B checkpoint, the method trains in just $250$ updates and achieves $84.63$ VBench Total, offering a markedly shorter path to a fast causal generator.

Few-step autoregressive video generation enables low-latency streaming, yet prevailing training pipelines separate causal adaptation from distribution matching. Recent representation-based text-to-video methods retain this separation by starting from ODE-initialized checkpoints, even when the target distribution is defined directly by reference videos. We introduce Direct Forcing, a single-stage framework that uses reference videos both as paired examples of how a history continues and as a target population for self-generated rollouts. Causal Continuation Alignment learns paired spatiotemporal correspondence under reference histories, while Rollout Distribution Matching uses maximum mean discrepancy to align the representation distributions of self-generated and reference videos. Together, these complementary signals allow a pretrained video model to learn causal continuation and the target video distribution in a single training stage. Dynamic Gradient Balancing adapts the relative gradient contributions of continuation alignment and distribution matching during training. Starting from bidirectional Wan2.1-1.3B, Direct Forcing learns a four-step autoregressive generator in 250 updates without a separate initialization stage or online diffusion-score supervision, achieving 84.63 VBench Total and 86.01 Quality. Ablation studies further demonstrate the benefits of dynamic gradient balancing and reveal distinct representation preferences: deeper features benefit continuation alignment, whereas intermediate features yield better performance for rollout distribution matching.
0
cs.CRcs.AIcs.LG Wonjune Seo, Joonhyuk Baek, Yeseong Jung et al. · Oct 22, 2026

MIG-COW addresses a critical vulnerability in deepfake detection: the difficulty of crafting adversarial examples that simultaneously fool both CNN and ViT architectures. The method combines momentum-integrated gradients with a consensus-orthogonal decomposition to separate shared vulnerabilities from model-specific decision cues. While it achieves near-perfect white-box success, the work is most valuable for highlighting how fragile cross-architecture transferability remains in practice.

Despite recent advances, deepfake detectors remain vulnerable to adversarial examples, particularly in diverse, real-world settings. We propose MIG-COW, a novel adversarial attack framework that generates highly generalizable and visually imperceptible adversarial examples. By combining momentum-integrated gradients with a consensus-orthogonal decomposition, MIG-COW captures both shared and model-specific vulnerabilities across heterogeneous CNN and ViT detectors. On the AADD-2025 Challenge benchmarks, MIG-COW achieves a 99.96% white-box attack success rate (ASR) with high perceptual similarity (SSIM), significantly outperforming existing baselines. However, its limited 7.16% ASR against official black-box targets - despite achieving the best overall score - highlights the ongoing challenge of transferability. We also demonstrate that incorporating low-performing but diverse models in the ensemble can degrade attack effectiveness, underscoring the need for careful surrogate model selection in real-world adversarial settings.
0
cs.SEcs.AI Bin Duan, Jintao Lin, Guowei Yang · Oct 22, 2026

VLTest addresses the problem of testing vision-language models (VLMs) where mutating an image, a text prompt, or both can change the expected answer, making naive output-change counting unreliable. Its core idea is to generate controlled visual variants via VQGAN latent code editing and textual variants via a rewrite–expand–prune pipeline, then confirm failures with an automated oracle and attribute joint failures to the specific image-text combination using matched four-cell evidence. This matters because VLMs are increasingly embedded in software systems, and existing robustness evaluations systematically overcount failures by ignoring whether an input still has the same correct answer.

Vision-language models (VLMs) are increasingly embedded in software systems. Testing them raises two problems. Mutating either input can change the expected answer, so an output change is not by itself a failure. Some failures appear only when both inputs are mutated; attributing them to the combination requires testing each mutation alone. We present VLTest, a black-box VLM testing approach. It generates image variants by editing VQGAN latent codes and text variants with a rewrite-expand-prune pipeline, filters variants likely to change the expected answer, and tests each variant alone before testing combinations, so every joint failure has four matched cells. A VLM judge confirms a failure only after checking that the input keeps the expected answer. On three tasks with eight VLMs, including two commercial API models, the oracle confirms 81.7% of the candidates, with 88.8% to 94.6% precision against human labels, and four-cell confirmation rejects 22.5% of joint candidates. Under the same budget, VLTest's generators find 1.8 to 2.5 times as many confirmed failures as SINVAD and TextFooler, and its joint tests find 91 to 197 attributed joint failures per 1,000 joint calls, 1.3 times as many as the same pairing applied to the baselines' variants.
0
cs.AIcs.MAphysics.optics Zhaoran Feng, Yuchen Ni, Jianan Liu et al. · Oct 22, 2026

Scientific optimization is expensive and constrained, yet the search policy is usually fixed ahead of time. ADAPT treats the complete policy $\pi=(W,O)$—where to start and how to move—as the object of optimization, using historical designs for target-aware initialization and multi-agent LLM evolution to adapt the procedure itself. Evaluated on eight held-out gravitational-wave detector topologies under matched budgets, it reduces mean loss by 54.9% versus the best classical optimizer and by 62.2% versus the best agentic baseline. The work is compelling within its domain but leaves open questions about generality and reproduction.

Scientific discovery often requires identifying a small number of high-performing designs in vast, constrained search spaces. This is difficult when evaluations are costly, feasible solutions are sparse, parameters are strongly coupled, and physical constraints are strict. Recent AI for AI methods can automatically improve algorithms and optimization procedures. However, general purpose approaches are not designed around scientific priors, physical constraints, and limited evaluation budgets. We introduce ADAPT for Science, a multi-agent framework that treats scientific optimization as two coupled decisions: where to search and how to search. ADAPT uses historical designs to identify promising and diverse initial conditions, progressively concentrates computation on favorable search directions, and evolves the optimization procedure from execution feedback. We evaluate ADAPT on the design of gravitational wave detectors using a differentiable physics simulator and eight unseen detector topologies. Under matched scientific evaluation budgets, ADAPT achieves a mean loss of 0.204 +/- 0.101, reducing loss by 54.9% relative to the best classical optimizer and by 62.2% relative to the best general purpose agentic evolution baseline. ADAPT achieves the lowest loss on all unseen topologies among the evaluated baselines. ADAPT provides a step toward scientific optimization systems that continuously learn from prior experience and their own search outcomes.
0
cs.AI Sirui Chen, Zhining Liu, Chao Zhang et al. · Oct 22, 2026

LLM agents improve by distilling experience into external knowledge, but different analyses of the same trajectories can produce guidance with wildly different utility. This paper introduces SPLICE, a framework that adapts consistency regularization to knowledge evolution: it perturbs the textual instructions that transform experience into skills or memories, replays tasks under each resulting view, and updates knowledge only where utility gains are consistent across views. A co-evolution loop interleaves this knowledge evolution with GRPO and gated contrastive self-distillation to internalize the guidance. The core idea matters because current agents can be misled by plausible-looking but ineffective skills, and SPLICE offers a principled filter for generalizable knowledge.

LLM agents can evolve by learning from accumulated experience. Existing approaches extract reusable external knowledge, such as skills and memories, from experience to guide subsequent task solving, with some further internalizing this knowledge through model training. However, different ways of analyzing and transforming the same experience can yield knowledge with substantially different utility, even when the resulting guidance appears reasonable. Inspired by consistency regularization, we identify consistent utility gains across different ways of analyzing the same experience, rather than relying on any single way of analyzing it. We introduce SPLICE, a framework for consistency-regularized knowledge-model co-evolution. It constructs evolution views by perturbing how the same experience is analyzed, producing different knowledge candidates. Knowledge updates are then guided by common gain, which accounts for utility gains and their consistency across views. During model evolution, self-distillation internalizes the evolved knowledge alongside reinforcement learning, using knowledge associated with consistent utility degradation as a contrastive reference. The two processes interleave, with model updates driving further knowledge evolution. Experiments across diverse domains show that SPLICE outperforms knowledge evolution and model training baselines by up to 7.1 and 4.6 points in average accuracy, while its evolved knowledge reduces output tokens per correct solution by up to 44% and transfers across model sizes and families.
0
cs.HCcs.AI Viktor Kewenig, Lev Tankelevitch, Sean Rintel et al. · Oct 22, 2026

This randomized experiment with 297 knowledge workers and 594 essays tests dynamic metacognitive scaffolds for goal specification and task decomposition in AI-assisted writing. The authors show that scaffolds improve output quality, prompting behavior, and three-day topic recall, even after the support is removed. Yet participants rated the AI as less helpful and reported higher cognitive load while using the scaffold. The paper argues this tension reveals a productive friction that designers should embrace rather than eliminate.

Generative AI imposes new metacognitive demands on knowledge workers as their work shifts from production to planning, evaluation, and orchestration. In a randomized, between-subjects experiment on AI-assisted writing (297 workers, 594 essays), we test dynamically-generated metacognitive scaffolds supporting goal specification and task decomposition. We find that scaffolds improve writing quality, with this boost persisting in short-lag transfer when scaffolds are removed. We also find evidence of improved topic recall three days later. These effects are consistent with observed changes in how people learn to prompt AI systems after exposure to scaffolding. However, scaffolded participants rate the AI as less helpful and more cognitively demanding even as they perform better, suggesting that subjective ease can understate the value of support. Our findings make the case for metacognitive scaffolds in AI-assisted knowledge work, revealing a productive friction worth designing for as workers increasingly delegate work to agentic AI.