Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.SEcs.AIcs.LO Naing Oo Lwin · Oct 1, 2026

Coding agents for Lean can produce compiler-passing proofs that do not match the intended theorem or rely on hidden assumptions. Forall-Lean-Agent tackles this by binding verifier results, fresh review, and artifact digests into a traceable acceptance protocol that works with any frontend. The paper evaluates the harness on software-verification and mathematics benchmarks and argues that auditable execution improves correctness guarantees and efficiency, though its empirical claims are stronger on integrity than on controlled performance gains.

Coding agents increasingly automate Lean proof development, but successful compilation alone does not establish that a candidate proves the intended statement under acceptable assumptions. We present FORALL-LEAN-AGENT, a frontend-agnostic framework for auditable reasoning in formal mathematics and software verification. The framework combines isolated workspaces, Lean tools, and fresh review with statement comparison, axiom audits, and independent proof checking where supported. Verification evidence and reviewer decisions are bound to the same candidate artifact, making acceptance traceable. We evaluate the framework on VeriSoftBench, PutnamBench, and both problems in the Lean Eval softwareverification track. On the 100-task VeriSoftBench subset, integration with FORALLLEAN-AGENT raises benchmark-rule success from 93 to 100 for GPT-5.6 Sol at low effort while reducing cost from $69 to $62. The PutnamBench evaluation accepts all 672 problems at an average of $4.72 each. These results show that agent harness design can improve correctness and efficiency while providing evidence beyond aggregate solve counts.
0
cs.LGcs.AI Hongyu Cao, Xinyuan Wang, Arun Vignesh Malarkkan et al. · Oct 1, 2026

Industrial tabular data often suffers from scarcity, class imbalance, and covariate shift between training and deployment. This paper defines the Augmented and Weighted Learning under Covariate Shift (AWL-CS) problem and proposes IGDPR, a framework that steers latent diffusion with invariant potentials and aggregates sample reliability through prototype-based reweighting. The core idea is to synthesize data that aligns with stable decision boundaries rather than outdated source correlations, while filtering out validation noise via structural clusters.

In many industrial applications, 1) tabular data is scarce and imbalanced and thus requires synthetic expansion; 2) input distributions drift between training and deployment (covariate shift); 3) validation sets often diverge from unseen test environments; or 4) standard generative models simply mimic outdated source distributions. This learning setting limits the stability of standard augmentation and adaptation pipelines. We generalize the task under such setting as the Augmented and Weighted Learning under Covariate Shift problem (AWL-CS). AWL-CS imposes two critical challenges on existing methods: 1) misleading generative guidance where models optimize for source similarity rather than downstream task relevance, and 2) structural instability of distributional density where reweighting mechanisms overfit to noisy validation signals. To tackle these challenges, we propose IGDPR (Invariant-Guided Diffusion with Prototype Reweighting), a unified framework that synergizes stable synthesis and structural adaptation: i) To achieve task-relevant generation, we steer the diffusion sampling process using invariant potentials to ensure synthetic samples align with stable decision boundaries rather than outdated correlations. ii) To ensure stable adaptation, we develop a prototype-based reweighting strategy that assesses sample reliability through structural clusters instead of isolated points, effectively filtering validation noise. Extensive experiments on real data demonstrate our method improves data quality by augmenting the most beneficial data for robust learning.
0
cs.AI Mitchell Piehl, Muchao Ye · Oct 1, 2026

MemFit tackles the high cost of LLM-driven memory consolidation by keeping the LLM out of the write path entirely. It stores each conversational turn verbatim in an append-only store, indexes via BM25 and dense embeddings, and retrieves through a multi-stage pipeline combining lexical matching, dense similarity, pseudo-relevance feedback, and cross-encoder reranking. The work claims state-of-the-art accuracy on three long-term conversational benchmarks while cutting memory construction cost and latency several-fold.

Long-term memory systems for large language models (LLMs) have gained popularity for extending reasoning capabilities across applications. Current memory systems rely on LLM agents to organize and consolidate memory, resulting in costly, inefficient write operations. To address this limitation, we propose MemFit, a long-term memory system for conversational agents that reduces the cost and latency of memory operations. Unlike existing systems that rely on expensive LLM calls for memory construction or discard surface-level details through compression, MemFit stores each turn verbatim in an append-only store with near-instantaneous, LLM-free insertion, indexing turns with segment summaries rather than replacing them. Additionally, MemFit uses an LLM-free, multi-path retrieval strategy that combines lexical and semantic signals with cross-encoder reranking over caption- augmented episodes in both textual and multimodal settings. Empirical results on three widely used benchmarks, LoCoMo, MemGallery, and LongMemEval-S, show that MemFit achieves state-of-the-art performance while reducing memory construction time and cost several-fold, providing a scalable and efficient solution for persistent agentic memory.
0
cs.AI Sara Riazi, Pedram Rooshenas · Oct 1, 2026

Conceptual database design is difficult to tutor at scale because students iterate on entity–relationship diagrams and need feedback timed to each revision. This paper proposes an educator-guided LLM agent that separates hidden diagnosis of ERD errors from a pedagogical workflow controlling what is disclosed and when. A four-stage scaffold—concept check, guided application, low-detail feedback, and Q&A—was deployed across 383 feedback episodes. The work matters because it trades unrestricted LLM dialogue for educator-governed, artifact-grounded scaffolding that preserves student agency.

We present an educator-guided LLM pedagogical agent for scaffolded feedback in conceptual database design. Integrated into an entity--relationship diagram (ERD) editor, the system grounds feedback in the student artifact, assignment requirements, educator-authored rubrics, and instructional resources. Its architecture separates hidden, artifact-grounded diagnosis from the workflow that controls the form and disclosure level of student-facing support. We instantiate the architecture as a four-stage workflow progressing from concept checks and guided application to low-detail feedback and localized clarification. Each feedback request creates a stateful episode linked to versioned ERD states. In a deployment spanning three ERD environments and 383 feedback episodes, 71.1\% of observed target-level changes fully or partially incorporated the hidden diagnostic target, including many after Stages~1--2. Qualitative analysis showed that staged disclosure sometimes withheld inaccurate details, supported selective uptake, or allowed later recovery, though some errors still shaped revisions. Survey responses from a self-selected sample favored delayed disclosure and student agency but noted indirectness and repetition.
0
cs.AIstat.ML Pedro Robles Dutenhefner, Dikshant Shehmar, Wagner Meira Jr. et al. · Oct 1, 2026

Offline goal-conditioned RL (GCRL) struggles with long-horizon tasks because discounting shrinks value differences between distant states until they fall below function approximation error. This work introduces GITA, which learns a single value network conditioned on a temporal abstraction stride $k$ and trains one high-level policy by aggregating advantage-weighted regression updates across multiple scales. By implicitly letting the best-suited scale dominate per state-goal pair, GITA raises average success rate on OGBench by 25 percentage points over HIQL without requiring a problem-specific fixed $k$.

Existing approaches to offline goal-conditioned reinforcement learning (GCRL) struggle with long-horizon tasks. Discounting shrinks value differences between distant states until they fall below the function approximation error, leaving the agent with no signal for ranking states. Temporal abstraction, which treats k environment steps as a single transition, restores this signal at long range, but no single fixed k suits all state-goal distances: large k preserves value differences across long temporal distances while collapsing distinctions between nearby states, and small k does the reverse. We make this trade-off explicit and introduce Generalized Implicit Temporal Abstraction (GITA), which conditions a single value function on k. GITA trains one policy by aggregating advantage-weighted supervision across multiple k values, so scales assigning larger positive advantages to a state-goal pair contribute more strongly to its update. GITA does not need to choose between local resolution and long-range signal; it retains both without committing to a single k. On OGBench, GITA outperforms a broad range of offline GCRL baselines, raising average success rate across all tasks by 25 percentage points (73% relative improvement) over HIQL. It also improves over the strongest fixed-k method, OTA, by 7 percentage points (14% relative).
0
cs.CV Masaya Takabe, Hiroshi Watanabe, Sujun Hong et al. · Oct 1, 2026

The paper tackles misalignment in canonical Gaussian video representations caused by large global camera motion. The core idea is to precompute frame-wise affine transforms, align all GOP frames into a larger atlas space, and fit canonical Gaussians there before projecting back. This plug-in alignment step lowers the burden on temporal deformation models with essentially no extra parameters, yielding large PSNR gains on high-motion sequences.

Gaussian splatting has recently emerged as an efficient representation for images and videos due to its explicit structure and fast rendering capability. Existing Gaussian-based video representations often decompose a video into canonical Gaussians and temporal deformation. However, when a video contains large global motion such as camera movement, the canonical representation may become misaligned with individual frames, increasing the burden on the temporal deformation model. In this paper, we propose an affine-atlas canonical Gaussian representation, which constructs canonical Gaussians in a larger affine-aligned atlas space. Frame-wise affine transforms absorb global motion before canonical Gaussian construction, reducing the gap between the canonical representation and target frames. Since the proposed method only modifies the canonical construction stage, it can be integrated into existing canonical-Gaussian-based methods with negligible additional parameter cost. Experiments show that our method improves reconstruction quality especially for sequences with large camera motion.
0
cs.CV Hanyuan Xiao, Gonglin Chen, Haolin Xiong et al. · Oct 1, 2026

Doppelgangers—visually similar yet geometrically distinct surfaces—routinely corrupt structure-from-motion by creating false matches in large image collections. MVDG attacks this bottleneck by repurposing the feed-forward 3D foundation model VGGT to encode arbitrary multi-view image sets in a single forward pass, then applying lightweight per-layer decoders and a confidence-based early-exit gate to classify covisible pairs. The goal is to escape the quadratic $\mathcal{O}(n^2)$ inference cost of pairwise classifiers while preserving downstream reconstruction accuracy.

Illusory matches between distinct yet visually similar 3D surfaces--doppelgangers--remain a fundamental obstacle for large-scale, in-the-wild 3D reconstruction and visual localization. Prior work mitigates this issue with pairwise classifiers, but this design limits multi-view contextual reasoning and incurs O(n^2) inference complexity for downstream structure-from-motion (SfM). We present MVDG, a scalable multi-view disambiguation framework built on the 3D foundation model VGGT, which jointly reasons over an arbitrary number of multiview images. By incorporating 3D-aware multi-view features, our method reduces dependence on pairwise comparisons by encoding and decoding views in a single pass. We further observe that direct multi-view fine-tuning of VGGT can be unstable under noisy supervision; motivated by label ambiguity in Doppelgangers, we construct a pseudo-pairwise training set from AerialMegaDepth and show that fine-tuning on sampled subsets yields stable optimization and strong generalization to held-out scenes. Finally, because full SfM evaluation (even with faster pipelines such as GLOMAP) remains expensive, we process a pseudo-pairwise dataset for efficient validation; we derive a predictive relationship between regular SfM metrics and the classification accuracy on this pseudo-pairwise test. Experiments show that our method achieves comparable pairwise accuracy while improving both SfM accuracy and inference speed over baselines.
0
cs.LGcs.CV Donghoon Lee, Shinjin Kang · Oct 1, 2026

Post-hoc OOD detectors routinely tune hyperparameters or fit combining rules on held-out samples from the same OOD datasets used for final evaluation. This paper shows that the standard validation protocol only prevents memorization of individual images, not memorization of dataset identity, and that most reported gains vanish when the detector is instead evaluated on truly unseen OOD datasets. The authors isolate the effect with two elegant controls and derive a closed-form expression for the inflation.

A post-hoc out-of-distribution (OOD) detector reads the activations of a trained classifier and returns a score. It fits that score on in-distribution data, and the benchmarks that evaluate it supply a second piece of OOD data for the fitting itself. Some detectors tune a constant on it. Others fit a direction in feature space or train a flexible combiner and report the number that it reaches as the gain that is still available. Every such fit is validated on held-out samples of the same OOD dataset. That check rules out memorizing individual images. It says nothing about a fit that has instead learned which dataset it is looking at, and a direction that recognizes one OOD dataset rather than novelty passes it perfectly. The detector that a practitioner installs meets OOD data from a source that nobody fitted it on, so the difference decides what the reported number is worth. We measure it by holding out the whole OOD dataset rather than a sample of it, and we call that gap the inflation. We read it across a range of combiners on ImageNet and CIFAR-100 backbones. Most of the gain that the usual protocol reports turns out to be dataset identity rather than novelty. The size of the fit does not move what survives, so the effect is not ordinary overfitting. The share depends instead on whether the input exposes class identity, and two controls that vary that property alone separate the inflation on every backbone of both benchmarks. A closed form accounts for the effect and computes it from the fitting rows, so a practitioner can tell which fits will inflate without running the hold-out protocol. One of these fits survives, namely the single constant that the field already picks on a designated validation dataset. Anything above it reports a gain that the hold-out protocol does not return, and on one benchmark what survives falls while what is reported climbs.
0
cs.ROcs.CV Shota Kobayashi, Koki Seno, Daichi Yashima et al. · Oct 1, 2026

NarrativeFlow tackles language-conditioned robot manipulation by generating dense robot velocity fields through a flow-matching formulation, allowing models to train on heterogeneous cross-embodiment data without platform-specific action labels. It introduces a Narrative Delta loss that aligns intermediate representations with textual descriptions of task-relevant scene changes, along with dual subtask tokens to isolate this auxiliary objective from the primary flow-generation path. On standard benchmarks and real-world mobile manipulation tasks with an HSR robot, the method substantially outperforms sparse-keypoint baselines, though absolute success rates and reliance on large MLLM-generated captions leave room for refinement.

We focus on language-conditioned flow-based manipulation, where robot flows (robot velocity fields) serve as embodiment-agnostic, motion-centric representations for leveraging data collected from multiple robot platforms. This task is crucial because language-conditioned manipulation is essential for practical robotic systems, yet scaling robot foundation models remains limited by the labor-intensive collection of embodiment-specific data. Existing methods either coarsely approximate robot flows with sparse keypoint displacements, or cannot handle language-conditioned manipulation. To address this limitation, we propose NarrativeFlow, which models robot flows as continuous velocity fields using a flow-matching formulation conditioned on language. Accordingly, NarrativeFlow generates robot flows that are physically consistent with real-world manipulation. To validate NarrativeFlow, we have conducted experiments on standard datasets for language-conditioned manipulation. The experimental results show that NarrativeFlow outperforms representative baseline methods on standard evaluation metrics. Furthermore, through real-world experiments, we show that NarrativeFlow achieves higher success rates than baseline methods across multiple manipulation tasks. The project page is available at https://shota0520.github.io/NarrativeFlow-project-page/
0
cs.CV Patrick Amadeus Irawan, Iskandar Muda Rizky Parlambang, Rava Maulana et al. · Oct 1, 2026

Ego2Act introduces a benchmark and automated evaluator for goal-directed egocentric manipulation video generation. It tests whether models can plan and execute multi-step physical tasks from a single starting image and high-level goal, spanning 110 real-world cases. Experiments reveal severe limitations in current video generators, with even the best proprietary model scoring only 64.0 on human evaluation and frequently skipping prerequisite steps or violating physical continuity.

Video generation models are increasingly being explored as world simulators for embodied planning and learning. To do so effectively, these models must not only generate visually appealing frames, but also predict how environments dynamically evolve when executing goal-directed actions. While evaluating these capabilities is crucial, existing benchmarks focus mainly on single short actions or step-by-step instructions. This leaves multi-step physical reasoning underexplored, especially in egocentric video generation that requires planning to simulate proper execution to accomplish high-level goals by carrying out multiple real-world manipulations. We introduce Ego2Act, a goal-directed benchmark featuring 2,640 videos from 110 real-world tasks across day-to-day settings, varying object clutter and multi-step complexity. Given an initial scene image and a high-level goal, Ego2Act evaluates whether video generation models can produce realistic egocentric videos of a hand manipulating objects to carry out the task. To support scalable evaluation, we also introduce Ego2ActJudge, a reference-free evaluation pipeline that achieves better task completion and physics plausibility evaluation alignment with human consensus compared to relevant baselines. Our findings reveal that models' generated simulations often skip or partially execute steps, leaving later steps missing dependent states, which leads to unfulfilled goal. Furthermore, models consistently fail at fine-grained physical dynamics, particularly during complex object manipulation and persistent world modeling. We hope Ego2Act provides a rigorous testbed for advancing video models toward physically plausible, goal-directed simulation.
0
cs.CVphysics.ed-ph Haiming Zhao, Tai Wang, Kun Zhang et al. · Oct 1, 2026

Science teachers need to find documentary clips that illustrate abstract physics concepts like inertia or gravity, but existing retrieval systems only match literal scene descriptions. This paper formalizes concept-to-example video retrieval and proposes CDDA, a three-stage adaptation framework that anchors curriculum concepts between textual examples and sparse visual evidence from documentaries. By structuring the language space on educational texts before transferring to video, CDDA aims to bridge the abstraction gap without destroying concrete image-text alignment, offering a targeted tool for instructional video search.

Science teachers frequently search for documentary excerpts not by describing what appears on screen, but by querying the abstract concepts they intend to teach. This use case exposes a limitation of existing language-based video moment retrieval methods, which typically assume that queries describe observable events, whereas instructional search requires retrieving concrete visual phenomena that instantiate an underlying scientific principle. We study this setting as concept-to-example video retrieval, an abstract-needle-in-a-haystack problem where compact curriculum concepts must be grounded in temporally sparse documentary evidence. To bridge this abstraction gap, we propose Concept-Driven Domain Adaptation (CDDA), a three-stage framework for adapting two-tower vision-language models to concept-level retrieval. CDDA treats concepts as intermediate semantic anchors: it first structures the textual embedding space with textbook and teacher-handbook example-concept pairs, then transfers this concept-aware geometry to documentary visuals under a frozen visual encoder, and finally jointly adapts both encoders with sparse visual concept supervision. From a geometric perspective, this staged alignment reduces text-concept and vision-concept angular gaps, thereby encouraging concept-level adaptation while preserving the pretrained model's concrete image description alignment. On a curated middle-school physics retrieval benchmark, CDDA achieves stronger pedagogically oriented concept retrieval than several competitive multimodal baselines, including Qwen3-VL-Embedding-2B, while maintaining concrete image-text matching after adaptation.
0
cs.CV Sejin Park, Hongjae Lee, Changwoo Han et al. · Oct 1, 2026

Logic gate networks replace arithmetic operations with purely Boolean functions for highly efficient inference, yet scaling their width naively causes kernel redundancy and performance saturation. This work identifies that redundancy is most severe at the first gate level and proposes Dynamic Logic Kernel (DLK) and Early-stage Dynamic Logic Kernel (EDLK), which use input-dependent Boolean routing to specialize kernel groups or first-level gate groups. The result is improved kernel diversity and better accuracy-efficiency trade-offs under width scaling, advancing the practicality of discrete logic-based deep learning.

Differentiable logic gate networks, which operate using only logic gates, have recently attracted attention as an efficient alternative to conventional neural networks. However, despite their efficiency, the scaling behavior of logic gate networks remains underexplored. By contrast, scaling model capacity is a central design principle in deep neural networks and typically leads to improved performance. This discrepancy raises a key question: Can similar scaling benefits also be achieved in logic gate networks? In this work, we focus on width as a primary scaling axis and conduct a systematic analysis of its behavior in logic gate networks. We observe that naive width scaling often introduces redundancy among logic kernels, limiting the effective use of additional kernels and leading to performance saturation. To address this limitation, we propose a dynamic logic kernel framework that reorganizes kernel utilization by promoting specialization across kernel groups. This enables the network to better utilize increased width via input-dependent kernel routing, while ensuring that both routing and computation are implemented entirely with gate-level Boolean operations at inference time. We further find that kernel redundancy is most pronounced at the first gate level, motivating an early-stage dynamic logic kernel strategy that concentrates adaptation at this level. Experimental results demonstrate that our approach improves kernel utilization and increases kernel diversity, leading to higher accuracy with improved parameter efficiency.
0
cs.CVcs.AI Minsu Kim, Jaesung Choe, Jiwoo Lee et al. · Oct 1, 2026

RelationVGGT tackles 3D spatial relation segmentation: given multi-view images, a reference subject mask, and a text relation (e.g., "resting on"), it segments the target object across unposed views without per-scene optimization. The core idea is to replace expensive volumetric relation search with per-pixel relation prediction by fusing semantic DINOv2 features with geometry-aware Pi3 tokens through a subject-conditioned relation transformer. This matters because it moves holistic scene understanding beyond isolated object recognition toward reasoning about how objects are spatially arranged, a capability critical for embodied agents and spatial QA.

Recent advances in 3D reconstruction have progressed from per-scene optimization to feed-forward inference, and semantic scene understanding has followed suit -- yet existing methods remain confined to object-centric perception, neglecting spatial relations between objects. We formulate 3D spatial relation segmentation in a feed-forward, pose-free multi-view setting: given a visually specified subject and a relational text query, the model segments the target across views without receiving its category name. To this end, we propose RelationVGGT, a novel feed-forward framework that integrates semantic features from a visual foundation model with geometry-aware representations from a 3D geometry foundation model and leverages a relation transformer for subject-conditioned, cross-view relation prediction -- requiring neither per-scene optimization nor known camera poses. We additionally provide a fully automated annotation pipeline built on ScanNet++ with VLMs and LLMs, enabling scalable training data generation for this new task.
0
cs.CVeess.IV Bi'an Du, Zhimin Zhang, Daizong Liu et al. · Oct 1, 2026

Sparse-view 3D reconstruction from only a handful of images is fundamentally ill-posed: standard methods overfit to individual views and leave unseen regions as holes or floaters. HierGF tackles this with a hierarchical 3D Gaussian Splatting pipeline that separates a coarse geometric backbone from a fine-scale field which inherits only spatial means and colors while re-estimating shape and appearance under enhanced pseudo-supervision. Geometry-consistent densification and confidence-weighted diffusion priors are then used to fill gaps and suppress artifacts in under-sampled regions. The authors report strong gains on MipNeRF360, OmniObject3D, LLFF and DTU, alongside a sub-11-minute per-scene reconstruction time on an A100 GPU.

Sparse view 3D reconstruction is an important and common scenario in multimedia applications, such as augmented reality/virtual reality (AR/VR) content creation, cultural heritage digitization, and certain robotic applications, where only a limited number of randomly captured views may be available. However, sparse views contain only limited 3D information, posing two major challenges:1) too few images are available for matching, making it difficult to build multi-view consistency; 2) insufficient view coverage leads to a lack of information in under-sampled regions, resulting in missing parts of object structure. Existing methods mostly still rely on limited reprojection errors and regularization terms, which are prone to overfitting to a single view and inconsistent appearances across views. In geometrically under-sampled regions, they often rely on heuristic density control, lacking reliable guidance and often resulting in blurring and structural holes.To address these issues, this paper proposes Hierarchical Gaussian Fields (HierGF), which revisits sparse-view reconstruction from a hierarchical geometry-perception perspective and converts limited observations into reliable self-generated supervision beyond fixed priors and heuristic density control. In particular, we transform coarse 3D geometric information and additional 2D generative priors into structured pseudo-supervision through a two-stage geometry-perception backbone network, thereby enhancing multi-view consistency with very few input views. In addition, we introduce a learnable confidence network to guide gradients toward cross-view consistent content, and a geometrically consistent densification module to improve the reconstruction of multi-view alignment and under-sampled regions.
0
cs.CV Enxin Song, Yinuo Xu, Shusheng Yang et al. · Oct 1, 2026

Video benchmarks are supposed to certify that models can understand temporal sequences, yet most can be gamed without watching the video. This paper audits 115 multiple-choice video benchmarks with a five-level attack pyramid that grants attackers access to answer options, question text, other items, single frames, or shuffled videos. After finding severe shortcut vulnerabilities—35 benchmarks break without any visual input and near-duplicates plague 63 of them—the authors screen half a million items down to 840 hardest survivors and compose them into Video-Index, a reproducible meta-benchmark backed by agent-assisted selection and lockfiles.

A video benchmark should reward the capability it claims to measure, yet models can exploit answer options, question text, or partial visual evidence. We introduce the attack pyramid, five levels of shortcut attacks with increasing access to each item, and audit 115 video benchmarks with it. On 35 benchmarks, attackers that never see a frame approach full-video accuracy. On 51 benchmarks with temporal probes, shuffled frames keep a median 96% of full-video accuracy. Near-duplicate questions make up at least half the items in 63 benchmarks. We screen 505,518 question-answer pairs from 112 of them into an audited pool. Agents turn evaluation requests into specifications, and a deterministic selector with a red-team gate composes reproducible benchmarks. We release Video-Index, the 210 hardest verified items under these attacks in each of four capability groups, 840 items from 76 sources. With the same fixed input, Claude Opus 5 outscores every open-source model by over 37 percentage points, and agent tools add about 20 more, yet all systems leave room to improve efficiency and accuracy. Blog: https://www.enxinsong.com/blog/video-index/ GitHub: https://github.com/Espere-1119-Song/Video-Index Hugging Face: https://huggingface.co/datasets/Video-Index/Video-Index
0
cs.CV Tongcheng Zhang, Jun Zhu, Jianfei Chen · Oct 1, 2026

As video generation scales to minute-long clips, subjects enter and leave the scene, making static-set consistency metrics inadequate. This paper introduces DynSC-Eval, a framework that tracks each subject over its entire visible lifespan and decomposes consistency into local continuity and global identity preservation via six object-level metrics. The authors further derive rewards from these metrics and use DiffusionNFT to post-train video models, demonstrating substantial consistency gains in an autonomous driving testbed and extending them to 30-second generation through curriculum learning.

We argue that as video generation extends to longer durations, subject consistency should be evaluated over \textit{dynamic subject sets}. We therefore introduce \textbf{DynSC-Eval}, an evaluation framework that dynamically tracks eligible subjects throughout their visible lifespans and measures local continuity and global identity preservation using six complementary object-level metrics, with explicit detection of inconsistency events. To validate its effectiveness, we design synthetic experiments that actively inject inconsistency events, demonstrating both the sensitivity of DynSC-Eval and the limitations of existing metrics. Evaluations of diverse models on 5s, 15s, and 60s video generation further reveal substantial subject consistency differences that are obscured by conventional metrics. Beyond evaluation, we construct rewards from DynSC-Eval and apply DiffusionNFT post-training in an autonomous-driving testbed. On 5s generation, our approach reduces the six inconsistency metrics by an average of 13.82\% for Wan-2.1-1.3B and 5.66\% for SANA-2B, with improvements also observed on the I2V model ReSim. Qualitative comparisons further demonstrate the effectiveness of our method. We then extend generation to 10s and 30s through curriculum learning and show that consistency optimization remains effective while largely preserving other capabilities.
0
cs.CVcs.AI Keuntae Kim, Yong Suk Choi · Oct 1, 2026

This paper studies masked diffusion multimodal language models and shows that answer candidates often stabilize retrospectively long before their positions are permanently committed or the rationale-side canvas is filled. The authors introduce two clocks—token stabilization $T_{\mathrm{stab}}$ and commitment $T_{\mathrm{commit}}$—and measure how much of the rationale region $\mathcal{R}$ remains unwritten at stabilization. They pair this with matched-canvas visual-sensitivity ablations and a coverage-accuracy decomposition to explain why prompting changes affect overall accuracy. The analysis matters because it reveals that observing the final rationale alone is insufficient to understand when or how a diffusion model decides its answer.

An answer candidate in a masked diffusion MLLM can stabilize while its rationale is still unfolding. We distinguish retrospective stabilization of the logged candidate from token commitment, and examine these two clocks relative to rationale generation. Analyzing our results across three visual question-answering benchmarks, we find that 89.4-98.1% of the rationale-side canvas remains unwritten at stabilization in single-block, EOS-suppressed LaViDa runs. On V*Bench, reducing block length from 128 to 8 changes this fraction from 89.4% to 1.7%, together with answer coverage and the eligible observation window. Under EOS-enabled prompting, direct instructions improve Nemotron's overall accuracy by 15.0 and 19.5 percentage points on M3CoT and ScienceQA, but reduce LaViDa/V*Bench accuracy by 11.0 points. A symmetric decomposition associates the larger absolute component of each change with coverage rather than conditional accuracy. Matched-canvas image ablations measure visual sensitivity alongside answer stabilization, separating the two temporal readouts. Together, these measurements distinguish answer stabilization, rationale unfolding, and visual sensitivity, and identify coverage as the larger component of the prompting differences.
0
cs.CVcs.AI Giyeong Oh, Junghun Park, Yuhan Bae et al. · Oct 1, 2026

This paper attacks a growing bottleneck in text-to-image training: how to audit billion-scale recaptioned corpora before spending millions of GPU-hours on downstream training. It proposes a matched-budget audit framework that fixes a text budget $B=64$ and profiles any supervision distribution $D_{\pi,V_c,C}$ across five axes—prompt-side coverage, image-conditioned faithfulness, and caption-surface health—using controllable basic units (CBUs) as a common claim currency. The work matters because it disentangles corpus quality from model-training confounders and releases both a ~490M-caption corpus and a reusable artifact bundle.

Recaptioned image-text corpora are now standard for text-to-image (T2I) training, with vision--language model (VLM) captioners replacing sparse alt-text by dense descriptions. A recaptioned corpus is a supervision distribution induced by a documented captioning policy ($\pi$), captioner ($V_c$), and source corpus ($C$). Length-correlated proxies miss caption-register artifacts and downstream T2I benchmarks entangle the corpus with training choices, so this distribution is hard to audit at corpus scale. We introduce a reusable matched-budget audit framework for recaptioned supervision distributions $D_{\pi,V_c,C}$: at a fixed text budget of $B = 64$ it reports a five-axis profile spanning prompt-side coverage, image-conditioned faithfulness, and caption-surface health, with claimed controllable basic units (CBU) as the common claim unit. We instantiate the framework on seven paired comparisons over five public source corpora. Across the four cross-corpus pairs, the released surface raises supported CBU per caption by $+3.39$ to $+6.36$ under both Qwen and Gemma Judges, and on CC12M the same framework exposes a long-vs-dense frontier that is consistent across both judges and four budgets. We release the audited multi-source recap corpus ($\approx$ 490M) together with the audit-artifact bundle.
0
cs.CV Jiho Jang, Jinyoung Kim, Nojun Kwak et al. · Oct 1, 2026

Recent video generative models produce stunning visuals but routinely fail at plausible physical interactions and state transitions. This paper proposes a modular synthetic-data pipeline that couples a structured taxonomy with image-editing-based start/end anchors and a novel State-Guided Sampling (SGS) method to smoothly interpolate between them. Fine-tuning a Wan 2.1 model on this curated dataset improves interaction realism, backed by a hybrid VLM-plus-probe evaluator validated against human judgments.

While recent video generative models can synthesize high-fidelity videos, they struggle to portray plausible physical interactions and the resulting state transitions, a critical bottleneck for applications in robotics and VR/AR. To address this, we introduce a framework to generate a scalable synthetic dataset of controllable interactions. Our pipeline leverages a structured taxonomy and state-of-the-art image editing models to create explicit `start' and `end' state images, which serve as visual anchors for the interaction. To generate a seamless video utilizing these anchors, we propose State-Guided Sampling (SGS), a novel sampling technique that mitigates artifacts common in naive conditional generation. Furthermore, we develop and validate a new automated evaluation system that aligns with human judgments to ensure data quality. Experiments show that fine-tuning a base model on our dataset significantly enhances its ability to generate plausible interactions.
0
cs.CV Arash Rocky, Q. M. Jonathan Wu · Oct 1, 2026

SAM3-ASH tackles fully automated video tracking annotation without any dataset-specific training. Its Generalized Presence Token (GPT) enables SAM3 to process multiple text prompts simultaneously by virtual batching over a single shared image encoding, collapsing per-prompt cost from $\mathcal{O}(N)$ to $\mathcal{O}(1)$. The Annotation and Segmentation Handler (ASH) splits videos of arbitrary length into overlapping temporal chunks and reconciles identities across boundaries via IoU matching, bounding peak GPU memory below 25 GB. Evaluated on eight benchmarks, the pipeline sets a zero-shot HOTA record on MOTS20 and stays within a narrow gap of trained specialists on tasks where mask-based output aligns with the ground-truth format.

Memory-attention-based Video Instance Segmentation (VIS) methods have demonstrated strong zero-shot tracking capability, yet their substantial memory requirements confine them to short video clips and their single-prompt inference design makes multi-category open-vocabulary tracking computationally prohibitive. This work introduces two contributions toward fully automated tracking annotation of arbitrary video. The Generalized Presence Token (GPT) reformulates SAM3's inference pipeline to process N text prompts simultaneously via virtual prompt batching, reducing image encoding cost from O(N) to O(1) with no modifications to any learned component. The Annotation and Segmentation Handler (ASH) extends any memory-attention VIS tracker to sequences of arbitrary length through overlapping temporal chunks with IoU-based inter-chunk identity matching, requiring no dataset-specific training. Instantiated on SAM3, the resulting pipeline -- SAM3-ASH -- achieves state-of-the-art HOTA on MOTS20 under fully zero-shot conditions and remains competitive with trained specialists across seven additional benchmarks, while peak GPU memory consumption stays below 25 GB, establishing a practical baseline for scalable, training-free automated video annotation.