Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
1579 papers
Trending mixes fresh papers with community signal.
0
cs.CV Ilan Theodoro, Jord\~ao Bragantini, Lo\"ic A. Royer · Oct 22, 2026

Most cell-tracking links are trivial nearest-neighbor associations that bury rare but biologically critical errors in cell divisions and state changes. This paper introduces CellTrack-Bench, a hard-mined benchmark that isolates these difficult local associations from 15 datasets across four imaging modalities and evaluates whether vision-language models can act as cognitive correctors—by linking cells directly, repairing tracker graphs, or inspecting them for human review. It matters because it provides a controlled diagnostic setting to test whether frontier VLMs genuinely reason about biological dynamics or simply exploit spatial proximity.

Large language models have shown outstanding performance on text-first tasks such as coding, math, and writing. Recent efforts are shifting models' training to include scientific problems that often live in highly specialized domains beyond text, such as protein structure and biological images. However, in these scenarios, their general-purpose accuracy compared with specialized algorithms remains in question. One such domain is cell tracking, which requires spatiotemporal awareness of cell dynamics. To evaluate this, we created a new benchmark, CellTrack-Bench, which assesses Vision-Language Models' (VLMs) cell-tracking-related performance against specialized trackers. The full benchmark draws from 15 standard cell-tracking datasets across four imaging modalities and comprises 1,537 problems corresponding to 9,041 cell-linking decisions. We selected a hard subset requiring greater reasoning effort by identifying failures shared across distinct algorithmic trackers. With this proposed dataset, we: (i) evaluated different environment harnesses for VLMs; (ii) benchmarked 9 frontier closed-source models and 13 open-weight models; and (iii) provided a detailed analysis of their failure modes. Code, the stored model outputs, and a pipeline that regenerates the benchmark from the source datasets are available at https://github.com/royerlab/celltrack-bench.
0
cs.CL Simon Berger, Larissa Kleppel, Ralf Schl\"uter · Oct 22, 2026

Modern end-to-end ASR systems typically rely on simplistic fixed-size beam search, assuming that large search spaces are unnecessary. This paper systematically compares search complexity and efficiency for CTC and neural transducer models across three datasets, showing that dynamic score-based pruning adapts to local uncertainty and dramatically cuts the real-time factor without sacrificing accuracy. The work challenges the prevailing assumption that small fixed beams are sufficient and provides tuned decoding parameters for reproducibility.

Search is a central component of Automatic Speech Recognition (ASR) systems and has been deeply investigated for classical ASR modeling based on Hidden Markov Models (HMMs). However, in work on current sequence-to-sequence ASR architectures it is often simplified to a small fixed-size beam search without external Language Model (LM). In this work, we present a comparative analysis of search space complexity and efficiency for Connectionist Temporal Classification (CTC) and neural transducer models under different pruning strategies and LM configurations. We show that these end-to-end (E2E) models work with a small search space most of the time but exhibit large temporary peaks in hypothesis count during periods of uncertainty. Score-based pruning dynamically adapts the search to model uncertainty, leading to a significantly lower Real-Time Factor (RTF). Our results highlight the limitations of search with low fixed-size beam pruning and provide practical guidelines for efficient search in E2E ASR.
0
cs.CLcs.CY Christian Arnold, Ernesto Calvo, Guadalupe Gonzalez et al. · Oct 22, 2026

This paper identifies a hidden cost of LLM safety alignment: when models are prompted with protected attributes such as race, they often refuse to judge the associated information at all. The authors formalize this as invisibilization using a two-urn Bayesian trust game with an exact benchmark, randomizing only the reporter's description across 6,600+ sessions. They show that some model configurations discard identical evidence far more often for Black-described reporters (46%) than white-described ones (9%), while ironically trusting the assessed Black source slightly more. The result is a probability bias that standard fairness audits miss entirely because they look only at cases where the model actually renders a judgment.

Language models are aligned to avoid using protected attributes such as race, ethnicity, and gender to inform their responses. Therefore, they increasingly refuse or hedge when such attributes appear in a prompt. However, if a system must decide how much to learn from what people tell it, it is costly to refuse valuable information because of its source. In this article, we measure the cost of declining information in a two-urn game with an exact Bayesian answer. We present leading LLM models from two developers (OpenAI and Anthropic) with a prompt that requires them to decide how far to trust an unverifiable report from a participant whose description we randomize across ten configurations (6,600 sessions). We show that leading models often decline to assess the reporter, treating information as worthless at rates set by the description rather than by the evidence. At its widest, models decline a Black-described reporter 46% of the time and a white-described reporter 9%; yet, when they do assess the information, the Black-described reporter receives slightly more trust. The bias is invisible to audits that compare average trust or look only at assessed cases. It grows with reasoning effort, follows words rather than categories (models invoke race for "Black" but not for its Spanish translation negro, and never for "Indigenous"), and worsens under warning instructions a practitioner would try first. We also present a scoring option that reduces the refusal rate bias. When a model's trust is scored against revealed truth over repeated rounds, it credits identical records equally. In four of five configurations from Anthropic and OpenAI, the racial gap in trust falls below 0.02 by the last rounds.
0
cs.CVstat.ML Xihao Wang, Chengyao Yu, Ruixing Ming · Oct 22, 2026

Post-hoc calibration usually adjusts confidence scores globally, which ignores that neural networks can be miscalibrated differently in different regions of feature space. This paper proposes Local Adaptive Probability Estimation (LAPE), a residual framework that keeps an existing global calibrator as a stable anchor and adds a non-parametric local correction drawn from neighboring calibration samples in the learned feature representation. It also extends this idea to multi-view inputs through Cascade Feature Augmentation Fusion (CFAF). By exploiting local geometry without retraining, the work targets high-stakes settings where uniform global corrections leave spatially varying errors untouched.

Deep neural networks often struggle to provide reliable confidence estimates, making post-hoc calibration essential for reliable decision-making. Existing post-hoc methods largely rely on score-based transformations, which improve marginal calibration but often fail to capture spatially varying miscalibration in local regions of the learned feature space. To address this gap, we propose Local Adaptive Probability Estimation (LAPE), a post-hoc residual calibration framework. Specifically, LAPE treats the global calibrator output as a stable anchor and refines the individual prediction by leveraging non-parametric local evidence from neighboring calibration samples. As a plug-and-play refinement module, LAPE effectively utilizes the information about feature-space geometry and can reuse the calibration data that are used to construct the global calibrator. Furthermore, we extend LAPE to the setting with multi-view inputs through Cascade Feature Augmentation Fusion (CFAF). Extensive experiments demonstrate that the proposed methods can improve the calibration quality of various existing baselines and remain efficient and robust across different settings.
0
cs.CV Xuhui Zuo, Chenjie Cao, Tengfei Wang et al. · Oct 22, 2026

Panorama generation faces a fundamental tension: equirectangular projection (ERP) enables global continuity but distorts polar regions, while cubemaps preserve perspective geometry yet suffer from seams. This paper proposes CubeAtlas, a compact single-canvas unfolding of cubemap faces with rotated half-polar regions, and pairs it with layout-aware sparse attention so a pretrained diffusion transformer can generate seamless 360° imagery in one forward pass without architectural surgery. The work matters because it promises both distortion-free perspective fidelity and global spherical coherence while retaining the strong priors of standard 2D image generators.

Generating 360-degree panoramas requires both local perspective fidelity and global spherical continuity. Existing representations face a trade-off: equirectangular projection (ERP) enables seamless panorama modeling but suffers from severe distortion and a domain gap to pre-trained image generators, whereas cubemaps preserve perspective geometry but often produce inconsistent faces and visible seams. We present Squaring-the-Sphere, a panoramic image generation framework built on a novel representation CubeAtlas, which unfolds all cubemap faces into a single compact canvas. By arranging orientation-aligned, rotated polar regions alongside the equatorial faces, this representation preserves the perspective geometry of cubemaps while organizing the cross-face relationships required for seamless panorama assembly. It further enables a pretrained diffusion transformer to model the complete panorama jointly in a single pass, without altering the backbone architecture or positional encoding. While CubeAtlas has a token count comparable to ERP, its structured layout makes many dense attention interactions unnecessary. We therefore introduce a layout-aware sparse attention mask that preserves the interactions required for panorama continuity while removing geometrically irrelevant token pairs. As a result, CubeAtlas achieves better quality than ERP modeling with lower attention computation. Furthermore, we introduce a training-free super-resolution technique and a fusion scheme that enhance fine details in distortion-free perspective space before achieving the final ERP panorama. Experiments on various benchmarks demonstrate that our method improves geometric fidelity, cross-view consistency, and high-resolution visual quality over previous methods.
0
cs.CV Namitha Guruprasad, Abhay Yadav, Cheng Peng et al. · Oct 22, 2026

OmniRay tackles monocular 3D reconstruction across arbitrary central cameras without requiring intrinsics or camera-type labels at inference. Its core idea is that camera geometry has a hierarchy of complexity, so the ray field should be composed rather than represented by a single basis: a monotone radial base captures symmetric lenses, a spherical-harmonic residual handles smooth global deviations, and a free-form residual cleans up local variation, all applied as successive rotations on the sphere $S^2$. A DINOv2 backbone drives a Ray Module for $\mathbf{d}(u) \in S^2$ and a Distance Module for $\rho(u) > 0$, yielding an up-to-scale point cloud $\mathbf{P}(u) = \rho(u)\,\mathbf{d}(u)$ in one forward pass.

Monocular models recover 3D geometry from a single image in one pass, but most assume a pinhole camera and produce distorted geometry on the wide-angle imagery produced by fisheye and panoramic lenses. Camera-aware models remove this assumption by predicting a per-pixel ray field. However, they represent different camera geometries using a single fixed basis to capture both the overall camera projection and its finer variations. We argue that camera geometry can be viewed as having a hierarchy of complexity for representing rays. We present OmniRay, a feed-forward model whose Ray Module is composed of three components: a monotone radial base that captures radially symmetric structure, a spherical-harmonic residual for smooth deviations from it, and a free-form residual for remaining local variation. These components are composed as successive rotations on the sphere, allowing the representation to accommodate diverse camera geometries. Given a single image, OmniRay predicts a ray direction and an up-to-scale radial distance for every pixel, from which a 3D point cloud is recovered without needing camera information at inference time. Extensive experiments across different camera configurations demonstrate that OmniRay establishes a new state-of-the-art in camera-agnostic monocular 3D reconstruction.
0
cs.SDcs.CL Kuan-Hsun Ho, Yuan-Chiao Cheng, Yen-Tung Yeh et al. · Oct 22, 2026

MixJudge tackles the problem of assessing vocal mixes via natural language queries, a capability that existing audio-language systems do not separately test. The authors synthesize a curriculum of 11 mixing issues at multiple severity levels and train a contrastive audio-text critic that learns to retrieve issues, discriminate opposites, and order severity. Their menu-selection experiments further show that issue evidence transfers to ranking real processing candidates against professional mixes, offering a concrete form of explicit, comparable mixing assistance.

Mixing requires not only applying processing but also assessing the resulting mix. Audio-language models can provide conversa- tional mixing advice, but existing evaluations do not separately test whether they can judge specific mixing issues. Since professional supervision for such judgments is scarce, we construct a curriculum of 11 vocal-mix issues at multiple severity levels and use it to train MixJudge, a language-queryable audio critic. MixJudge shows its ability to retrieve mixing issues, distinguish opposite issues, and order the severity of an issue. Moreover, its judgments transfer to menu selection: given a set of processing candidates, MixJudge often favors versions acoustically closer to a held-out professional version, demonstrating how explicit mixing judgment can support comparison and downstream mixing decisions.
0
cs.CV Siran Dai, Qianqian Xu, Peisong Wen et al. · Oct 22, 2026

CODI tackles a key limitation in self-supervised Vision Transformers: the [CLS] token hogs global semantics onto a sparse set of representative patches, leaving other patch tokens weak for dense prediction. The authors show that image-level distillation gradients are gated by [CLS]-to-patch attention mass, which systematically under-trains non-representative regions. Their fix, Cross Distillation, mixes a small fraction of the teacher class-token distribution into each patch-token target, giving every masked patch an attention-independent semantic nudge. The method is simple, architecture-agnostic, and yields consistent gains on segmentation, depth, video object segmentation, and classification under aligned pretraining.

Self-supervised Vision Transformers learn strong image-level representations, but their patch-level representations can be unreliable for dense prediction. We study this mismatch and find that the class token concentrates global semantics on a small number of representative patches, while dense prediction errors often occur on low-attention regions. We provide a local gradient analysis showing that, along the [CLS] attention readout, image-level self-distillation gradients are weighted by [CLS]-to-patch attention mass. To provide masked patches with global semantics without changing the architecture, we propose Cross Distillation (CODI), which mixes a small amount of the teacher class-token distribution into each teacher patch-token target. CODI gives every masked patch an attention-independent semantic correction while preserving the standard self-distillation architecture. Experiments on dense and image-level benchmarks show that CODI improves both dense and image-level performance under aligned pretraining settings. Code is available at https://github.com/EldercatSAM/CODI.
0
cs.CVcs.SD Lifan Jiang, Yibo Zhao, Senlin cheng et al. · Oct 22, 2026

Joint audio-visual diffusion models repeatedly run both denoising branches and expensive cross-modal attention at every step, making inference costly. CAVC observes that audio-side drift caused by mid-stage caching can be repaired by a few terminal joint steps, whereas video-side degradation persists, and exploits this asymmetry with a training-free sandwich structure: full joint warm-up, video-only continuation with cached audio, and brief terminal recoupling. The result is a modest wall-clock speedup with improved visual dynamics, though the gains are bounded by the preserved video backbone.

Diffusion-based audio-visual generation methods typically perform joint denoising of audio and video latents throughout the entire sampling trajectory, repeatedly executing modality-specific denoising branches and cross-modal attention at every timestep. However, we observe that such uniform joint computation is not always necessary. The key is a modality-asymmetric recoverability: audio-side drift introduced by mid-stage caching can be substantially reduced by only a few terminal joint denoising steps, whereas video-side degradation caused by caching leads to persistent loss of motion and temporal details. This asymmetry suggests that inference acceleration should selectively cache recoverable audio-side computation while preserving full video refinement. Motivated by this observation, we propose \textbf{Convergence-Adaptive Audio-Visual Cache (CAVC)}, a training-free modality-asymmetric caching framework. CAVC adopts a sandwich-structured computation allocation: after detecting that audio denoiser outputs enter a cache-tolerant regime, it caches and reuses the audio denoiser output to bypass audio denoising and cross-modal attention in the middle stage, while the video branch continues independent spatio-temporal refinement; a few joint steps are then restored at the end to reduce accumulated cross-modal drift and improve synchronization. Experiments across multiple public benchmarks demonstrate that CAVC achieves 1.10--1.35x wall-clock acceleration, improves several visual dynamics and temporal statistics, and maintains competitive audio fidelity and audio-visual alignment.
0
cs.LG Andrea Giuseppe Di Francesco, Rishabh Jain, Franco Maria Nardini et al. · Oct 22, 2026

Graph soft prompting methods such as G-Retriever claim to inject relational graph knowledge into LLMs via learned continuous tokens, yet it remains unclear whether these tokens actually carry graph-specific information. This paper identifies and systematically investigates a pathological failure mode called token collapse, in which graph-derived tokens become nearly identical across inputs, effectively degenerating into generic soft prompts. Through causal interventions across three benchmarks, multiple graph encoders, and two LLM families, the authors show that strong task accuracy can conceal a token interface that the model does not meaningfully use, and they propose a diagnostic protocol to evaluate graph-token alignment beyond simple accuracy.

Recent methods for injecting graph structure into LLM prompts include graph soft prompting, in which a graph neural network (GNN) learns graph-specific tokens that capture relational information among entities in textual prompts. G-Retriever combines graph soft prompts with a verbalized description of the same graph to strengthen the textual prompt signal. We conduct an in-depth analysis of G-Retriever and uncover a pathological behavior we term token collapse. Across three benchmarks, three graph encoders, two LLM families, and both frozen and LoRA-adapted models, G-Retriever's graph tokens become almost indistinguishable across inputs. We provide evidence that the same failure is inherited by subsequent methods, even with multi-token pooling. Under the standard setup, swapping a token with the dataset mean, a token from another example, or one derived from a corrupted graph produces no resolved answer-level effect in accuracy. Moreover, a learned constant prompt that never accesses the graph matches or surpasses G-Retriever on all three benchmarks. These findings indicate that, rather than conveying graph content as intended, the collapsed token functions primarily as a generic soft prompt. We also examine conditions linked to this collapse and propose a two-stage procedure that yields non-collapsed tokens while maintaining competitive performance in most cases. However, token variability alone does not prove that the model uses graph information: via interventions and decoding probes, we show that depending on the configuration, a token can reflect the question, an answer prior, or graph-derived content that the LLM may or may not use. Overall, our results offer a practical approach to evaluating graph-token alignment rather than inferring it from task accuracy alone. Code to reproduce our experiments is available at https://github.com/difra100/Token_Collapse_KGQA.
0
cs.CV Aijing Yu, Kuangpu Guo, Jian Liang et al. · Oct 22, 2026

Unsupervised federated classification with Vision-Language Models like CLIP suffers under non-IID shifts because standard pseudo-labeling discards ambiguous samples near decision boundaries. This paper proposes FedBST, a bilateral self-training framework that penalizes confident predictions on uncertain "waist" samples during training and refines inference by ensembling local visual prototypes with global textual prototypes. The goal is to squeeze extra robustness out of existing CLIP-based federated pipelines without any labeled data.

Unsupervised federated learning with Vision-Language Models (e.g., CLIP) offers a promising solution for label-free classification, yet its performance often degrades under severe non-IID shifts. A pioneering method, FedCoPL, typically relies on self-training strategies that exclusively prioritize high-confidence predictions for pseudo-labeling. However, this selective approach neglects the information of ambiguous samples (often referred to as ``waist" samples), leading to the underutilization of data and biased decision boundaries. To address this limitation, we propose FedBST, a bilateral self-training framework that effectively exploits both high-confidence and ambiguous data. Specifically, for local optimization, we introduce uncertainty-aware confidence penalization (UACP). UACP targets ambiguous samples by penalizing overconfident predictions to implicitly promote higher uncertainty, thereby preventing erroneous pseudo-labeling. At inference, we employ a visual-text ensemble strategy. This approach aggregates uncertainty-aware local visual prototypes and ensembles them with textual prototypes, achieving lightweight adaptation to local distributions via prototype-based calibration. Experiments demonstrate that FedBST achieves consistent improvements over existing methods with standard federated aggregation protocols.
0
cs.CV Raffaele Cali, Giuseppe Lando, Rosario Forte et al. · Oct 22, 2026

Episodic memory video question answering asks models to reason over long egocentric recordings by compressing the visual stream into a queryable memory. This work isolates retrieval within a fixed online textual-memory pipeline, systematically comparing retrieval units, context budgets, and reranking strategies on QAEgo4D-Closed. The authors show that their best Parent strategy matches state-of-the-art accuracy with far fewer tokens, and reveal that higher temporal retrieval coverage can actually hurt accuracy by injecting hard distractors.

Long egocentric videos pose a central challenge for multimodal language models: the visual stream must be compressed into a memory representation that can be searched efficiently while still preserving the evidence needed for question answering. Building on an online textual-memory framework in which first-person videos are converted into temporally grounded captions, this work systematically studies the role of retrieval in episodic-memory video question answering. We evaluate how different retrieval units, query formulations, context budgets, and reranking strategies affect multiple-choice answering on QAEgo4D-Closed, isolating retrieval as the main variable while keeping the underlying generated memory fixed. Our best configuration, Parent, matches fine-grained caption subchunks, then provides their full parent captions to the reasoner. It achieves 56.4 % accuracy, matching strong full-memory and retrieval baselines while exposing only a small fraction of the textual memory at question time. More importantly, our analysis shows that better temporal coverage does not necessarily translate into better answers: increasing the retrieval budget improves temporal Hit@K and Recall@K, but can reduce accuracy by introducing visually plausible distractors and uncertain caption evidence. These findings suggest that retrieval-augmented egocentric memory should not be optimized only for evidence recall, but also for the reliability, specificity, and answer-discriminative value of the retrieved context. The study motivates more structured episodic memories that move beyond raw caption retrieval toward evidence-aware representations for long-form egocentric reasoning.
0
cs.CV Enzhe Zhao, Marco Fiorucci, Lamberto Ballan · Oct 22, 2026

This paper studies class-level unpaired vision-language matching, where frozen visual and language encoders must recover an unknown category correspondence without any paired supervision. Its core contribution is RankAlign, a preprocessing strategy that rank-transforms each within-modality similarity kernel before permutation matching, yielding an objective that is invariant to arbitrary strictly increasing reparameterizations of similarity values. The work matters because it tests whether the Platonic Representation Hypothesis can be operationalized through pure relational order rather than absolute metric alignment, and it provides exact-recovery guarantees under ordinal consistency.

While the Platonic Representation Hypothesis posits that vision and language models converge toward compatible latent geometries, recovering class-level correspondences between unpaired modalities without cross-modal supervision remains challenging. Existing relational matching methods compare within-modality similarity kernels directly, although the same semantic structure may be represented through different numerical parameterizations across modalities. We propose RankAlign, a rank-based normalization strategy for class-level unpaired vision-language matching. RankAlign transforms each within-modality similarity kernel into an ordinal relational representation before permutation matching, while leaving the correspondence space and matching solver unchanged. The resulting representation is invariant to strictly increasing reparameterizations of similarity values while preserving the ordinal structure used for matching. We provide exact-recovery and stability guarantees that characterize correspondence recovery under both exact and partial ordinal agreement. Experiments across diverse frozen vision and language encoders and multiple datasets demonstrate improved and more stable class-level correspondence recovery, including under label corruption and domain shift.
0
cs.CV Claudia Giardina, Montse Pard\`as, Ver\'onica Vilaplana · Oct 22, 2026

Synthetic prostate MRI could help train deep learning models, but generating complete biparametric exams from anatomical masks remains underexplored. This paper proposes a 3D diffusion framework that compares sequential versus joint synthesis of T2-weighted and diffusion modalities, and evaluates directly synthesizing ADC and computed high-b-value DWI instead of deriving them from raw diffusion-weighted images. The work matters because it identifies practical pathways for generating clinically complete exams and shows that direct biomarker synthesis outperforms two-step derivation.

Synthetic biparametric MRI (bpMRI) may help alleviate the limited availability of large and representative prostate MRI datasets for deep learning applications. In this work, we present a conditional 3D diffusion framework for anatomy-conditioned synthesis of complete prostate bpMRI from anatomical masks. The framework supports sequential synthesis, in which T2w and diffusion modalities are generated by separately trained models, and joint synthesis, in which all bpMRI modalities are generated simultaneously within a single model. Five configurations were trained using PI-CAI, FastMRI Prostate, and PROSTATEx datasets to investigate different conditioning schemes, target modalities, and synthesis strategies. Evaluation using distribution-based metrics, paired-image similarity, and qualitative assessment demonstrated the feasibility of both synthesis pathways. Joint synthesis achieved competitive distributional fidelity while generating complete bpMRI, whereas direct synthesis of ADC and computed high-b-value DWI outperformed their derivation from synthetic diffusion-weighted images.
0
cs.CL Tirana Noor Fatyanosa, Ummu Ditya Erliana, Mahendra Data et al. · Oct 22, 2026

Clinical question answering in Indonesian is hampered by a complete lack of public, domain-specific data. IndoNutriQA introduces 911 expert-authored, abstractive question–answer pairs grounded in real clinical-nutrition reports, using eight standardized questions from the Nutrition Care Process to create a controlled evaluation benchmark. Its rigorous validation protocol and public release aim to advance low-resource clinical NLP and nutrition-focused decision support.

Clinical Question Answering (QA) underpins Clinical Intelligent Decision Support Systems, but progress is severely limited for low-resource languages such as Indonesian by the absence of public domain-specific data. We introduce IndoNutriQA, an expert-curated Indonesian clinical QA benchmark of 911 question-answer pairs built from real clinical-nutrition reports. Rather than a large-scale training corpus, it is positioned as a high-quality evaluation resource: every pair is grounded in a clinically relevant context, enriched with structured metadata (anthropometric assessment, medical diagnosis, document provenance, chunk segmentation). Eight standardised question types following the Nutrition Care Process (NCP), including the Problem, Etiology, Sign and Symptom (PES) diagnosis statement, are answered for every report, which was written by a graduate-level dietetic intern, by one of three nutritionists. Answers are free-form clinical prose rather than extractive spans, and an expert validation study finds 6-10% of reference answers contestable. The dataset supports generative, extractive and retrieval-augmented QA as well as zero- and few-shot LLM evaluation. We report fine-tuned baselines (IndoBERT variants, mT5, RAG) with 5-fold cross-validation, learning curves and bootstrap 95% confidence intervals, and benchmark eight contemporary LLMs zero- and five-shot. We further calibrate our LLM-as-judge rubric against three expert raters (one RD, two nutritionists), finding it human-comparable on factuality and completeness but unreliable on clinical safety, and a human error analysis shows it misses unsupported content that the raters identify. IndoNutriQA is released to foster research in Indonesian clinical NLP and nutritional decision support.
0
cs.CV Aijing Yu, Zhengbo Wang, Lijun Sheng et al. · Oct 22, 2026

The paper tackles open-vocabulary semantic segmentation without pixel-level annotations, aiming to adapt CLIP from image-level classification to dense prediction. Its core idea is a regional semantic preservation module that alters the final attention layer to use a v-v self-attention mapping, together with a visual prototype memory bank and self-training with EMA to refine predictions. The prospect of annotation-free dense segmentation is appealing, but the paper’s claims and reproducibility need close scrutiny.

Contrastive Language-Image Pre-training (CLIP) has shown superior performance in the image-level open-vocabulary classification task, benefiting from its powerful alignment of visual features and text embeddings. However, dense prediction tasks require models to perform pixel-level predictions, necessitating modifications to CLIP for region-text alignment. In this paper, we adjust the attention layers within the vanilla visual encoder of CLIP. With a novel attention calculation method for selective attention features, the model retains more regional semantic information. To further mitigate the negative impact of the modality gap, we introduce additional visual prototypes to refine the original predictor solely based on text embeddings. Specifically, patch features with confident predictions are selected to form an additional auxiliary memory-based classifier for more accurate prediction. We further integrate an optimizable feature extractor with an exponential moving average updating strategy to enhance prediction quality. Extensive experiments on $5$ semantic segmentation datasets demonstrate the effectiveness of our method.
0
cs.LGcs.DC Kyrylo Yemets, Andrii Yaroshevych, Victor Muryn et al. · Oct 22, 2026

Apple Silicon dominates local LLM inference, yet nearly every published optimization is designed and benchmarked on NVIDIA server GPUs under batched serving workloads. This paper asks which speedups survive when moved to single-request, unified-memory Apple machines, evaluating four families—KV-cache pruning, speculative decoding, ported CUDA kernels, and post-training quantization—across four Apple devices with matched RTX 4090 controls. The central finding is that a reported speedup is not an intrinsic property of a technique but a joint function of technique, runtime, hardware contract, and workload regime.

Apple Silicon is among the most widely used platforms for local LLM inference, yet nearly all inference optimizations are designed and validated on server-class NVIDIA GPUs under batched serving workloads. Which optimizations retain their benefits when moved to Apple Silicon, and what determines their applicability? We evaluate four optimization families: KV-cache pruning, speculative decoding, ported GPU kernels, and post-training quantization. Experiments span four Apple machines under a common single-request decode workload, with matched RTX 4090 comparisons where possible. KV-cache pruning can reach up to 1.75 times end-to-end throughput on Apple but can reduce throughput on desktop NVIDIA GPUs. Under the common benchmark, all evaluated speculative decoding methods reduce throughput on Apple, despite reported 2-6 times gains on server GPUs. CUDA kernel designs transfer only partially: public Metal lacks asynchronous copy, and batch-one decode makes several serving-oriented mechanisms inapplicable, although transferable components yield up to 1.20 times decode throughput. Quantization gains vary by machine. Across four families, a reported speedup is not a portable property of a technique alone but a joint function of technique, runtime, hardware contract, and workload regime.
0
cs.CVcs.LG Chuang Chen · Oct 22, 2026

RaSFNet tackles LiDAR semantic segmentation by fusing 3D point features with 2D frustum features in a projection-based pipeline. Its three proposed modules—RAGDE for ray-aligned geometric encoding, STAM for azimuth-aware global context via a scan-serpentine Mamba, and RCPFF for range-constrained cross-representation fusion—are designed to resolve projection conflicts and preserve 3D spatial correspondence. The method reports $70.2\%$ mIoU on the SemanticKITTI validation set and $77.7\%$ on the nuScenes validation set.

LiDAR point cloud semantic segmentation is a fundamental component of 3D perception for autonomous driving and robotics. Projection-based methods map 3D point clouds into 2D representations for feature extraction using 2D networks. However, aggregating multiple points during projection can obscure geometric differences within each frustum, while local feature extraction limits the modeling of spatial relationships across scanning regions. Moreover, proximity in the projected representation does not necessarily imply proximity in 3D space, and interactions between point and projected features may mix features from different ranges, reducing semantic discriminability. To address these challenges, we propose the Ray-aligned and Scan-aware Fusion Network (RaSFNet), which incorporates point cloud geometry and LiDAR scanning characteristics into projection-based semantic segmentation. Specifically, the Ray-Aligned Geometric Distribution Encoding (RAGDE) module characterizes point distributions within each frustum using a ray-aligned coordinate system. To model spatial context, a Scan-Topology-Aware Mamba (STAM) block organizes frustum features according to the LiDAR azimuth sampling pattern and captures long-range dependencies across scanning regions. In addition, a Range-Constrained Point-Frustum Fusion (RCPFF) mechanism uses shared range information to guide feature exchange between point and frustum representations while maintaining spatial correspondence. RaSFNet achieves mIoU scores of 70.2% and 77.7% on the SemanticKITTI and nuScenes validation sets, respectively, indicating competitive segmentation performance compared with the evaluated methods.
0
cs.CV Zhaolu Kang, Tailong Luo, Chenxin Li et al. · Oct 22, 2026

Long chain-of-thought helps vision-language models solve complex visual tasks, yet it introduces a temporal grounding problem: intermediate reasoning steps can drift from image evidence, and standard final-answer reinforcement learning cannot credit which tokens should have revisited the image. This paper identifies "visual revisit"—localized spikes in cross-modal attention after language-internal reasoning—as a key temporal signal. The authors show across three backbones that revisit peaks predict correctness and are causally linked to accuracy. Building on this, they propose RECAP, a GRPO-compatible training method that propagates terminal rewards through revisit-conditioned dynamic discounting and gated value prediction, yielding consistent HallusionBench gains without inference-time cost.

Long chain-of-thought reasoning improves vision-language models (VLMs), but it also exposes a temporal grounding failure: as generation unfolds, models may drift from image evidence while reinforcement learning still provides only a final-answer reward. We study this gap through visual revisit, a temporally localized reactivation of image evidence during reasoning. Across three VLM backbones, revisit peaks are predictive of correctness and causally linked to performance: masking them degrades accuracy more than masking non-peaks, while injecting revisit-like peaks into failed rollouts partially restores correct answers. Control analyses show that this signal is not explained by raw attention strength, uncertainty, logit margin, or hidden-state norm. We propose RECAP, a GRPO-compatible training method that turns detached revisit traces into a credit-assignment signal. RECAP uses revisit-conditioned advantage estimation, dynamic discounting, and gated value prediction to propagate final rewards through visually important reasoning steps, without extra rewards, additional rollouts, or inference-time changes. Across Qwen2.5-VL-7B, InternVL3-8B, and LLaVA-OV-7B, RECAP consistently improves over GRPO and VPPO, yielding $+6.1$--$+6.5$ HallusionBench gains over the SFT base while preserving reasoning and text-only performance. Results on larger LoRA-tuned models, Chinese zero-shot benchmarks, visual perturbations, and human evaluation further demonstrate robust improvements in image-grounded reasoning.
0
physics.data-ancs.LGhep-ex Shuhang Li, Haiwang Yu, Gabor Galgoczi et al. · Oct 22, 2026

Modern nuclear and particle physics detectors such as the sPHENIX TPC produce increasingly large, sparse data volumes that strain conventional reconstruction. This work evaluates FM4NPP, a ~200M-parameter Mamba-based foundation model pretrained on TPC spacepoint sequences via self-supervised $k$-Next-Nearest-Neighbor prediction, on downstream track finding and particle identification. The central claim is that a single frozen backbone with lightweight adapters can outperform a traditional Cellular-Automaton seeder at low momentum and match or exceed a Gaussian-Process-Regression $dE/dx$ baseline for PID, potentially extending physics reach while simplifying analysis chains.

Modern high energy nuclear and particle physics experiments produce large amounts of sparse data that must be reduced significantly in size before performing physics analysis. Recently, there has been an effort to evaluate Foundation Models as a potential tool for performing data analysis. These models have been shown to learn features in high dimensional datasets based on the multi-modal data they are trained on. To show their effectiveness at performing complex pattern recognition tasks, such as reconstructing charged particles in a magnetic field, we evaluated the performance of a Foundation Model based reconstruction on several downstream tasks with a dataset composed of spacepoints in a Time Projection Chamber. We show that the performance of the Foundation Model based data analysis significantly improves upon that of traditional methods, and furthermore can be adapted to learn additional tasks that are not necessarily related to the initial training objective.