arXiv's cs.CV (Computer Vision) category covers research on image and video understanding, generation, and recognition - the visual perception side of AI.
A new arXiv preprint introduces SafeIMG, a benchmark designed to test AI-generated image detectors in 12 scenarios relevant to public and individual safety. The study finds that leading vision-language models and specialized detectors perform far below human accuracy, with the best model detecting only about half of synthetic images and providing limited explanations for anomalies. Detection and explanation performance drops further for commonsense and physical inconsistencies, and after image degradation.
Why it matters: The results highlight significant limitations in current AI image detection tools, raising concerns about their reliability in high-stakes contexts where visual authenticity is crucial.
A new arXiv preprint introduces adversarial examples with large, visible perturbations that cause AI models to maintain correct predictions while humans can no longer recognize the images. On benchmarks like CIFAR-10, a human proxy's accuracy drops to chance levels, while the model remains unaffected, and standard out-of-distribution (OOD) detectors fail to flag these examples. Classical defenses, including adversarial training, do not mitigate the attack's success.
Why it matters: This finding exposes a significant gap between human and model perception, highlighting a blind spot in current AI safety and robustness measures.
A new arXiv preprint introduces Medical-Checklist, a benchmark designed to test whether medical multimodal models can accurately distinguish between nearly identical image captions that differ by a single medical concept. The authors report that several leading models, despite strong results on established tasks like Med-VQA, often fail this more stringent test, suggesting that current benchmarks may not fully capture real-world comprehension challenges.
Why it matters: This work highlights that widely used evaluation methods may overestimate the clinical readiness of medical AI models, raising concerns about their deployment in healthcare settings.
A new framework for generating synthetic lung CT slices combines Optimal Transport Conditional Flow Matching with geometric latent space filtering to enhance privacy. While the method reduces direct image memorization and some privacy risks, official challenge results show that deeper anatomical identity can still be inferred from generated images. This suggests that current filtering techniques are insufficient to fully protect patient identity in medical image synthesis.
Why it matters: The findings underscore a significant limitation in privacy-preserving medical image generation, with implications for data sharing and regulatory compliance.
A new study demonstrates that cropping student responses with bounding boxes significantly enhances both the accuracy and computational efficiency of small language models (SLMs) on vision-based grading tasks. Evaluated on scanned handwritten answers from the 2025 Australian Physics Olympiad, SLMs ranging from 4B to 72B parameters showed improved grading performance and reduced computational cost when this preprocessing step was applied. The method addresses challenges posed by visual distractions and large image sizes in automated exam grading.
Why it matters: This approach could make automated grading with SLMs more practical and scalable for educational assessments involving handwritten responses.
A new dual adversarial fine-tuning framework has been proposed to enhance the robustness of large vision-language models (LVLMs) against adversarial attacks. By jointly optimizing visual and semantic supervision signals, the method generalizes across multiple tasks—including zero-shot classification, image captioning, and visual question answering—without requiring task-specific retraining. Experimental results indicate that this approach outperforms existing state-of-the-art defense methods in adversarial robustness evaluations.
Why it matters: This work offers a generalizable defense mechanism that addresses the vulnerability of LVLMs to adversarial attacks across diverse multimodal tasks.
A new causal evaluation of attention and saliency heatmaps in medical Vision-Language Models (VLMs) for chest X-rays finds that none of the tested VLMs produce faithful visual explanations. The study assessed MedGemma, LLaVA-RAD, Qwen3-VL, and CheXagent, showing that their heatmaps either anti-correlate with causal importance or reflect near-text-only behavior. In contrast, standard chest X-ray classifiers passed all faithfulness metrics, indicating the issue is specific to VLM heatmaps.
Why it matters: This work challenges the reliability of widely used visual explanations in medical AI, showing that attention heatmaps can be visually reassuring but causally unfaithful, which has direct implications for clinical deployment and trust.
AlayaRenderer-Flash is a real-time generative renderer that increases the original AlayaRenderer's speed from 0.56 FPS to 31.54 FPS. It achieves this by using a few-step autoregressive streaming model and lightweight distilled codecs, enabling continuous rendering from physics engine outputs. The system maintains scene structure and supports both G-buffer and text-prompt interfaces for user control.
Why it matters: This work shows that generative world models can now operate at interactive frame rates, enabling real-time, controllable environments without traditional rendering pipelines.
Researchers introduce PhyParam-Dataset, a collection of 130,000 physically simulated videos with detailed physical parameterization, and PhyParam, a diffusion model that conditions video generation on explicit physical parameters such as force, mass, and friction. The model demonstrates improved physical consistency in image-to-video generation while maintaining visual fidelity. Additionally, the team establishes PhyParam-Bench, a new benchmark for evaluating physical-law consistency in generated videos.
Why it matters: This work enables explicit control over physical parameters in video generation, advancing the realism and controllability of simulated physical dynamics.
A new preprint introduces Moving Alphabet, a procedural testbed designed for controlled experiments on text-to-video training data. The study finds that a diverse and balanced distribution of video content and duration is critical for model generalization, and that caption quality significantly affects both performance and training efficiency. It also shows that classifier-free guidance and fine-tuning on high-quality data can only partially recover performance if pre-training data is poor.
Why it matters: This research provides systematic insights into the underexplored role of training data quality and distribution in text-to-video models, offering guidance for effective data curation.
A new benchmark, MissingBench-Verified, demonstrates that leading vision-language models (VLMs) consistently fail to recognize when an essential part of an object is missing from an image. This failure persists even when external tool evidence, such as image processing outputs, contradicts the model's initial perception. The study finds that current mitigation strategies—including tool-assisted verification, autonomous visual reasoning, and fine-tuning—offer negligible improvement, indicating that this limitation cannot be addressed with existing techniques.
Why it matters: This exposes a fundamental limitation in current VLMs for inspection and monitoring applications, suggesting that more substantial architectural or training changes are required.
Researchers introduce ZeroSplat, a training-free framework for generalized referring segmentation in 3D Gaussian Splatting. ZeroSplat enables segmentation of zero, one, or multiple targets in response to language queries by transferring 2D vision-language model priors into 3D space using multi-view geometric constraints. The method demonstrates significant performance improvements over existing approaches on the newly proposed GR-LERF and GR-ScanNet benchmarks, without requiring per-scene optimization.
Why it matters: ZeroSplat addresses key limitations in language-guided 3D scene understanding, enabling more flexible and efficient segmentation that better reflects the ambiguity of real-world instructions.
Researchers have introduced DuSPiT, a dual-branch architecture for pixel-space diffusion transformers that separates global structural reasoning from local appearance modeling. The model features a compact base branch for efficient global reasoning and a parallel pixel branch organized into subpatch groups for detailed appearance, with cross-attention facilitating interaction between the branches. Experimental results indicate that DuSPiT produces images with richer details and achieves a better quality-efficiency trade-off compared to previous pixel-space diffusion transformers.
Why it matters: DuSPiT advances image generation by improving detail preservation and efficiency in pixel-space diffusion transformers.
Researchers introduce a sim-to-real framework for tomato plant segmentation that leverages synthetic data generation and fine-tuning of the Segment Anything Model 3 (SAM 3). By procedurally modeling a commercial cherry tomato greenhouse, they create a large-scale synthetic dataset to specialize SAM 3's text-conditioned segmentation for greenhouse crop organs. The method leads to notable improvements in segmentation performance and model confidence on real-world greenhouse datasets.
Why it matters: This work provides a practical solution to the scarcity of annotated training data in agricultural computer vision, advancing reliable automation for crop phenotyping.
A new framework called Distribution-Aware Expert Routing (DAER) is introduced for adapting video multimodal large language models (Video-MLLMs) to sequentially evolving domains. DAER uses domain-isolated lightweight experts and a distribution-aware routing mechanism to reduce cross-domain interference and catastrophic forgetting, while keeping the pretrained backbone frozen. Experiments on a benchmark of ten diverse video question-answering datasets show that DAER consistently outperforms previous continual learning methods.
Why it matters: This approach advances the robustness and adaptability of video understanding systems in real-world scenarios where data domains change over time.
A new preprint demonstrates that post-training quantization (PTQ) of vision models for edge robotics can significantly reduce robustness to real-world distribution shifts, such as sensor noise and severe weather, even when in-distribution accuracy is maintained. The authors introduce Recti-Q, a lightweight feature-space rectification framework that restores much of the lost robustness with minimal parameter and compute overhead, and supports efficient over-the-air patching for deployed robotic fleets.
Why it matters: This work highlights and addresses a critical robustness gap in quantized perception models for edge robotics, improving reliability in unpredictable real-world environments.
A new study finds that class descriptors generated by large language models (LLMs) for zero-shot image classification often lack visual evidence, causing ImageNet accuracy to drop from 59.5% to 15.5% when class names are omitted. The researchers propose a method that selects attributes directly from target images using CLIP's embedding space, achieving 23.8% accuracy without class names and outperforming prompt-tuning methods with significantly less computation.
Why it matters: This work exposes a key limitation in LLM-based descriptor generation for vision-language models and introduces a more robust, interpretable, and efficient alternative.
A new preprint investigates how Vision Mamba (VMamba) and MambaOut, two state-space model-based vision architectures, encode visual information differently. The study finds that VMamba distributes discriminative signals across token directions, while MambaOut concentrates them in high-norm foreground tokens. This difference in encoding strategies explains why VMamba outperforms MambaOut in dense prediction tasks such as semantic segmentation, especially at high resolutions.
Why it matters: These findings could inform the design of more effective vision backbones for dense prediction tasks by highlighting the importance of token magnitude and direction in model representations.
A new preprint introduces Surprise Forcing, a training-free framework designed to enhance long video generation by adaptively managing memory and denoising steps. The method employs a Surprise-Gated Memory Bank to retain important visual information and a Surprise-Aware Denoising schedule that dynamically skips steps for easier video segments. Experimental results on several benchmarks demonstrate improved long-horizon consistency and visual quality, while maintaining real-time streaming throughput.
Why it matters: This approach addresses major challenges in streaming video generation, enabling longer and more coherent videos without compromising efficiency.
A new study demonstrates that pretrained generative image-editing models can be adapted as a unified interface for numerical simulation across a wide range of physical systems, including elliptic equations, fluid dynamics, and elasticity. By encoding both inputs and solutions as images and introducing scalar parameters through lightweight adapters, the approach enables the model to represent diverse static and time-dependent physical mappings. The work highlights broad applicability but also notes key limitations, such as challenges with chaotic systems and enforcing governing equations.
Why it matters: This research suggests that general-purpose image models could be repurposed as flexible numerical solvers, potentially simplifying access to complex physical simulations.