← Back to arXiv Robotics

arXiv Robotics briefings

ResearchOfficialarXiv Robotics

OptiTac: Biomimetic Optical-Fiber Tactile Sensor for Robots

Researchers have developed OptiTac, a biomimetic tactile sensor that uses optical fibers paired with mechanical pins to emulate the mechanoreceptor-to-nerve architecture of human touch. This design enables routing of tactile information away from the sensing surface while maintaining high spatial resolution. The system uses simple analytical methods, rather than deep learning, to infer contact properties such as location, size, and shape, resulting in interpretable tactile intelligence.

Why it matters: OptiTac offers a scalable and interpretable approach to distributed tactile sensing in robots, advancing the development of human-like touch perception.

ResearchOfficialarXiv Robotics

Think at 5 Hz, Act at 20 Hz: Asynchronous Fast-Slow Vision-Language-Action Inference for Closed-Loop Driving

Researchers introduce a fast-slow architecture for autonomous driving that separates a frozen 7B vision-language model (operating at 5 Hz) from a lightweight action expert (operating at 20 Hz). The slow model provides a cached scene representation, while the fast expert uses this cache and the current camera frame to generate waypoints at every simulation tick. In CARLA simulations on LangAuto-Short routes, this approach achieves 94% route completion compared to 37% for a frame-skipping baseline, and per-tick freshness reduces red-light violations by a third. The system also demonstrates strong zero-shot transfer to unseen towns and significantly lowers waypoint error compared to the backbone model's own action head.

Why it matters: This work offers a practical solution to bridging the latency gap between large language model inference and real-time control in autonomous driving, enabling substantial improvements in closed-loop performance and generalization.

ResearchOfficialarXiv Robotics

AC-VLA: Compositional Learning Boosts Out-of-Distribution Generalization for Robotic VLA Models

Researchers introduce AC-VLA, a plug-and-play framework designed to improve out-of-distribution (OOD) generalization in Vision-Language-Action (VLA) models for robotics. The approach addresses two key failure modes—trajectory overfitting and perceptual shortcuts—by combining an LLM-driven instruction decomposer with a state-conditioned masking strategy. AC-VLA achieves approximately 28% absolute improvement on compositional OOD tasks in benchmark tests, while maintaining strong in-distribution performance.

Why it matters: Improving OOD generalization in VLA models is crucial for enabling robots to reliably perform novel task combinations in real-world environments.

ResearchOfficialarXiv Robotics

AEGIS: Assay-Aware Protocol Validation and Runtime Monitoring for Open-Source Liquid Handling Robots

AEGIS is a two-layer system for open-source liquid handlers such as the Opentrons OT-2. The first layer uses a large language model (LLM) combined with an assay rule database to detect protocol violations, achieving an F1 score of 0.97 on a multi-assay benchmark. The second layer applies PCA to pipette trajectories for runtime failure detection, reaching an average precision of 0.89. The system is open-source and demonstrates low-cost monitoring through cascade triage.

Why it matters: AEGIS enables reliable, low-cost detection of both protocol and runtime failures in open-source liquid handling robots, addressing a key gap in self-driving laboratory automation.

ResearchOfficialarXiv Robotics

Generative Partially Specified Finite State Machine for Robot Behavior Planning

Researchers introduce a Generative Partially Specified Finite State Machine (GPSFSM) neurosymbolic architecture for robot behavior planning, combining the structure of FSMs with large language models. The system demonstrates higher plan-generation success rates than the state-of-the-art BTGenBot, especially in zero-shot scenarios, while maintaining comparable or lower planning latency. An open-source ROS2 stack implementing this approach is released.

Why it matters: This work presents the first generative FSM framework for robotics, offering a computationally efficient and interpretable alternative to existing behavior planning methods.

ResearchOfficialarXiv Robotics

Comprehensive Benchmark for Robotic Arm Reach-Avoid Task Using Deep Reinforcement Learning

Researchers have introduced a comprehensive benchmark for the robotic arm reach-avoid task using deep reinforcement learning (DRL), employing MuJoCo MJX and Brax for parallelized simulation. The benchmark covers a diverse range of settings, achieving state-of-the-art success rates up to 98.8% for reach tasks and 95.2% for static reach-avoid tasks. However, the study finds that DRL agents' performance drops significantly in more realistic, complex scenarios, highlighting current limitations.

Why it matters: This work exposes the gap between DRL performance in simplified versus realistic robotic control tasks, emphasizing the need for further research to address real-world complexities.

ModelsOfficialarXiv Robotics

Xiaomi-Robotics-1: A Foundation VLA Model Trained on Over 100K Hours of Real-World Trajectories

Xiaomi has introduced Xiaomi-Robotics-1, a vision-language-action (VLA) model trained on more than 100,000 hours of real-world manipulation trajectories. The model demonstrates strong scaling behavior, achieving new state-of-the-art results on the RoboCasa365 benchmark (57.6% success rate) and RoboDojo (20.07 average score), surpassing previous bests. Xiaomi-Robotics-1 can also be efficiently fine-tuned for novel downstream tasks with minimal data.

Why it matters: This work establishes a new performance benchmark for robotics foundation models, highlighting the impact of large-scale real-world data and model scaling on generalization and adaptability.

ResearchOfficialarXiv Robotics

FLARE and ChromaGuard: Adversarial Lighting Attacks and Defenses for VLA Models

Researchers introduce FLARE, a physical spotlight attack that can reduce Vision-Language-Action (VLA) model task success rates to zero without requiring access to model internals. They find that standard adversarial training causes models to ignore color information, leading to degraded performance on color-dependent tasks. To address this, they propose ChromaGuard, a chroma-preserving defense that restores high success rates—97.5% on benign and 92.5% on attacked tasks—on a real robot platform.

Why it matters: This work exposes a critical vulnerability in VLA models to lighting-based attacks and demonstrates a practical defense, informing the deployment of robust robot manipulation systems in real-world environments.

ResearchOfficialarXiv Robotics

MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning

MEMORA introduces Embodied Action Memory (EAM), a structured memory system for long-horizon robot planning that mimics human-like recall of past experiences. The system uses a formation-consolidation-retrieval lifecycle with four distinct memory stores and is evaluated on 45 hours of EPIC-KITCHENS-100 video. MEMORA demonstrates improvements in memory-assessment accuracy by up to 20.5 points and robot-grounded plan scores by 16.6% over baseline methods.

Why it matters: This work advances robot planning by enabling systems to leverage structured, persistent memories of past experiences, leading to more effective long-term reasoning and action.

ResearchOfficialarXiv Robotics

CosFly-VLA: Spatially Aware Vision-Language-Action Model for UAV Tracking

CosFly-VLA is a spatially aware vision-language-action (VLA) model designed for UAV tracking in complex environments with frequent occlusions. The model jointly grounds targets, estimates their visibility, and generates flight actions using a structured prediction interface. Its multi-stage training pipeline includes spatial pretraining, curriculum-based fine-tuning, chain-of-thought reasoning, and reinforcement learning. Compared to OpenVLA, CosFly-VLA achieves over 34% reduction in displacement error and up to 29.8% improvement in success rate on benchmark tests.

Why it matters: This work demonstrates a significant advance in robust UAV tracking by integrating spatial reasoning and occlusion handling, enabling more reliable autonomous navigation in challenging real-world scenarios.

ResearchOfficialarXiv Robotics

Agent-Client Protocol Proposed as Standard for Human-Robot Interaction in GenAI Architectures

A new preprint proposes adopting the Agent-Client Protocol (ACP) as a unified communication standard for the human-robot interaction (HRI) layer in agent-based robotic systems. By combining ACP with the Model Context Protocol (MCP), the authors introduce a decoupled three-layer architecture that separates human interaction, deliberative orchestration, and physical execution. Experiments on a physical mobile robot demonstrate interoperability across three different user interfaces with negligible latency overhead.

Why it matters: Standardizing the HRI layer could reduce fragmentation and enable more flexible, real-time human-in-the-loop collaboration in robotic systems.

ResearchReportedarXiv Robotics

Scaling Behavior Foundation Models for Humanoid Robots

A new arXiv preprint presents a scaling recipe for Behavior Foundation Models (BFMs) in humanoid robot control. The authors coordinate motion tracking learning, on-policy rollouts with diverse reference motions, and a Humanoid Transformer architecture to improve control fidelity and generalization. Their approach achieves substantial reductions in Mean Per-Keypoint Position Error—over 10% in local mode and 82% in global mode—compared to existing humanoid controllers, as demonstrated in both simulation and real-world tests.

Why it matters: This work offers a principled and effective framework for scaling BFMs, advancing the development of more capable and general-purpose humanoid robots.

ResearchOfficialarXiv Robotics

Cloud-Edge Multimodal System Improves Robot Gesture Recognition and Task Planning

A new cloud-edge multimodal interaction framework for robots integrates an enhanced YOLO-based gesture detector with large language and vision-language model agents. The system achieves high precision (98.9% on a public dataset) and strong task success rates (95% for single-action tasks) while offloading intensive computation to the cloud. User evaluation with 30 participants reported a mean satisfaction score of 3.69 out of 5.

Why it matters: This work demonstrates a practical and effective approach to combining advanced gesture detection with large language and vision models for improving human-robot interaction in resource-constrained settings.

ResearchOfficialarXiv Robotics

ConFlow: Constraints-Guided Flow Matching Improves Robot Motion Generation

A new framework called ConFlow introduces constraint-guided flow matching for robot motion generation by integrating constraints directly into the training process using differentiable barrier or cost functions. The method leverages conditional Gaussian processes and uses infeasible demonstrations as negative supervision to enhance constraint satisfaction. Experiments on a two-robot navigation task show that ConFlow achieves lower collision rates and higher trajectory quality compared to standard flow matching approaches.

Why it matters: Integrating constraints during training addresses the gap between training and inference in generative motion models, potentially improving the safety and reliability of robot motion planning.

ResearchOfficialarXiv Robotics

GCA-Bench: Benchmarking Complex Robotic Grasping Beyond Visual Detection

Researchers have introduced GCA-Bench, a new benchmark designed to evaluate robotic grasping in scenarios that require multi-step reasoning and semantic understanding, rather than relying solely on visual detection. Empirical results show that current methods achieve less than 70% success on these complex tasks, revealing significant limitations in existing approaches.

Why it matters: GCA-Bench highlights the gap between current robotic grasping systems and the advanced reasoning required for real-world manipulation tasks.

ResearchOfficialarXiv Robotics

DiMaS: Distribution Matching for Steering Vision-Language-Action Models

Researchers introduce DiMaS, a distribution-matching steering strategy for flow-matching vision-language-action (VLA) models, enabling fine-grained behavioral control in robotic manipulation. Unlike classical linear steering, which is ineffective in this context, DiMaS transports between representation distributions to control robot behavior. The method is demonstrated to effectively steer behavior across two state-of-the-art VLA models and its generalizability is analyzed as task similarity varies.

Why it matters: This work provides a principled approach for controlling robotic policies by intervening on internal representations, addressing a key limitation in current VLA-based robotic systems.

ResearchOfficialarXiv Robotics

LifelongVLA: A Lifelong Learning Framework for Robotic Manipulation

Researchers have introduced LifelongVLA, a lifelong Vision-Language-Action learning framework designed for robotic manipulation. The framework addresses the plasticity-stability trade-off by employing a dual-timescale LoRA gating module and a cache-efficient replay strategy, allowing robots to sequentially learn new tasks while retaining previously acquired skills. Experiments with an xArm robot demonstrate that LifelongVLA outperforms existing baselines in skill retention and expansion, with reduced need for retraining.

Why it matters: This work represents a meaningful advance in lifelong learning for robotics, supporting more adaptive and efficient real-world deployment.

ResearchOfficialarXiv Robotics

LIFT: Force-Aware Post-Training Boosts VLA Policies for Contact-Rich Manipulation

Researchers introduce LIFT (Late Reactive Injection of Force for VLA Post-Training), a framework that enhances pretrained vision-language-action (VLA) policies by adding contact reactivity through a reactive action expert with force memory and cross-attention. By combining this with an online DAgger loop for training on both offline and human-corrected online data, LIFT enables faster learning and higher performance on contact-rich manipulation tasks such as towel folding and book insertion compared to vision-only post-training.

Why it matters: LIFT addresses a key limitation of vision-driven VLA policies by enabling more robust robot manipulation in scenarios involving occlusion or force-sensitive interactions, without sacrificing general manipulation knowledge.

ResearchOfficialarXiv Robotics

Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation

Researchers propose a Latent Tactile Predictor (LTP) that aligns intermediate action representations in robotic manipulation policies with future tactile outcomes. By applying tactile supervision at the most predictive representation layer, their method improves performance in real-world contact-rich manipulation tasks compared to less targeted tactile prediction approaches.

Why it matters: This work demonstrates that the placement of tactile supervision within policy architectures can significantly affect manipulation performance, providing a more effective way to integrate touch sensing into robotics.

ResearchOfficialarXiv Robotics

DriftWorld: Fast World Modeling through Drifting

DriftWorld is a new action-conditioned world model for robotics that generates future frames in a single forward pass at over 30 frames per second, making it 17 times faster than diffusion-based baselines. It achieves state-of-the-art decision-making performance on standard robotic manipulation benchmarks and can also be used as an offline simulator for policy evaluation, with rollout-based scores showing high correlation with ground truth.

Why it matters: DriftWorld's significant speed and accuracy improvements over diffusion-based models enable more efficient real-time planning and policy evaluation in robotics.