Tactile is an open-source tool layer designed to improve the reliability of computer-using agents by converting diverse UI evidence into action-grounded interface states. This enables agents to operate through an observe-ground-act-verify loop, preferring semantic actions and maintaining provenance for verification and failure analysis. In experiments on macOSWorld-style tasks, Tactile increased Codex Success@100 from 41.1% to 50.0% overall and showed consistent improvements across multiple agent models.
Why it matters: Tactile addresses a key bottleneck in agent reliability by making software actions semantic and verifiable, enabling more robust and auditable computer use by AI agents.
A new evaluation framework, Just Keep Prompting (JKP), assesses the stability of vision-language models (VLMs) like GPT-4o, Gemini 2.5 Pro, and Qwen3-VL-30B under repeated multi-turn questioning. The study finds that repeated prompting often destabilizes model answers, leading to answer flipping and reduced reliability, rather than improving reasoning. Notably, GPT-4o exhibited the most instability, while Qwen3-VL-30B and Gemini 2.5 Pro showed different failure modes under pressure.
Why it matters: This work highlights a critical failure mode in VLMs, showing that sustained conversational pressure can undermine answer reliability, which is important for real-world deployment.
A new sampling-based method called LBA is proposed for generating high-quality adversarial texts in hard-label scenarios with low query budgets. LBA constructs an approximate distribution of adversarial examples by integrating prior and posterior knowledge, enabling more effective sampling. Experiments across six language models and four datasets show that LBA outperforms state-of-the-art baselines on all evaluation metrics and produces more semantically preserved adversarial texts according to LLM-based assessments.
Why it matters: Improving the efficiency and quality of adversarial attacks is important for robustly evaluating and strengthening language models against real-world threats.
Polestar is a training-free inference framework for diffusion large language models (dLLMs) that leverages token representation drift to address inefficiencies in KV-cache reuse and challenges in decoding parallelism. It introduces Polestar-Cache for selective KV-cache refreshes and Polestar-Commit for identifying commit-ready tokens. Experiments show Polestar achieves up to 10.73% accuracy improvement and up to 3.7x higher throughput compared to existing baselines on mathematics and coding benchmarks.
Why it matters: This work demonstrates a significant advance in the efficient inference of diffusion LLMs, potentially accelerating their adoption as an alternative to autoregressive models.
A new preprint introduces the Intention Abstraction Layer (IAL), a middleware that leverages large language models and OWL ontologies to represent human intentions as persistent runtime objects in autonomous industrial systems. The IAL enables pre-execution detection and explanation of goal conflicts between autonomous agents, as demonstrated in a proof-of-concept scenario where conflicting intentions were flagged before execution. This approach shifts behavioral assurance from post-hoc analysis to intention-level checking.
Why it matters: The IAL offers a novel method for improving safety and reliability in multi-agent industrial systems by identifying and explaining goal conflicts before they lead to operational failures.
Researchers present a new method for creating a 3D MRI-text dataset in brain oncology by having multiple large language models (LLMs) collaboratively generate and verify radiology reports. Using this dataset, they develop a vision-language model that outperforms existing 2D and 3D approaches in both report generation and visual question answering tasks.
Why it matters: This work addresses the scarcity of paired 3D imaging-text data in medicine, potentially improving automated report generation and diagnostic support for brain tumors.
A new formal framework for analytic abduction is proposed, enabling AI systems to identify and manage latent causal factors under risk-sensitive commitment thresholds. The κ-τ apparatus models epistemic interactions and calibrates commitment based on decision stakes, producing causal clusters that help prevent premature convergence on explanations. Demonstrations in epidemiology and cybersecurity show the approach yields legible, decomposable explanations to support human-AI coordination.
Why it matters: This framework enables AI to present multiple plausible explanatory scenarios to humans, supporting informed decision-making even under uncertainty.
Researchers introduce AGOPS, an automatic method for generating task-specific prompt guidelines to help users write more effective queries for large language models (LLMs). AGOPS evolves these guidelines by optimizing downstream performance on reference examples, addressing the issue of prompt underspecification that can cause significant drops in LLM performance. The method demonstrates substantial recovery of lost performance across tasks such as mathematical reasoning, medical question answering, and coding.
Why it matters: This work offers a systematic solution to the widespread problem of prompt underspecification, enabling more reliable and effective use of LLMs in practical applications.
Researchers have introduced Token Time Continuous Diffusion (TTCD), a novel diffusion-based language model that operates in continuous space and assigns per-token times, allowing some tokens to be generated from noise more quickly than others. TTCD demonstrates improved performance over discrete models in conditional text generation at high speedups and achieves comparable quality in unconditional generation. A 160M parameter TTCD model, trained and self-distilled on OpenWebText, also shows gains in language modeling and Sudoku solving tasks.
Why it matters: TTCD represents a meaningful advance in diffusion language modeling by enabling faster and more accurate text generation through continuous space modeling and per-token timing.
A new study introduces a neuro-symbolic agentic framework designed to enhance the reasoning abilities of small language models (SLMs) such as Gemma 3 and Llama 3.2 by grounding their outputs in knowledge graphs. The approach leverages tool calls for fact extraction and expert hints from a relational graph convolutional network, resulting in 1.5-2x performance improvements on the CLUTRR kinship reasoning benchmark. The research also highlights key challenges, including errors in fact extraction and a distraction effect from noisy, self-generated facts.
Why it matters: This work offers a promising strategy to improve SLM reasoning efficiency without relying on large, resource-intensive models, while also identifying critical limitations in current neuro-symbolic systems.
CatalogAgent is a self-learning system designed to enhance e-commerce catalog enrichment by mediating conflicts between LLM-based generator and evaluator models through a Supervisor Agent. The system stores and summarizes learnings from these interventions in a memory base, which are then used to improve the generator and evaluator models via context engineering. Experiments show performance improvements of 15.24% for the generator and 13.98% for the evaluator, demonstrating the effectiveness of the Supervisor Agent-mediated approach.
Why it matters: This work presents a novel agentic framework for self-improving AI systems in e-commerce, enabling continuous model enhancement without human intervention.
Chat2Scenic introduces an iterative retrieval-augmented generation (RAG) framework that generates executable scenario scripts for autonomous driving testing directly from regulatory descriptions. The system achieves a 76.42% compilation success rate and 58.17% framework accuracy, substantially outperforming previous methods. The authors also provide an open benchmark and have released their code as open source.
Why it matters: This work advances the automation of regulation-compliant scenario generation, addressing a key challenge in validating autonomous driving systems.
Researchers introduce Dialogue Place Recognition (DlgPR), a new approach that frames visual place recognition as an interactive, dialogue-driven reasoning process rather than static one-shot retrieval. They present DlgQuest-Cities, the first large-scale dialogue-based benchmark for this task, and a unified framework combining a cross-modal retriever with an intelligent questioner trained via curriculum learning and reinforcement refinement. Experimental results show that this reasoning-based method significantly outperforms existing baselines.
Why it matters: This work advances geo-localization by enabling systems to resolve ambiguity through conversational interaction, offering a more robust and natural alternative to static retrieval methods.
A new preprint demonstrates that the design of evaluation instruments—such as the number of verdict options and whether success criteria are disclosed—can substantially alter measured honesty in language models. Using a text-adventure environment with a fixed player model, the authors show that expanding from two to three verdict options and clarifying success criteria dramatically reduce the incidence of false claims. The study also finds that repeated runs of the same configuration can yield unstable verdict distributions, and proposes a four-check integrity protocol for evaluation instruments.
Why it matters: This work reveals that the tools used to measure AI honesty can themselves introduce significant distortions, emphasizing the need for more rigorous and transparent evaluation protocols.
MemoHarness is a framework that adaptively optimizes agent harnesses—the control layer managing context, tools, and memory for LLM-based agents—by learning from past executions. It decomposes the harness into six editable dimensions, stores experiences in a dual-layer bank, and retrieves relevant patterns to adapt to new tasks without additional labels or search. Evaluations on shell-agent, code-generation, and analytical-reasoning benchmarks show that MemoHarness outperforms fixed harnesses and demonstrates selective transfer to unseen tasks and models.
Why it matters: This work demonstrates that execution experience can be leveraged to build more adaptive agent harnesses, potentially reducing manual tuning and improving agent performance across diverse tasks.
A new preprint demonstrates that the quality of context engineering—measured across seven criteria such as role clarity and guardrail coverage—serves as a leading indicator of AI agent reliability. Using the open-source ProofAgent-Harness, the study shows that higher context quality predicts improved behavioral outcomes, including resistance to hallucinations and better instruction following. The validation is performed independently of behavioral metrics, supporting the use of context measurement as a preflight signal for agent governance.
Why it matters: This work offers a validated, proactive method for predicting and improving AI agent reliability before deployment, supporting more robust and auditable agent governance.
Researchers have developed and validated the Generative AI Reliance Types Scale (GenAI-RTS), a 20-item instrument that measures four types of reliance on generative AI in academic writing: Strategic, Instrumental, Dependent, and Dialogic. The scale was tested with 382 undergraduates at a U.S. Minority-Serving Institution and further supported by interviews with 14 students, demonstrating good reliability and measurement invariance across gender, first-generation status, and STEM/non-STEM majors.
Why it matters: This provides educators and researchers with a robust, validated tool to assess how undergraduates rely on generative AI, informing targeted interventions and research on AI literacy.
RegNetAgents is a multi-agent AI framework designed to identify regulatory driver genes across heterogeneous gene regulatory networks by integrating TCGA and single-cell data. The system uses LangGraph DAG workflows and OncoKB annotations to rank candidate regulators, demonstrating significant enrichment for known cancer genes in breast and colorectal cancer datasets. It also includes modules for evaluating oncogenic potential, druggability, and clinical relevance, supporting end-to-end interpretation from candidate identification to hypothesis generation.
Why it matters: This framework introduces an interpretable AI approach for systematically identifying cancer driver genes across multiple regulatory networks, which could accelerate target discovery and hypothesis generation in cancer genomics.
A new study proposes replacing traditional scalar reward signals in self-evolving agent loops with a pairwise validator—a frozen large language model (LLM) that compares parent and child candidates to decide which is better. This approach eliminates the need for domain-specific labeling and reward engineering, and matches or exceeds the performance of full-reward baselines across several agent engines and artifact types. The method is demonstrated to be a drop-in replacement for per-step reward design, maintaining competitive task accuracy without additional labeling costs.
Why it matters: This method could lower the barrier to developing autonomous AI agents by reducing the cost and expertise required for reward signal design.
A new automated red-teaming framework uses a multi-agent system to generate challenging adversarial examples for multimodal large language models (MLLMs). The approach reduces the false negative rate from 41.2% to 24.5% on a public image safety benchmark, achieving this improvement without any human labeling.
Why it matters: This work presents a scalable, fully automated method for enhancing AI safety and robustness against adversarial attacks, reducing dependence on manual annotation.