arXiv's cs.SE (Software Engineering) category includes research on AI for writing, testing, and maintaining code - coding assistants and autonomous coding agents.
A new arXiv preprint introduces RepoReasoner, a benchmark designed to test large language models (LLMs) on repository-level code reasoning tasks that require understanding across multiple files and complex dependencies. The study finds that even top-performing LLMs achieve only 69.1% Pass@1 on output prediction and display high precision but low recall on call chain prediction, indicating difficulty with multi-hop dependency reasoning. The results suggest that current LLMs have significant limitations in handling real-world software engineering scenarios involving cross-file reasoning.
Why it matters: This work exposes a key gap in LLMs' ability to reason about large, multi-file codebases, which is essential for practical software engineering applications.
A study of 1,723 Model Context Protocol (MCP) applications on GitHub finds that while most use configuration files and official SDKs, only about a third require human approval before tool execution. The analysis also notes a lack of standard naming conventions for configuration files, and that most applications allow LLMs to invoke enabled tools without additional checks. These findings highlight variability in safety-related practices across the MCP application ecosystem.
Why it matters: The inconsistent implementation of human oversight in MCP applications raises concerns about the safety and control of autonomous AI agents using these tools.
A new arXiv preprint audits licenses for over 364,000 datasets and 1.6 million models on Hugging Face, along with 140,000 GitHub projects, uncovering systemic non-compliance: 35.5% of model-to-application transitions relicense under more permissive terms, removing restrictive clauses. The authors also introduce a rule engine that detects 86.4% of license conflicts in software applications, and release both their dataset and tool for further research.
Why it matters: The findings highlight significant legal and ethical risks in the open-source AI ecosystem, underscoring the need for automated license compliance tools.
A large-scale analysis of over 230,000 dataset-to-model-to-application chains on Hugging Face and GitHub finds that 62.3% of these chains include at least one artifact lacking a declared license. The study also reports that licenses with legal obligations rarely persist through the supply chain, with less than 7% end-to-end survival, while permissive licenses are retained in 95.1% of cases.
Why it matters: This highlights a significant challenge for legal compliance and rights enforcement in the AI ecosystem, raising concerns for developers, rights holders, and platform operators.
A new arXiv preprint introduces TRACE, a method for evaluating how large language models (LLMs) allocate trust across conflicting software artifacts such as code, documentation, and tests. Testing seven LLMs on Java method bundles with injected faults, the study finds that models are much better at detecting errors in documentation than in code, and often fail to deprioritize faulty implementations when documentation appears correct. The results suggest LLMs may over-rely on documentation and miss subtle code errors, with confidence scores offering little help in distinguishing correct from incorrect judgments.
Why it matters: This highlights a significant limitation in current LLM-based coding assistants, raising concerns for their use in safety- or correctness-critical software development.
A new arXiv preprint introduces CEO-Bench, a benchmark designed to test language model agents on managing a simulated startup over 500 days, requiring long-term planning, adaptation, and multi-task coordination. The study finds that only a few advanced models—Claude Fable 5, GPT-5.6 Sol, and Claude Opus 4.8—end with more than the initial $1M balance, but all perform worse than a simple rule-based baseline. This highlights a significant gap in current AI agents' ability to handle complex, sustained decision-making tasks.
Why it matters: The results suggest that even leading AI models are not yet capable of reliably managing complex, long-term real-world tasks, underscoring a key limitation for practical deployment.
FVRuleLearner is a new framework that applies Operator Reasoning Trees (Op-Trees) to automate the translation of natural language specifications into SystemVerilog Assertions (NL-to-SVA) for formal verification. By decomposing the alignment process into operator-aware reasoning steps, FVRuleLearner enables more accurate and interpretable rule generation. In evaluations, it outperformed state-of-the-art baselines in both syntax and functional correctness, and significantly reduced SVA functional failures across operator categories.
Why it matters: This work introduces a novel, interpretable approach that improves the reliability and efficiency of automated formal verification, which is essential for ensuring hardware correctness.
Researchers have introduced QuArch, the first benchmark specifically designed to evaluate large language models' (LLMs) knowledge and reasoning abilities in computer architecture. QuArch includes 2,671 expert-validated question-answer pairs spanning topics such as processor design and memory systems. Leading LLMs achieved between 34% and 73% accuracy on advanced questions, and fine-tuning on QuArch led to improved performance on a realistic memory hierarchy design task, yielding more area-efficient and viable hardware solutions.
Why it matters: QuArch addresses a significant gap in LLM evaluation by providing a domain-specific benchmark for computer architecture, enabling more rigorous assessment and development of AI capabilities in this critical field.
A new controlled longitudinal study investigates the impact of agent harness evolution on coding agent quality, finding that quality regressions often attributed to large language models (LLMs) are actually caused by updates to the agent harness. By evaluating 35 sequential releases of the Qwen Code CLI while keeping the underlying LLM constant, the study reveals that quality fluctuations are linked to specific development patterns and architectural changes in the harness.
Why it matters: This research challenges the common assumption that LLMs are primarily responsible for coding agent regressions, highlighting the significant influence of agent harness middleware and the importance of its careful management.
Researchers introduce SWE-Milestone, a benchmark designed to evaluate AI agents on streams of milestone-level coding tasks that simulate real-world software evolution. By testing 12 advanced models across 4 agent frameworks, they observe that performance drops from over 80% on isolated tasks to 38.03% in continuous, evolving scenarios. This highlights significant challenges for AI agents in maintaining system integrity and managing error propagation over time.
Why it matters: This benchmark reveals a major limitation in current AI coding agents: their inability to reliably handle long-term software maintenance, which is essential for real-world applications.
TraceDev is a multi-agent framework designed to convert natural language requirements into repository-level code using five specialized agents and a traceability graph. In evaluations on two datasets, TraceDev achieved success rates of 53.63% and 56.82%, outperforming state-of-the-art baselines by up to 340.80%. The framework emphasizes explicit requirement traceability, supporting more reliable code generation for complex software scenarios.
Why it matters: TraceDev introduces a novel approach to requirement traceability in automated code generation, addressing a key limitation in current LLM-based software development methods.
Researchers present Spaghetti Architect, a tool that generates code datasets in five programming languages (Python, JavaScript, Go, Java, C++) with controlled difficulty and resistance to data contamination. The tool produces correct-by-construction programs from a known-optimal reference, allowing for reliable evaluation of code models. It enables fine-grained control over code 'messiness' and labels each instance along intrinsic and incidental difficulty axes.
Why it matters: This tool addresses the persistent challenge of data contamination in code model evaluation by enabling the creation of fresh, controlled, and contamination-resistant datasets.
Researchers introduce LISA, a framework that leverages large language models (LLMs) to generate API sequences and program invariants for detecting functional bugs in software libraries. LISA achieves higher bug-detection rates and competitive code coverage compared to traditional fuzzing and previous LLM-based test generation methods.
Why it matters: LISA offers a new approach to uncovering non-crashing functional bugs that are often missed by conventional fuzzing techniques, potentially improving software reliability.
Researchers have released SciCodePile, a 128GB dataset of scientific code collected from 37,737 public repositories, along with a 200-task executable benchmark designed to rigorously test code generation by large language models (LLMs). Evaluation of 15 LLMs on this benchmark revealed that even the best-performing model achieved only 12.30% Pass@1 on executable tasks, indicating that scientific code generation remains a major challenge for current LLMs.
Why it matters: This work establishes a new large-scale standard for evaluating scientific code generation and demonstrates that current LLMs are not yet reliable for this critical application area.
A new preprint demonstrates that widely used benchmarks for evaluating LLM-generated GPU kernels can incorrectly certify buggy code as correct. The study shows that these benchmarks, which rely on fixed-shape, small-sample allclose checks, often miss subtle errors. By applying op-schema-aware seeded fuzzing with high-precision references, the authors catch all tested bugs without false positives across five different GPU classes.
Why it matters: This work reveals a critical flaw in current evaluation methods for LLM-generated GPU code, indicating that many kernels considered correct may actually harbor undetected bugs.
Researchers used large language models (LLMs) to generate Alloy formal specifications from both documentation and source code for two Python libraries, then derived executable tests from these specifications. Their pipeline uncovered a genuine bug in Flipper—a feature flag management system—where duplicate flag names were silently accepted, a defect missed by a direct LLM test generation baseline that achieved 68% branch coverage. Additionally, code-derived specifications showed lower variance in test generation compared to documentation-derived ones.
Why it matters: This study demonstrates that LLM-generated formal specifications can reveal constraint-level software defects that may be overlooked by coverage-focused test generation, suggesting a new avenue for improving automated software validation.
Researchers introduce 'falsifiable release gates,' a methodology requiring every new capability in self-improving AI systems to pass a pre-declared, machine-checkable acceptance suite while preserving fixed safety invariants. This approach was implemented in the Antahkarana runtime, where safety invariants held unchanged across six releases, and the acceptance suite expanded from 122 to 563 tests. The system demonstrated gated self-improvement on real hardware, increasing a small model's accuracy from 20% to 70% while automatically rejecting unsafe candidates.
Why it matters: This work offers a practical, verifiable framework for maintaining safety guarantees in self-improving AI systems, addressing a key challenge in AI alignment and deployment.
Researchers have introduced eight uncertainty and five quality metrics tailored for evaluating Vision-Language-Action (VLA) robots, moving beyond traditional binary success rates. In a large-scale study involving 908 successful task executions from three state-of-the-art VLA models, these metrics demonstrated moderate to strong correlation with human expert judgments. The findings suggest that these metrics can better capture task quality and model confidence, and can distinguish between varying levels of execution quality even when binary success is achieved.
Why it matters: This work offers a more nuanced and informative evaluation framework for VLA robots, supporting improved real-time monitoring and adaptive system improvement.
A new preprint formalizes 'binding drift' in tool-augmented language-model agents, where entity bindings that are correct at step 1 can silently become incorrect in later steps, distinct from simple error propagation. In a controlled testbed, the commonly suggested 'entity lock' fix actually amplifies wrong actions by 3x, while a lightweight LLM-based re-verifier reduces wrong actions by 79%, nearly matching an oracle upper bound.
Why it matters: This work identifies a previously underappreciated failure mode in multi-step tool-augmented agents and demonstrates a practical mitigation, with direct implications for the reliability of such systems.
A new preprint introduces Skillware, a software abstraction designed to formalize and manage persistent behavioral artifacts—called Skill Artifacts—in AI agent systems. The paper defines Skillware Units as managed software entities with independent identity and lifecycle, operationalized through three necessary conditions: behavioral primacy, independent software identity, and an Agent Host execution relationship. The work is supported by analysis of a large corpus of SKILL.md records and multiple engineering implementations, establishing a recurring artifact structure and lifecycle engineering considerations.
Why it matters: Skillware offers a formal ontology and lifecycle for agent skills, potentially enabling more robust, maintainable, and evolvable software artifacts in AI agent ecosystems.