Researchers present an explainable agentic system for detecting conversational scams that unfold over weeks or months, leveraging summary-based memory. The system achieves 100% phishing recall on isolated messages and 97.8% accuracy on the new ConScamBench-278 benchmark. User studies indicate increased user trust, self-confidence, and perceived need for AI-based scam detection after interacting with the system. The work also introduces ConScamBench-278, a public benchmark for reproducible evaluation of conversational scam detection.
Why it matters: This work addresses the challenge of detecting long-term conversational scams, which are not effectively caught by existing single-message detectors, and provides a new public benchmark for the field.
Researchers introduce SaMer, an object-aware token merging framework for multi-vector vision-language retrieval. SaMer compresses image-side tokens by over 93% while improving retrieval accuracy on benchmarks like Flickr30K and MSCOCO. The method preserves object-level evidence needed for effective retrieval, outperforming existing compression baselines and enhancing phrase-level grounding.
Why it matters: This work demonstrates that preserving object evidence, rather than merely reducing token count, is crucial for efficient and accurate multi-vector vision-language retrieval, enabling substantial storage and computation savings.
A new method called Depth-Entropy Guided Sampling (DEGS) leverages layer-wise entropy collapse as a quality signal to enhance large language model (LLM) reasoning at test time, without requiring any additional training. DEGS integrates sequence likelihood with collapse depth in a Markov Chain Monte Carlo (MCMC) framework, achieving state-of-the-art accuracy among training-free methods on several reasoning benchmarks. The approach demonstrates particular strength out-of-domain and on challenging tasks, sometimes surpassing reinforcement learning (RL)-trained models, all with minimal computational overhead.
Why it matters: DEGS offers a practical, training-free alternative to RL for boosting LLM reasoning, potentially lowering the cost and complexity of deploying advanced reasoning systems.
Researchers introduce MG²-RAG, a lightweight framework that constructs a hierarchical multimodal knowledge graph by combining textual parsing with entity-driven visual grounding, enabling unified multimodal nodes. The framework features a multi-granularity graph retrieval mechanism that supports structured multi-hop reasoning and aggregates dense similarities across the graph. MG²-RAG achieves state-of-the-art performance across four multimodal tasks, while reducing graph construction overhead with significant speedup and cost reduction compared to prior graph-based methods.
Why it matters: MG²-RAG advances multimodal retrieval-augmented generation by enabling efficient, fine-grained cross-modal reasoning without relying on costly translation-to-text pipelines.
Researchers have developed a foundation transformer model pretrained on multimodal sequences of user events for financial services. By unifying heterogeneous data sources into chronological event sequences and using next-event prediction, the model learns general-purpose representations that can be applied to multiple downstream tasks. The system outperformed traditional task-specific models and was deployed in production at a major Eastern European bank, where it led to measurable improvements in business metrics.
Why it matters: This work demonstrates a practical and effective foundation model for financial event sequences, showing real-world impact through improved predictive performance and reduced development overhead in a production banking environment.
A new preprint demonstrates that low-precision training can cause neural network weights to 'freeze'—stop updating—when gradient updates become too small to affect stored values, due to rounding. This freeze is deterministic and can be predicted in advance using only high-precision training trajectories and the mantissa length of the target precision. The phenomenon was observed in both small GPT models and a 124-million-parameter GPT-2, and stochastic rounding was shown to prevent the freeze.
Why it matters: This work reveals a predictable and silent failure mode in low-precision neural network training, with practical implications for the design and reliability of efficient AI systems.
A new independent testbed evaluates long-term memory (LTM) frameworks for LLM-based agents in distributed cloud-edge environments. The study compares mem0, Graphiti, cognee, RAG, and full-context baselines on the LoCoMo benchmark, finding that mem0, RAG, and full-context achieve 77–81% accuracy, while Graphiti and cognee reach only 55–56%. RAG matches the top accuracy at 8.4 times lower total cost of ownership than mem0, and both are the only non-dominated backends on the Pareto frontier.
Why it matters: This work provides the first independent, reproducible comparison of LTM frameworks for multi-agent systems, showing that retrieval completeness, not context volume, drives accuracy and that RAG offers the best cost-performance trade-off.
Researchers present NAILS, a method that aligns recommender system outputs with target distributions over item attributes such as fairness and diversity, without requiring retraining. NAILS adjusts the user-conditional item distribution to achieve specified marginal attribute distributions while preserving the system's learned user preferences. Experiments demonstrate that NAILS improves attribute-level alignment with minimal effect on user engagement.
Why it matters: This approach offers a scalable way to embed normative values like fairness and diversity into existing recommender systems without retraining or significant performance loss.
A preprint study analyzes four open-weight transformer language models and finds that multimodal instruction-tuning causes a qualitative shift in how identity-specifying system prompts are encoded in hidden-state trajectories. Specifically, the encoding changes from being direction-based in the base model to magnitude-based after multimodal RLHF instruction-tuning, a reorganization not observed in RL distillation or SFT regimes. The study uses geometric metrics and permutation tests to support these findings.
Why it matters: This work uncovers a previously unrecognized effect of multimodal instruction-tuning on internal model representations, which could inform future approaches to model interpretability and control.
This study systematically compares Turbo-Quant and SpectralQuant KV-cache compression methods, using a statistical validation methodology to evaluate non-dominated schemes. The research finds that eigenbasis-based methods perform poorly on heavy-tailed data due to covariance instability but excel in structured regimes, with the effective semantic dimension adapting to calibration budgets rather than true data rank.
Why it matters: The work provides a rigorous framework for evaluating KV-cache compression techniques, which is important for optimizing memory and latency in large language model inference.
Researchers introduce PaperRouter-Agent, a training-free large language model (LLM) agent designed to route new academic papers into user-specific folder hierarchies by grounding its decisions in the content of folder members rather than relying solely on folder names. In tests on real personal libraries, PaperRouter-Agent improved Recall@1 from 0.39 to 0.61 and Recall@3 from 0.57 to 0.83. On the public LaMP-2 benchmark, it increased accuracy from 44.5% to 51.5% and macro-F1 by 9.0 points over a single-shot baseline.
Why it matters: This work demonstrates a significant advance in personalized information organization, showing that LLM agents can effectively route papers in reference managers without per-user training.
Researchers introduce an output-aware safety guardrail for multimodal large language models (MLLMs) that predicts unsafe generations from hidden states, rather than relying solely on input analysis. Their method achieves safety performance comparable to existing approaches but significantly reduces over-refusal, thereby maintaining the model's utility and leveraging its intrinsic safety mechanisms.
Why it matters: This work offers a practical advance in balancing safety and usability for MLLMs by enabling more targeted safety interventions and reducing unnecessary refusals.
Researchers introduce TALRanker, a framework that models relevance scoring as a Markov decision process, enabling large language models to selectively use external tools only when uncertain. The approach employs a two-stage training process—first preventing catastrophic forgetting, then using reinforcement learning to optimize tool invocation. TALRanker achieves state-of-the-art results on retrieval benchmarks while maintaining throughput comparable to pointwise rerankers.
Why it matters: This work offers a novel solution to the accuracy-efficiency trade-off in LLM-based reranking by enabling models to autonomously decide when to use external tools, reducing latency without compromising performance.
A new preprint introduces Low-Rank Attention Residuals (LR-AttnRes), a method that uses low-dimensional keys for depthwise routing in large language models (LLMs) while retaining full-dimensional residual values. This approach decouples routing from representation, leading to improved validation loss and reduced computational cost. The authors present two variants—Projected and Sliced LR-AttnRes—and release code and models for further research.
Why it matters: The work demonstrates that effective depthwise routing in LLMs can be achieved with significantly fewer dimensions, suggesting a path toward more efficient model architectures.
Researchers have introduced Adaptive Model Compression (AMC), a framework that dynamically allocates hardware resources during transformer inference based on token saliency. AMC uses a multi-tier architecture to process important tokens at full precision while compressing less significant data, resulting in a 59.2% reduction in system energy and a 2.24x increase in throughput on 45nm CMOS hardware, with only a 3.6% drop in accuracy.
Why it matters: This approach could make it feasible to run large transformer models efficiently on edge devices, significantly improving battery life without major performance loss.
EvoClawBench is a new benchmark designed to test whether AI agents can transform evidence from their own runs into reusable skills that improve future executions. The benchmark covers 100 tasks across coding, data, office, security, operations, and domain-document workflows, and supports multiple agent runtimes. Experiments with OpenClaw and nanobot show that the ability to learn reusable skills is selective and cost-sensitive: some models improve with skill learning, while others experience performance drops or collapse. This demonstrates that skill learning from experience is not an automatic benefit for agent systems.
Why it matters: This work isolates and rigorously tests a critical capability for autonomous agents—learning from their own experience—and shows that it is not guaranteed, informing the design of more robust agent systems.
A new preprint introduces SPARC, a spectral-algebraic theory that formally explains why autoregressive language models (LLMs) often fail to correct their own errors but can fix identical errors when attributed to external sources. The theory proves that this 'self-correction blind spot' arises when the spectral radius of the error-propagation operator is at least one, and it derives a precise activation threshold for correction markers. Experiments across four model backbones and a visual autoregressive probe validate the theory, with predictions matching observed blind-spot rates within 3.2% RMSE.
Why it matters: This work provides the first formal, quantitative model of the self-correction blind spot in autoregressive generation, offering new insights that could improve the reliability of LLMs and related models.
Researchers present CORE-Bench, a new benchmark designed to evaluate code retrieval in agentic coding scenarios. The benchmark assesses models on code understanding, issue-to-edit localization, and broader context retrieval, using over 180,000 queries and 106,000 relevance labels. Results show that current embedding models perform poorly on these tasks, but simple supervised fine-tuning leads to notable improvements, highlighting significant room for advancement.
Why it matters: CORE-Bench fills a critical gap in evaluating code retrieval for AI coding agents, supporting the development of more capable systems for navigating and understanding code repositories.
Researchers introduce GRASP, a reinforcement learning framework that enables agents to adaptively coordinate semantic search, keyword search, and paragraph reading during multi-step reasoning. The policy learns to control context granularity, leading to improved retrieval recall and question answering performance on multi-hop benchmarks. The learned strategies include interpretable skimming and scanning behaviors.
Why it matters: This work advances agentic retrieval-augmented generation by enabling dynamic and context-aware retrieval strategies, which are important for accurate multi-step reasoning.
Researchers have introduced ARGUS-EVAL, a new evaluation framework that assesses Vision-Language Models (VLMs) not only on their benchmark capabilities but also on cross-dataset consistency, robustness, and efficiency. Testing models such as Qwen-2.5VL-3B-Instruct and CLIP, the study finds that models with similar benchmark scores can differ significantly in reliability and efficiency. Qwen-2.5VL-3B-Instruct demonstrates the highest overall capability, while CLIP stands out for its efficiency.
Why it matters: ARGUS-EVAL provides a more comprehensive way to evaluate and select VLMs for real-world applications by highlighting differences in reliability and efficiency that are not captured by standard benchmarks.