arXiv's cs.IR (Information Retrieval) category covers research on search and retrieval, including retrieval-augmented generation (RAG) and other methods for finding and ranking relevant information with AI.
A new arXiv preprint finds that large language models (LLMs) used as listwise rerankers in recommendation systems are vulnerable to input order manipulation. Attackers can promote irrelevant items into top-k recommendations simply by reordering the input list, with the effect quantified by a new metric (promo@k) reaching up to 0.57 in tested domains. The study also explores mitigation strategies, including architectural changes and regularization techniques.
Why it matters: This highlights a practical security vulnerability in LLM-powered recommendation systems that could affect the trustworthiness of AI-driven content ranking.
A new arXiv preprint introduces HiEviDR-Bench, a benchmark designed to evaluate how well AI models aggregate and trace evidence in complex research tasks. The benchmark includes 2,000 human-validated questions with explicit evidence graphs, spanning both text-only and multimodal scenarios. Tests on 16 multimodal large language models reveal that while these systems often generate high-quality reports, they perform poorly on citation accuracy and constructing well-supported claims.
Why it matters: This work highlights a significant gap between the appearance of report quality and the underlying reasoning and evidence-tracing abilities of current AI models, which is crucial for trustworthy research automation.
A recent arXiv preprint reports that, in the context of extracting product attributes using large language models (LLMs), the choice of evaluation methodology introduces much more variance in results than either the choice of model or prompting strategy. The study finds that evaluation methodology accounts for approximately 23 times more variance than model selection and 5 times more than prompt engineering, and also identifies a significant noise rate in the widely used MAVE benchmark dataset.
Why it matters: This suggests that reported advances in LLM-based product attribute extraction may be more influenced by evaluation setup and data quality than by actual model improvements, raising questions about how progress in this area is measured.
A new arXiv preprint describes Melo, a large language model-powered music recommendation agent deployed at scale on NetEase Cloud Music. The system uses a deterministic state graph and introduces inference-time entity grounding and reflective retry mechanisms to address entity hallucination and long-tail recommendation issues. In a month-long online A/B test, Melo achieved over a 2 percentage point increase in playlist retention and more than a one-minute increase in user engagement.
Why it matters: This work demonstrates the real-world deployment and measurable impact of LLM-based agents in a major consumer music platform, highlighting the importance of robust error recovery mechanisms for industrial-scale AI applications.
A recent arXiv preprint reports that missing metadata in scholarly databases can prevent AI systems from correctly attributing scientific work, sometimes resulting in fabricated citations or refusals to answer. The authors systematically tested how hiding or restoring specific metadata fields (such as author or reference links) affected AI attribution, finding that only the correct metadata enabled proper credit. They propose a 'Nexus-Score' as a diagnostic tool to identify and address these metadata gaps.
Why it matters: Ensuring accurate metadata is increasingly important as AI systems are used to discover and credit scientific work, with implications for research integrity and trust.
A new arXiv preprint presents a controlled study of five large language models (LLMs) across six few-shot prompting configurations on the AG News benchmark. The authors find that the effect of adding more examples (shots) is highly variable: some models show no improvement, some recover from poor zero-shot performance, others degrade with more examples, and one exhibits a U-shaped performance curve. The study also uncovers a parsing artifact that significantly distorted results for one model, highlighting the importance of robust evaluation methods.
Why it matters: These findings challenge the common assumption that more prompt examples always help, revealing that few-shot prompting effects are complex and not reliably predicted by model size or architecture.
A recent arXiv preprint reports that storing verbatim conversation chunks enables large language models (LLMs) to retrieve long-conversation memories more accurately than using LLM-extracted structured artifacts such as facts or decisions. In controlled experiments, verbatim chunks outperformed structured memory by significant margins on two benchmarks, with the performance gap attributed to information loss during artifact extraction rather than the use of structure itself. The study suggests that structured artifacts should supplement, not replace, raw text in conversational memory systems.
Why it matters: This finding challenges the common belief that structured memory is inherently superior, highlighting the importance of preserving raw conversational text for effective LLM memory retrieval.
HashViT presents a Vision Transformer framework that natively learns binary hash codes using a dedicated HASH token, addressing the feature-to-code discrepancy found in post-quantization methods. The HASH token is split into a Hash Register for binary code generation and a Semantic Workspace for continuous semantics, with a refinement adapter enabling progressive improvement across transformer layers. Experiments on three standard benchmarks show that HashViT achieves state-of-the-art or highly competitive image retrieval performance with compact Hamming codes.
Why it matters: By integrating binary code learning directly into the transformer backbone, HashViT could enable more efficient and accurate large-scale image retrieval systems.
Researchers present STATIC, a method that transforms prefix trees into sparse matrices to enable efficient constrained decoding for LLM-based generative retrieval on TPUs and GPUs. STATIC achieves up to a 948x speedup over CPU trie implementations and minimal latency overhead when deployed on a large-scale video recommendation platform. The method also demonstrates improved cold-start performance on academic benchmarks.
Why it matters: STATIC enables the first production-scale deployment of strictly constrained generative retrieval, addressing a major efficiency bottleneck for industrial recommender systems that require business logic constraints.
M-RAG proposes a semantic key-value indexing layer for retrieval-augmented generation (RAG) systems, decoupling retrieval keys from generation payloads. This approach allows for more efficient use of context budgets and improved retrieval robustness. Experiments on LongBench QA tasks demonstrate that M-RAG achieves competitive or better accuracy than chunk-based baselines, with higher document coverage and lower retrieval latency.
Why it matters: This work introduces a practical and effective indexing method that addresses inefficiencies in current RAG pipelines, potentially improving the accuracy and efficiency of large language model applications.
Researchers propose TSGR, a generative retrieval framework for e-commerce search that incorporates business value awareness into both item representation and candidate ranking. TSGR introduces query-aware parallel SIDs and a value-aware ranking module, resulting in a 9.16% improvement in HR@1000 in offline experiments. Online A/B tests on Taobao show increases of +0.43% in item page views (IPV), +1.12% in transaction count, and +1.64% in gross merchandise value (GMV).
Why it matters: This work demonstrates a practical advance in aligning retrieval models with business goals, leading to measurable improvements in key e-commerce metrics.
A new preprint introduces TopoTok, a tokenization framework designed to preserve item relational structure during quantization in generative recommendation systems. By employing a multi-level distillation approach—addressing global, local, and item-level relationships—TopoTok reduces topology distortion that can hinder recommendation accuracy. Experiments on three benchmark datasets show that TopoTok outperforms existing tokenizers, with improvements of up to 9.42% in Recall@5.
Why it matters: This work offers a notable advance in generative recommendation by addressing topology distortion, a key limitation in current tokenization methods, and demonstrates substantial accuracy gains.
Researchers developed RAGAL, a retrieval-augmented assistant deployed for the Romanian Agency for Financing Rural Investments (AFIR) under strict constraints: zero data egress, a read-only mandate, and operation on a single 8 GB laptop. By combining hybrid dense-sparse retrieval with intent routing, internal evaluation accuracy improved from 62% to 81%. Fine-tuning the bge-m3 embedder on real support ticket data further increased recall@10 from 0.663 to 0.850 after 72 minutes of training.
Why it matters: This work demonstrates a practical and reproducible approach for building effective AI assistants in sensitive government environments where cloud-based solutions are not permitted.
AutoIndex is a framework that learns executable transformation programs to map raw documents into optimized representations for retrieval systems. In experiments on the CRUMB benchmark, AutoIndex improved recall and nDCG over a static BM25 baseline across all 8 tasks, with average gains of +8.4% in Recall@100 and +8.3% in nDCG@10. The approach involves validation-guided program search, iteratively refining document representations to enhance retrieval quality.
Why it matters: This work demonstrates that document representation can be explicitly optimized as part of the retrieval pipeline, potentially leading to significant improvements in retrieval performance.
A new method called PLAID-PRF is introduced to enhance multi-vector dense retrieval models by applying pseudo-relevance feedback using centroid-based quantization from PLAID. By selecting a diverse set of expansion vectors from top-ranked results and appending them to the original query, PLAID-PRF improves retrieval effectiveness—achieving up to 4.3% higher nDCG@10 and 7.3% higher MRR@10 compared to PLAID, with minimal computational overhead. The approach is validated on MSMARCO and BEIR benchmarks, showing consistent improvements over existing baselines.
Why it matters: This work provides a practical and efficient way to boost retrieval quality in late-interaction models, which is valuable for advancing search and information retrieval systems.
MagicSelector is a framework designed to improve tool retrieval in AI agents by decomposing ambiguous user instructions into atomic subtasks and applying counterfactual rewards, progressive reranking, and dynamic Top-K selection. The method is evaluated on the new MTDTool benchmark for mobile multi-turn interactions, where it demonstrates significant improvements over state-of-the-art methods in tool retrieval accuracy, out-of-domain generalization, and token efficiency.
Why it matters: This work addresses a key challenge in AI agent development by improving the reliability and precision of tool selection, especially when handling ambiguous instructions and noisy retrieval scenarios.
Researchers have introduced BONSAI, a framework that optimizes the structure of decoding tries in large language model (LLM)-based generative recommendation systems. BONSAI co-designs textual term IDs and their underlying trie structure by ensuring adaptive ID lengths and constrained branching factors, which improves the effectiveness of constrained beam search. Experiments show that BONSAI achieves up to a 21.6% relative improvement over state-of-the-art baselines in generative recommendation tasks.
Why it matters: This work demonstrates that optimizing the decoding trie structure can significantly enhance the performance of LLM-based generative recommendation systems, addressing an overlooked aspect of their design.
A new preprint proposes that the primary function of memory consolidation—both biological and artificial—is to enable cross-domain recombination of knowledge, similar to the process of dreaming. The authors implement this mechanism in two distinct systems: a LoRA fine-tuning pipeline (DREAMS) and a symbolic engine (SAPIENCE). They find that cross-domain consolidation yields substantial gains in generating novel connections and improving performance on cross-domain tasks, while within-domain rehearsal does not. The symbolic system achieves 85.7% novel cross-domain connections, and the neural system shows up to +14.5 percentage point improvement on cross-domain tasks.
Why it matters: This work introduces a potentially general principle for AI and neuroscience, suggesting that offline recombination of knowledge—analogous to dreaming—may be essential for discovery and generalization across domains.
Infrastructure→Official→arXiv Information Retrieval
D-NOVA is a hardware-software co-designed in-storage retrieval accelerator that executes IVF-based hierarchical retrieval directly within NAND memory arrays. It introduces a Dual-Bound Tight Similarity Sensing (DTS) metric and a lightweight contrastive adapter to recover near-software recall. The system achieves up to 41.7x speedup and 71x energy efficiency over CPU baselines, and up to 12.13x higher throughput than prior in-storage RAG accelerators.
Why it matters: This work addresses the critical latency and energy bottleneck of dense vector retrieval in RAG by deeply embedding search into NAND memory, potentially enabling scalable and efficient retrieval for large-scale LLM applications.
Jina AI has released jina-reranker-v3.5, a 0.6B-parameter listwise reranker that achieves 63.20 nDCG@10 on the BEIR benchmark, matching the performance of a 4B-parameter model with significantly fewer parameters. The model introduces a hybrid attention mechanism combining sliding-window and global layers, and employs a three-stage self-distillation process to enhance efficiency and domain robustness. Notably, it delivers a 9.6-point improvement in nDCG@10 over its predecessor on semi-structured retrieval tasks and reduces inference latency by up to 1.56x.
Why it matters: This work demonstrates that efficient listwise reranking models can achieve state-of-the-art performance with far fewer parameters, enabling more cost-effective and scalable deployment in retrieval systems.