Benchmark Study Compares Supervised XMLC and LLM-Based Methods for Automated Subject Indexing
A new benchmark study evaluates supervised Extreme Multi-Label Classification (XMLC) methods and large language model (LLM)-based generative approaches for automated subject indexing of German scientific literature. The results show that supervised XMLC methods with transformer-based features achieve the best overall binary relevance metrics, while LLM-based methods outperform on graded relevance and in handling long-tail vocabulary. These findings indicate that LLM-based methods could serve as a promising alternative for future subject indexing tasks.
Why it matters: This study offers a direct comparison of traditional supervised and generative AI methods for a key library automation task, providing insights that can guide practical deployment decisions.
Full story at: arXiv Information Retrieval ↗