Multilingual Semantic Retrieval for Apple Music Search
AuthorsVishalaksh Aggarwal*, Kevin Sebastian*, Vivek Kanojiya, Leo Le, Nick Tucey, Santosh Shankar
Multilingual Semantic Retrieval for Apple Music Search
AuthorsVishalaksh Aggarwal*, Kevin Sebastian*, Vivek Kanojiya, Leo Le, Nick Tucey, Santosh Shankar
Apple Music serves listeners across 150+ storefronts in dozens of languages, with a catalog that grows by hundreds of thousands of new tracks daily. At this scale, search recall on misspelled, transliterated, and cross-lingual queries becomes a dominant driver of session quality, particularly for tail queries that account for the majority of unique queries. We present a multilingual semantic retrieval system built on a 305M-parameter Siamese bi-encoder fine-tuned from GTE-multilingual-base with curriculum-scheduled multi-objective training. The model is integrated into the search stack via a hybrid retrieval architecture that blends dense nearest-neighbor results with the existing token-based index using quantile distribution matching, enabling deployment without retraining downstream rankers. Offline, the model achieves a 69% relative improvement in Hit@10 over GTE-multilingual-base. In a worldwide online A/B test, the system delivers a 2.28% relative conversion-rate (CR) lift overall, an 86% reduction in the no-result rate, and gains across every storefront with no observed regressions. The improvement is concentrated where it is needed most: tail queries see a 7.93% relative CR lift, compared with 0.89% for mid-frequency queries and 0.14% for head queries—evidence that semantic retrieval improves recall on hard queries without disturbing well-served popular ones. To our knowledge, this is one of the largest search-quality improvements deployed on the platform.
DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Search
January 12, 2026research area Computer Vision, research area Speech and Natural Language Processing
Multimodal Large Language Models (MLLMs) in real-world applications require access to external knowledge sources and must remain responsive to the dynamic and ever-changing real-world information in order to address information-seeking and knowledge-intensive user queries. Existing approaches, such as retrieval augmented generation (RAG) methods, search agents, and search equipped MLLMs, often suffer from rigid pipelines, excessive search calls,…
Over-Searching in Search-Augmented Large Language Models
January 12, 2026research area Knowledge Bases and Search, research area Speech and Natural Language Processingconference EACL
Search-augmented large language models (LLMs) excel at knowledge-intensive tasks by integrating external retrieval. However, they often over-search – unnecessarily invoking search tool even when it does not improve response quality, which leads to computational inefficiency and hallucinations by incorporating irrelevant context. In this work, we conduct a systematic evaluation of over-searching across multiple dimensions, including query types,…