Machine Learning
Research at Apple

Research highlights

The “Super Weight:” How Even a Single Parameter can Determine a Large Language Model’s Behavior

August 21, 2025

A recent paper from Apple researchers, “The Super Weight in Large Language Models,” reveals that an extremely small subset of parameters in LLMs (in some cases, a single parameter) can exert a disproportionate influence on an LLM’s overall functionality (see Figure 1). This work highlights the critical role of these “super weights” and their corresponding “super activations,”…

FastVLM: Efficient Vision Encoding for Vision Language Models

July 23, 2025research area Computer Vision

Vision Language Models (VLMs) enable visual understanding alongside textual inputs. They are typically built by passing visual tokens from a pretrained vision encoder to a pretrained Large Language Model (LLM) through a projection layer. By leveraging the rich visual representations of the vision encoder and the world knowledge and reasoning capabilities of the LLM, VLMs can be useful for a wide range of applications, including accessibility…

View all highlights

Recent publications

Explore all publications

Compute-Optimal Quantization-Aware Training

Aleksandr Dremov**†, David Grangier, Angelos Katharopoulos, Awni Hannun

Read paper

Checklists Are Better Than Reward Models For Aligning Language Models

Methods and Algorithms, Speech and Natural Language ProcessingNeurIPS2025

Vijay Viswanathan†, Yanchao Sun, Shuang Ma‡**, Xiang Kong, Meng Cao, Graham Neubig†, Tongshuang Wu†

Read paper

Explore all publications

Events

View all events

Apple Workshop on Natural Language and Interactive Systems 2025

September 23, 2025

Natural language processing (NLP) remains one of the most quickly evolving fields in AI, as new research continues to rapidly advance large language models (LLMs), systems for speech recognition and generation, language agents, and more. This technology is essential to many of today’s AI experiences, including Apple Intelligence and Siri, and fundamental research in NLP will be foundational to future AI.

Apple Workshop on Privacy-Preserving Machine Learning 2025

August 12, 2025

Apple believes that privacy is a fundamental human right. As AI experiences become increasingly personal and a part of people’s daily lives, it’s important that novel privacy-preserving techniques are created in parallel to advancing AI capabilities.