Machine Learning
Research at Apple

Recent research

Read paper
AuthorsMohammad Samragh, Arnav Kundu, Ting-Yao Hu, Aman Chadha (no longer with apple), Ashish Srivastava (no longer with apple), Minsik Cho, Oncel Tuzel, Devang Naik
Read paper

Explore all research

Research articles

3D Parametric Room Representation with RoomPlan

3D Scene understanding has been an active area of machine learning (ML) research for more than a decade. More recently the release of LiDAR sensor functionality in Apple iPhone and iPad has begun a new era in scene understanding for the computer vision and developer communities. Fundamental research in scene understanding combined with the advances in ML can now impact everyday experiences. A variety of methods are addressing different parts of the challenge, like depth estimation, 3D reconstruction, instance segmentation, object detection, and more. Among these problems, creating a 3D floor plan is becoming key for many applications in augmented reality, robotics, e-commerce, games, and real estate.

See article details

A Multi-Task Neural Architecture for On-Device Scene Analysis

Scene analysis is an integral core technology that powers many features and experiences in the Apple ecosystem. From visual content search to powerful memories marking special occasions in one’s life, outputs (or "signals") produced by scene analysis are critical to how users interface with the photos on their devices. Deploying dedicated models for each of these individual features is inefficient as many of these models can benefit from sharing resources. We present how we developed Apple Neural Scene Analyzer (ANSA), a unified backbone to build and maintain scene analysis workflows in production. This was an important step towards enabling Apple to be among the first in the industry to deploy fully client-side scene analysis in 2016.

See article details

All events

NeurIPS 2022

Apple sponsored the Neural Information Processing Systems Conference (NeurIPS), which was held in New Orleans, Louisiana from November 28 to December 9. NeurIPS is a global conference focused on fostering the exchange of research on neural information processing systems in their biological, technological, mathematical, and theoretical aspects.
See event details

EMNLP 2022

Apple sponsored Empirical Methods in Natural Language Processing (EMNLP), which was held in Abu Dhabi, United Arab Emirates from December 7 to 11. EMNLP is a leading conference focused on natural language processing.
See event details