Explore advancements in
Machine Learning

All research

- A – Z
- Z – A
- Newest
- Oldest

Towards Low-Bit Communication for Tensor Parallel LLM Inference
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsHarry Dong, Tyler Johnson, Minsik Cho, Emad Soroush
Duo-LLM: A Framework for Studying Adaptive Computation in Large Language Models
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsKeivan Alizadeh, Iman Mirzadeh, Hooman Shahrokhi, Dmitry Belenko, Frank Sun, Minsik Cho, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsEtai Littwin, Vimal Thilak, Anand Gopalakrishnan
Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsMohammad Samragh, Iman Mirzadeh, Keivan Alizadeh Vahid, Fartash Faghri, Minsik Cho, Moin Nabi, Devang Naik, Mehrdad Farajtabar
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models
content type paper research area Human-Computer Interaction, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsOggi Rudovic, Pranay Dighe, Yi Su, Vineet Garg, Sameer Dharur, Xiaochuan Niu, Ahmed H. Abdelaziz, Saurabh Adya, Ahmed Tewfik
Computational Bottlenecks of Training Small-Scale Large Language Models
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsSaleh Ashkboos, Iman Mirzadeh, Keivan Alizadeh, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar, Fartash Faghri
Transfer Learning for Structured Pruning under Limited Task Data
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsLucio Dery, David Grangier, Awni Hannun
What Can CLIP Learn From Task-specific Experts?
content type paper research area Computer Vision, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsReza Salehi, Mehrdad Farajtabar, Max Horton, Fartash Faghri, Hadi Pour Ansari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta
Bin Prediction for Better Conformal Prediction
content type paper research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsEtash Guha, Shlok Natarajan, Thomas Möllenhoff, Emtiyaz Khan, Eugene Ndiaye
Hybrid Model Learning for Cardiovascular Biomarkers Inference
content type paper research area Health, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsOrtal Senouf, Jens Behrmann, Joern-Henrik Jacobsen, Pascal Frossard, Emmanuel Abbe, Antoine Wehenkel

Momentum Approximation in Asynchronous Private Federated Learning
content type paper research area PrivacyWorkshop at NeurIPSPublished year 2024
AuthorsTao Yu, Congzheng Song, Jianyu Wang, Mona Chitnis
How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts
content type paper research area Computer Vision, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsYusu Qian, Haotian Zhang, Yinfei Yang, Zhe Gan
SALSA: Soup-Based Alignment Learning for Stronger Adaptation in RLHF
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsAtoosa Chegini, Hamid Kazemi, Iman Mirzadeh, Dong Yin, Maxwell Horton, Moin Nabi, Mehrdad Farajtabar, Keivan Alizadeh
Classifier-Free Guidance Is a Predictor-Corrector
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsArwen Bradley, Preetum Nakkiran
Efficient and Effective Uncertainty Quantification in LLMs
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsMiao Xiong, Andrea Santilli, Michael Kirchhof, Adam Golinski, Sinead Williamson
Memory-Retaining Finetuning via Distillation
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsZitong Yang, Aonan Zhang, Sam Wiseman, Xiang Kong, Ke Ye, Dong Yin
Do LLMs Estimate Uncertainty Well in Instruction-Following?
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsJuyeon Heo, Miao Xiong, Christina Heinze-Deml, Jaya Narain
Do LLMs Internally "Know" When They Follow Instructions?
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsJuyeon Heo, Christina Heinze-Deml, Oussama Elachqar, Shirley Ren, Udhay Nallasamy, Andy Miller, Kwan Ho Ryan Chan, Jaya Narain
Do Compressed LLMs Forget Knowledge? An Experimental Study with Practical Implications
content type paper research area Methods and Algorithms, research area Tools, Platforms, FrameworksWorkshop at NeurIPSPublished year 2024
AuthorsScott Hoang, Minsik Cho, Thomas Merth, Atlas Wang, Mohammad Rastegari, Devang Naik
Speculative Streaming: Fast LLM Inference Without Auxiliary Models
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsNikhil Bhendawade, Irina Belousova, Qichen Fu, Henry Mason, Mohammad Rastegari, Mahyar Najibi
Towards Low-Bit Communication for Tensor Parallel LLM Inference
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsHarry Dong, Tyler Johnson, Minsik Cho, Emad Soroush
Duo-LLM: A Framework for Studying Adaptive Computation in Large Language Models
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsKeivan Alizadeh, Iman Mirzadeh, Hooman Shahrokhi, Dmitry Belenko, Frank Sun, Minsik Cho, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsEtai Littwin, Vimal Thilak, Anand Gopalakrishnan
Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsMohammad Samragh, Iman Mirzadeh, Keivan Alizadeh Vahid, Fartash Faghri, Minsik Cho, Moin Nabi, Devang Naik, Mehrdad Farajtabar
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models
content type paper research area Human-Computer Interaction, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsOggi Rudovic, Pranay Dighe, Yi Su, Vineet Garg, Sameer Dharur, Xiaochuan Niu, Ahmed H. Abdelaziz, Saurabh Adya, Ahmed Tewfik
Computational Bottlenecks of Training Small-Scale Large Language Models
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsSaleh Ashkboos, Iman Mirzadeh, Keivan Alizadeh, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar, Fartash Faghri
Transfer Learning for Structured Pruning under Limited Task Data
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsLucio Dery, David Grangier, Awni Hannun
What Can CLIP Learn From Task-specific Experts?
content type paper research area Computer Vision, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2024
AuthorsReza Salehi, Mehrdad Farajtabar, Max Horton, Fartash Faghri, Hadi Pour Ansari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta
Bin Prediction for Better Conformal Prediction
content type paper research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsEtash Guha, Shlok Natarajan, Thomas Möllenhoff, Emtiyaz Khan, Eugene Ndiaye
Hybrid Model Learning for Cardiovascular Biomarkers Inference
content type paper research area Health, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2024
AuthorsOrtal Senouf, Jens Behrmann, Joern-Henrik Jacobsen, Pascal Frossard, Emmanuel Abbe, Antoine Wehenkel
Simulation-based Inference for Cardiovascular Models
content type paper research area Methods and Algorithms, research area Tools, Platforms, FrameworksWorkshop at NeurIPSPublished year 2024
AuthorsAntoine Wehenkel, Jens Behrmann, Andrew C. Miller, Guillermo Sapiro, Ozan Sener, Marco Cuturi Cameto, Jörn-Henrik Jacobsen
Private and Personalized Histogram Estimation in a Federated Setting
content type paper research area Methods and Algorithms, research area PrivacyWorkshop at NeurIPSPublished year 2023
AuthorsAmrith Setlur*, Vitaly Feldman*, Kunal Talwar*
Bootstrap Your Own Variance
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2023
In collaboration with University of Göttingen
AuthorsPolina Turishcheva*, Jason Ramapuram*, Sinead Williamson*, Dan Busbridge, Eeshan Dhekane, Russ Webb
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures
content type paper research area Computer Visionconference ICLR, Workshop at NeurIPSPublished year 2023
AuthorsVimal Thilak, Omid Saremi, Preetum Nakkiran, Josh Susskind, Chen Huang, Hanlin Goh, Laurent Dinh, Etai Littwin
Multimodal Data and Resource Efficient Device-Directed Speech Detection with Large Foundation Models
content type paper research area Speech and Natural Language Processingconference ICASSP, Workshop at NeurIPSPublished year 2023
AuthorsDominik Wagner*, Alex Churchill*, Siddharth Sigtia, Panos Georgiou, Matt Mirsamadi, Aarshee Mishra, Erik Marchi
Generating Molecular Conformers with Manifold Diffusion Fields
content type paper research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2023
AuthorsYuyang Wang, Ahmed Elhag, Navdeep Jaitly, Josh Susskind, Miguel Angel Bautista Martin
Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation
content type paper research area Computer Vision, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2023
AuthorsYuhui Zhang, Brandon McKinzie, Vaishaal Shankar, Zhe Gan, Alexander Toshev
TiC-CLIP: Continual Training of CLIP Models
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2023
AuthorsSaurabh Garg, Hadi Pour Ansari, Mehrdad Farajtabar, Sachin Mehta, Raviteja Vemulapalli, Oncel Tuzel, Vaishaal Shankar, Fartash Faghri
What Algorithms can Transformers Learn? A Study in Length Generalization
content type paper research area Methods and Algorithmsconference ICLR, Workshop at NeurIPSPublished year 2023
AuthorsHattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin, Omid Saremi, Josh Susskind, Samy Bengio, Preetum Nakkiran
Diffusion Models as Masked Audio-Video Learners
content type paper research area Computer VisionWorkshop at NeurIPSPublished year 2023
AuthorsElvis Nunez, Yanzi Jin, Mohammad Rastegari, Sachin Mehta, Maxwell Horton
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer
content type paper research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2022
AuthorsBenjamin Muller, Deepanshu, Gupta Siddharth, Patwardhan, Jean-Philippe Fauconnier, David Vandyke, Sachin Agarwal
Rewards Encoding Environment Dynamics Improves Preference-based Reinforcement Learning
content type paper research area Human-Computer Interaction, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2022
AuthorsKatherine Metcalf, Miguel Sarabia, Barry-John Theobald
Continuous Soft Pseudo-Labeling in ASR
content type paper research area Methods and Algorithms, research area Speech and Natural Language ProcessingWorkshop at NeurIPSPublished year 2022
AuthorsTatiana Likhomanenko, Ronan Collobert, Navdeep Jaitly, Samy Bengio
Elastic Weight Consolidation Improves the Robustness of Self-Supervised Learning Methods under Transfer
content type paper research area Computer Vision, research area FairnessWorkshop at NeurIPSPublished year 2022
AuthorsAndrius Ovsianas, Jason Ramapuram, Dan Busbridge, Eeshan Gunesh Dhekane, Russ Webb
A Large-Scale Observational Study of the Causal Effects of a Behavioral Health Nudge
content type paper research area Health, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2022
AuthorsAchille Nazaret, Guillermo Sapiro
MAEEG: Masked Auto-encoder for EEG Representation Learning
content type paper research area Health, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2022
AuthorsHsiang-Yun Sherry Chien, Hanlin Goh, Christopher M. Sandino, Joseph Y. Cheng
APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations
content type paper research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2022
In collaboration with Carnegie Mellon University
AuthorsElan Rosenfeld, Preetum Nakkiran, Hadi Pouransari, Oncel Tuzel, Fartash Faghri
The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2022
AuthorsVimal Thilak, Etai Littwin, Shuangfei Zhai, Omid Saremi, Roni Paiss and Josh Susskind
Learning Invariant Representations with Missing Data
content type paper research area Health, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
In collaboration with New York University
AuthorsMark Goldstein, Jörn-Henrik Jacobsen, Olina Chau, Adriel Saporta, Aahlad Puli, Rajesh Ranganath, Andrew C. Miller
Robust Robotic Control from Pixels Using Contrastive Recurrent State-Space Models
content type paper research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
AuthorsNitish Srivastava, Walter Talbott, Martin Bertran Lopez, Shuangfei Zhai, Josh Susskind
Challenges of Adversarial Image Augmentations
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
AuthorsArno Blaas, Xavier Suau Cuadros, Jason Ramapuram, Luca Zappella, Nicholas Apostoloff
Self-supervised Semi-supervised Learning for Data Labeling and Quality Evaluation
content type paper research area Data Science and Annotation, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
AuthorsHaoping Bai, Meng Cao, Ping Huang, Jiulong Shan
Do Self-Supervised and Supervised Methods Learn Similar Visual Representations?
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
AuthorsTom George Grigg*, Dan Busbridge*, Jason Ramapuram, Russ Webb
Enforcing Fairness in Private Federated Learning via The Modified Method of Differential Multipliers
content type paper research area Fairness, research area PrivacyWorkshop at NeurIPSPublished year 2021
AuthorsBorja Rodríguez-Gálvez, Filip Granqvist, Rogier van Dalen, Matt Seigel
Individual Privacy Accounting via a Renyi Filter
content type paper research area PrivacyWorkshop at NeurIPSPublished year 2021
AuthorsVitaly Feldman, Tijana Zrnic
Stochastic Contrastive Learning
content type paper research area Computer Vision, research area Methods and AlgorithmsWorkshop at NeurIPSPublished year 2021
AuthorsJason Ramapuram*, Dan Busbridge*, Xavier Suau, Russ Webb
Representing and Denoising Wearable ECG Recordings
content type paper research area HealthWorkshop at NeurIPSPublished year 2020
AuthorsJeffrey Chan, Andrew C. Miller, Emily B. Fox

Research - Apple Machine Learning Research