content type videopublished June 28, 2022
PPML Workshop Talk: When the Curious Abandon Honesty
AuthorsNicolas Papernot (Google)
Related readings and updates.
Evaluating the Evaluators: Investigating LLM Judges for Personalized Writing Style Assessment
November 10, 2026research area Human-Computer Interaction, research area Methods and AlgorithmsWorkshop at NeurIPS
This paper was accepted at the Can We Trust AI Evaluation? Workshop at NeurIPS 2026.
We evaluate how good large language model (LLM) judges are for personalized writing tasks. This is important when a user’s preferred writing style is known (e.g., “upbeat”) and an LLM judge is used to evaluate whether generated text adheres to this preference. We examine how the writing task, the combination of generator and judge LLM, the evaluation objective,…
On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models
November 10, 2026research area Methods and Algorithms, research area Speech and Natural Language Processingconference NeurIPS
State Space Models (SSMs) have emerged as a compelling alternative to Transformers, enabling sequence modeling with constant memory and linear compute. Although SSMs exhibit reasonable performance and favorable computational characteristics, they continue to lag behind Transformers on tasks that require in-context learning and precise retrieval, slowing their adoption for large-scale language modeling. In this work, we demonstrate that both the…
Discover opportunities in Machine Learning.
Our research in machine learning breaks new ground every day.