Alternative Statistical Inference for the First Normalized Incomplete Moment
AuthorsJiannan Lu, Peng Ding†, Anqi Zhao‡
Alternative Statistical Inference for the First Normalized Incomplete Moment
AuthorsJiannan Lu, Peng Ding†, Anqi Zhao‡
This paper re-examines the first normalized incomplete moment, a well-established measure of inequality with wide applications in economic and social sciences. Despite the popularity of the measure itself, existing statistical inference appears to lag behind the needs of modern-age analytics. To fill this gap, we propose an alternative solution that is intuitive, computationally efficient, mathematically equivalent to the existing solutions for “standard” cases, and easily adaptable to “non-standard” ones. The theoretical and practical advantages of the proposed methodology are demonstrated via both simulated and real-life examples. In particular, we discover that a common practice in industry can lead to highly non-trivial challenges for trustworthy statistical inference, or misleading decision making altogether.
Universally Instance-Optimal Mechanisms for Private Statistical Estimation
April 2, 2025research area Methods and Algorithms, research area Privacyconference COLT
We consider the problem of instance-optimal statistical estimation under the constraint of differential privacy where mechanisms must adapt to the difficulty of the input dataset. We prove a new instance specific lower bound using a new divergence and show it characterizes the local minimax optimal rates for private statistical estimation. We propose two new mechanisms that are universally instance-optimal for general estimation problems up to…
All About Sample-Size Calculations for A/B Testing: Novel Extensions and Practical Guide
September 11, 2023research area Data Science and Annotation, research area Methods and Algorithmsconference CIKM
While there exists a large amount of literature on the general challenges and best practices for trustworthy online A/B testing, there are limited studies on sample size estimation, which plays a crucial role in trustworthy and efficient A/B testing that ensures the resulting inference has a sufficient power and type I error control. For example, when the sample size is under-estimated the statistical inference, even with the correct analysis…