A1155
Title: Distributionally robust risk evaluation with an isotonic constraint
Authors: Yu Gui - University of Chicago (United States)
Rina Foygel Barber - University of Chicago (United States)
Cong Ma - University of Chicago (United States) [presenting]
Abstract: Statistical learning under the distribution shift is challenging when neither prior knowledge nor data from the target distribution is available. Distributionally robust learning (DRL) aims to control the worst-case statistical performance within a set of candidate distributions, but how to properly specify the set remains challenging. To enable distributional robustness without being overly conservative, a shape-constrained approach to DRL is proposed, which incorporates prior information about the way in which the unknown target distribution differs from its estimate: specifically, the unknown density ratio is assumed between the target distribution and its estimate is isotonic with respect to some partial order. At the population level, a solution to the shape-constrained optimization problem that can be solved without the challenge of an explicit isotonic constraint is provided. At the sample level, consistent results are provided for an empirical estimator of the target in a range of different settings. Empirical studies on both synthetic and real data demonstrate the improved efficiency of the proposed shape-constrained approach.