Shape-Constrained Regression Using Sum of Squares Polynomials

Abstract

Shape-Constrained Regression Using Algebraic Techniques How can one fit a multivariate polynomial to data points in such a way that this polynomial is guaranteed to have certain shape constraints, such as convexity or monotonicity in some of its variables? In “Shape-constrained regression using sum-of-squares polynomials,” M. Curmei and G. Hall propose a hierarchy of semidefinite programs to address this problem. They show that polynomial functions that are optimal to any fixed level of our hierarchy form a consistent estimator of the underlying shape-constrained function, which generates the data points. As a by-product of the proof, they establish that sum-of-squares-convex polynomials are dense in the set of polynomials that are convex over an arbitrary box. They further demonstrate the performance of the regressor for the problem of computing optimal transport maps in a color transfer task and that of estimating the optimal value function of a conic program. A real-time application of the latter problem to inventory management contract negotiation is presented.