Evaluating the quality of remote sensing products for agricultural index insurance

Abstract

Agricultural index insurance contracts increasingly use remote sensing data to estimate losses and determine indemnity payouts. Index insurance contracts inevitably make errors, failing to detect losses that occur and issuing payments when no losses occur. The quality of these contracts and the indices on which they are based, need to be evaluated to assess their fitness as insurance, and to provide a guide to choosing the index that best protects the insured. In the remote sensing literature, indices are often evaluated with generic model evaluation statistics such as R2 or Root Mean Square Error that do not directly consider the effect of errors on the quality of the insurance contract. Economic analysis suggests using measures that capture the impact of insurance on the expected economic well-being of the insured. To bridge the gap between the remote sensing and economic perspectives, we adopt a standard economic measure of expected well-being and transform it into a Relative Insurance Benefit (RIB) metric. RIB expresses the welfare benefits derived from an index insurance contract relative to a hypothetical contract that perfectly measures losses. RIB takes on its maximal value of one when the index contract offers the same economic benefits as the perfect contract. When it achieves none of the benefits of insurance it takes on a value of zero, and becomes negative if the contract leaves the insured worse off than having no insurance. Part of our contribution is to decompose this economic well-being measure into an asymmetric loss function. We also argue that the expected well-being measure we use has advantages over other economic measures for the normative purpose of insurance quality ascertainment. Finally, we illustrate the use of the RIB measure with a case study of potential livestock insurance contracts in Northern Kenya. We compared 24 indices that were made with 4 different statistical models and 3 remote sensing data sources. RIB for these indices ranged from 0.09 to 0.5, and R2 ranged from 0.2 to 0.51. While RIB and R2 were correlated, the model with the highest RIB did not have the highest R2. Our findings suggest that, when designing and evaluating an index insurance program, it is useful to separately consider the quality of a remote sensing-based index with a metric like the RIB instead of a generic goodness-of-fit metric.