Minimizing information overload: the ranking of electronic messages

Abstract

The decision to examine a message at a particular point in time should be made rationally and economically if the mes sage recipient is to operate efficiently. Electronic message distribution systems, electronic bulletin board systems, and telephone systems capable of leaving digitized voice messages can contribute to "information overload", defined as the eco nomic loss associated with the examination of a number of non- or less-relevant messages. Our model provides a formal method for minimizing expected information overload. The proposed adaptive model predicts the usefulness of a message based on the available message features and may be useful to rank messages by expected importance or economic worth. The assumptions of binary and two Poisson indepen dent probabilistic distributions of message feature frequencies are examined, and methods of incorporating these distributions into the ranking model are examined. Ways to incorporate user supplied relevance feedback are suggested. Analytic perfor mance measures are proposed to predict system quality. Other message handling models, including rule based expert systems, are seen as special cases of the model. The performance is given for a set of UNIX shell programs which rank USENET messages. Problems with the use of this formal model are examined, and areas for future research are suggested.