Affiliation:
1. Department of Mechanical Engineering, University of Maryland, College Park, MD 20742 e-mail:
Abstract
When selecting ideas or trying to find inspiration, designers often must sift through hundreds or thousands of ideas. This paper provides an algorithm to rank design ideas such that the ranked list simultaneously maximizes the quality and diversity of recommended designs. To do so, we first define and compare two diversity measures using determinantal point processes (DPP) and additive submodular functions. We show that DPPs are more suitable for items expressed as text and that a greedy algorithm diversifies rankings with both theoretical guarantees and empirical performance on what is otherwise an NP-Hard problem. To produce such rankings, this paper contributes a novel way to extend quality and diversity metrics from sets to permutations of ranked lists. These rank metrics open up the use of multi-objective optimization to describe trade-offs between diversity and quality in ranked lists. We use such trade-off fronts to help designers select rankings using indifference curves. However, we also show that rankings on trade-off front share a number of top-ranked items; this means reviewing items (for a given depth like the top ten) from across the entire diversity-to-quality front incurs only a marginal increase in the number of designs considered. While the proposed techniques are general purpose enough to be used across domains, we demonstrate concrete performance on selecting items in an online design community (OpenIDEO), where our approach reduces the time required to review diverse, high-quality ideas from around 25 h to 90 min. This makes evaluation of crowd-generated ideas tractable for a single designer. Our code is publicly accessible for further research.
Subject
Computer Graphics and Computer-Aided Design,Computer Science Applications,Mechanical Engineering,Mechanics of Materials
Reference61 articles.
1. Ahmed, F., Fuge, M., and Gorbunov, L. D., 2016, “Discovering Diverse, High Quality Design Ideas From a Large Corpus,” ASME Paper No. DETC2016-59926.10.1115/DETC2016-59926
2. Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments;ASME J. Mech. Des.,2000
3. Refinements to the Variety Metric for Idea Evaluation;Des. Stud.,2013
4. Consensual Assessment;Encycl. Creativity,1999
Cited by
15 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献