Author:
Welty Chris,Aroyo Lora,Korn Flip,McCarthy Sara M.,Zhao Shubin
Abstract
Successful knowledge graphs (KGs) solved the historical knowledge acquisition bottleneck by supplanting the previous expert focus with a simple, crowd-friendly one: KG nodes represent popular people, places, organizations, etc., and the graph arcs represent common sense relations like affiliations, locations, etc. Techniques for more general, categorical, KG curation do not seem to have made the same transition: the KG research community is still largely focused on logic-based methods that belie the common-sense characteristics of successful KGs. In this paper, we propose a simple yet novel three-tier crowd approach to acquiringclass-level attributesthat represent broad common sense associations between categories, and can be used with the classic knowledge-base default & override technique, to address the earlylabel sparsity problemfaced by machine learning systems for problems that lack data for training. We demonstrate the effectiveness of our acquisition and reasoning approach on a pair of very real industrial-scale problems: how to augment an existing KG of places and offerings (e.g. stores and products, restaurants and dishes) with associations between them indicating the availability of the offerings at those places. Label sparsity is a general problem, and not specific to these use cases, that prevents modern AI and machine learning techniques from applying to many applications for which labeled data is not readily available. As a result, the study of how to acquire the knowledge and data needed for AI to work is as much a problem today as it was in the 1970s and 80s during the advent of expert systems. Our approach was a critical part of enabling a worldwidelocal searchcapability on Google Maps, with which users can find products and dishes that are available in most places on earth.
Reference53 articles.
1. Enriching knowledge bases with interesting negative statements;Arnaout,2020
2. Negative knowledge for open-world wikidata;Arnaout,2021
3. AroyoL. ParitoshP. Uncovering Unknown Unknowns in Machine Learning. Google AI Blog2021
4. Crowd truth: harnessing disagreement in crowdsourcing a relation extraction gold standard;Aroyo,2013
5. The three sides of crowdtruth;Aroyo;Hum. Comput,2014
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Vexation-Aware Active Learning for On-Menu Restaurant Dish Availability;Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2022-08-14