Affiliation:
1. IBM India Research Lab, Vasanth Kunj, New Delhi, India
2. Carnegie Mellon University, Pittsburgh, PA
Abstract
We consider the problem of constructing decision trees for entity identification from a given relational table. The input is a table containing information about a set of entities over a fixed set of attributes and a probability distribution over the set of entities that specifies the likelihood of the occurrence of each entity. The goal is to construct a decision tree that identifies each entity unambiguously by testing the attribute values such that the average number of tests is minimized. This classical problem finds such diverse applications as efficient fault detection, species identification in biology, and efficient diagnosis in the field of medicine. Prior work mainly deals with the special case where the input table is binary and the probability distribution over the set of entities is uniform. We study the general problem involving arbitrary input tables and arbitrary probability distributions over the set of entities. We consider a natural greedy algorithm and prove an approximation guarantee of
O
(
r
K
⋅ log
N
), where
N
is the number of entities and
K
is the maximum number of distinct values of an attribute. The value
r
K
is a suitably defined Ramsey number, which is at most log
K
. We show that it is NP-hard to approximate the problem within a factor of Ω(log
N
), even for binary tables (i.e.,
K
=2). Thus, for the case of binary tables, our approximation algorithm is optimal up to constant factors (since
r
2
=2). In addition, our analysis indicates a possible way of resolving a Ramsey-theoretic conjecture by Erdös.
Publisher
Association for Computing Machinery (ACM)
Subject
Mathematics (miscellaneous)
Cited by
12 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. An Optimal Algorithm for Partial Order Multiway Search;ACM SIGMOD Record;2023-06-07
2. Improving Oracle-Guided Inductive Synthesis by Efficient Question Selection;Proceedings of the ACM on Programming Languages;2023-04-06
3. A Novel Method for Product Quality Control Based on Production IoT Data;2022 5th International Conference on Computing and Big Data (ICCBD);2022-12-16
4. The Power of Adaptivity for Stochastic Submodular Cover;Operations Research;2022-10-19
5. Optimal Algorithms for Multiway Search on Partial Orders;Proceedings of the 41st ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems;2022-06-12