Op-Trans: An Optimization Framework for Negative Sampling and Triplet-Mapping Properties in Knowledge Graph Embedding
-
Published:2023-02-22
Issue:5
Volume:13
Page:2817
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Han Huixia1ORCID, Li Xinyue1ORCID, Wu Kaijun1
Affiliation:
1. College of Information Technology, Shanghai Ocean University, Shanghai 201306, China
Abstract
Knowledge graphs are a popular research field in artificial intelligence, and store large amounts of real-world data. Since data are enriched over time, the knowledge graph is often incomplete. Therefore, knowledge graph completion is particularly important as it predicts missing links based on existing facts. Currently, the family of translation models delivers a better performance in knowledge graph completion. However, most of these models randomly generate negative triplets during the training process, resulting in the low quality of negative triplets. In addition, such models ignore the important characteristics of triplet-mapping properties during model learning. Therefore, we propose an optimization framework based on the translation models (Op-Trans). It enhances the knowledge-graph completion effect from both negative sampling and triplet-mapping properties. First, we propose a clustering cache to generate negative triplets, which generate negative triplets based on entity similarity. This sampling method can directly use the cache to track the negative triplets with large scores. In addition, we focus on the different contributions of the triplets to the optimization goal. We calculate the distinct weight for each triplet according to its mapping properties. In this way, the scoring function deals with each triplet depending on its own weight. The experimental results show that Op-Trans can help the state-of-the-art baselines to obtain a better performance in a link prediction task.
Funder
Shanghai Science and Technology Innovation Action Planning
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference47 articles.
1. Chami, I., Wolf, A., Juan, D.C., Sala, F., Ravi, S., and Ré, C. (2020, January 5–10). Low-Dimensional Hyperbolic Knowledge Graph Embeddings. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online. 2. WordNet;Miller;Commun. ACM,1995 3. Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, January 9–12). Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge. Proceedings of the 2008 ACM SIGMOD international conference on Management of data-SIG-MOD’08, Vancouver, BC, Canada. 4. Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., and Ives, Z. (2007, January 11–15). DBpedia: A Nucleus for a Web of Open Data. Proceedings of the Semantic Web: 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007+ ASWC 2007, Busan, Korea. 5. Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., and Mitchell, T. (2010, January 11–15). Toward an architecture for never-ending language learning. Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, Atlanta, Georgia.
|
|