Extrapolation over temporal knowledge graph via hyperbolic embedding

Abstract

AbstractPredicting potential facts in the future, Temporal Knowledge Graph (TKG) extrapolation remains challenging because of the deep dependence between the temporal association and semantic patterns of facts. Intuitively, facts (events) that happened at different timestamps have different influences on future events, which can be attributed to a hierarchy among not only facts but also relevant entities. Therefore, it is crucial to pay more attention to important entities and events when forecasting the future. However, most existing methods focus on reasoning over temporally evolving facts or mining evolutional patterns from known facts, which may be affected by the diversity and variability of the evolution, and they might fail to attach importance to facts that matter. Hyperbolic geometry was proved to be effective in capturing hierarchical patterns among data, which is considered to be a solution for modelling hierarchical relations among facts. To this end, we propose ReTIN, a novel model integrating real‐time influence of historical facts for TKG reasoning based on hyperbolic geometry, which provides low‐dimensional embeddings to capture latent hierarchical structures and other rich semantic patterns of the existing TKG. Considering both real‐time and global features of TKG boosts the adaptation of ReTIN to the ever‐changing dynamics and inherent constraints. Extensive experiments on benchmarks demonstrate the superiority of ReTIN over various baselines. The ablation study further supports the value of exploiting temporal information.