Abstract
AbstractConsider a directed tree $${\mathcal {U}}$$
U
and the space of all finite walks on it endowed with a quasi-pseudo-metric—the space of the strategies $${\mathcal {S}}$$
S
on the graph,—which represent the possible changes in the evolution of a dynamical system over time. Consider a reward function acting in a subset $${\mathcal {S}}_0 \subset {\mathcal {S}}$$
S
0
⊂
S
which measures the success. Using well-known facts of the theory of semi-Lipschitz functions in quasi-pseudo-metric spaces, we extend the reward function to the whole space $${\mathcal {S}}.$$
S
.
We obtain in this way an oracle function, which gives a forecast of the reward function for the elements of $${\mathcal {S}}$$
S
, that is, an estimate of the degree of success for any given strategy. After explaining the fundamental properties of a specific quasi-pseudo-metric that we define for the (graph) trees (the bifurcation quasi-pseudo-metric), we focus our attention on analyzing how this structure can be used to represent dynamical systems on graphs. We begin the explanation of the method with a simple example, which is proposed as a reference point for which some variants and successive generalizations are consecutively shown. The main objective is to explain the role of the lack of symmetry of quasi-metrics in our proposal: the irreversibility of dynamical processes is reflected in the asymmetry of their definition.
Funder
Cátedra de Transparencia y Gestión de Datos. UPV y GVA
Tactical Whistleblower
Universidad Politècnica de València
Publisher
Springer Science and Business Media LLC
Subject
Artificial Intelligence,Software
Reference62 articles.
1. Asadi, K., Misra, D., & Littman, M.L. (2018). Lipschitz continuity in model-based reinforcement learning. arXiv preprint arXiv:180407193.
2. Barnes, J. A., & Harary, F. (1983). Graph theory in network analysis. Social Networks, 5(2), 235–244.
3. Barrett, C. L., Chen, W. Y., & Zheng, M. J. (2004). Discrete dynamical systems on graphs and boolean functions. Mathematics and Computers in Simulation, 66(6), 487–497.
4. Bellman, R. (1957). Dynamic programming. Princeton University Press.
5. Bellman, R. (1958). On a routing problem. Quarterly of Applied Mathematics, 16(1), 87–90.
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献