Neural Probabilistic Logic Programming in Discrete-Continuous DomainsShow others and affiliations
2023 (English)In: Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence / [ed] Robin J. Evans; Ilya Shpitser, JMLR , 2023, p. 529-538Conference paper, Published paper (Refereed)
Abstract [en]
Neural-symbolic AI (NeSy) allows neural net-works to exploit symbolic background knowledge in the form of logic. It has been shown to aid learning in the limited data regime and to facilitate inference on out-of-distribution data. Probabilistic NeSy focuses on integrating neural networks with both logic and probability theory, which additionally allows learning under uncertainty. A major limitation of current probabilistic NeSy systems, such as DeepProbLog, is their restriction to finite probability distributions, i.e., discrete random variables. In contrast, deep probabilistic programming (DPP) excels in modelling and optimising continuous probability distributions. Hence, we introduce DeepSeaProbLog, a neural probabilistic logic programming language that incorporates DPP techniques into NeSy. Doing so results in the support of inference and learning of both discrete and continuous probability distributions under logical constraints. Our main contributions are 1) the semantics of DeepSeaProbLog and its corresponding inference algorithm, 2) a proven asymptotically unbiased learning algorithm, and 3) a series of experiments that illustrate the versatility of our approach.
Place, publisher, year, edition, pages
JMLR , 2023. p. 529-538
Series
Proceedings of Machine Learning Research (PMLR), E-ISSN 2640-3498 ; 216
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-110790DOI: 10.48550/arXiv.2303.04660Scopus ID: 2-s2.0-85170062584OAI: oai:DiVA.org:oru-110790DiVA, id: diva2:1828649
Conference
39th Conference on Uncertainty in Artificial Intelligence (UAI 2023), Pittsburgh, Pennsylvania, USA, July 31 - August 4, 2023
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)EU, Horizon 2020
Note
This research is funded by TAILOR, a project from the EU Horizon 2020 research and innovation programme under GA No 952215. It was also supported by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation. We also have to acknowledge support from Flanders AI, FWO and the KU Leuven Research Fund.
2024-01-172024-01-172024-01-17Bibliographically approved