Symbolic Learning and Reasoning With Noisy Data for Probabilistic AnchoringShow others and affiliations
2020 (English)In: Frontiers in Robotics and AI, E-ISSN 2296-9144, Vol. 7, article id 100Article in journal (Refereed) Published
Abstract [en]
Robotic agents should be able to learn from sub-symbolic sensor data and, at the same time, be able to reason about objects and communicate with humans on a symbolic level. This raises the question of how to overcome the gap between symbolic and sub-symbolic artificial intelligence. We propose a semantic world modeling approach based on bottom-up object anchoring using an object-centered representation of the world. Perceptual anchoring processes continuous perceptual sensor data and maintains a correspondence to a symbolic representation. We extend the definitions of anchoring to handle multi-modal probability distributions and we couple the resulting symbol anchoring system to a probabilistic logic reasoner for performing inference. Furthermore, we use statistical relational learning to enable the anchoring framework to learn symbolic knowledge in the form of a set of probabilistic logic rules of the world from noisy and sub-symbolic sensor input. The resulting framework, which combines perceptual anchoring and statistical relational learning, is able to maintain a semantic world model of all the objects that have been perceived over time, while still exploiting the expressiveness of logical rules to reason about the state of objects which are not directly observed through sensory input data. To validate our approach we demonstrate, on the one hand, the ability of our system to perform probabilistic reasoning over multi-modal probability distributions, and on the other hand, the learning of probabilistic logical rules from anchored objects produced by perceptual observations. The learned logical rules are, subsequently, used to assess our proposed probabilistic anchoring procedure. We demonstrate our system in a setting involving object interactions where object occlusions arise and where probabilistic inference is needed to correctly anchor objects.
Place, publisher, year, edition, pages
Frontiers Media S.A., 2020. Vol. 7, article id 100
Keywords [en]
semantic world modeling, perceptual anchoring, probabilistic anchoring, statistical relational learning, probabilistic logic programming, object tracking, relational particle filtering, probabilistic rule learning
National Category
Computer Vision and Robotics (Autonomous Systems)
Identifiers
URN: urn:nbn:se:oru:diva-85553DOI: 10.3389/frobt.2020.00100ISI: 000561679200001PubMedID: 33501267Scopus ID: 2-s2.0-85089550833OAI: oai:DiVA.org:oru-85553DiVA, id: diva2:1466262
Funder
Swedish Research Council, 2016-05321Knut and Alice Wallenberg Foundation
Note
Funding Agencies:
FWO
Special Research Fund of the KU Leuven
European Research Council (ERC) 694980
ReGround project - EU H2020 framework program
2020-09-112020-09-112021-01-28Bibliographically approved