To Örebro University

oru.seÖrebro University Publications
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Long-Term Human Motion Prediction Using Spatio-Temporal Maps of Dynamics
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor Systems (AASS))ORCID iD: 0000-0002-1298-5607
Technical University of Munich, München, Germany.
Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, Espoo, Finland.
Örebro University, School of Science and Technology. Technical University of Munich, München, Germany. (Centre for Applied Autonomous Sensor Systems (AASS))ORCID iD: 0000-0003-0217-9326
Show others and affiliations
2025 (English)In: IEEE Robotics and Automation Letters, E-ISSN 2377-3766, Vol. 10, no 11, p. 12229-12236Article in journal (Refereed) Published
Abstract [en]

Long-term human motion prediction (LHMP) is important for the safe and efficient operation of autonomous robots and vehicles in environments shared with humans. Accurate predictions are important for applications including motion planning, tracking, human-robot interaction, and safety monitoring. In this letter, we exploit Maps of Dynamics (MoDs), which encode spatial or spatio-temporal motion patterns as environment features, to achieve LHMP for horizons of up to 60 seconds. We propose an MoD-informed LHMP framework that supports various types of MoDs and includes a ranking method to output the most likely predicted trajectory, improving practical utility in robotics. Further, a time-conditioned MoD is introduced to capture motion patterns that vary across different times of day. We evaluate MoD-LHMP instantiated with three types of MoDs. Experiments on two real-world datasets show that MoD-informed method outperforms learning-based ones, with up to 50% improvement in average displacement error, and the time-conditioned variant achieves the highest accuracy overall.

Place, publisher, year, edition, pages
IEEE, 2025. Vol. 10, no 11, p. 12229-12236
Keywords [en]
Trajectory, Dynamics, Hidden Markov models, Predictive models, Robots, Prediction algorithms, Accuracy, Vehicle dynamics, Tracking, Pedestrians, Human detection and tracking, human and humanoid motion analysis and synthesis, probability and statistical methods, human-aware motion planning
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:oru:diva-124979DOI: 10.1109/LRA.2025.3619831ISI: 001598761800006OAI: oai:DiVA.org:oru-124979DiVA, id: diva2:2013627
Funder
EU, Horizon 2020, 101017274EU, Horizon 2020, 101070596Available from: 2025-11-13 Created: 2025-11-13 Last updated: 2026-09-16Bibliographically approved
In thesis
1. Spatio-Temporal Representations of Human Dynamics for Motion Prediction and Robot Navigation
Open this publication in new window or tab >>Spatio-Temporal Representations of Human Dynamics for Motion Prediction and Robot Navigation
2026 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Safe and efficient robot operation in human-shared environments requires understanding and anticipating how people move. This thesis advances the representation, learning, and exploitation of spatio-temporal Maps of Dynamics (MoDs), which are structured models that encode statistical motion patterns observed in an environment, for long-horizon human motion prediction and human-aware robot navigation.

On the representation side, this thesis addresses key limitations of existing MoDs along four complementary dimensions: adaptivity, continuity, robustness, and context-awareness. First, for adaptivity, an online learning method based on stochastic Expectation Maximization enables MoDs to adapt incrementally to changing motion patterns without costly offline reconstruction, maintaining accuracy at substantially lower computational cost and enablin glong-term deployment on mobile robots without storing historical data. Second, for continuity, a neural implicit representation eliminates spatial discretization by learning a continuous function that maps arbitrary spatio-temporal coordinates to multi-modal velocity distributions, achieving higher representation accuracy than grid-based approaches while training efficiently. Third, for robustness, a method inspired by data-driven airflow modeling extracts the structured laminar component from observed motion, mitigating the impact of anomalous data and producing more robust motion pattern representations. Fourth, for context-awareness, conditioning MoDs on time of day and agent class captures heterogeneous motion behaviours that single aggregated maps cannot represent, yielding more informative motion priors that directly improve downstream prediction accuracy.

On the exploitation side, MoDs are shown to serve as powerful environmentlevel priors for downstream tasks. This thesis exploits MoDs first f or longhorizon human motion prediction, where a sampling-based framework queries MoDs at each prediction step to generate multi-modal, spatially grounded trajectories that respect the environment topology over horizons of up to 60 seconds. The predicted trajectories implicitly follow corridors, turn at junctions, and reach semantically meaningful goal regions, improving interpretability. Across multiple datasets and prediction horizons, MoD-based methods outperform learning-based and diffusion-based baselines at long horizons, with the advantage being most pronounced under data scarcity and class imbalance. This framework is further extended with laminar enhancement, temporal conditioning, and agent-class conditioning, along with a trajectory ranking mechanism based on cumulative MoD likelihood that provides a principled way to select the most probable prediction from the multi-modal output, improving practical utility for real-world deployment.

This thesis also exploits MoDs for human-aware robot navigation. A hierarchical framework that treats crowd motion as guidance rather than solely as an obstacle enables proactive flow alignment in dense crowds, addressing the freezing robot problem and successfully transferring from simulation to real-world deployment in a public museum without retraining. Finally, MoD priors are integrated into multi-agent path finding to reduce conflicts between robots and human flows in shared environments, extending the utility of structured motion representations from single-robot planning to multi-robot coordination.

Together, these contributions demonstrate that learned structured representations of human dynamics provide a unifying foundation for prediction and navigation, extending the robot’s contextual awareness beyond its immediate sensing range toward more predictive, socially aware, and robust autonomous operation in human-shared spaces.

Place, publisher, year, edition, pages
Örebro: Örebro University, 2026. p. 62
Series
Örebro Studies in Technology, ISSN 1650-8580 ; 117
Keywords
Spatiotemporal Pattern Learning, Neural Implicit Representations, Generative Modeling, Maps of Dynamics, Human Motion Prediction
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-130800 (URN)9789175297996 (ISBN)
Public defence
2026-10-12, Örebro universitet, Långhuset, Hörsal L3, Fakultetsgatan 1, Örebro, 13:15 (English)
Opponent
Supervisors
Available from: 2026-08-25 Created: 2026-08-25 Last updated: 2026-09-23Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Zhu, YufeiLilienthal, Achim J.Magnusson, Martin

Search in DiVA

By author/editor
Zhu, YufeiLilienthal, Achim J.Magnusson, Martin
By organisation
School of Science and Technology
In the same journal
IEEE Robotics and Automation Letters
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 139 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf