Human Motion Prediction (HMP) is a key capability for a wide range of applications, including collaborative robotics, rehabilitation, and human-machine interaction. Despite advances in deep learning for HMP, most existing methods overlook the environmental context. In this paper, we present Prediction of Actions through Data about a Single Object (PADSO), a novel HMP model that enriches input human poses with spatial semantic information by incorporating environmental object data, thereby enabling joint processing of human pose and object pose predictions. Experimental evaluation on the GRasping Actions with Bodies (GRAB) dataset shows that PADSO significantly improves prediction accuracy over both a non-spatially aware version of the same architecture and the Zero-Velocity baseline. These results highlight the critical role of spatial context in enhancing the robustness of HMP. Furthermore, the efficient design of PADSO enables real-time inference, a critical feature for deployment in real-world scenarios.

Human Motion Prediction Using Spatial Semantics of Objects: The PADSO Approach

Reggiani, Monica
2025

Abstract

Human Motion Prediction (HMP) is a key capability for a wide range of applications, including collaborative robotics, rehabilitation, and human-machine interaction. Despite advances in deep learning for HMP, most existing methods overlook the environmental context. In this paper, we present Prediction of Actions through Data about a Single Object (PADSO), a novel HMP model that enriches input human poses with spatial semantic information by incorporating environmental object data, thereby enabling joint processing of human pose and object pose predictions. Experimental evaluation on the GRasping Actions with Bodies (GRAB) dataset shows that PADSO significantly improves prediction accuracy over both a non-spatially aware version of the same architecture and the Zero-Velocity baseline. These results highlight the critical role of spatial context in enhancing the robustness of HMP. Furthermore, the efficient design of PADSO enables real-time inference, a critical feature for deployment in real-world scenarios.
2025
IFAC-PapersOnLine
7th IFAC Conference on Intelligent Control and Automation Sciences, ICONS 2025
   Made in Italy – Circular and Sustainable
   MICS
   Next-Generation EU (Italian PNRR – M4 C2, Invest 1.3 – D.D. 1551.11-10-2022, PE00000004)
   C93C22005280001

   anticiPatoRy bEhaviors for Safe and Effective humaNrobot CoopEration
   PRESENCE
   BIRD221598
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3577798
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex 0
social impact