Wear and Go: Calibration Free Sparse Inertial Motion Capture via Online Sensor Setup Estimation
1 Shanghai Jiao Tong University2 National University of Singapore
Overview
Abstract
Sparse inertial motion capture typically assumes that each sensor's anatomical identity and mounting orientation are known. We present MOSAIC (Motion-based Sensor Assignment and Inertial Calibration), a framework that recovers this setup from ordinary motion without a calibration pose. Our central insight is that body pose changes continuously while the sensor setup persists, allowing movements that are individually ambiguous to provide complementary evidence over time. A setup network processes unordered sensor streams with temporal and cross-sensor attention, then accumulates assignment and rotation evidence into a session-level estimate. The recovered setup canonicalizes measurements for frozen pretrained pose estimators, separating sensor configuration from motion reconstruction. For sensors worn at prescribed body sites, evaluation on real inertial recordings with randomized setups shows near-calibrated pose accuracy for bounded offsets and substantial benefits from accumulation under arbitrary orientations. Transfer across pose networks supports setup recovery as a reusable interface between interchangeable sensors and pretrained pose models.
Method
MOSAIC recovers sensor identities and mounting orientations from ordinary motion using six IMUs at prescribed body sites. It accumulates evidence across motion windows and corrects the measurements for existing pose networks, without requiring a calibration pose.
Public dataset results
Real IMU recordings with simulated arbitrary sensor configurations. Root-aligned poses at 1× speed.
Live demos
Our Xsens recordings with arbitrary sensor setups, at 1× speed. Original IMU pose predictions are aligned to the visual reference for display.
Qualitative comparison
Quantitative results
- Per-take
- Setup estimation starts afresh for each recording.
- Per-session
- Setup evidence carries across a subject's recordings under one fixed sensor configuration.
θmax is the largest allowed mounting-angle offset from the calibrated sensor orientation. Arbitrary mounting allows any 3D orientation.
DIP-IMU
TotalCapture
Pose accuracy over time
Mounting recovery over time
BibTeX
@article{tan2026wearandgo,
title = {Wear and Go: Calibration Free Sparse Inertial Motion Capture via Online Sensor Setup Estimation},
author = {Tan, Yuanshuo and Zhong, Licheng},
journal = {arXiv preprint arXiv:2611.22894},
year = {2026}
}