MoCap and Humanoid

Hi! 👋

Here is CITE-Robotics group in CITE (Computational Imaging Technology and Engineering) Lab, Nanjing University. We explore how robots can move beyond mere actuation to truly understand and adapt to the physical and social world. Our research focuses on three interconnected pillars: Physical Intelligence (perception and adaptation in uncertain physical contexts), Social Intelligence (understanding human intent and facilitating natural collaboration), and Coexistence & Symbiosis (long-term co-evolution among robots, humans, and environments). We pursue the integration of action and understanding, with the goal of fostering intelligent systems that genuinely embed into society and co-develop with people and their surroundings.

Members

Qiu Shen (Associate Professor) 📧email 🔗homepage
Yi Lu (Ph.D.) 📧email 🔗homepage github
Qingrui Zhao (Ph.D.) 📧email github
Qinhui Yang (M.S.)
Tianhao Jiang (M.S.)
Ziqi Liang(M.S.)
Tianyu Xiong (M.S.)
Zhaoxiang Li (M.S.)
Jiaqi Li (M.S.)
Junhong Liao (M.S.)
Mengzhu Li (M.S.)
Yixiang Xu (M.S.)
Yugen Chen (M.S.)
Yunlu Zhao (M.S.)
Yongqian Wu (M.S.)

Alumni

Tianyi Zhao (M.S.) 📧email
Shenghao Ren (M.S.) 📧email 🔗homepage github

Publications

MotionPRO: Exploring the Role of Pressure in Human MoCap and Beyond. Shenghao Ren*, Yi Lu*, Jiayi Huang, Jiayi Zhao, He Zhang, Tao Yu, Qiu Shen†, Xun Cao. [C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2025.
Leveraging RGB-Pressure for Whole-body Human-to-Humanoid Motion Imitation. Yi Lu, Shenghao Ren, Qiu Shen†, Xun Cao. [C]//Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM). 2024.
MMVP: A Multimodal MoCap Dataset with Vision and Pressure Sensors. He Zhang*, Shenghao Ren*, Haolei Yuan*, Jianhui Zhao, Fan Li, Shuangpeng Sun, Zhenghao Liang, Tao Yu†, Qiu Shen†, Xun Cao†. [C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2024.

Demos

MMVP
MotionPRO