ROSE: A Shared Cross-Embodiment Facial-Motion Latent Space for Humanoid Robot Expression
Yongji Fu, Man Cao, Yi Zhou, Fei Lin, Mark F. Hansen, Guanqun Cao
ICRA 2027, Submitted, 2026
Natural, coherent full-face dynamic expressions are central to making humanoid robots socially approachable, yet existing systems commonly realize only limited lip motion or scripted expressions. The limitation is both physical and algorithmic: a compact head leaves little room for densely packed, independently controllable actuation, while learned systems often generate an avatar video, landmarks, or facial parameters and then infer actuator commands through visual retargeting — a render-and-invert path that adds latency and artifacts and does not reliably transfer generated behavior to a physical robot. We present ROSE (RObot facial expression through Shared motion Embeddings), a framework that integrates biomimetic hardware, cross-embodiment motion representation learning, and multimodal motion generation. On the hardware side, a flexible tendon-sheath transmission integrates 34 actuators into a 19.5 cm biomimetic head; by decoupling actuator placement from facial action points, it enables coordinated full-face expression within a compact volume. On the algorithmic side, ROSE-VAE learns an identity-independent shared facial-motion latent space from human, digital-human, and robot observations; ROSE-Flow maps text, audio, or both directly to trajectories in this space without using video as a generator input; and ROSE-Act converts these trajectories into constrained actuator commands.
@unpublished{fu2026rose,
title={ROSE: A Shared Cross-Embodiment Facial-Motion Latent Space for Humanoid Robot Expression},
author={Fu, Yongji and Cao, Man and Zhou, Yi and Lin, Fei and Hansen, Mark F. and Cao, Guanqun},
note={Submitted to IEEE International Conference on Robotics and Automation (ICRA)},
year={2026}
}