Live Pose Music

Interactive Installation | Live Web | Machine learning

Took charge of Front End Development Year:Dec 2018

LivePoseMusic.gif

Live Pose Music is a screen-based musical instrument played with users’ body, head, hips & feet.

It is programmed in Javascript with PoseNet, which is a machine learning model that allows for Real-time Human Pose Estimation.

Due to the use of socket.io and peer.js, it allows multiple users to play at the same time, even when they are remote from each other. Users can see how each other is doing from the bottom right corner of the screens.

 
 

Collaborated with Yifan Liu and Danxiaomeng Huang

 

Back To

Selected           Installation/Performance AR/MR      VR/3D/GAME       Web/Mobile