Live Pose Music
Interactive Installation | Live Web | Machine learning
Took charge of Front End Development Year:Dec 2018
Live Pose Music is a screen-based musical instrument played with users’ body, head, hips & feet.
It is programmed in Javascript with PoseNet, which is a machine learning model that allows for Real-time Human Pose Estimation.
Due to the use of socket.io and peer.js, it allows multiple users to play at the same time, even when they are remote from each other. Users can see how each other is doing from the bottom right corner of the screens.
Collaborated with Yifan Liu and Danxiaomeng Huang