MusiKraken
MusiKraken
Experimental MIDI Controller Construction Kit

Body Pose Tracking

This module analyzes the camera images to detect human body poses. It can detect up to two persons simultaneously and tracks the hands, feet and head positions.

The hand and feet positions can either be defined relative to the body or relative to the screen. This can be changed in the settings.

Relative to the body means that the size of the body is determined by measuring the distance between the middle of your body and your head. The hand positions are relative to your shoulders, so for example for the right hand, the right shoulder position is the zero position in both x- and y-direction. Moving the hand to the right increases the x-position up to 1.0, while moving the hand to the left decreases it down to -1.0. Likewise up increases the y-position, while downwards decreases it.

The feet are relative to the hips, so increasing the y-position of the feet over a value of 0.0 can be difficult.

The head position is always relative to the image coordinates, as relative to body wouldn't make much sense here.

The advantage of using positions relative to the body are that it doesn't matter how far away of the image a person is, or how large the person is, or where in the image the person is standing.

Ports:

Settings:

Positions are relative to the body: The positions of the hands and feet are computed relative to the body, as described above.