MusiKraken
MusiKraken
Experimental MIDI Controller Construction Kit

TrueDepth

iOS only, and needs device with TrueDepth front camera

This feature requires that your device has an iOS TrueDepth front camera. Most iPhones since iPhone X have this, and also the newer iPad Pros, so that FaceID can be used to unlock the device. "Normal" iPads do not have a TrueDepth sensor, so you cannot use this there, but you can do similar things with the Hand Tracking module.

Using the TrueDepth camera, you can convert the distance between your iOS device and your hand (or anything else) to MIDI events. So you can for example place the iOS device on a table, hover your hand (or anything else) above the camera and move it up and down to make music or generate MIDI modulation events.

Ports:

Depth:

This value is generated by getting the nearest pixel from a depth image created by the iOS TrueDepth front camera. So it measures the closest distance to whatever is in front of the camera. Note that if you go too near to the camera, the measurements do not work anymore, so starting with a range of around 0.1 or 0.2 makes sense.

Range: ~0.1 to 1.0 (in meters)