CONTROLLER TO EASE COMMUNICATION WITH LESS EFFORT

Challenge: Sohan is a kid eager to connect and exchange with the environment that surrounds him. Although not able to speak,he communicates  with the help of pictograms and his Grid3 interface, which gives him a large amount of vocabulary and controllers. The downside of these technologies is that they require too much effort for Sohan to activate them, resulting in a great impairment.

Solution: HandTracking4Sohan is an interface combining two effortless controllers with:

(1) the use of capacitive sensors emulating a joystick, allowing to navigate within Grid3 software by only touching those sensors.

(2) by tracking his hand using HSV filter (detection of a coloured patch) or Hand Pose Estimation providing a continuous control of the mouse.

The project is released as open-source, and can be downloaded from this link below!