CONTROLLER TO EASE COMMUNICATION WITH LESS EFFORT
Challenge: Sohan is a kid eager to connect and exchange with the environment that surrounds him. Although not able to speak,he communicates with the help of pictograms and his Grid3 interface, which gives him a large amount of vocabulary and controllers. The downside of these technologies is that they require too much effort for Sohan to activate them, resulting in a great impairment.
Solution: HandTracking4Sohan is an interface combining two effortless controllers with:
(1) the use of capacitive sensors emulating a joystick, allowing to navigate within Grid3 software by only touching those sensors.
(2) by tracking his hand using HSV filter (detection of a coloured patch) or Hand Pose Estimation providing a continuous control of the mouse.
The project is released as open-source, and can be downloaded from this link below!