Search
Duplicate
Notion
Drag image to reposition
Tacteyele
Github
https://github.com/nikhilJain17/Tacteyele_V2
Status
Finished
Date
Dec 9, 2018
Tech
Python
Keras
Deep Learning
Tacteyele is a computer vision program that lets you control your computer without your hands, just with your eyes. My friends and I made Tacteyele_V1 at PennApps XV, a 36 hour hackathon in senior year of high school, where we won 3rd place.
The initial vision was to look at a part of the screen and have the mouse move there. However, for Tacteyele_V1, we couldn't get that working and instead used head position. You could click by blinking your eye, and type with voice controls.
After going through Stanford's CS231n course on ConvNets, I decided to revisit the eye idea. I wrote a script and built a dataset, then trained a classifier on it for different eye poses. Testing accuracy was around 97%.
Check out the README and a demo of v1.0 and of v2.0.