Eye Tracking Module

Question

Hello, I'd like to find a tutorial for achieving the eye tracking demo:

http://jevois.org/moddoc/DemoEyeTracker/modinfo.html

Are there any resources, tutorials that can show me how to accomplish this?

Thanks!

Answer 1

You need to select this videmo mode in your video capture software (guvcview, etc):

GREY 176x144 @ 120.0 fps

and the eye tracker module will start. Under windows, there are issues with AMCap and other software not being able to grab in greyscale mode (this is called Y800 in USB video jargon). So for now this is a Linux only thing but wi will work on it soon.

That's pretty much all there is to it from the machine vision standpoint. To make a full eye-tracking system, you then need:

- some optics, like a telephoto lens of sorts that you would place in front of JeVois, so that you can place JeVois farther away from the eye

- write some software that will capture the text strings issued by JeVois over serial port (hardware serial or serial-over-USB). On every frame, you get a description of the ellipse that was fit to the pupil.

- decide on a calibration procedure and implement it (e.g., you flash some dots in various knowl locations on your screen, then ask people to look at them, then get the ellipses from JeVois, then implement some mapping from ellipse coordinates to screen coordinates). The OpenEyes software that the module is based on, or other open-source eye-tracking framework will help.

- then you will be good to go.

So, some work is necessary, but resources are available online to help (look for various open source eye-tracking frameworks to help with calibration, coordinate transforms, etc).

Comments

Thank you so much for this detailed, helpful answer. I would love to make a full eye-tracking system but I must admit I am that technically savvy to pull it off.

A tutorial on this would be great and my best hope at accomplishing it. Lol