A.
Background
on Eye Movements
1.
Complexity
of eye movements & efficiency of human gaze movements
a.
When
walking, or running, we do not stare at the ground all the time to avoid
obstacles and ensure that we are not straying from our path. Instead, we make occasional eye movements to
the ground and our surroundings
b.
Another
aspect of the efficiency of human gaze movements is how, when running, we
continuously adjust our gaze as our body moves up and down, in synchrony with
the movement of our feet
II.
Rationale/Purpose
A.
The
goal of this project is to analyze and pre-process human gaze data collected
from mobile eye trackers so that it can help create a machine learning based
system that can predict and mimic a human’s gaze movements in specific
situations (such as running or navigating an unfamiliar environment)
B.
The
machine-learning based system created from this effort can be used in numerous
scenarios
1.
Can
assist in making robots more efficient in how they extract information from
their surroundings
a.
When
a robot is navigating an environment, it could mimic a human’s gaze movements
which can help reduce the amount of sensory input needed
2.
In
the efficiency of Virtual Reality (VR) software
a.
Assist
in the improvement of foveated rendering, which is reducing the quality of the
images that can be seen in people’s peripheral vision. Foveated rendering helps reduce the amount of
processing power required for creating the graphics. By reducing the amount of processing power
required, higher resolution images can be created in real time since the
processing power can be focused on the detailed areas of the image.
III.
Methods
A.
Collect
human gaze movement data using an SMI (SensoMotoric Instruments) eye tracker
(company now acquired by Apple)
1.
Discuss
specific scenarios in which data was collected
B.
Create
programs in Python to analyze and pre-process it
1.
Angular
Velocity vs Time graphs & their Significance
2.
Using
interpolation functions to clean the data and remove any invalid data
C.
Pre-processing
the data
1.
Cleaning
the data by removing any invalid data values and interpolating over them
2.
Creating
filters further smooth the data and process it for data labelling
D.
Classify
eye movements for data labelling
1.
Types
of Eye Movements (Definitions for Data Labeling)
a.
Fixations
i.
When
the gaze focuses at one specific location for an extended amount of time
b.
Saccades
i.
Occur
when the eye moves from one fixation point to another at a very high rate
IV.
Results
V.
Conclusion/Recommendations/Future
A.
Create
a model of human gaze movements using machine learning
1.
This
model, as stated before, can be used to help with optimizing the graphics of VR
software, make robots more efficient in navigating their surroundings, and
assist in advertising research