Interactive motion-based eye tracking calibration
The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device ( 12 ), wherein a stimulus object (S) is displayed within a certain display area ( 22 ), such that the stimulus object (S) is at least temporarily moving along a defined trajectory ( 26 ) and images of at least one eye ( 16 ) of at least one user ( 18 ) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye ( 16 ) of the user ( 18 ) with respect to the display area ( 22 ) are determined. Further, at least one calibration parameter (a 1 ; a 2 ; a 3 ; a 4 ; a 5 ; a 6 ; a 7 ; a 8 ; a 9 ; a 10 ; a 11 ; a 12 ; a 13 ; a 14 ; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M 1 , M 2 , M 3 , M 4 , M 5 , M 6 ) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory ( 26 ) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
1. A method comprising:
at a device with one or more processors, non-transitory memory, a camera, and a display:
displaying, on the display, a stimulus object moving along a trajectory at a movement speed;
while displaying the stimulus object, capturing, via the camera, images of an eye of a user;
determining, based on the captured images, a plurality of gaze points of the user;
determining, based on the plurality of gaze points with respect to the trajectory of the stimulus object, a calibration parameter of a predefined calibration model;
determining, based on the gaze points of the user, a control parameter; and
continuing display of the stimulus object by adapting, based on the control parameter, at least one of the trajectory or the movement speed.
2. The method of claim 1 , wherein determining the control parameter includes classifying a subset of the gaze points as valid or invalid according to a predefined criterion.
3. The method of claim 2 , wherein the control parameter defines a capability of the user to follow the displayed stimulus object based on the number of valid gaze points in comparison to the number of invalid gaze points.
4. The method of claim 3 , wherein adapting at least one of the trajectory or the movement speed includes reducing the movement speed based on the capability of the user being lower than a predefined threshold.
5. The method of claim 3 , wherein adapting at least one of the trajectory or the movement speed includes repeating a portion of the trajectory based on the capability of the user being lower than a predefined threshold.
6. The method of claim 1 , wherein displaying, on the display, the stimulus object moving along the trajectory at the movement speed includes temporarily statically displaying the stimulus object.
7. A device comprising:
a display to display a stimulus object moving along a trajectory at a movement speed;
a camera to capture images of an eye of a user while the stimulus object is displayed;
a processor to:
determine, based on the captured images, a plurality of gaze points of the user;
determine, based on the plurality of gaze points with respect to the trajectory of the stimulus object, a calibration parameter of a predefined calibration model;
determine, based on the gaze points of the user, a control parameter; and
continue display of the stimulus object by adapting, based on the control parameter, at least one of the trajectory or the movement speed.
8. The device of claim 7 , wherein the processor is to determine the control parameter by classifying a subset of the gaze points as valid or invalid according to a predefined criterion.
9. The device of claim 8 , wherein the control parameter defines a capability of the user to follow the displayed stimulus object based on the number of valid gaze points in comparison to the number of invalid gaze points.
10. A non-transitory computer-readable medium storing instructions which, when executed by a device including a display and a camera, causes the device to perform operations comprising:
displaying, on the display, a stimulus object moving along a trajectory at a movement speed;
while displaying the stimulus object, capturing, via the camera, images of an eye of a user;
determining, based on the captured images, a plurality of gaze points of the user;
determining, based on the plurality of gaze points with respect to the trajectory of the stimulus object, a calibration parameter of a predefined calibration model;
determining, based on the gaze points of the user, a control parameter; and
continuing display of the stimulus object by adapting, based on the control parameter, at least one of the trajectory or the movement speed.
11. The non-transitory computer-readable medium of claim 10 , wherein determining the control parameter includes classifying a subset of the gaze points as valid or invalid according to a predefined criterion.
12. The non-transitory computer-readable medium of claim 11 , wherein the control parameter defines a capability of the user to follow the displayed stimulus object based on the number of valid gaze points in comparison to the number of invalid gaze points.