IP Library › Granted Patent US 12,608,081
Granted Patent B2
US 12,608,081 · App. 18/983,659 · Granted Apr 21, 2026

Gaze-based interaction and the method thereof

Inventors: Yuen Yan Chan (Pak Shek Kok, HK); Xindi Tong (Pak Shek Kok, HK)
G06F3/013G06F3/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,081
App. No.
18/983,659
Granted
Apr 21, 2026
Kind
B2
Abstract

Disclosed is a system and method for adjusting an eye-gaze of a disabled subject having involuntary head movements. The system includes one or more processors and a database coupled to one or more processors, wherein the database includes an adaptation module. The adaptation module is programmable to execute instructions for tracking and monitoring an eye-gaze and head movements of the subject during a gaze-based interaction, computing the tracked eye-gaze and the head movements of the subject based on pre-determined parameters, and generating an adjusted eye-gaze until the interaction completes.

Claims (32)

1 . A method for adjusting an eye-gaze of a disabled subject having involuntary head movements, the method comprising:

detecting an initial gaze point and a head movement, the head movement having a head position and a rotation angle during a gaze-based interaction;

monitoring for continuous interactions by continuously detecting the gaze point and the head position and the rotation angle so as to generate a moving average gaze point and a moving average head position value based on values of the gaze point and the head position;

computing the detected and monitored eye-gaze and head movements of the subject based on pre-determined parameters during the interactions, the step of computing comprising:

obtaining the gaze point and the head position and the moving average gaze point and the moving average head position and the rotation angle if continuous interaction is detected;

adapting the gaze point based on the head position and the rotation angle so as to produce an adapted gaze point;

calculating the gaze speed based on the gaze point and the moving average gaze point with a pre-determined timeframe;

determining an impact factor that decides a confidence level of current measurement based on a pre-determined speed threshold;

adapting the head position based on the gaze speed and the impact factor so as to produce the adapted head position;

computing and generating the adjusted eye-gaze based on the adapted gaze point and the adapted head position; and

updating the moving-average gaze point and moving average head position until the gaze-based interaction is completed; and

generating an adjusted eye-gaze until the gaze-based interaction is completed.

2 . The method of claim 1 , further comprising:

denoting the gaze point as equal to the moving average gaze point when the gaze-based interactions continue but no further gaze point is detected;

updating the moving average gaze point; and

computing and generating the adjusted eye-gaze until the gaze-based interactions are completed.

3 . The method of claim 2 , further comprising:

stopping the step of computing and generating of the adjusted eye-gaze when no further eye-gaze interactions are detected.

4 . The method of claim 1 , further comprising:

outputting a three-dimensional vector that represents the adapted head position.

5 . The method of claim 1 , further comprising:

initiating an adaptation module before commencing the gaze-based interactions, wherein the gaze point and the head position and the rotation angle and the moving average gaze point and the moving average head position are set an initial value of zero.

6 . A system for adjusting an eye-gaze of a disabled subject having involuntary head movements, the system comprising:

an adaptation module comprising:

a head pose monitor operable to receive a detected gaze point and detected head position and a detected rotation angle and to produce an adapted gaze point by adapting the gaze point based on the head position and the rotation angle;

a gaze points speed controller operable to calculate a gaze speed based on the gaze point and a moving average gaze point and to determine an impact factor and to output an adapted head position; and

a computation module operable to compute an adjusted eye gaze based on the adapted gaze point and the adapted head position;

a processor in data communication with said adaptation module; and

a hardware storage medium in data communication with said processor, wherein the hardware storage medium having instructions thereon that, when executed by said processor, causes said processor to detect and monitor an initial eye-gaze point and head movements, the head movements including head position and a rotation angle during gaze-based interactions, and to compute a moving average head position value, and to execute said head pose monitor to produce the adapted gaze point, to execute said gaze points speed controller to produce the adapted head position, and to compute and generate and adjusted eye-gaze based on the adapted gaze point and the adapted head position based on the eye-gaze and the head movement of the subject based on pre-determined parameters until the interactions are completed.

7 . The system of claim 6 , wherein said adaptation module computes an adjusted eye-gaze based on the adapted gaze point and the adapted head position.

8 . The system of claim 6 , wherein the rotation angle is a y-axis Euler rotation angle.

9 . The system of claim 6 , wherein the eye-gaze point is in two dimensions, the head position being in three dimensions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2025
From: CHAN, YUEN YAN; TONG, XINDI
To: CENTRE FOR PERCEPTUAL AND INTERACTIVE INTELLIGENCE (CPII) LIMITED
Reel/Frame 069784/0206 →
Continuity (2)
Provisional Application 63549349 · Feb 2, 2024
Related Publication 20250251788A1 · Aug 7, 2025
References Cited (15)
US 5360971A · Kaufman et al. · 1994 [cited by applicant]
US 8793620B2 · Stafford · 2014 [cited by examiner]
US 10540008B2 · Klingström · 2020 [cited by examiner]
US 11435822B2 · Yamashita · 2022 [cited by examiner]
US 11880501B2 · Connor · 2024 [cited by examiner]
US 12326971B1 · Abel · 2025 [cited by examiner]
US 20160077344A1 · Burns · 2016 [cited by examiner]
US 20160170482A1 · Yajima · 2016 [cited by examiner]
US 20190324270A1 · Stellmach · 2019 [cited by applicant]
US 20200012341A1 · Stellmach et al. · 2020 [cited by applicant]
US 20200081526A1 · Walker · 2020 [cited by examiner]
US 20200305707A1 · Fink et al. · 2020 [cited by applicant]
US 20210103336A1 · Li · 2021 [cited by examiner]
US 20220129080A1 · Yasuda · 2022 [cited by examiner]
Adriano Galante, Paulo Menezes, “A Gaze-Based Interaction System for People with Cerebral Palsy”, Procedia Technology, vol. 5, 2012, pp. 895-902, ISSN 2212-0173, https://doi.org/10.1016/j.protcy.2012.09.099. (https://ww… [cited by applicant]