IP Library › Granted Patent US 12,204,689
Granted Patent B2
US 12,204,689 · App. 18/372,789 · Granted Jan 21, 2025

Method, system, and computer program product for drawing and fine-tuned motor controls

Inventors: Björn Tibbling (Järfälla, SE); Simon Cicek (Örebro, SE); Volodymyr Iakovenko (Stockholm, SE); Emil Lennart Johannes Eriksson Wallin (Farsta, SE); Gordan Gubic (Stockholm, SE); Erik Joel Ahlgren (Visby, SE)
Assignee: Tobii Dynavox AB
G06F3/013G06F3/04812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,204,689
App. No.
18/372,789
Granted
Jan 21, 2025
Kind
B2
Abstract

A method, system, and computer program product is provided for drawing and fine-tuned motor controls. The method may include displaying data comprising an activation zone via a display of a user device; receiving gaze data from a user comprising a gaze point; and determining a location of the gaze point is within the activation zone. Additionally, the method may include moving a cursor in a direction of the gaze point based on determining the location of the gaze point is within the activation zone, where moving the cursor causes an action. Data associated with the action may be displayed via the display of the user device.

Claims (61)

1. A method for drawing and fine tuned motor controls comprising:

displaying, with at least one processor, data comprising an activation zone via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter;

receiving, with at least one processor, gaze data from a user comprising a gaze point;

determining, with at least one processor, a location of the gaze point is within the activation zone, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

moving, with at least one processor, a cursor in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor in a direction of the gaze point, causing, with at least one processor, an action to be performed; and

displaying, with at least one processor, data associated with the action via the display of the user device.

2. The method of claim 1 , wherein determining the location of the gaze point is within the activation zone comprises:

determining a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determining the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

3. The method of claim 1 , wherein moving the cursor in the direction of the gaze point comprises:

determining a location of the cursor;

determining a distance between the location of the gaze point and the location of the cursor; and

moving the cursor in the direction of the gaze point at a speed, wherein the speed of a cursor movement is based on the distance between the location of the gaze point and the location of the cursor.

4. The method of claim 1 , further comprising:

stopping movement of the cursor when the location of the gaze point is not within the activation zone, wherein stopping movement of the cursor causes the action to end.

5. The method of claim 1 , wherein an outer edge of the activation zone comprises an icon, the method further comprising:

receiving a selection of the icon by the user; and

stopping movement of the cursor, wherein stopping movement of the cursor causes the action to end.

6. The method of claim 1 , wherein a size of the activation zone is based on a percentage of a width of a display of the user device.

7. A system for drawing and fine tuned motor controls comprising:

at least one processor, the at least one processor programmed or configured to:

display data comprising an activation zone via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter;

receiving, with at least one processor, gaze data from a user comprising a gaze point;

determine a location of the gaze point is within the activation zone, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

move a cursor in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor in a direction of the gaze point, cause an action to be performed; and

display data associated with the action via the display of the user device.

8. The system of claim 7 , wherein, when determining the location of the gaze point is within the activation zone, the at least one processor is programmed or configured to:

determine a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determine the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

9. The system of claim 7 , wherein, when moving the cursor in the direction of the gaze point, the at least one processor is programmed or configured to:

determine a location of the cursor;

determine a distance between the location of the gaze point and the location of the cursor; and

move the cursor in the direction of the gaze point at a speed, wherein the speed of a cursor movement is based on the distance between the location of the gaze point and the location of the cursor.

10. The system of claim 7 , wherein the at least one processor is further programmed or configured to:

stop movement of the cursor when the location of the gaze point is not within the activation zone, wherein stopping movement of the cursor causes the action to end.

11. The system of claim 7 , wherein an outer edge of the activation zone comprises an icon, and wherein the at least one processor is further programmed or configured to:

receive a selection of the icon by the user; and

stop movement of the cursor, wherein stopping movement of the cursor causes the action to end.

12. The system of claim 7 , wherein a size of the activation zone is based on a percentage of a width of a display of the user device.

13. A computer program product comprising at least one non-transitory computer-readable medium including one or more instructions that, when executed by at least one processor, cause the at least one processor to:

display data comprising an activation zone via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter;

receive gaze data from a user comprising a gaze point;

determine a location of the gaze point is within the activation zone, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

move a cursor in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor in a direction of the gaze point, cause an action to be performed; and

display data associated with the action via the display of the user device.

14. The computer program product of claim 13 , wherein, when determining the location of the gaze point is within the activation zone, the instructions cause the at least one processor to:

determine a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determine the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

15. The computer program product of claim 13 , wherein, when moving the cursor in the direction of the gaze point, the instructions cause the at least one processor to:

determine a location of the cursor;

determine a distance between the location of the gaze point and the location of the cursor; and

move the cursor in the direction of the gaze point at a speed, wherein the speed of a cursor movement is based on the distance between the location of the gaze point and the location of the cursor.

16. The computer program product of claim 13 , wherein the instructions further cause the at least one processor to:

stop movement of the cursor when the location of the gaze point is not within the activation zone, wherein stopping movement of the cursor causes the action to end.

17. The computer program product of claim 13 , wherein an outer edge of the activation zone comprises an icon, and wherein the instructions further cause the at least one processor to:

receive a selection of the icon by the user; and

stop movement of the cursor, wherein stopping movement of the cursor causes the action to end.

18. The computer program of claim 13 , wherein a size of the activation zone is based on a percentage of a width of a display of the user device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2023
From: TIBBLING, BJÖRN; CICEK, SIMON; AHLGREN, ERIK JOEL; WALLIN, EMIL LENNART JOHANNES ERIKSSON; GUBIC, GORDAN; IAKOVENKO, VOLODYMYR
To: TOBII DYNAVOX AB
Reel/Frame 065041/0392 →
Continuity (2)
Provisional Application 63410382 · Sep 27, 2022
Related Publication 20240111361A1 · Apr 4, 2024
References Cited (55)
US 6637883B1 · Tengshe · 2003 [cited by examiner]
US 7561143B1 · Milekic · 2009 [cited by examiner]
US 8913004B1 · Bozarth · 2014 [cited by examiner]
US 9442566B2 · Eskilsson et al. · 2016 [cited by applicant]
US 9626072B2 · Feit et al. · 2017 [cited by applicant]
US 9971401B2 · Stafford · 2018 [cited by applicant]
US 10133945B2 · Sezgin et al. · 2018 [cited by applicant]
US 10345898B2 · Chen et al. · 2019 [cited by applicant]
US 10394019B2 · Ryan et al. · 2019 [cited by applicant]
US 10534982B2 · Linden · 2020 [cited by applicant]
US 10564714B2 · Marggraff et al. · 2020 [cited by applicant]
US 10678897B2 · Skogo et al. · 2020 [cited by applicant]
US 10936063B2 · Thunstrom et al. · 2021 [cited by applicant]
US 10996751B2 · Mohlin et al. · 2021 [cited by applicant]
US 11054903B2 · Andersson · 2021 [cited by applicant]
US 11061471B2 · Linden · 2021 [cited by applicant]
US 11061473B2 · Ryan et al. · 2021 [cited by applicant]
US 11231777B2 · Lee et al. · 2022 [cited by applicant]
US 11249547B2 · Wang et al. · 2022 [cited by applicant]
US 11308321B2 · Masko et al. · 2022 [cited by applicant]
US 20090125849A1 · Bouvin · 2009 [cited by examiner]
US 20140085204A1 · Jahnke · 2014 [cited by examiner]
US 20140247232A1 · George-Svahn · 2014 [cited by examiner]
US 20140359521A1 · Lin · 2014 [cited by examiner]
US 20150091793A1 · Lee · 2015 [cited by examiner]
US 20160246384A1 · Mullins · 2016 [cited by examiner]
US 20160314562A1 · Sakamoto · 2016 [cited by examiner]
US 20160357255A1 · Lindh et al. · 2016 [cited by applicant]
US 20170139556A1 · Josephson · 2017 [cited by examiner]
US 20170318019A1 · Gordon · 2017 [cited by examiner]
US 20180275753A1 · Publicover · 2018 [cited by examiner]
US 20190033966A1 · Odagiri · 2019 [cited by examiner]
US 20190318708A1 · Tall · 2019 [cited by examiner]
US 20190354171A1 · Dai · 2019 [cited by examiner]
US 20200022577A1 · Rishoni · 2020 [cited by examiner]
US 20200134867A1 · Zachrisson et al. · 2020 [cited by applicant]
US 20200257358A1 · Rosell et al. · 2020 [cited by applicant]
US 20210089121A1 · Ronngren · 2021 [cited by applicant]
US 20210255698A1 · Rana et al. · 2021 [cited by applicant]
US 20210256715A1 · Ryan et al. · 2021 [cited by applicant]
US 20210278678A1 · Brannan · 2021 [cited by examiner]
US 20210287443A1 · Pateriya · 2021 [cited by applicant]
US 20210350565A1 · Fogelstrom et al. · 2021 [cited by applicant]
US 20210405760A1 · Schoen · 2021 [cited by examiner]
US 20220043509A1 · Dahl et al. · 2022 [cited by applicant]
US 20220229524A1 · McKenzie · 2022 [cited by examiner]
US 20230071037A1 · Kim · 2023 [cited by examiner]
US 20240028110A1 · Aurongzeb · 2024 [cited by examiner]
CN 111949131B · 2023 [cited by applicant]
WO 2008066460A1 · 2008 [cited by applicant]
WO 2022101451A2 · 2022 [cited by applicant]
Huang et al., “Eyes can draw: A high-fidelity free-eye drawing method with unimodal gaze control”, International Journal of Human-Computer Studies, 2023, pp. 1-21, vol. 170:102966. [cited by applicant]
Huang et al., “Improving and Analyzing Sketchy High-Fidelity Free-Eye Drawing,” Designing Interactive Systems Conference, Jul. 2023, pp. 856-870. [cited by applicant]
Porta et al., “ceCursor, a Contextual Eye Cursor for General Pointing in Windows Environments”, Proceedings of the 27th Annual International Conference on Mobile Computing and Networking, Association for Computing Machi… [cited by applicant]
Yeo et al., “Gaze Estimation Model for Eye Drawing”, CHI, ACM/IEEE Design Automation Conference, Apr. 2006, pp. 1559-1564. [cited by applicant]