IP Library › Granted Patent US 12,730,510
Granted Patent B2
US 12,730,510 · App. 19/001,002 · Granted Sep 8, 2026

Method, system, and computer program product for drawing and fine-tuned motor controls

Inventors: Björn Tibbling (Järfälla, SE); Simon Cicek (Örebro, SE); Erik Joel Ahlgren (Visby, SE); Emil Lennart Johannes Eriksson Wallin (Farsta, SE); Gordan Gubic (Stockholm, SE); Volodymyr Iakovenko (Stockholm, SE)
Assignee: Tobii Dynavox AB
G06F3/013G06F3/04812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,730,510
App. No.
19/001,002
Granted
Sep 8, 2026
Kind
B2
Abstract

A method, system, and computer program product is provided for drawing and fine-tuned motor controls. The method may include displaying data comprising an activation zone via a display of a user device; receiving gaze data from a user comprising a gaze point; and determining a location of the gaze point is within the activation zone. Additionally, the method may include moving a cursor in a direction of the gaze point based on determining the location of the gaze point is within the activation zone, where moving the cursor causes an action. Data associated with the action may be displayed via the display of the user device.

Claims (42)

1 . A method comprising:

receiving, with at least one processor, gaze data from a user comprising a gaze point;

determining, with at least one processor, a location of the gaze point is within an activation zone displayed via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

moving, with at least one processor, a cursor and the activation zone across the display of the user device in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor and the activation zone in a direction of the gaze point, causing, with at least one processor, an action to be performed;

displaying, with at least one processor, data associated with the action via the display of the user device; and

stopping, with at least one processor, movement of the cursor based on determining the location of the gaze point is outside the activation zone, wherein stopping movement of the cursor causes the action to end.

2 . The method of claim 1 , wherein determining the location of the gaze point is within the activation zone comprises:

determining a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determining the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

3 . The method of claim 1 , wherein an outer edge of the activation zone comprises an icon, the method further comprising:

receiving a selection of the icon by the user; and

stopping movement of the cursor based on receiving the selection of the icon by the user.

4 . The method of claim 1 , wherein a size of the activation zone is based on a percentage of a width of a display of the user device.

5 . A system comprising:

at least one processor, the at least one processor programmed or configured to:

receive, with at least one processor, gaze data from a user comprising a gaze point;

determine a location of the gaze point is within an activation zone displayed via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

move a cursor and the activation zone across the display of the user device in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor and the activation zone in a direction of the gaze point, cause an action to be performed;

display data associated with the action via the display of the user device; and

stop movement of the cursor based on determining the location of the gaze point is outside the activation zone, wherein stopping movement of the cursor causes the action to end.

6 . The system of claim 5 , wherein, when determining the location of the gaze point is within the activation zone, the at least one processor is programmed or configured to:

determine a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determine the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

7 . The system of claim 5 , wherein an outer edge of the activation zone comprises an icon, and wherein the at least one processor is further programmed or configured to:

receive a selection of the icon by the user; and

stop movement of the cursor based on receiving the selection of the icon by the user.

8 . The system of claim 5 , wherein a size of the activation zone is based on a percentage of a width of a display of the user device.

9 . A computer program product comprising at least one non-transitory computer-readable medium including one or more instructions that, when executed by at least one processor, cause the at least one processor to:

receive gaze data from a user comprising a gaze point;

determine a location of the gaze point is within an activation zone displayed via a display of a user device, wherein the activation zone comprises an annulus between two concentric circles, wherein a first circle of the two concentric circles is an inner circle with a first perimeter, wherein a second circle of the two concentric circles is an outer circle with a second perimeter, wherein any part of the display of the user device inside of the perimeter of the first circle is outside of the activation zone, and wherein any part of the display of the user device outside of the perimeter of the second circle is outside of the activation zone;

move a cursor and the activation zone across the display of the user device in a direction of the gaze point based on determining the location of the gaze point is within the activation zone;

in response to moving the cursor and the activation zone in a direction of the gaze point, cause an action to be performed;

display data associated with the action via the display of the user device; and

stop movement of the cursor based on determining the location of the gaze point is outside the activation zone, wherein stopping movement of the cursor causes the action to end.

10 . The computer program product of claim 9 , wherein, when determining the location of the gaze point is within the activation zone, the instructions cause the at least one processor to:

determine a time the location of the gaze point is within the activation zone satisfies a threshold value; and

determine the location of the gaze point is within the activation zone based on determining the time the location of the gaze point is within the activation zone satisfies the threshold value.

11 . The computer program product of claim 9 , wherein an outer edge of the activation zone comprises an icon, and wherein the instructions further cause the at least one processor to:

receive a selection of the icon by the user; and

stop movement of the cursor based on receiving the selection of the icon by the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 24, 2024
From: TIBBLING, BJÖRN; CICEK, SIMON; AHLGREN, ERIK JOEL; WALLIN, EMIL LENNART JOHANNES ERIKSSON; GUBIC, GORDAN; IAKOVENKO, VOLODYMYR
To: TOBII DYNAVOX AB
Reel/Frame 069674/0656 →
Continuity (3)
Continuation 18372789 · Sep 26, 2023
Provisional Application 63410382 · Sep 27, 2022
Related Publication 20250130637A1 · Apr 24, 2025
References Cited (66)
US 6637883B1 · Tengshe · 2003 [cited by examiner]
US 7561143B1 · Milekic · 2009 [cited by examiner]
US 8913004B1 · Bozarth · 2014 [cited by examiner]
US 9442566B2 · Eskilsson et al. · 2016 [cited by applicant]
US 9626072B2 · Feit et al. · 2017 [cited by applicant]
US 9823745B1 · Fateh · 2017 [cited by examiner]
US 9971401B2 · Stafford · 2018 [cited by applicant]
US 10133945B2 · Sezgin et al. · 2018 [cited by applicant]
US 10345898B2 · Chen et al. · 2019 [cited by applicant]
US 10394019B2 · Ryan et al. · 2019 [cited by applicant]
US 10534982B2 · Linden · 2020 [cited by applicant]
US 10564714B2 · Marggraff et al. · 2020 [cited by applicant]
US 10678897B2 · Skogo et al. · 2020 [cited by applicant]
US 10936063B2 · Thunstrom et al. · 2021 [cited by applicant]
US 10996751B2 · Mohlin et al. · 2021 [cited by applicant]
US 11054903B2 · Andersson · 2021 [cited by applicant]
US 11061471B2 · Linden · 2021 [cited by applicant]
US 11061473B2 · Ryan et al. · 2021 [cited by applicant]
US 11231777B2 · Lee et al. · 2022 [cited by applicant]
US 11249547B2 · Wang et al. · 2022 [cited by applicant]
US 11308321B2 · Masko et al. · 2022 [cited by applicant]
US 20080074389A1 · Beale · 2008 [cited by examiner]
US 20090125849A1 · Bouvin · 2009 [cited by examiner]
US 20120287040A1 · Moore · 2012 [cited by examiner]
US 20140085204A1 · Jahnke · 2014 [cited by examiner]
US 20140247232A1 · George-Svahn · 2014 [cited by examiner]
US 20140359521A1 · Lin · 2014 [cited by examiner]
US 20150091793A1 · Lee · 2015 [cited by examiner]
US 20160048223A1 · Taguchi · 2016 [cited by examiner]
US 20160246384A1 · Mullins · 2016 [cited by examiner]
US 20160313804A1 · Neisler · 2016 [cited by examiner]
US 20160314562A1 · Sakamoto · 2016 [cited by examiner]
US 20160357255A1 · Lindh et al. · 2016 [cited by applicant]
US 20170139556A1 · Josephson · 2017 [cited by examiner]
US 20170140224A1 · Wilson · 2017 [cited by examiner]
US 20170285737A1 · Khalid · 2017 [cited by examiner]
US 20170318019A1 · Gordon · 2017 [cited by examiner]
US 20180275753A1 · Publicover · 2018 [cited by examiner]
US 20190033964A1 · Kulkarni · 2019 [cited by examiner]
US 20190033966A1 · Odagiri · 2019 [cited by examiner]
US 20190318708A1 · Tall · 2019 [cited by examiner]
US 20190354171A1 · Dai · 2019 [cited by examiner]
US 20200022577A1 · Rishoni · 2020 [cited by examiner]
US 20200134867A1 · Zachrisson et al. · 2020 [cited by applicant]
US 20200257358A1 · Rosell et al. · 2020 [cited by applicant]
US 20210089121A1 · Ronngren · 2021 [cited by applicant]
US 20210255698A1 · Rana et al. · 2021 [cited by applicant]
US 20210256715A1 · Ryan et al. · 2021 [cited by applicant]
US 20210278678A1 · Brannan · 2021 [cited by examiner]
US 20210287443A1 · Pateriya · 2021 [cited by applicant]
US 20210350565A1 · Fogelstrom et al. · 2021 [cited by applicant]
US 20210405760A1 · Schoen · 2021 [cited by examiner]
US 20220043509A1 · Dahl et al. · 2022 [cited by applicant]
US 20220129080A1 · Yasuda · 2022 [cited by examiner]
US 20220229524A1 · McKenzie · 2022 [cited by examiner]
US 20220283637A1 · Watanabe · 2022 [cited by examiner]
US 20230071037A1 · Kim · 2023 [cited by examiner]
US 20230328357A1 · Ogawa · 2023 [cited by examiner]
US 20240028110A1 · Aurongzeb · 2024 [cited by examiner]
CN 111949131B · 2023 [cited by applicant]
WO 2008066460A1 · 2008 [cited by applicant]
WO 2022101451A2 · 2022 [cited by applicant]
Huang et al., “Eyes can draw: A high-fidelity free-eye drawing method with unimodal gaze control”, International Journal of Human-Computer Studies, 2023, pp. 1-21, vol. 170:102966. [cited by applicant]
Huang et al., “Improving and Analyzing Sketchy High-Fidelity Free-Eye Drawing,” Designing Interactive Systems Conference, Jul. 2023, pp. 856-870. [cited by applicant]
Porta et al., “ceCursor, a Contextual Eye Cursor for General Pointing in Windows Environments”, Proceedings of the 27th Annual International Conference on Mobile Computing and Networking, Association for Computing Machi… [cited by applicant]
Yeo et al., “Gaze Estimation Model for Eye Drawing”, CHI, ACM/IEEE Design Automation Conference, Apr. 2006, pp. 1559-1564. [cited by applicant]