IP Library Granted Patent US 11,147,640
Granted Patent B2
US 11,147,640 · App. 16/370,171 · Granted Oct 19, 2021

Medical devices, systems, and methods using eye gaze tracking

Inventors: Anthony Michael Jarc (Duluth, GA); Henry C. Lin (San Jose, CA); Jonathan Michael Sorger (Belmont, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B34/35A61B1/00193A61B17/00234A61B34/71A61B90/361A61B90/37G02B27/0093G06F3/013A61B2017/00216A61B2090/371A61B2090/372
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,147,640
App. No.
16/370,171
Granted
Oct 19, 2021
Kind
B2
Abstract

A medical system comprises an eye tracking unit. The eye tracking unit includes an image display configured to display to a user an image of a surgical field and an eye tracker configured to measure data about a gaze point of the user during a procedure. The eye tracking unit also includes a processor configured to process the data to determine an evaluation factor based on movement of the gaze point of the user during the procedure and compare the evaluation factor to baseline gaze point data.

Claims (30)

1. A medical system comprising:

an eye tracking unit including:

an image display configured to display to a user an image of a surgical field;

an eye tracker configured to measure data about a gaze point of the user during a procedure; and

a processor configured to

process the data to determine an evaluation factor quantifying a skill level of the user based on movement of the gaze point of the user during the procedure and

compare the evaluation factor to baseline gaze point data representing at least one standard for assessing the user.

2. The medical system of claim 1 wherein the evaluation factor includes a displacement factor determined by measuring a displacement of the gaze point during the movement of the gaze point of the user between a target location and an instrument location in the image of the surgical field.

3. The medical system of claim 1 wherein the evaluation factor includes a time factor determined by measuring a time for movement of the gaze point of the user between a target location and an instrument location in the image of the surgical field.

4. The medical system of claim 1 wherein the evaluation factor includes a gaze fixation factor determined by measuring a fixation time for the gaze point of the user before movement of the gaze point of the user.

5. The medical system of claim 1 wherein the evaluation factor incudes a movement direction for the movement of the gaze point of the user.

6. The medical system of claim 1 wherein the baseline gaze point data is acquired from a prior user prior to the procedure.

7. The medical system of claim 1 wherein the processor is further configured to evaluate a skill level of the user based on the evaluation factor.

8. The medical system of claim 7 wherein the processor is further configured to evaluate the skill level of the user based on at least one of kinematic data for a movement of a hand of the user, kinematic data for a movement of an instrument, or kinematic data for a movement of a camera.

9. The medical system of claim 1 wherein the image display is a 3D image display configured to display to the user a 3D image of the surgical field.

10. The medical system of claim 1 further comprising a surgical instrument, wherein the movement of the gaze point of the user is between a target location and a location of the surgical instrument in the image of the surgical field.

11. A method comprising:

displaying an image, including a surgical field image of a surgical field, on an image display;

measuring a gaze point of a user during a procedure;

determining an evaluation factor quantifying a skill level of the user based on movement of the gaze point of the user during the procedure; and

comparing the evaluation factor to baseline gaze point data representing at least one standard for assessing the user.

12. The method of claim 11 wherein the evaluation factor includes a displacement factor determined by measuring a displacement of the gaze point during the movement of the gaze point of the user between a target location and an instrument location in the image of the surgical field.

13. The method of claim 11 wherein the evaluation factor includes a time factor determined by measuring a time for movement of the gaze point of the user between a target location and an instrument location in the image of the surgical field.

14. The method of claim 11 wherein the evaluation factor includes a gaze fixation factor determined by measuring a fixation time for the gaze point of the user before movement of the gaze point of the user.

15. The method of claim 11 wherein the evaluation factor incudes a movement direction for the movement of the gaze point of the user.

16. The method of claim 11 wherein the baseline gaze point data is acquired from a prior user prior to the procedure.

17. The method of claim 11 further comprising evaluating a skill level of the user based on the evaluation factor.

18. The method of claim 17 wherein evaluating the skill level of the user included evaluating at least one of kinematic data for a movement of a hand of the user, kinematic data for a movement of an instrument, or kinematic data for a movement of a camera.

19. The method of claim 11 further comprising receiving a signal indicating a start of the procedure.

20. The method of claim 19 further comprising initiating the measuring of the gaze point in response to receipt of the signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2019
From: JARC, ANTHONY MICHAEL; LIN, HENRY C.; SORGER, JONATHAN MICHAEL
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 049867/0560 →
Continuity (4)
Continuation 15126074
Provisional Application 61955314 · Mar 19, 2014
Provisional Application 61955355 · Mar 19, 2014
Related Publication 20190223968A1 · Jul 25, 2019
Cited By (47)
US 1,066,378 US 1,066,379 US 1,066,380 US 1,066,381 US 1,066,382 US 1,066,383 US 1,066,404 US 1,066,405 US 1,087,135 US 1,087,995 US 12,186,040 US 12,223,629 US 12,256,890 US 12,262,863 US 12,262,964 US 12,315,109 US 12,329,475 US 12,350,828 US 12,364,555 US 12,369,998 US 12,376,934 US 12,390,294 US 12,409,003 US 12,419,711 US 12,433,699 US 12,433,700 US 12,465,447 US 12,479,098 US 12,491,028 US 12,496,119 US 12,496,728 US 12,548,667 US 12,564,457 US 12,599,445 US 12,599,449 US 12,611,086 US 12,611,272 US 12,616,474 US 12,617,078 US 12,626,422 US 12,642,613 US 12,648,685 US 12,661,192 US 12,672,927 US 12,678,238 US 12,685,603 US 12,708,466