IP Library Granted Patent US 11,944,481
Granted Patent B1
US 11,944,481 · App. 17/520,647 · Granted Apr 2, 2024

Method and apparatus for predicting an image analysis tool based on user behavior

Inventors: Robert Edwin Douglas (Winter Park, FL); David Byron Douglas (Winter Park, FL); Kathleen Mary Douglas (Winter Park, FL)
A61B6/5223A61B6/032A61B6/466A61B6/468A61N5/103G06T7/62G06T2207/10081G06T2207/20036G06T2207/20081G06T2207/20084G06T2207/30096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,944,481
App. No.
17/520,647
Granted
Apr 2, 2024
Kind
B1
Abstract

This patent provides a method and apparatus to improve image analysis for a user viewing an image comprising multiple structures on a display. An eye tracking system is set up for a user viewing the image on a display, such as using an eye facing camera. An analysis of the eye tracking data and a structure that is being viewed is performed. An image analysis tool, such as an image manipulation tool, an image measurement tool or an image annotation tool, is predicted from a group of image analysis tools and is presented to the user. The user can then use the predicted tool as the user sees fit, such as executing the capabilities of the tool via a mouse.

Claims (92)

1. A method comprising:

performing eye tracking of a user

wherein said eye tracking is performed with an eye facing camera,

wherein eye tracking data is analyzed in near real time,

wherein said user is viewing a display,

wherein said display is displaying an image, and

wherein said image comprises multiple structures;

performing an analysis of eye tracking data

wherein said analysis determines that said user is viewing a first structure of said image;

predicting a first image analysis tool from a group of image analysis tools

wherein said first image analysis tool optimizes image analysis of said first structure of said image;

presenting said first image analysis tool to said user;

performing an analysis of eye tracking data at a subsequent time epoch

wherein said analysis of eye tracking data at said subsequent time epoch determines that said user is viewing a second structure, and

wherein said second structure is different from said first structure;

predicting a second image analysis tool from said group of image analysis tools

wherein said second image analysis tool optimizes image analysis of said second structure, and

wherein said second image analysis tool is different than said first image analysis tool; and

presenting said second image analysis tool to said user.

2. The method of claim 1 further comprising performing an artificial intelligence (AI) classification of said first structure.

3. The method of claim 2 further comprising wherein said first image analysis tool is predicted based on said AI classification of said first structure.

4. The method of claim 1 further comprising wherein said display comprises at least one of the group of: a monitor; a phone; a tablet; and, a head display unit (HDU).

5. The method of claim 1 further comprising wherein said analysis of said eye tracking data comprises an artificial intelligence (AI) algorithm.

6. The method of claim 1 further comprising wherein said predicting said first image analysis tool and said second image analysis tool is based on a personalized AI algorithm.

7. The method of claim 6 further comprising wherein said personalized AI algorithm is trained based on data exclusively from said user.

8. The method of claim 7 further comprising:

wherein user data to train said personalized AI algorithm comprises a user-selected tool for a segmented structure.

9. The method of claim 1 further comprising wherein said first image analysis tool comprises an image manipulation tool and wherein said image manipulation tool alters an appearance of said image on said display.

10. The method of claim 9 further comprising wherein said image manipulation tool comprises at least one of the group of:

a grayscale adjustment tool; and

a color adjustment tool.

11. The method of claim 9 further comprising wherein said image manipulation tool comprises at least one of the group of:

a zoom tool; and

a rotation tool.

12. The method of claim 1 further comprising wherein said image analysis tool comprises an image measurement tool and wherein said image measurement tool performs a measurement on said image.

13. The method of claim 12 further comprising wherein said image measurement tool comprises at least one of the group of:

a ruler;

an area measurement tool; and

volume measurement tool.

14. The method of claim 12 further comprising wherein said image measurement tool comprises at least one of the group of:

a pixel value measurement tool; and

a voxel value measurement tool.

15. The method of claim 1 further comprising wherein said first image analysis tool comprises an image mark up tool and wherein said image mark up tool performs an annotation on said image.

16. The method of claim 15 further comprising wherein said image mark up tool comprises at least one of the group of:

an arrow; and

a circle.

17. The method of claim 1 further comprising wherein said first image analysis tool is controlled by a computer mouse.

18. The method of claim 1 further comprising wherein said first image analysis tool comprises an image diagnostic tool comprising at least one of the group of:

a texture analysis tool;

a sub-volume analysis tool;

a feature classification tool; and

an artificial intelligence (AI) analysis tool.

19. A non-transitory computer readable medium having computer readable code thereon for image processing, the computer readable code including instructions comprising:

performing eye tracking of a user

wherein said eye tracking is performed with an eye facing camera,

wherein eye tracking data is performed in near real time,

wherein said user is viewing a display,

wherein said display is displaying an image, and

wherein said image comprises multiple structures;

performing an analysis of eye tracking data at a first time epoch

wherein said analysis determines that said user is viewing a first structure of said image;

predicting a first image analysis tool from a group of image analysis tools based on said first structure

wherein said first image analysis tool optimizes image analysis of said first structure of said image;

presenting said first image analysis tool to said user;

performing an analysis of eye tracking data at a subsequent time epoch

wherein said analysis of eye tracking data at said subsequent time epoch determines that said user is viewing a second structure, and

wherein said second structure is different from said first structure;

predicting a second image analysis tool from said group of image analysis tools based on said second structure

wherein said second image analysis tool optimizes image analysis of said second structure, and

wherein said second image analysis tool is different than said first image analysis tool; and

presenting said second image analysis tool to said user.

20. An apparatus comprising:

an IO device; and

an image processor in communication with the IO device, the image processor comprising a program stored on a computer-readable non-transitory media, the program comprising instructions that:

perform eye tracking of a user

wherein said eye tracking is performed with an eye facing camera,

wherein eye tracking data is performed in near real time,

wherein said user is viewing a display,

wherein said display is displaying an image, and

wherein said image comprises multiple structures;

perform an analysis of eye tracking data at a first time epoch

wherein said analysis determines that said user is viewing a first structure of said image;

predict a first image analysis tool from a group of image analysis tools based on said first structure and said analysis of eye tracking data at said first time epoch

wherein said first image analysis tool optimizes image analysis of said first structure of said image;

present said first image analysis tool to said user;

perform an analysis of eye tracking data at a subsequent time epoch

wherein said analysis of eye tracking data at said subsequent time epoch determines that said user is viewing a second structure, and

wherein said second structure is different from said first structure;

predict a second image analysis tool from said group of image analysis tools based on said second structure and said analysis of eye tracking data at said subsequent time epoch

wherein said second image analysis tool optimizes image analysis of said second structure, and

wherein said second image analysis tool is different than said first image analysis tool; and

present said second image analysis tool to said user.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE SU PATENT APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 058667 FRAME: 0058. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 21, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058803/0854 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058667/0058 →
Continuity (9)
Continuation In Part 17175727 · Feb 15, 2021
Continuation 17100902 · Nov 22, 2020
Continuation In Part 16785606 · Feb 9, 2020
Continuation In Part 16752691 · Jan 26, 2020
Continuation In Part 15904092 · Feb 23, 2018
Provisional Application 62963069 · Jan 19, 2020
Provisional Application 62961689 · Jan 15, 2020
Provisional Application 62940822 · Nov 26, 2019
Provisional Application 62939685 · Nov 25, 2019
Cited By (1)
US 12,462,405