IP Library Granted Patent US 11,417,071
Granted Patent B1
US 11,417,071 · App. 17/181,757 · Granted Aug 16, 2022

Virtual toolkit for radiologists

Inventors: Robert Edwin Douglas (Winter Park, FL); David Byron Douglas (Winter Park, FL); Kathleen Mary Douglas (Winter Park, FL)
Assignee: RED PACS, LLC
G06T19/20G06T15/08G06T2219/2012G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,417,071
App. No.
17/181,757
Granted
Aug 16, 2022
Kind
B1
Abstract

Virtual tools are used to manipulate aspects of a three-dimensional medical image volume. The virtual tools are geo-registered with the image volume. Presentation of the image volume is manipulated by an image processor in response to use of the virtual tools. The virtual tools may be used to facilitate analysis of the image volume. The virtual tools may include: a virtual focal point pen; a virtual 3D cursor; a virtual transport viewer; a virtual pedestal; a virtual knife; a virtual catheter; a virtual road sign; a virtual ablation tool; a virtual table; a virtual contrast tool; and virtual icons.

Claims (60)

1. A method comprising:

selecting a three-dimensional image volume loaded in an image processing system;

displaying said three-dimensional image volume on an extended reality head display unit;

selecting a set of virtual tools from a group of available virtual tools responsive to user input;

geo-registering each virtual tool of the selected set with both the three-dimensional image volume and a corresponding tangible tool;

manipulating the three-dimensional image volume in response to manipulation of ones of the set of virtual tools to generate a manipulated three-dimensional image volume

wherein said manipulation of said ones of the set of virtual tools is performed by changing an orientation or a position of said corresponding tangible tool, and

wherein said manipulation comprises altering three-dimensional image volume's structure; and

displaying said manipulated three-dimensional image volume on said extended reality head display unit.

2. The method of claim 1 comprising selecting the set of virtual tools from a group of available virtual tools comprising: a virtual focal point pen; a virtual 3D cursor; a virtual transport viewer; a virtual pedestal; a virtual knife; a virtual catheter; a virtual road sign; a virtual ablation tool; a virtual table; a virtual contrast tool; and virtual icons.

3. The method of claim 1 wherein the set of virtual tools comprises a virtual focal point pen and comprising manipulating the three-dimensional image volume responsive to the virtual focal point pen by highlighting a portion of the three-dimensional image volume and adding annotations.

4. The method of claim 3 comprising altering a portion of the three-dimensional image volume adjacent to a tip of the virtual focal point pen.

5. The method of claim 1 wherein the set of virtual tools comprises a virtual knife and comprising manipulating the three-dimensional image volume responsive to the virtual knife consisting of at least one of the group consisting of separating portions of the three-dimensional image volume.

6. The method of claim 1 wherein the set of virtual tools comprises a virtual transport viewer and comprising:

manipulating the three-dimensional image volume responsive to the virtual transport viewer by moving the virtual transport viewer within a hollow structure of the three-dimensional image volume and presenting an image from a perspective of the virtual transport viewer; and

using the virtual transport viewer to perform a virtual colonoscopy.

7. The method of claim 1 wherein the set of virtual tools comprises a virtual contrast material and comprising:

manipulating the three-dimensional image volume responsive to the virtual contrast material by inserting voxels into the three-dimensional image volume; and

assigning data units values to different ones of the voxels.

8. The method of claim 1 wherein manipulating the three-dimensional image volume in response to manipulation of ones of the set of virtual tools comprises removing voxels of an outer shell of an organ in a repeated outer-shell by outer-shell fashion.

9. The method of claim 1 wherein manipulating the three-dimensional image volume in response to manipulation of ones of the set of virtual tools comprises spreading apart closely spaced tissue of interest by adjusting coordinates of voxels of the tissue of interest.

10. The method of claim 1 wherein the set of virtual tools comprises a virtual table and comprising manipulating the three-dimensional image volume responsive to the virtual table by placing portions of the three-dimensional image volume in a virtual storage bin of the virtual table.

11. The method of claim 1 wherein the set of virtual tools comprises a virtual catheter and comprising manipulating the three-dimensional image volume responsive to the virtual catheter by restricting movement of the virtual catheter to a column of blood voxels within a selected blood vessel.

12. The method of claim 1 comprising automatically displaying information associated with a selected sub-volume of the three-dimensional image volume wherein said information comprises patient's meta data and current condition for which obtaining the medical image volume was prompted, patient's medical history, laboratory results, and pathology results.

13. The method of claim 1 wherein the comprising displaying at least one of the group consisting of:

an information on a virtual windshield;

a distance with a virtual road sign;

a visual aid icon indicating viewing perspective;

each of sub-volume on a list of sub-volumes in a sequential fashion; and

a visual aid icon indicating a finding detected by an artificial intelligence algorithm.

14. The method of claim 1 comprising selecting at least one of the group comprising:

at least one sub-volume with a volume-subtending three-dimensional cursor;

a sub-volume from a plurality of sub-volumes of a predetermined list of sub-volumes;

a sub-volume from a plurality of sub-volumes defined by sequential search pattern coordinates; and

a sub-volume from a plurality of sub-volumes defined by random search pattern coordinates.

15. The method of claim 1 wherein manipulating the three-dimensional image volume comprises at least one of: changing voxel size; changing voxel shape; changing voxel position; changing voxel orientation; changing voxel internal parameter; creating a voxel; eliminating a voxel; dividing a sub-volume volume of interest into multiple parts based on common characteristics; and, generating an exploded view wherein segmented structures of the three-dimensional image are moved away from a point in the three-dimensional image volume.

16. The method of claim 1 comprising employing a virtual eye tracker symbol to assist in human eye viewing.

17. The method of claim 16 comprising making the virtual eye tracker symbol appear and disappear at spatially separate lactations so that the human eye can perform saccades and jump from one location to another.

18. The method of claim 16 comprising making the virtual eye tracker symbol move smoothly along a path, so that the human eye can perform smooth tracking.

19. A non-transitory computer readable medium having computer readable code thereon for medical imaging, the medium comprising instructions for:

selecting a three-dimensional image volume loaded in an image processing system;

displaying said three-dimensional image volume on an extended reality head display unit;

selecting a set of virtual tools from a group of available virtual tools responsive to user input;

geo-registering each virtual tool of the selected set with both the three-dimensional image volume and a corresponding tangible tool;

manipulating the three-dimensional image volume in response to manipulation of ones of the set of virtual tools to generate a manipulated three-dimensional image volume

wherein said manipulation of said ones of the set of virtual tools is performed by changing an orientation or a position of said corresponding tangible tool, and

wherein said manipulation comprises altering said three-dimensional image volume's structure; and

displaying said manipulated three-dimensional image volume on said extended reality head display unit.

20. A computer system comprising:

a memory;

a processor; and

wherein the memory is encoded with an application that when performed on the processor, provides a process for processing information, the process causing the computer system to perform the operations of:

selecting a three-dimensional image volume loaded in an image processing system,

displaying said three-dimensional image volume on an extended reality head display unit;

selecting a set of virtual tools from a group of available virtual tools responsive to user input;

geo-registering each virtual tool of the selected set with both the three-dimensional image volume and a corresponding tangible tool;

manipulating the three-dimensional image volume in response to manipulation of ones of the set of virtual tools to generate a manipulated three-dimensional image volume

wherein said manipulation of said ones of the set of virtual tools is performed by changing an orientation or a position of said corresponding tangible tool, and

wherein said manipulation comprises altering said three-dimensional image volume's structure; and

displaying said manipulated three-dimensional image volume on said extended reality head display unit.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE SU PATENT APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 058667 FRAME: 0058. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 21, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058803/0854 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058667/0058 →
Continuity (4)
Continuation In Part 17175815 · Feb 15, 2021
Continuation 16843988 · Apr 9, 2020
Continuation 16752662 · Jan 26, 2020
Continuation 15904092 · Feb 23, 2018
Cited By (2)
US 12,515,045 US 12,646,609