IP Library › Granted Patent US 10,643,360
Granted Patent B2
US 10,643,360 · App. 15/893,404 · Granted May 5, 2020

Real-time medical image visualization systems and related methods

Inventors: David Frakes (Scottsdale, AZ); Ross Maciejewski (Phoenix, AZ); Mark Spano (Casa Grande, AZ); Dustin Plaas (Gilbert, AZ); Alison Van Putten (Phoenix, AZ); Joseph Sansone (Phoenix, AZ); Matthew Mortensen (Chandler, AZ); Nathaniel Kirkpatrick (Atlanta, GA); Jonah Thomas (Chandler, AZ)
Assignee: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
G06T11/60A61B90/36A61B2034/2065A61B2090/365A61B2090/372A61B2090/502G06T2200/24G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,643,360
App. No.
15/893,404
Filed
Feb 9, 2018
Granted
May 5, 2020
Kind
B2
Art Unit
2668
USPC
382/131
Abstract

Some systems include a memory, and a processor coupled to the memory, wherein the processor is configured to: identify one or more spatial markers in a medical data-based image of a patient, identify one or more spatial markers in a real-time perceived image of the patient, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient, superimpose the medical data-based image of the patient with the real-time perceived image of the patient, and align the one or more spatial markers in the medical data-based image with the respective one or more spatial markers in the real-time perceived image.

Claims (44)

1. A system comprising:

a user interface device comprising:

one or more sensors;

a memory; and

a processor coupled to the memory;

wherein the processor is configured to:

identify one or more spatial markers in a medical data-based image of a patient;

in real-time:

receive a real-time perceived image of the patient from the one or more sensors;

based on a field of view of the one or more sensors, detect one or more spatial markers within the real-time perceived image, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient;

superimpose the medical data-based image of the patient with the real-time perceived image of the patient;

align the one or more spatial markers in the superimposed medical data-based image with the respective one or more spatial markers in the real-time perceived image; and

initiate display, via the user interface device, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image.

2. The system of claim 1 , wherein the medical data-based image comprises at least one of the following: a computed axial tomography (CAT) image, a magnetic resonance imaging (MRI) image, a positron emission tomography (PET) image, an ultrasound image, and an x-ray image.

3. The system of claim 1 , wherein the anatomical feature of the patient comprises one or more of the following: one or both eye sockets, a mouth, one or both ears, and an anterior nasal aperture.

4. The system of claim 1 , wherein:

the user interface further comprises a display screen;

the processor is further configured to initiate display, the display screen, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image; and

the real-time perceived image of the patient is captured by the one or more sensors.

5. The system of claim 1 , wherein the one or more sensors are configured to detect movement of the position of the one or more spatial markers in the real-time perceived image; and wherein the processor is configured to update the position of the one or more spatial markers of the medical data-based image in response to the detected movement of the position of the one or more spatial markers in the real-time perceived image.

6. The system of claim 1 , wherein the user interface device comprises a smartphone.

7. The system of claim 1 , wherein the user interface device comprises wearable computer glasses.

8. The system of claim 1 , wherein the user interface device comprises a tablet computer.

9. A computerized method comprising:

identifying one or more spatial markers in a medical data-based image of a patient with a user interface device;

in real-time:

based on a field of view of the one or more sensors, detecting one or more spatial markers in a real-time perceived image of the patient with the user interface device, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient;

simultaneously displaying the medical data-based image of the patient and the real-time perceived image of the patient via the user interface device;

aligning the one or more spatial markers in the medical data-based image with the one or more spatial markers in the real-time perceived image with the user interface device; and

initiating display, via the user interface device, of the medical data-based image of the patient with the real-time perceived image such that the one or more spatial markers in the medical data-based image are aligned and superimposed with the one or more spatial markers in the real-time perceived image.

10. The method of claim 9 , wherein the medical data-based image comprises at least one of the following: a computed axial tomography (CAT) image, a magnetic resonance imaging (MRI) image, a positron emission tomography (PET) image, an ultrasound image, and an x-ray image.

11. The method of claim 9 , wherein the anatomical feature of the patient comprises one or more of the following: one or both eye sockets, a mouth, one or both ears, and an anterior nasal aperture.

12. The method of claim 9 , wherein the real-time perceived image of the patient is captured by one or more sensors configured to capture an image.

13. The method of claim 9 , comprising:

detecting movement of the one or more spatial markers in the real-time perceived image; and

updating on a display a position of the one or more spatial markers of the medical data-based image in response to the detected movement of the one or more spatial markers in the real-time perceived image.

14. The computerized method of claim 9 , further comprising demonstrating in real-time the orientation, location, and/or spatial relevance of the anatomical feature of the patient relative to the perceived image with the user interface device.

15. The computerized method of claim 14 , wherein the real-time perceived image of the patient is captured by the one or more sensors, and wherein the one or more sensors are included in a camera.

16. The computerized method of claim 14 , wherein:

the one or more sensors are configured to detect movement of the position of the one or more spatial markers in the real-time perceived image; and

the processor is configured to update the position of the one or more spatial markers of the medical data-based image in response to the detected movement of the position of the one or more spatial markers in the real-time perceived image.

17. The system of claim 1 , further comprising a login controller, wherein the login controller is configured to determine whether the medical data-based image of the patient matches the real-time perceived image of the patient.

18. The system of claim 17 , wherein the login controller is configured to retrieve the medical data-based image of the patient based on a determination that the medical data-based image of the patient matches the real-time perceived image of the patient.

19. The system of claim 17 , wherein the login controller is configured to restrict access to the medical data-based image based on a determination that the medical data-based image of the patient does not match the real-time perceived image of the patient.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: KIRKPATRICK, NATHANIEL; SPANO, MARK; THOMAS, JONAH; MORTENSEN, MATTHEW; MACIEJEWSKI, ROSS; VAN PUTTEN, ALISON; SANSONE, JOSEPH; FRAKES, DAVID; PLAAS, DUSTIN
To: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
Reel/Frame 049846/0560 →
Continuity (2)
Provisional Application 62457545 · Feb 10, 2017
Related Publication 20180232925A1 · Aug 16, 2018
Cited By (1)
US 12,322,098