IP Library › Granted Patent US 10,991,461
Granted Patent B2
US 10,991,461 · App. 15/616,915 · Granted Apr 27, 2021

Assessing the current state of a physical area of a healthcare facility using image analysis

Inventors: Lucas Jason Divine (West Allis, WI); Curtis Gibeaut, Jr. (Saukville, WI); Bryan Dickerson (Neosho, WI); Megan Wimmer (Milwaukee, WI)
Assignee: General Electric Company
G16H40/20G06K9/00671G06T11/60G06T19/006G16H20/40G16H40/63G16H40/67G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,991,461
App. No.
15/616,915
Filed
Jun 7, 2017
Granted
Apr 27, 2021
Kind
B2
Art Unit
3626
USPC
705/2
Abstract

Techniques for determining issues associated with a current state of an area of a healthcare facility are provided. In one example, a computer-implemented method comprises identifying an area of a healthcare facility included in image data captured of the healthcare facility, and characterizing aspects of a current state of the area of the area based on analysis of the image data, including determining object information characterizing objects included in the area. The method further comprises determining whether one or more of the aspects of the current state of the area deviate from a defined requirement for the area based on evaluation of the object information. Based on a determination that an aspect of the current state of the area deviates from the defined requirement for the area, the method can further comprise generating feedback information regarding the deviating aspect of the current state of the area.

Claims (41)

1. A system, comprising:

a memory that stores computer executable components;

a processor that executes computer executable components stored in the memory, wherein the computer executable components comprise:

an environment recognition component configured to identify an area of a healthcare facility included in image data captured of the healthcare facility;

an environment characterization component configured to identify medical resources included in the area based on the image data, wherein the medical resources comprise one or more medical supplies;

an environment assessment component configured to determine resource utilization information associated with usage of the medical resources at the healthcare facility and cost information regarding costs associated with the usage, wherein the resource utilization information comprises supply usage information regarding usage of the one or more medical supplies, and wherein the cost information comprises supply cost information associated with the usage of the one or more medical supplies,

wherein the supply usage information identifies a clinical success rate associated with usage of a first medical supply of the one or more medical supplies and a second clinical success rate associated with usage of an alternative medical supply; and

an augmented reality component configured to generate and display overlay data comprising the resource utilization information and the cost information for projection on a display of a device over a current view of the area as viewed on or through the display.

2. The system of claim 1 , wherein the computer executable components further comprise:

a rendering component configured to present the overlay data on the display and spatially align the overlay data with the medical resources.

3. The system of claim 2 , wherein the display is integrated into an eyewear device worn by the user.

4. The system of claim 1 , wherein the area comprises an operating room where a medical procedure is currently being performed on a patient by at least one clinician, and wherein the cost information comprises clinician costs attributed to usage of the clinician for the procedure.

5. A method comprising:

identifying, by a system comprising a processor, an area of a healthcare facility included in image data captured of the healthcare facility;

identifying, by the system, medical resources included in the area based on analysis of the image data, wherein the medical resources comprise one or more medical supplies;

determining, by the system, resource utilization information associated with usage of the medical resources at the healthcare facility, wherein the resource utilization information comprises supply usage information regarding usage of the one or more medical supplies;

determining, by the system, cost information regarding costs associated with the usage, wherein the cost information comprises supply cost information associated with the usage of the one or more medical supplies,

wherein the supply usage information identifies a clinical success rate associated with usage of a first medical supply of the one or more medical supplies and a second clinical success rate associated with usage of an alternative medical supply; and

generating and displaying, by the system, overlay data comprising the resource utilization information and the cost information for projection on a display of a device over a current view of the area as viewed on or through the display.

6. The method of claim 5 , further comprising:

rendering, by the system, the overlay data on the display and spatially aligning the overlay data with the medical resources.

7. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

receiving image data captured of an area of a healthcare facility;

identifying resources included in the area based on analysis of the image data, wherein the resources comprise one or more medical supplies;

determining resource utilization information associated with usage of the medical resource at the healthcare facility, wherein the resource utilization information comprises supply usage information regarding usage of the one or more medical supplies;

determining, by the system, cost information regarding costs associated with the usage, wherein the cost information comprises supply cost information associated with the usage of the one or more medical supplies,

wherein the supply usage information identifies a clinical success rate associated with usage of a first medical supply of the one or more medical supplies and a second clinical success rate associated with usage of an alternative medical supply; and

generating and displaying overlay data comprising the resource utilization information and the cost information for projection on a display of a device over a current view of the area as viewed on or through the display.

8. The machine-readable storage medium of claim 7 , wherein the operations further comprise:

rendering the overlay data on the display and spatially aligning the overlay data with the medical resource.

9. The system of claim 1 , wherein the supply usage information identifies an amount or frequency of past usage of the one or more medical supplies.

10. The system of claim 1 , wherein the supply usage information identifies an amount or frequency of expected future usage of the one or more medical supplies.

11. The system of claim 1 , wherein the supply usage information indicates whether there is a surplus or a deficiency in amount of the one or more medical supplies.

12. The system of claim 1 , wherein the supply cost information comprises financial gain or loss information attributed to the usage of the one or more medical supplies.

13. The system of claim 1 , wherein the one or more medical supplies comprise a piece of medical equipment, and wherein the supply cost information comprises a measure of financial return on investment for the piece of medical equipment.

14. The system of claim 1 , wherein the medical resources comprise one or more medical workers, wherein the resource utilization information comprises worker usage information regarding usage of the one or more medical workers, and wherein the cost information comprises medical worker cost information associated with the usage of the one or more medical workers.

15. The system of claim 14 , wherein the worker usage information comprises performance information regarding performance of job responsibilities of the one or more medical workers at the healthcare facility.

16. The system of claim 15 , wherein the worker cost information comprises a measure of financial return on investment for the one or more workers determined based on the performance information.

17. The system of claim 1 , wherein the computer executable components further comprise:

a recommendation component that determines financial and clinical losses attributed to the medical resources based on evaluation of the utilization information and the cost information, and wherein the augmented reality component includes loss information regarding the financial and clinical losses in the overlay data.

18. The system of claim 17 , wherein the recommendation component employs one or more machine learning techniques to determine the financial and clinical losses.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded May 8, 2025
From: GENERAL ELECTRIC COMPANY
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 071225/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2017
From: DIVINE, LUCAS JASON; GIBEAUT, CURTIS, JR.; DICKERSON, BRYAN; WIMMER, MEGAN
To: GENERAL ELECTRIC COMPANY
Reel/Frame 042640/0935 →
Continuity (2)
Continuation 15442386 · Feb 24, 2017
Related Publication 20180247024A1 · Aug 30, 2018
Cited By (1)
US 12,705,737