Granted Patent B2

US 12,322,185 · App. 18/514,662 · Granted Jun 3, 2025

Inventors: Nadeesha O. Ranasinghe (Laguna Niguel, CA); Ammar Al-Ali (San Juan Capistrano, CA); Massi Joe E. Kiani (Laguna Niguel, CA); Mohammad Usman (Mission Viejo, CA); Bowen Zhao (Irvine, CA); Pierre de Malliard (Laguna Beach, CA); Peter Sunghwan Min (Irvine, CA)

Assignee: Masimo Corporation

G06V20/52G01S11/12G06N3/044G06V10/764G06V10/82G06V40/10G06V40/103G06V40/20G08B21/245G16H40/20G16H50/80H04N23/90

Abstract

Claims (34)

1. A system for monitoring of hand hygiene compliance on a local network in a clinical room, the clinical room including a patient zone and a hand hygiene station outside the patient zone, the system comprising:

a first camera configured to capture first image data from a first viewpoint in the clinical room;

a first hardware processor configured to detect a person in an image frame from the first image data and assign a boundary box to the person, the first processor further configured to track movement of the boundary box in subsequent image frames from the first image data;

a second camera configured to capture second image data from a second viewpoint in the clinical room;

a second hardware processor configured to detect whether a hand hygiene activity has been performed from the second image data; and

a plurality of display devices in different locations of the clinical room, the first processor and/or the second processor in communication with the plurality of the display devices,

wherein the first and/or second processors are further configured to receive configuration information of the clinical room from a server upon initiation of the system, wherein the configuration information comprises one or more of display device locations, camera locations, an entrance location, a hand hygiene station location, and/or a patient bed location, and

wherein the first and second processors are in communication with each other, the first or second processor further configured to:

determine that the person to whom the boundary box is assigned has not performed the hand hygiene activity,

locate, based at least in part on the configuration information, a nearest display device of the plurality of display devices to the person, wherein the person is entering the patient zone, and

output an alert to the nearest display device.

2. The system of claim 1 , wherein the first processor is configured to output the alert to the nearest display device.

3. The system of claim 1 , wherein the first and second viewpoints are fixed.

4. The system of claim 1 , wherein the first camera faces an entrance of the clinical room.

5. The system of claim 1 , wherein the second camera faces the hand hygiene station in the clinical room.

6. The system of claim 5 , wherein the second camera faces downward at the hand hygiene station.

7. The system of claim 5 , wherein the second processor is configured to detect a handwashing activity or a hand sanitizing activity at the hand hygiene station.

8. The system of claim 1 , comprising a third camera, wherein the third camera is configured to capture third image data from a third viewpoint in the clinical room.

9. The system of claim 1 , wherein the first processor is configured to assign a contaminated status to any person upon first detection of said any person.

10. The system of claim 9 , wherein the first or second processor is configured to change the contaminated status to a clean status upon detection of said any person having performed the hand hygiene activity.

11. The system of claim 1 , wherein no image data from the first or second cameras is transmitted to the server or any of the plurality of display devices, or stored or recorded.

12. The system of claim 1 , wherein the second processor is configured to detect the hand hygiene activity from the second image data by extracting hand hygiene-related features from image frames of the second image data.

13. The system of claim 1 , wherein the second processor is configured to detect the hand hygiene activity from the second image data using deep learning modules.

14. A system for monitoring activities or actions occurring in a clinical setting comprising a hospital bed, the system comprising:

a plurality of sensors including a first camera and a second camera in the clinical setting, the first and second cameras being high-resolution cameras, wherein the first and second cameras are facing a fixed object at different angles and relative positions of the first and second camera being fixed, the plurality of sensors further comprising at least one camera processor in electrical communication with the first and/or second cameras; and

a plurality of display devices,

wherein the at least one camera processor is in communication with a server, the at least one camera processor configured to process images captured by the first and/or second cameras to output data to the server and assign a boundary box to the person, the at least one camera processor further configured to track movement of the boundary box in subsequent image frames from the data, and

wherein the server is configured to detect an event of hand hygiene incompliance by detecting the person to whom the boundary box is assigned having not performed a hand hygiene activity and assign a contaminated status to the person, the server further configured to output an alarm to one of the plurality of display devices in response to the person being within a predetermined distance from the hospital bed, wherein the one of the plurality of display devices is a display device nearest to the person or the hospital bed.

15. The system of claim 14 , wherein the data comprises boundary box coordinates, tag identifier information, extracted facial features, activity features, camera identifier information, unique ID for each person, frame number of the images, or any combinations thereof.

16. The system of claim 15 , wherein the first and/or second cameras are configured to prioritize detection of the unique ID for each person.

17. The system of claim 14 , wherein the fixed object is the hospital bed and the first and second cameras are at opposite sides of the hospital bed.

18. The system of claim 14 , wherein the plurality of sensors further comprises a third camera facing a hand hygiene station.

19. The system of claim 14 , wherein the plurality of devices displays are displays of a plurality of patient monitoring systems.

20. The system of claim 14 , wherein the plurality of sensors further comprises at least one microphone.

Assignments (1)

Continuity (5)

References Cited (400)