IP Library › Granted Patent US 11,721,105
Granted Patent B2
US 11,721,105 · App. 17/174,931 · Granted Aug 8, 2023

System and method for monitoring clinical activities

Inventors: Nadeesha O. Ranasinghe (Laguna Niguel, CA); Ammar Al-Ali (San Juan Capistrano, CA); Massi Joe E. Kiani (Laguna Niguel, CA); Mohammad Usman (Mission Viejo, CA); Bowen Zhao (Irvine, CA); Pierre de Malliard (Laguna Beach, CA); Peter Sunghwan Min (Irvine, CA)
Assignee: Masimo Corporation
G06V20/52G16H40/20G16H50/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,105
App. No.
17/174,931
Granted
Aug 8, 2023
Kind
B2
Abstract

A monitoring system can be configured to monitor activities or actions occurring in clinical settings, such as hospitals. The monitoring system can improve patient safety. The system can use visual and/or other tracking methods. The system can detect and/or identify people in a clinical setting. The system can also track activities of the people, for example, to improve adherence to hygiene protocols.

Claims (32)

1. A system for tracking, on a local network, movements of people in an enclosed room with an entrance/exit, the system comprising:

a camera configured to capture image data from a viewpoint in the room; and

a hardware processor in physical proximity to the camera, the hardware processor configured to:

detect each person in an image frame from the image data;

extract coordinates of each detected person relative to the image frame; and

update tracks monitored by the hardware processor based on the coordinates of each detected person without storing any image from the image data, wherein a new track is assigned to a person detected within a predetermined distance from the entrance/exit and not having been assigned a track in a previous image frame from the image data, wherein only non-image data is transmitted by the hardware processor.

2. The system of claim 1 , wherein, in response to a person detected within the predetermined distance from the entrance/exit and having been assigned a track in the previous image frame from the image data, the hardware processor is configured to delete the track.

3. The system of claim 1 , wherein, in response to a person detected away from the entrance/exit by the predetermined distance and having been assigned a track in the previous image frame from the image data, the hardware processor is configured to confirm the track.

4. The system of claim 1 , wherein the enclosed room is a clinical room, the hardware processor further configured to assign a contaminated status to any person who is assigned a new track.

5. The system of claim 4 , wherein the hardware processor is further configured to change the contaminated status of a person upon detecting the person performing a hand hygiene activity.

6. The system of claim 5 , further comprising a second camera configured to capture image data from a second viewpoint in the room and a second hardware processor in physical proximity to the second camera, the second viewpoint including a view of a hand hygiene area and the second processor configured to detect the hand hygiene activity.

7. The system of claim 6 , wherein the hardware processor is configured to output an alert to a display device in the clinical room in response to detecting a track of a contaminated person entering a patient zone.

8. The system of claim 1 , wherein the processor is configured to determine that a track in a previous image frame belongs to the same person detected in the image frame by performing an intersection over union calculation of coordinates of the track in the previous image frame and the coordinates of the person detected in the image frame.

9. The system of claim 1 , comprising a plurality of cameras and a plurality of hardware processors, each of the plurality of cameras being in physical proximity and associated with one of the plurality of hardware processors.

10. The system of claim 9 , wherein the plurality of hardware processors are configured to resolve occlusion based at least in part on a number of tracks detected in an image frame from image data of their respective associated cameras.

11. The system of claim 1 , wherein the coordinates of each detected person are coordinates of each boundary box surrounding an entirety of a respective detected person.

12. A system for tracking movements of a person in a clinical room, wherein more than one person is present at the clinical room, the system comprising:

a first camera configured to capture first image data from a first viewpoint in the clinical room;

a first hardware processor in physical proximity to the first camera, the first processor configured to detect each person in an image frame from the first image data and assign a unique boundary box to each person, the first processor further configured to track movement of the boundary boxes in subsequent image frames from the first image data without storing any image from the first image data;

a second camera configured to capture second image data from a second viewpoint in the clinical room; and

a second hardware processor in physical proximity to the second camera, the second processor configured to detect each person in an image frame from the second image data and assign a unique boundary box to each person, the second processor further configured to track movement of the boundary boxes in subsequent image frames from the second image data without storing any image from the first image data,

wherein at least one of the first or second cameras comprises a depth camera, the first and/or second processor configured to detect occlusion of a person in the clinical room by another person or object using depth information from the depth camera, wherein only non-image data is transmitted by the first or second hardware processor.

13. The system of claim 12 , wherein the first and second viewpoints are fixed.

14. The system of claim 12 , wherein the first camera faces an entrance of the clinical room.

15. The system of claim 12 , wherein the clinical room consists of a single entrance.

16. The system of claim 12 , comprising a third camera,

wherein the third camera is configured to capture third image data from a third viewpoint in the clinical room.

17. The system of claim 16 , wherein the third camera comprises a depth camera.

18. The system of claim 12 , wherein the first and second cameras each comprise a depth camera.

19. The system of claim 12 , wherein the depth information of the first camera translates to information in a direction of the second camera that is orthogonal to Z axis of the first camera.

20. The system of claim 12 , wherein the depth information of the first camera is orthogonal to depth information of the second camera.

21. The system of claim 12 , wherein the first and/or second processors are configured to detect occlusion of a person if the first processor is tracking a different number of boundary boxes than the second processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: RANASINGHE, NADEESHA O.; AL-ALI, AMMAR; KIANI, MASSI JOE E.; USMAN, MOHAMMAD; ZHAO, BOWEN; DE MALLIARD, PIERRE; MIN, PETER SUNGHWAN
To: MASIMO CORPORATION
Reel/Frame 063220/0252 →
Continuity (4)
Provisional Application 63085058 · Sep 29, 2020
Provisional Application 63075731 · Sep 8, 2020
Provisional Application 62976000 · Feb 13, 2020
Related Publication 20210256267A1 · Aug 19, 2021
Cited By (139)
US 1,060,680 US 1,063,893 US 1,066,244 US 1,066,672 US 1,068,656 US 1,071,195 US 1,078,689 US 1,079,020 US 1,083,653 US 1,085,102 US 1,092,244 US 1,095,288 US 1,095,483 US 1,102,622 US 1,106,466 US 1,119,639 US 1,127,209 US 1,132,251 US 1,140,023 US 1,146,885 US 1,148,151 US 1,149,054 US 12,186,079 US 12,193,813 US 12,193,849 US 12,198,790 US 12,201,420 US 12,201,702 US 12,205,208 US 12,207,419 US 12,207,901 US 12,211,617 US 12,214,274 US 12,220,205 US 12,220,207 US 12,220,257 US 12,226,206 US 12,230,391 US 12,230,393 US 12,230,396 US 12,232,888 US 12,232,905 US 12,235,941 US 12,235,947 US 12,236,767 US 12,237,081 US 12,238,489 US 12,257,022 US 12,257,081 US 12,257,183 US 12,263,018 US 12,272,445 US 12,283,374 US 12,295,708 US 12,302,426 US 12,310,695 US 12,318,175 US 12,318,176 US 12,318,196 US 12,318,229 US 12,318,580 US 12,322,185 US 12,329,548 US 12,336,796 US 12,343,108 US 12,343,142 US 12,347,202 US 12,357,181 US 12,357,203 US 12,357,237 US 12,362,596 US 12,364,403 US 12,367,973 US 12,374,843 US 12,383,194 US 12,390,114 US 12,390,140 US 12,394,285 US 12,396,667 US 12,402,816 US 12,402,832 US 12,402,843 US 12,408,869 US 12,419,588 US 12,433,524 US 12,440,128 US 12,440,171 US 12,465,270 US 12,465,286 US 12,478,272 US 12,478,293 US 12,484,844 US 12,495,967 US 12,495,968 US 12,495,998 US 12,495,999 US 12,507,952 US 12,514,503 US 12,521,021 US 12,521,039 US 12,521,506 US 12,533,068 US 12,533,089 US 12,538,084 US 12,539,046 US 12,541,293 US 12,558,033 US 12,573,286 US 12,575,797 US 12,582,313 US 12,587,806 US 12,593,980 US 12,609,013 US 12,611,117 US 12,616,623 US 12,642,491 US 12,648,718 US 12,661,039 US 12,661,488 US 12,667,307 US 12,677,331 US 12,689,232 US 12,691,223 US 12,694,892 US 12,702,202 US 12,702,333 US 12,702,755 US 12,708,328 US 12,714,369 US 12,727,766 US 12,728,202 US 12,731,671 US 12,733,845 US 12,733,847 US 12,740,728 US 12,744,120 US 12,744,134 US 12,745,932 US 12,750,228