IP Library Granted Patent US 11,570,421
Granted Patent B1
US 11,570,421 · App. 16/700,507 · Granted Jan 31, 2023

Medical environment monitoring system

Inventors: Benjamin D. Rush (Lincoln, NE); Joshua M. Brown-Kramer (Lincoln, NE); Lucas A. Sabalka (Lincoln, NE); Brian S. Gansemer (Lincoln, NE); Clay T. Upton (Lincoln, NE); Paul B. Bauer (Lincoln, NE); Andrew R. Unterseher (Lincoln, NE); Benjamin J. Origas (Lincoln, NE); Douglas W. Durham (Lincoln, NE)
Assignee: Ocuvera, LLC
H04N13/207A61B5/002A61B5/1115A61B5/1116A61B5/1118A61B5/1128G06T7/73G06T7/74G06V20/52G06V40/103G06V40/20G08B21/0476A61B5/112A61B5/1114A61B5/1123A61B5/4815G06T2207/20076G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,570,421
App. No.
16/700,507
Granted
Jan 31, 2023
Kind
B1
Abstract

A system and a method are described for monitoring a medical care environment. In one or more implementations, a method includes identifying a first subset of pixels within a field of view of a camera as representing a bed. The method also includes identifying a second subset of pixels within the field of view of the camera as representing an object (e.g., a subject, such as a patient, medical personnel; bed; chair; patient tray; medical equipment; etc.) proximal to the bed. The method also includes determining an orientation of the object within the bed.

Claims (38)

1. A system for monitoring a medical care environment, the system comprising:

a depth imaging device having an imaging plane, the depth imaging device configured to:

receive at least one of a depth frame image or a color frame image representing a three-dimensional environment corresponding to a physical space;

at least one computing device in communication with the depth imaging device, the at least one computing device including:

a memory configured to store one or more modules;

a processor coupled to the memory, the processor is configured to execute the one or more modules to cause the processor to:

receive at least one of the depth frame image or the color frame image associated with a body part of a subject;

process, via a first processing technique, the at least one of the depth frame image or the color frame image to generate a first orientation signal of the body part with respect to the image plane, wherein the first orientation signal is based on a first set of a weights applied to the first orientation signal;

process, via a second processing technique, the at least one of the depth frame image or the color frame image to generate a second orientation signal of the body part with respect to the image plane, wherein the second orientation signal is based on a second set of a weights applied to the second orientation signal; and

determine a state of the subject based upon the first orientation signal and the second orientation signal.

2. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to determine a probability distribution based upon the first orientation signal and the second orientation signal via a fusion engine; and determine the state of the subject based upon the probability distribution.

3. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to determine the state of the subject comprises determining an orientation of the subject within a bed.

4. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to determine the state comprises determining an orientation of the subject within a chair.

5. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to process, via the first processing technique, the at least one of the depth frame image or the color frame image to identify a position of at least one of a second subject or an object relative to the subject.

6. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to determine whether the subject is at least one of transitioning from the a bed or transitioning within the bed.

7. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to process the at least one of the depth frame image or the color frame image to detect at least one of a presence or an absence of a gesture; and provide an indication associated with the at least one of the presence or the absence of the gesture.

8. The system as recited in claim 1 , wherein the processor is further configured to execute the one or more modules to cause the processor to issue an electronic communication based upon the state of the subject.

9. A method for monitoring a subject within a medical care environment, the method comprising:

identifying, by a processor, a first subset of pixels within a field of view of an imaging device as representing an object of interest, the first subset of pixels representing a portion of a three-dimensional environment;

identifying a second subset of pixels within the field of view of the imaging device as representing the subject within the field of view, the second subset of pixels representing another portion of the three-dimensional environment; and

determining, by the processor, a state associated with the subject based upon the first subset of pixels and the second subset of pixels via a first processing technique and a second processing technique, wherein the first processing technique generates a first orientation signal and the second processing technique generates a second orientation signal.

10. The method as recited in claim 9 , wherein determining the state comprises determining an orientation of the subject within a bed.

11. The method as recited in claim 9 , wherein determining the state comprises determining whether an activity level is associated with the subject.

12. The method as recited in claim 9 , further comprising identifying at least one of a presence or an absence of a gesture based upon the second subset of pixels; and

providing an indication associated with the at least one of the presence or the absence of the gesture.

13. The method as recited in claim 9 , further comprising issuing an electronic communication based upon the at least one state of the subject.

14. A method for monitoring a medical care environment, the method comprising:

receiving at least one of a depth frame image or a color frame image associated with a body part of a subject, the at least one of the depth frame image of the color frame image captured by an imaging device having an image plane;

processing, via a first processing technique, the at least one of the depth frame image or the color frame image to generate a first orientation signal of the body part with respect to the image plane, wherein the first orientation signal is based on a first set of a weights applied to the first orientation signal;

processing, via a second processing technique, the at least one of the depth frame image or the color frame image to generate a second orientation signal of the body part with respect to the image plane, wherein the second orientation signal is based on a second set of a weights applied to the second orientation signal;

determining a probability distribution based upon at least the first orientation signal and the second orientation signal via a fusion engine; and

determining a state of the subject based upon the probability distribution.

15. The method as recited in claim 14 , further comprising processing, via a third processing technique, the at least one of the depth frame image or the color frame image to generate a third orientation signal of the body part with respect to the image plane, wherein determining a probability distribution based upon at least the first orientation signal and the second orientation signal via the fusion engine comprises determining the probability distribution based upon at least the first orientation signal, the second orientation signal, and the third orientation signal via the fusion engine.

16. The method as recited in claim 14 , wherein determining the state comprises determining an activity level associated with the object.

17. The method as recited in claim 14 , wherein determining the state comprises determining whether the subject is in a bed.

18. The method as recited in claim 14 , wherein determining the state comprises determining an orientation of the subject within a chair.

19. The method as recited in claim 14 , further comprising identifying a position of at least one of a second subject or an object relative to the subject.

20. The method as recited in claim 14 , further comprising detecting at least one of a presence or an absence of a gesture; and providing an indication associated with the at least one of the presence or the absence of the gesture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2022
From: RUSH, BENJAMIN D.; BROWN-KRAMER, JOSHUA M.; SABALKA, LUCAS; GANSEMER, BRIAN S.; UPTON, CLAY T.; BAUER, PAUL B.; UNTERSEHER, ANDREW R.; ORIGAS, BENJAMIN J.; DURHAM, DOUGLAS W.
To: OCUVERA, LLC
Reel/Frame 062144/0325 →
Continuity (5)
Continuation 15392222 · Dec 28, 2016
Continuation 14055139 · Oct 16, 2013
Provisional Application 61880273 · Sep 20, 2013
Provisional Application 16826669 · May 23, 2013
Provisional Application 61714252 · Oct 16, 2012
Cited By (1)
US 12,299,852