IP Library Granted Patent US 9,495,855
Granted Patent B2
US 9,495,855 · App. 14/714,485 · Granted Nov 15, 2016

Fall detection and reporting technology

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,495,855
App. No.
14/714,485
Granted
Nov 15, 2016
Kind
B2
Abstract

Fall detection and reporting technology, in which output from at least one sensor configured to sense, in a room of a building, activity associated with a patient falling is monitored and a determination is made to capture one or more images of the room based on the monitoring. An image of the room is captured with a camera positioned to include the patient within a field of view of the camera and the captured image of the room is analyzed to detect a state of the patient at a time of capturing the image. A potential fall event for the patient is determined based on the detected state of the patient and a message indicating the potential fall event for the patient is sent based on the determination of the potential fall event for the patient. Techniques are also described for fall detection and reporting using an on-body sensing device.

Claims (76)

1. A method comprising:

monitoring output from at least one sensor configured to sense activity associated with a fall;

based on the monitoring of output from the at least one sensor, determining to capture one or more images of an area associated with the at least one sensor;

based on the determination to capture one or more images of the area associated with the at least one sensor, capturing, with a camera, an image of the area associated with the at least one sensor;

detecting, in the captured image, a state of a person included in the captured image;

determining, based on the detected state of the person, a potential fall event in the area associated with the at least one sensor; and

based on the determination of the potential fall event, sending, by a communication device and to a device associated with the person involved in the potential fall event, a message that indicates the potential fall event and provides the person with an opportunity to cancel the potential fall event.

2. The method of claim 1 , further comprising:

determining that the person has not cancelled the potential fall event within a threshold period of time; and

based on determining that the person has not cancelled the potential fall event within the threshold period of time, sending a message to a monitoring server indicating the potential fall event.

3. The method of claim 1 , further comprising:

receiving, from the person, an indication to cancel the potential fall event; and

based on receiving the indication to cancel the potential fall event, determining an overall activity of the person between detecting the potential fall event and receiving the indication to cancel the potential fall event.

4. The method of claim 3 , further comprising:

determining that the overall activity of the person is above a threshold level of activity; and

based on determining that the overall activity of the person is above the threshold level of activity, signaling that the potential fall event was detection of a false fall.

5. The method of claim 3 , further comprising:

determining that the overall activity of the person is below a threshold level of activity; and

based on determining that the overall activity of the person is below the threshold level of activity, determining an orientation of the person.

6. The method of claim 5 , further comprising:

determining that the determined orientation of the person is upright; and

based on determining that the determined orientation of the person is upright, signaling that the potential fall event was detection of a minor fall.

7. The method of claim 5 , further comprising:

determining that the determined orientation of the person is not upright; and

based on determining that the determined orientation of the person is not upright, sending another message to the person that provides the person with another opportunity to cancel the potential fall event.

8. The method of claim 7 , further comprising:

determining that the person has not cancelled the potential fall event within a threshold period of time after sending another message to the person that provides the person with another opportunity to cancel the potential fall event; and

based on determining that the person has not cancelled the potential fall event within the threshold period of time after sending another message to the person that provides the person with another opportunity to cancel the potential fall event, sending a message to a monitoring server indicating the potential fall event.

9. The method of claim 7 , further comprising:

after sending another message to the person that provides the person with another opportunity to cancel the potential fall event, receiving, from the person, an indication to cancel the potential fall event; and

based on receiving the indication to cancel the potential fall event, signaling that the potential fall event was a cancelled fall event.

10. The method of claim 1 :

wherein detecting, in the captured image, the state of the person included in the captured image comprises:

performing image foreground segmentation on the captured image to create a segmented image,

performing template matching on the segmented image to identify a human shape in the segmented image, and

calculating a position and an orientation associated with the identified human shape in the segmented image, and

wherein determining the potential fall event in the area associated with the at least one sensor comprises determining a potential fall event for the person based on the calculated position and the calculated orientation.

11. A system comprising:

at least one processor; and

at least one memory coupled to the at least one processor having stored thereon instructions which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:

monitoring output from at least one sensor configured to sense activity associated with a fall;

based on the monitoring of output from the at least one sensor, determining to capture one or more images of an area associated with the at least one sensor;

based on the determination to capture one or more images of the area associated with the at least one sensor, capturing, with a camera, an image of the area associated with the at least one sensor;

detecting, in the captured image, a state of a person included in the captured image;

determining, based on the detected state of the person, a potential fall event in the area associated with the at least one sensor; and

based on the determination of the potential fall event, sending, by a communication device and to a device associated with the person involved in the potential fall event, a message that indicates the potential fall event and provides the person with an opportunity to cancel the potential fall event.

12. The system of claim 11 , wherein the operations further comprise:

determining that the person has not cancelled the potential fall event within a threshold period of time; and

based on determining that the person has not cancelled the potential fall event within the threshold period of time, sending a message to a monitoring server indicating the potential fall event.

13. The system of claim 11 , wherein the operations further comprise:

receiving, from the person, an indication to cancel the potential fall event; and

based on receiving the indication to cancel the potential fall event, determining an overall activity of the person between detecting the potential fall event and receiving the indication to cancel the potential fall event.

14. The system of claim 13 , wherein the operations further comprise:

determining that the overall activity of the person is above a threshold level of activity; and

based on determining that the overall activity of the person is above the threshold level of activity, signaling that the potential fall event was detection of a false fall.

15. The system of claim 13 , wherein the operations further comprise:

determining that the overall activity of the person is below a threshold level of activity; and

based on determining that the overall activity of the person is below the threshold level of activity, determining an orientation of the person.

16. The system of claim 15 , wherein the operations further comprise:

determining that the determined orientation of the person is upright; and

based on determining that the determined orientation of the person is upright, signaling that the potential fall event was detection of a minor fall.

17. The system of claim 15 , wherein the operations further comprise:

determining that the determined orientation of the person is not upright; and

based on determining that the determined orientation of the person is not upright, sending another message to the person that provides the person with another opportunity to cancel the potential fall event.

18. The system of claim 17 , wherein the operations further comprise:

determining that the person has not cancelled the potential fall event within a threshold period of time after sending another message to the person that provides the person with another opportunity to cancel the potential fall event; and

based on determining that the person has not cancelled the potential fall event within the threshold period of time after sending another message to the person that provides the person with another opportunity to cancel the potential fall event, sending a message to a monitoring server indicating the potential fall event.

19. The system of claim 17 , wherein the operations further comprise:

after sending another message to the person that provides the person with another opportunity to cancel the potential fall event, receiving, from the person, an indication to cancel the potential fall event; and

based on receiving the indication to cancel the potential fall event, signaling that the potential fall event was a cancelled fall event.

20. The system of claim 11 :

wherein detecting, in the captured image, the state of the person included in the captured image comprises:

performing image foreground segmentation on the captured image to create a segmented image,

performing template matching on the segmented image to identify a human shape in the segmented image, and

calculating a position and an orientation associated with the identified human shape in the segmented image, and

wherein determining the potential fall event in the area associated with the at least one sensor comprises determining a potential fall event for the person based on the calculated position and the calculated orientation.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Jan 21, 2021
From: SILICON VALLEY BANK
To: ENERGYHUB, INC.; ICN ACQUISITION, LLC; ALARM.COM INCORPORATED
Reel/Frame 055069/0001 →
SECURITY INTEREST Recorded Oct 10, 2017
From: ALARM.COM, INCORPORATED; ENERGYHUB, INC.; ICN ACQUISITION, LLC
To: SILICON VALLEY BANK
Reel/Frame 044167/0235 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT Recorded Aug 11, 2016
From: ALARM.COM INCORPORATED
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 039656/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2015
From: HANSON, MARK ANDREW; MARTIN, JEAN-PAUL; BARTH, ADAM T.; SILVERMAN, CHRISTOPHER
To: ALARM.COM INCORPORATED
Reel/Frame 035713/0613 →