IP Library Granted Patent US 12,072,348
Granted Patent B2
US 12,072,348 · App. 16/265,779 · Granted Aug 27, 2024

Fall detection system using a combination of accelerometer, audio input and magnetometer

Inventors: Ram David Adva Fish (Menlo Park, CA); Henry Messenger (Campbell, CA); Leonid Baryudin (San Francisco, CA); Soroush Salehian Dardashti (Mountain View, CA); Evgenia Goldshtein (Madison, NJ)
Assignee: Nice North America LLC
G01P1/07H04M1/72421H04W4/90H04M2201/40H04M2250/02H04M2250/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,072,348
App. No.
16/265,779
Granted
Aug 27, 2024
Kind
B2
Abstract

A wearable device for detecting a user state is disclosed. The wearable device includes an accelerometer for measuring an acceleration of a user, a magnetometer for measuring a magnetic field associated with the user's change of orientation, a microphone for receiving audio, a memory for storing the audio, and at least one processor communicatively connected to the accelerometer, the magnetometer, the microphone, and the memory. The processor is identified to declare a measured acceleration as a suspected user state, and to categorize the suspected user state based on the stored audio as one of an activity of daily life (ADL), a confirmed user state, or an inconclusive event.

Claims (29)

1. A non-transitory computer readable storage medium including instructions that, when executed by a processor, cause the processor to

perform operations to:

receive a set of measurement data including accelerometer data, magnetometer data and audio data;

receive category information for the set of measurement data, the category information identifying a first set of measurement data categorized as indicative of a suspected fall, based on the accelerometer data, a second set of measurement data categorized as indicative of an activity of daily life (ADL) based on physical movement of users, and a third set of measurement data categorized as an inconclusive event;

train a fall model and train an ADL model using the set of measurement data and the category information; and

wherein the fall model and the ADL model are used to classify unclassified measurement data as indicative of a fall or an ADL, the ADL model classifying at least talking and walking as ADL events, and wherein the fall model is used to re-confirm whether the first set of measurement data categorized as indicative of the suspected fall indicates a fall.

2. The computer readable storage medium of claim 1 , wherein the fall model and the ADL model are Gaussian mixture model (GMM) models.

3. The computer readable storage medium of claim 2 , wherein the GMM models are trained using an expectation maximization algorithm.

4. The computer readable storage medium of claim 1 , wherein the set of measurement data includes prior events classified as fall and ADL events.

5. The computer readable storage medium of claim 1 , wherein the instructions further cause the processor to receive additional measurement data including in-use data and update the fall model and the ADL model using the additional measurement data.

6. The computer readable storage medium of claim 1 , wherein the instructions further cause the processor to implement Gaussian mixture model (GMM) classifiers on a subset of a selected feature space of events from the set of measurement data.

7. The computer readable storage medium of claim 6 , wherein the selected feature space is selected via a sequential forward floating selection (SFFS) algorithm to maximize classifier performance.

8. The computer readable storage medium of claim 1 , wherein the instructions further cause the processor to determine a threshold for classifying an event as a fall, and wherein the unclassified measurement data is classified based on a score for the unclassified measurement data and the threshold.

9. The computer readable storage medium of claim 1 , wherein the set of measurement data includes accelerometer data, magnetometer data, and audio data.

10. The computer readable storage medium of claim 1 , wherein to classify the unclassified measurement data as indicative of a fall or an ADL, the fall model and the ADL model are to determine a re-confirmation or change of classification from an initial classification received from a wearable device that generated the unclassified measurement data.

11. A method comprising:

receiving, at a processor, a set of measurement data including accelerometer data, magnetometer data and audio data;

receiving category information for the set of measurement data, the category information identifying a first set of measurement data categorized as indicative of a suspected fall, based on the accelerometer data, a second set of measurement data categorized as indicative of an activity of daily life (ADL) based on physical movement of users, and a third set of measurement data categorized as an inconclusive event;

training, using the processor, a fall model and training an ADL model using the set of measurement data and the category information; and

wherein the fall model and the ADL model are used to classify unclassified measurement data as indicative of a fall or an ADL, the ADL model classifying at least talking and walking as ADL events, and wherein the fall model is used to re-confirm whether the first set of measurement data categorized as indicative of the suspected fall indicates a fall.

12. The method of claim 11 , wherein the fall model and the ADL model are Gaussian mixture model (GMM) models.

13. The method of claim 12 , wherein the GMM models are trained using an expectation maximization algorithm.

14. The method of claim 11 , wherein the set of measurement data includes prior events classified as fall and ADL events.

15. The method of claim 11 , further comprising receiving additional measurement data including in-use data and updating the fall model and the ADL model using the additional measurement data.

16. The method of claim 11 , further comprising implementing Gaussian mixture model (GMM) classifiers on a subset of a selected feature space of events from the set of measurement data.

17. The method of claim 16 , wherein the selected feature space is selected via a sequential forward floating selection (SFFS) algorithm to maximize classifier performance.

18. The method of claim 11 , further comprising determining a threshold for classifying an event as a fall, and wherein the unclassified measurement data is classified based on a score for the unclassified measurement data and the threshold.

19. The method of claim 11 , wherein the set of measurement data includes accelerometer data, magnetometer data, and audio data.

20. The method of claim 11 , wherein to classify the unclassified measurement data as indicative of a fall or an ADL, the fall model and the ADL model are to determine a reconfirmation or change of classification from an initial classification received from a wearable device that generated the unclassified measurement data.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2024
From: NICE NORTH AMERICA LLC
To: NUMERA SYSTEMS INC.
Reel/Frame 068791/0751 →
CHANGE OF NAME Recorded Jan 9, 2024
From: NORTEK SECURITY & CONTROL LLC
To: NICE NORTH AMERICA LLC
Reel/Frame 066242/0513 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: FISH, RAM DAVID ADVA; MESSENGER, HENRY; BARYUDIN, LEONID; DARDASHTI, SOROUSH SALEHIAN; GOLDSHTEIN, EVGENIA
To: BLUELIBRIS
Reel/Frame 052910/0638 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: NUMERA, INC.
To: NORTEK SECURITY & CONTROL LLC
Reel/Frame 052911/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: BLUELIBRIS INC.
To: NUMERA, INC.
Reel/Frame 052914/0028 →