IP Library Patent Application 15690087
Patent Application
App. No. 15/690,087

EMERGENCY RESPONSE USING VOICE AND SENSOR DATA CAPTURE

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/690,087
Abstract

Methods, systems, computer-readable media, and apparatuses for emergency response using voice and sensor data capture are presented. One example method includes transmitting, by a user device, an emergency call request to an emergency services provider; prior to the emergency call request being answered: recording, by the user device, audio signals comprising speech signals; and obtaining one or more keywords from recognized words based on the speech signals; and after detecting an emergency call connection: generating a message to the emergency services provider, the message comprising at least one annotation based on the keywords; and transmitting, by the user device, the message to the emergency services provider

Claims (91)

1 . A method comprising:

transmitting, by a user device, an emergency call request to an emergency services provider;

prior to the emergency call request being answered or while the emergency call is interrupted or is put on hold:

recording, by the user device, audio signals comprising speech signals; and

obtaining one or more keywords from recognized words based on the speech signals; and

after detecting an emergency call connection or that the emergency call is resumed:

generating a message to the emergency services provider, the message comprising at least one of on the keywords; and

transmitting, by the user device, the message to the emergency services provider.

2 . The method of claim 1 , further comprising transmitting the recorded audio signals to the emergency services provider.

3 . The method of claim 1 , further comprising receiving, by the user device, a sensor signal from a sensor and, wherein the message comprises sensor information based on the sensor signal.

4 . The method of claim 1 , further comprising after detecting the emergency call connection:

receiving a second sensor signal from a second sensor;

continuing recording, by the user device, second audio signals comprising second speech signals;

obtaining one or more second keywords from recognized words based on the second speech signals; and

generating a second message to the emergency services provider based on the second keywords and the second sensor signal, the second message comprising a second annotation.

5 . The method of claim 1 , further comprising detecting, by the user device, an emergency condition prior to transmitting the emergency call request, and wherein the message comprises an indication of the emergency condition.

6 . The method of claim 5 , wherein detecting the emergency condition comprises:

(i) detecting an identified body part based on the speech signals

(ii) detecting an object name based on the speech signals;

(iii) detecting a drug name or drug type based on the speech signals; or

(iv) any combination of (i) to (iii).

7 . The method of claim 1 , outputting, by the user device, an audio prompt to indicate for a user to begin speaking.

8 . The method of claim 1 , further comprising:

for each emergency of a set of emergencies, determining a probability associated with the emergency based on the recognized words; and

selecting an emergency having the highest probability.

9 . The method of claim 8 , wherein the set of emergencies comprises (i) a fall, (ii) a heart attack, (iii) a stroke, (iv) a broken bone, or (v) any combination of (i) to (iv).

10 . The method of claim 1 , further comprising detecting slurred speech based on the speech signals.

11 . The method of claim 1 , wherein the user device comprises (i) a smartphone, (ii) a wearable device, (iii) a drug delivery device, (iv) a virtual personal assistant device, or (v) any combination of (i) to (iv).

12 . The method of claim 1 , further comprising obtaining medical information about a user of the user device.

13 . The method of claim 12 , wherein the medical information comprises (i) a chronic medical condition, (ii) a medical procedure, (iii) a drug prescription, (iv) participation in a clinical trial, (v) a drug dosage time, or (vi) any combination of (i) to (v).

14 . The method of claim 1 , further comprising transmitting, by the user device, the message to a health services provider.

15 . The method of claim 14 , wherein the health services provider comprises (i) a doctor, (ii) a caregiver, (iii) a hospital, (iv) an insurer, (v) a clinical research organization, (vi) a drug company, or (vii) any combination of (i) to (vi).

16 . A device comprising:

a microphone;

a communications network interface;

a non-transitory computer-readable medium; and

a processor in communication with the microphone, the communications network interface, wherein the processor is configured to:

transmit, using the communications network interface, an emergency call request to an emergency services provider;

prior to the emergency call request being answered or while the emergency call is interrupted or is put on hold:

record audio signals obtained by the microphone, the audio signals comprising speech signals; and

obtain one or more keywords from recognized words based on the speech signals;

after detection of an emergency call connection or resumption of the emergency call:

generate a message to the emergency services provider, the message comprising at least one of the keywords; and

transmit the message to the emergency services provider.

17 . The device of claim 16 , wherein the processor is further configured to transmit the recorded audio signals to the emergency services provider.

18 . The device of claim 16 , further comprising a sensor, and wherein the processor is further configured to receive a sensor signal from a sensor and, wherein the message comprises sensor information based on the sensor signal.

19 . The device of claim 16 , wherein the processor is further configured to, after detection of the emergency call connection:

receive a second sensor signal from a second sensor;

continue recording second audio signals comprising second speech signals;

obtain one or more second keywords from recognized words based on the second speech signals; and

generate a second message to the emergency services provider based on the second keywords and the second sensor signal, the second message comprising a second annotation.

20 . The device of claim 16 , wherein the processor is further configured to detect an emergency condition prior to transmitting the emergency call request, and wherein the messages comprise an indication of the emergency condition.

21 . The device of claim 20 , wherein the processor is further configured to:

(i) detect an identified body part based on the speech signals

(ii) detect an object name based on the speech signals;

(iii) detect a drug name or drug type based on the speech signals; or

(iv) any combination of (i) to (iii).

22 . The device of claim 16 , wherein the processor is further configured to output an audio prompt to indicate for a user to begin speaking.

23 . The device of claim 16 , wherein the processor is further configured to:

for each emergency of a set of emergencies, determine a probability associated with the emergency based on the recognized words; and

select an emergency having the highest probability.

24 . The device of claim 23 , wherein the set of emergencies comprises (i) a fall, (ii) a heart attack, (iii) a stroke, (iv) a broken bone, or (v) any combination of (i) to (iv).

25 . The device of claim 16 , wherein the processor is further configured to detect slurred speech based on the speech signals.

26 . The device of claim 16 , wherein the device comprises (i) a smartphone, (ii) a wearable device, (iii) a drug delivery device, (iv) a virtual personal assistant device, or (v) any combination of (i) to (iv).

27 . The device of claim 16 , wherein the processor is further configured to obtain medical information about an individual associated with the speech signals.

28 . The device of claim 27 , wherein the medical information comprises (i) a chronic medical condition, (ii) a medical procedure, (iii) a drug prescription, (iv) participation in a clinical trial, (v) a drug dosage time, or (vi) any combination of (i) to (v).

29 . The device of claim 16 , wherein the processor is further configured to transmit the message to a health services provider.

30 . The device of claim 29 , wherein the health services provider comprises (i) a doctor, (ii) a caregiver, (iii) a hospital, (iv) an insurer, (v) a clinical research organization, (vi) a drug company, or (vii) any combination of (i) to (vi).

31 . A non-transitory computer-readable medium comprising processor-executable instructions configured to cause a processor to:

transmit an emergency call request to an emergency services provider;

prior to the emergency call request being answered or while the emergency call is interrupted or is put on hold:

record audio signals, the audio signals comprising speech signals; and

obtain one or more keywords from recognized words based on the speech signals;

after detection of an emergency call connection or resumption of the emergency call:

generate a message to the emergency services provider, the message comprising at least one of the keywords; and

transmit the message to the emergency services provider.

32 . An apparatus comprising:

means for transmitting an emergency call request to an emergency services provider;

means for recording audio signals prior to the emergency call request being answered or while the emergency call is interrupted or is put on hold, the audio signals comprising speech signals; and

means for obtaining one or more keywords from recognized words based on the speech signals;

means for generating a message to the emergency services provider after detection of an emergency call connection or resumption of the emergency call, the message comprising at least one of the keywords; and

means for transmitting the message to the emergency services provider.

33 . A method comprising:

answering an emergency services call from a user device;

receiving a message from the user device, the message comprising at least one annotation associated with an emergency condition;

modifying an emergency response protocol for the emergency condition based on the annotation; and

initiating the modified emergency response protocol.

34 . A method comprising:

receiving a message from a user device, the message comprising at least one annotation associated with an emergency condition, the user device associated with an individual;

identifying a medical record associated with the individual; and

updating the medical record based on the emergency condition.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Mar 4, 2021
From: TC LENDING, LLC
To: CAPSULETECH, INC.; CAPSULE TECHNOLOGIES, INC.
Reel/Frame 056455/0263 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2020
From: CAPSULE TECHNOLOGIES, INC.
To: PHILIPS HEALTHCARE INFORMATICS, INC.
Reel/Frame 053262/0405 →
RELEASE OF THE SECURITY INTEREST RECORDED AT REEL/FRAME 048301/0269 Recorded Apr 17, 2020
From: TC LENDING, LLC, AS COLLATERAL AGENT
To: CAPSULE TECHNOLOGIES, INC.
Reel/Frame 052434/0262 →
CHANGE OF NAME Recorded Feb 15, 2019
From: QUALCOMM LIFE, INC.
To: CAPSULE TECHNOLOGIES, INC.
Reel/Frame 048356/0787 →
SECURITY INTEREST Recorded Feb 11, 2019
From: CAPSULE TECHNOLOGIES, INC.; CAPSULETECH, INC.
To: TC LENDING, LLC
Reel/Frame 048301/0269 →
PATENT ASSIGNMENT EFFECTIVE AS OF 02/11/2019 Recorded Feb 11, 2019
From: QUALCOMM INCORPORATED
To: QUALCOMM LIFE, INC.
Reel/Frame 048301/0902 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2017
From: DANTSKER, EUGENE
To: QUALCOMM INCORPORATED
Reel/Frame 043745/0014 →