IP Library Granted Patent US 10,318,890
Granted Patent B1
US 10,318,890 · App. 15/987,805 · Granted Jun 11, 2019

Training data for a motion detection system using data from a sensor device

Inventors: Oleksiy Kravets (Petersburg, CA); Mikhail Ravkine (Waterloo, CA)
Assignee: Cognitive Systems Corp.
G06N20/00H04W4/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,318,890
App. No.
15/987,805
Granted
Jun 11, 2019
Kind
B1
Abstract

In a general aspect of the examples described, sensor data from a sensor device are used to improve training data for a motion detection system. In some aspects, “ground truth” labels, sensor data, and channel information are received for a motion detection training period. The labels and sensor data are analyzed to detect variances between the labels and sensor data. The labels are corrected or augmented based on the sensor data. The channel information is tagged with the labels and provided as training information to train the motion detection system.

Claims (83)

1. A motion detection training method comprising:

receiving, by one or more processors of a data processing apparatus, channel information based on training signals, the training signals comprising wireless signals transmitted by a wireless communication device through a space between the wireless communication device and a second wireless communication device during a motion detection training time period supervised by a user;

receiving, by the one or more processors of the data processing apparatus, a label comprising a first set of motion information input to a user interface by the user of a mobile device in the space during the motion detection training time period;

receiving, by the one or more processors of the data processing apparatus, sensor data comprising a second set of motion information collected by a wearable sensor device of the user in the space during the motion detection training time period;

analyzing, by the one or more processors of the data processing apparatus, the label and the sensor data to detect a variance between the label and the sensor data for the motion detection training time period, wherein analyzing the label and the sensor data comprises:

detecting the variance when the analysis indicates that the sensor data does not correspond to the label; and

either correcting the label based on the received sensor data, or augmenting the label with the received sensor data, depending on the variance detected;

generating, by the one or more processors of the data processing apparatus, a tag for the channel information based on the analysis of the label and the sensor data; and

providing, by the one or more processors of the data processing apparatus, the channel information and the tag as training input to train a motion detection system.

2. The motion detection training method of claim 1 , wherein generating the tag based on the analysis of the label and the sensor data improves accuracy of the tag compared to generating the tag only from the label.

3. The motion detection training method of claim 1 , wherein the sensor device comprises at least one of:

an accelerometer;

a gyroscope;

a compass;

a pedometer; and

a barometer.

4. The motion detection training method of claim 1 , wherein the mobile device comprises the sensor device.

5. The motion detection training method of claim 1 , wherein the variance between the label and the sensor data comprises at least one of:

a difference between a timestamp in the label and a timestamp in the sensor data;

a difference between a type of measurement indicated in the label and a type of measurement in the sensor data; or

additional information provided in the sensor data but not the label.

6. The motion detection training method of claim 1 , wherein providing the channel information and the tag as training input to train the motion detection system comprises providing a tagged channel information to a machine learning system.

7. The motion detection training method of claim 6 , wherein the tag indicates at least one of:

whether motion occurred in the space during the motion detection training time period;

a direction of motion that occurred in the space during the motion detection training time period;

a location of motion that occurred in the space during the motion detecting training time period; or

a time at which motion occurred in the space during the motion detection training time period.

8. A motion detection training system comprising:

one or more processors;

memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

receive channel information based on training signals, the training signals comprising wireless signals transmitted by a wireless communication device to a second wireless communication device through a space during a motion detection training time period supervised by a user;

receive a label comprising a first set of motion information input to a user interface by the user of a mobile device in the space during the motion detection training time period;

receive sensor data comprising a second set of motion information collected by a wearable sensor device of the user in the space during the motion detection training time period; wherein analyzing the label and the sensor data comprises:

detecting the variance when the analysis indicates that the sensor data does not correspond to the label; and

either correcting the label based on the received sensor data, or augmenting the label with the received sensor data, depending on the variance detected;

analyze the label and the sensor data to detect a variance between the label and the sensor data for the motion detection training time period;

generate a tag for the channel information based on the analysis of the label and the sensor data; and

provide the channel information and the tag as training input to train a motion detection system.

9. The motion detection training system of claim 8 , wherein generating the tag based on the analysis of the label and the sensor data improves accuracy of the tag compared to generating the tag only from the label.

10. The motion detection training system of claim 8 , wherein the sensor device comprises at least one of:

an accelerometer;

a gyroscope;

a compass;

a pedometer; and

a barometer.

11. The motion detection training system of claim 8 , wherein the mobile device comprises the sensor device.

12. The motion detection training system of claim 8 , wherein the variance between the label and the sensor data comprises at least one of:

a difference between a timestamp in the label and a timestamp in the sensor data;

a difference between a type of measurement indicated in the label and a type of measurement in the sensor data; or

additional information provided in the sensor data but not the label.

13. The motion detection training system of claim 8 , wherein providing the channel information and the tag as training input to train the motion detection system comprises providing a tagged channel information to a machine learning system.

14. The motion detection training system of claim 13 , wherein the tag indicates at least one of:

whether motion occurred in the space during the motion detection training time period;

a direction of motion that occurred in the space during the motion detection training time period;

a location of motion that occurred in the space during the motion detection training time period; or

a time at which motion occurred in the space during the motion detection training time period.

15. A non-transitory computer readable medium comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

receiving channel information based on training signals, the training signals comprising wireless signals transmitted by a wireless communication device to a second wireless communication device through a space during a motion detection training time period supervised by a user;

receiving a label comprising a first set of motion information input to a user interface by the user of a mobile device in the space during the motion detection training time period;

receiving sensor data comprising a second set of motion information collected by a wearable sensor device of the user in the space during the motion detection training time period;

analyzing the label and the sensor data to detect a variance between the label and the sensor data for the motion detection training time period, wherein analyzing the label and the sensor data comprises:

detecting the variance when the analysis indicates that the sensor data does not correspond to the label; and

either correcting the label based on the received sensor data, or augmenting the label with the received sensor data, depending on the variance detected;

generating a tag for the channel information based on the analysis of the label and the sensor data; and

providing the channel information and the tag as training input to train a motion detection system.

16. The computer readable medium of claim 15 , wherein generating the tag based on the analysis of the label and the sensor data improves accuracy of the tag compared to generating the tag only from the label.

17. The computer readable medium of claim 15 , wherein the sensor device comprises at least one of:

an accelerometer;

a gyroscope;

a compass;

a pedometer; and

a barometer.

18. The computer readable medium of claim 15 , wherein the mobile device comprises the sensor device.

19. The computer readable medium of claim 15 , wherein the variance between the label and the sensor data comprises at least one of:

a difference between a timestamp in the label and a timestamp in the sensor data;

a difference between a type of measurement indicated in the label and a type of measurement in the sensor data; or

additional information provided in the sensor data but not the label.

20. The computer readable medium of claim 15 , wherein providing the channel information and the tag as training input to train the motion detection system comprises providing a tagged channel information to a machine learning system.

21. The computer readable medium of claim 20 , wherein the tag indicates at least one of:

whether motion occurred in the space during the motion detection training time period;

a direction of motion that occurred in the space during the motion detection training time period;

a location of motion that occurred in the space during the motion detection training time period; or

a time at which motion occurred in the space during the motion detection training time period.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2018
From: KRAVETS, OLEKSIY; RAVKINE, MIKHAIL
To: COGNITIVE SYSTEMS CORP.
Reel/Frame 045953/0486 →
Cited By (5)
US 12,245,187 US 12,418,784 US 12,432,096 US 12,449,529 US 12,493,666