Enhanced human activity recognition
The present disclosure is directed to a device with enhanced human activity recognition. The device detects a human activity using one more motion sensors, and enhances the detected human activity depending on whether the device is in an indoor environment or an outdoor environment. The device utilizes one or more electrostatic charge sensors to determine whether the device is in an indoor environment or an outdoor environment.
1. A device, comprising:
a motion sensor configured to generate a motion measurement of the device;
an electrostatic charge sensor configured to generate an electrostatic charge measurement of the device; and
a processing unit configured to:
perform context detection to detect the device is indoors or outdoors based on the electrostatic charge measurement;
perform, subsequent to the device being determined to be indoors based on the electrostatic charge measurement, first human activity recognition to detect a first activity state of a user of the device selected from a plurality of indoor states based on the motion measurement, the first human activity recognition being performed without outdoor state detection;
perform, subsequent to the device being determined to be outdoors based on the electrostatic charge measurement, second human activity recognition to detect a second activity state of the user of the device selected from a plurality of outdoor states based on the motion measurement, the second human activity recognition being performed without indoor state detection; and
output the first activity state or the second activity state.
2. The device of claim 1 wherein the processing unit detects the device is indoors in a case where the electrostatic charge measurement includes a first peak at a frequency corresponding to an alternating current (AC) power line.
3. The device of claim 2 wherein the processing unit detects the device is outdoors in a case where the electrostatic charge measurement does not include a peak at the frequency corresponding to the AC power line, or the electrostatic charge measurement includes a second peak, which is smaller than the first peak, at the frequency corresponding to the AC power line.
4. The device of claim 1 wherein the processing unit is configured to determine at least one feature of the electrostatic charge measurement, and detect whether the device is indoors or outdoors based on the at least one feature.
5. The device of claim 4 wherein the at least one feature includes at least one of an energy calculation, a variance calculation, a zero crossing calculation, a peak-to-peak calculation, a peak count calculation, an absolute mean calculation, a maximum calculation, or a minimum calculation.
6. The device of claim 1 wherein the electrostatic charge sensor includes a single electrode.
7. The device of claim 1 wherein the electrostatic charge sensor includes a plurality of electrodes.
8. The device of claim 1 wherein the processing unit is configured to:
determine a first peak of the electrostatic charge measurement;
detect the device is indoors in a case where the first peak corresponds to an alternating current (AC) power line;
determine a second peak of the electrostatic charge measurement; and
detect the device is outdoors in a case where the second peak corresponds to the AC power line and is smaller than the first peak.
9. The device of claim 1 wherein
the plurality of indoor states includes a stationary state that indicates the user is remaining still, an indoor walking state that indicates the user is walking indoors, and a stationary bicycle state that indicates the user is cycling on a stationary bicycle, and
the plurality of outdoor states includes an outdoor walking state that indicates the user is walking outside, an outdoor cycling state that indicates the user is cycling outdoors, and a driving state that indicates the user is driving a vehicle.
10. The device of claim 1 wherein the processing unit is configured to:
count a first total number of times the first activity state has been determined;
output the first activity state in response to the first total number being equal to or greater than a first threshold count value;
count a second total number of times the second activity state has been determined;
output the second activity state in response to the second total number being equal to or greater than a second threshold count value.
11. The device of claim 1 wherein the processing unit is configured to:
filter the electrostatic charge measurement with a high pass filter, the device being determined to be indoors or outdoors based on the filtered electrostatic charge measurement.
12. A device, comprising:
a motion sensor configured to generate a motion measurement of the device;
an electrostatic charge sensor configured to generate an electrostatic charge measurement of the device; and
a processing unit configured to:
perform human activity recognition to detect a driving state of a user of the device based on the motion measurement, the driving state indicating the user is driving a vehicle;
perform context detection to detect the device is indoors or outdoors based on the electrostatic charge measurement;
detect a valid detection of the driving state determined based on the motion measurement in response to the device being determined to be outdoors based on the electrostatic charge measurement;
detect a false detection of the driving state determined based on the motion measurement in response to the device being determined to be indoors based on the electrostatic charge measurement;
output the driving state in response to the valid detection of the driving state determined based on the motion measurement being detected.
13. The device of claim 12 wherein the processing unit detects the device is indoors in a case where the electrostatic charge measurement includes a first peak at a frequency corresponding to an alternating current (AC) power line, and
detects the device is outdoors in a case where the electrostatic charge measurement does not include a peak at the frequency corresponding to the AC power line, or the electrostatic charge measurement includes a second peak, which is smaller than the first peak, at the frequency corresponding to the AC power line.
14. The device of claim 12 wherein the processing unit is configured to determine at least one feature of the electrostatic charge measurement, and detect whether the device is indoors or outdoors based on the at least one feature.
15. The device of claim 14 wherein the at least one feature includes at least one of an energy calculation, a variance calculation, a zero crossing calculation, a peak-to-peak calculation, a peak count calculation, an absolute mean calculation, a maximum calculation, or a minimum calculation.
16. The device of claim 12 wherein the processing unit is configured to, in response to the false detection of the driving state determined based on the motion measurement being detected, switch the driving state to another state different from the driving state, and output the another state.
17. A device, comprising:
a motion sensor configured to generate a motion measurement of the device;
an electrostatic charge sensor configured to generate an electrostatic charge measurement of the device; and
a processing unit configured to:
determine a walking state of a user of the device based on the motion measurement, the walking state indicating the user is walking;
determine a cycling state of the user of the device based on the motion measurement, the cycling state indicating the user is cycling;
determine the device is indoors or outdoors based on the electrostatic charge measurement;
in case the walking state is determined,
switch the walking state determined based on the motion measurement to an indoor walking state that indicates the user is walking indoors in response to the device being determined to be indoors based on the electrostatic charge measurement, and output the indoor walking state, and
switch the walking state to an outdoor walking state determined based on the motion measurement that indicates the user is walking outdoors in response to the device being determined to be outdoors, and output the outdoor walking state based on the electrostatic charge measurement; and
in case the cycling state is determined,
switch the cycling state determined based on the motion measurement to a stationary bicycle state that indicates the user is cycling on a stationary bicycle in response to the device being determined to be indoors based on the electrostatic charge measurement, and output the stationary bicycle state, and
switch the cycling state determined based on the motion measurement to an outdoor cycling state that indicates the user is cycling outdoors in response to the device being determined to be outdoors based on the electrostatic charge measurement, and output the outdoor cycling state.
18. The device of claim 17 wherein the processing unit
determines the device is indoors in a case where the electrostatic charge measurement incudes a first peak at a frequency corresponding to an alternating current (AC) power line, and
determines the device is outdoors in a case where the electrostatic charge measurement does not include a peak at the frequency corresponding to the AC power line, or the electrostatic charge measurement includes a second peak, which is smaller than the first peak, at the frequency corresponding to the AC power line.