IP Library › Granted Patent US 10,104,195
Granted Patent B2
US 10,104,195 · App. 15/074,305 · Granted Oct 16, 2018

Device-free activity identification using fine-grained WiFi signatures

Inventors: Yingying Chen (Morganville, NJ); Jie Yang (Tallahassee, FL); Yan Wang (Jersey City, NJ); Jian Liu (Jersey City, NJ); Marco Gruteser (Princeton, NJ)
Assignee: THE TRUSTEES OF THE STEVENS INSTITUTE OF TECHNOLOGY
H04L67/306H04W4/027H04W4/029H04W4/04H04W84/12H04W88/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,104,195
App. No.
15/074,305
Granted
Oct 16, 2018
Kind
B2
Abstract

A system includes a device that is disposed within an environment and is adapted to communicate over a radio frequency communication link. The system also includes a wireless access point disposed within the environment, including a wireless transceiver in communication with the device over a radio frequency communication link using a plurality of channels, and recording a channel state information data set for the radio frequency communication link. The system also includes a monitoring device including a memory storing a plurality of activity profiles, each of which includes an activity and a channel state information profile corresponding to the activity, and a processor receiving, from the wireless access point, the channel state information data set and determining, based on a comparison of the channel state information data set to the channel state information profile of each of the plurality of activity profiles, the activity of the person in the environment.

Claims (55)

1. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said monitoring device determines the activity by classifying the activity as one of a walking activity and an in-place activity; if the activity is classified as a walking activity, identifying the walking activity; and, if the activity is classified as an in-place activity, identifying the in-place activity; and

wherein said monitoring device classifies the activity as one of a walking activity and an in-place activity by determining a moving variance based on said channel state information data set and a further channel state information data set and comparing said moving variance to a threshold.

2. The system of claim 1 , wherein said monitoring device classifies the activity as a walking activity if said moving variance is greater than said threshold.

3. The system of claim 1 , wherein said wireless access point is a WiFi access point.

4. The system of claim 3 , wherein said WiFi access point is an 802.11n access point.

5. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said monitoring device determines the activity by classifying the activity as one of a walking activity and an in-place activity; if the activity is classified as a walking activity, identifying the walking activity; and, if the activity is classified as an in-place activity, identifying the in-place activity; and

wherein said monitoring device identifies the in-place activity by comparing a histogram of said channel state information data set to a histogram of each of said at least one channel state information profile of each of said plurality of activity profiles.

6. The system of claim 5 , wherein said monitoring device compares said histogram of said channel state information data set to said histogram of each of said at least one channel state information profile of each of said plurality of activity profiles using an earth mover's distance comparison.

7. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said monitoring device determines the activity by classifying the activity as one of a walking activity and an in-place activity; if the activity is classified as a walking activity, identifying the walking activity; and, if the activity is classified as an in-place activity, identifying the in-place activity; and

wherein said monitoring device identifies the walking activity by comparing a time series of said channel state information data set to a time series of each of said at least one channel state information profile of each of said activity profiles.

8. The system of claim 7 , wherein said monitoring device compares said time series of said channel state information data set to a time series of each of said at least one channel state information profile of each of said activity profiles using dynamic time warping.

9. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said plurality of activity profiles are determined based on user feedback; and

wherein said determination of said plurality of activity profiles comprises clustering similar channel state information samples in an initial data set and receiving user input corresponding to said clustered channel state information samples to define one of said plurality of activity profiles.

10. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said plurality of activity profiles are determined based on user feedback; and

wherein, when said monitoring device determines that no activity profile matches said channel state information data set, said monitoring device receives user input to define a new activity profile for said channel state information data set.

11. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said monitoring device filters said channel state information data set before determining the activity; and

wherein said filtering comprises applying a dynamic exponential smoothing filter to said channel state information data set.

12. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time; and

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set,

wherein said monitoring device filters said channel state information data set before determining the activity; and

wherein said filtering comprises removing, from said channel state information data set, data points having a modulation and coding scheme index less than a threshold value.

13. The system of claim 12 , wherein said threshold value is about 263.

14. A system for identifying an activity of a person in an environment, comprising:

a communication device disposed within the environment and adapted to communicate over a radio frequency communication link;

a wireless access point disposed within the environment, said wireless access point including a wireless transceiver in communication with at least said communication device over a corresponding one of at least one radio frequency communication link, each of said at least one radio frequency communication link using a plurality of channels, said wireless access point being configured to record a channel state information data set, said channel state information data set being recorded for said one of said at least one radio frequency communication link at a corresponding time;

a monitoring device including a memory storing a plurality of activity profiles, each of said activity profiles including an activity and at least one channel state information profile corresponding to said activity, and a processor receiving, from said wireless access point, said channel state information data set and determining, based on a comparison of said channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles, the activity of the person in the environment at said time corresponding to said channel state information data set; and

a further communication device disposed within the environment, said wireless transceiver of said wireless access point being in communication with said further communication device over a corresponding further one of said at least one radio frequency communication link, said wireless access point being configured to record a further channel state information data set for said further one of said at least one radio frequency communication link at a corresponding time,

wherein said determining the activity of the person in the environment comprises determining the activity of the person in the environment based on a comparison of said further channel state information data set to each of said at least one channel state information profile of each of said plurality of activity profiles; and

wherein the activity is determined based on a sum of a similarity measurement of said channel state information data set and a similarity measurement of said further channel state information data set.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: CHEN, YINGYING; YANG, JIE; WANG, YAN; LIU, JIAN
To: THE TRUSTEES OF THE STEVENS INSTITUTE OF TECHNOLOGY
Reel/Frame 040393/0261 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2016
From: GRUTESER, MARCO
To: RUTGERS, THE STATE UNIVERSITY OF NEW JERSEY
Reel/Frame 038980/0188 →
Continuity (2)
Provisional Application 62135776 · Mar 20, 2015
Related Publication 20160277529A1 · Sep 22, 2016
Cited By (1)
US 12,627,948