Granted Patent B2

US 12,216,190 · App. 17/838,244 · Granted Feb 4, 2025

Inventors: Yuqian Hu (College Park, MD); Beibei Wang (Clarksville, MD); Sai Deepika Regani (Hyattsville, MD); Peng Zan (Gaithersburg, MD); Chenshu Wu (Hong Kong, CN); Dan Bugos (Baltimore, MD); Xiaolu Zeng (Beijing, CN); Hung-Quoc Duc Lai (Parkville, MD); K. J. Ray Liu (Potomac, MD); Oscar Chi-Lim Au (San Jose, CA)

Assignee: ORIGIN RESEARCH WIRELESS, INC.

G01S13/003G01S13/56

Abstract

Claims (100)

1. A method of a wireless sensing system, comprising:

determining a plurality of heterogeneous wireless devices of the wireless sensing system in a venue;

determining a plurality of device-links each of which comprises two of the heterogeneous wireless devices, wherein one of the two heterogeneous wireless devices functions as a transmitter and the other one of the two heterogeneous wireless devices functions as a receiver;

for each respective device-link of the plurality of device-links,

transmitting a respective wireless signal from a respective transmitter of the respective device-link through a wireless multipath channel of the venue, wherein the wireless multipath channel is impacted by a motion of an object in the venue,

receiving the respective wireless signal by a respective receiver of the respective device-link through the wireless multipath channel, wherein the respective received wireless signal differs from the respective transmitted wireless signal due to the wireless multipath channel of the venue and the motion of the object,

obtaining a respective time series of channel information (TSCI) of the wireless multipath channel based on the respective received wireless signal of the respective device-link, wherein each channel information comprises one of: channel state information (CSI), channel impulse response (CIR), or channel frequency response (CFR), and

computing a respective linkwise motion statistics (link-MS) for the respective device-link based on the respective TSCI, wherein the respective link-MS is computed based on: (i) a similarity score between a pair of temporally adjacent CI of the respective TSCI, (ii) an autocorrelation function (ACF) of the respective TSCI, and (iii) a characteristics of the ACF;

performing a sensing task associated with the motion of the object based on at least one of: all the TSCI or all the link-MS;

determining a number of candidate locations, each candidate location being associated with a respective heterogeneous wireless device;

computing a respective location-wise motion statistics (loc-MS) for each respective candidate location based on respective multiple link-MS, wherein for each respective candidate location associated with the respective heterogeneous wireless device:

the respective loc-MS comprises a respective weighted sum or a respective weighted product of a respective plurality of link-based quantities, each respective link-based quantity associated with a respective device-link and a respective weight,

the respective weight is positive when the respective device-link is in a respective first group comprising device-links at a device-link-distance less than or equal to k1 from the respective device associated with the respective candidate location, and is negative when the respective device-link is in a respective second group comprising device-links at a device-link-distance greater than or equal to k2 from the respective device associated with the respective candidate location, k1 being an integer, k2 being an integer greater than k1,

each of the respective plurality of link-based quantities is a univariate monotonic function of the respective link-MS associated with the respective device-link;

analyzing the number of loc-MS and the plurality of link-MS; and

computing a location in the venue associated with the sensing task based on the analyzing of all the link-MS and the loc-MS.

2. The method of claim 1 , wherein:

the respective link-MS comprises at least one of: time reversal resonating strength (TRRS), correlation, cross-correlation, autocorrelation, inner product, or dot product; and

the respective plurality of link-based quantities are normalized such that their sum is equal to one.

3. The method of claim 2 , further comprising:

preprocessing the respective TSCI; and

smoothing the respective link-MS over time based on a smoothing filter.

4. The method of claim 3 , further comprising:

applying a correction to a particular link-MS associated with a particular device-link of the plurality of device-links based on a characteristics of the transmitter, the receiver, and the wireless signal associated with the particular device-link, wherein the correction is pre-determined or adaptively determined.

5. The method of claim 4 , further comprising:

obtaining multiple TSCI of the wireless multipath channel based on a first received wireless signal of a first device-link of the plurality of device-links, wherein at least one of the transmitter or the receiver associated with the first device-link comprises multiple antennas;

computing multiple first candidate link-MS based on the multiple TSCI, wherein each first candidate link-MS is computed based on a respective one of the multiple TSCI; and

aggregating the multiple first candidate link-MS to compute a first link-MS associated with the first device-link, using a maximum ratio combining (MRC) scheme.

6. The method of claim 5 , wherein:

each channel information (CI) of a particular TSCI associated with a second device-link the plurality of device-links comprises multiple components;

the method further comprises:

computing multiple second candidate link-MS based on multiple components of each CI of the particular TSCI, and

aggregating the multiple second candidate link-MS to compute a second link-MS for the second device-link based on the particular TSCI, using a maximum ratio combining (MRC) scheme.

7. The method of claim 6 , further comprising:

partitioning the venue into a plurality of regions, wherein each region is a candidate location associated with the sensing task;

associating each region with one of the heterogeneous wireless devices; and

computing the location associated with the sensing task as one of the plurality of candidate locations.

8. The method of claim 7 , further comprising:

computing a measurement value based on a measure for each of the plurality of loc-MS; and

detecting a target associated with the sensing task when at least one of the plurality of loc-MS has a measurement value greater than a first threshold.

9. The method of claim 8 , further comprising:

computing the location of the target as a candidate location whose loc-MS has a maximum measurement value among the plurality of loc-MS.

10. The method of claim 9 , further comprising:

removing the location of the target from the plurality of candidate locations to obtain remaining candidate locations;

detecting a second target associated with the sensing task when at least one loc-MS associated with the remaining candidate locations has a measurement value greater than a second threshold; and

computing a second location of the second target as one of the remaining candidate locations whose loc-MS has a maximum measurement value among all loc-MS associated with the remaining candidate locations.

11. The method of claim 10 , wherein each loc-MS comprises at least one of:

a sum, a weighted sum, a product, a weighted product, an average, a median, a weighted sum of a function, or a weighted product of the function.

12. The method of claim 11 , further comprising:

for a particular candidate location associated with a particular heterogeneous wireless device:

partitioning all of the plurality of device-links into a first group and a second group, and

computing the loc-MS for the particular candidate location based on a weighted sum of all the link-MS or a weighted product of all the link-MS, such that a first weight for each link-MS associated with the first group is greater than a second weight for any link-MS associated with the second group.

13. The method of claim 12 , further comprising:

for the particular candidate location, computing the loc-MS for the particular candidate location with a positive weight for each link-MS associated with the first group and a negative weight for each link-MS associated with the second group.

14. The method of claim 13 , wherein:

the first group comprises any device-link of which one of the transmitter or the receiver is the particular heterogeneous wireless device.

15. The method of claim 14 , wherein:

the first group comprises any distance-k device-link for the particular candidate location, where k is an integer less than or equal to k1;

the particular device associated with the particular candidate location is considered a distance-0 device for the particular candidate location;

a distance-1 device-link is a device-link of which one of the transmitter or the receiver is the distance-0 device,

the other one of the transmitter or the receiver of the distance-1 device link is considered a distance-1 device for the particular candidate location;

the device-link-distance of any distance-1 device-link is 1 from the particular device;

a distance-k device-link is an additional device link of which one of the transmitter or the receiver is a distance-(k−1) device for the particular candidate location, and the other one of the transmitter or the receiver is not a distance-(k−2) device;

the other one of the transmitter or the receiver of the distance-k device link is considered a distance-k device for the particular candidate location; and

the device-link-distance of any distance-k device-link from the particular device is computed as the device-link-distance of the distance-(k−1) device plus 1.

16. The method of claim 15 , wherein:

the first group comprises distance-1 device links and distance-2 device links; and

a respective weight for a distance-1 device-link is greater than or equal to a respective weight for a distance-2 device-link.

17. The method of claim 16 , wherein:

the first group further recursively comprises any additional device-link of which one of the transmitter or the receiver is a distance-k3 device for the particular candidate location, and the other one of the transmitter or the receiver is considered a distance-(k3+1) device for the particular candidate location.

18. The method of claim 17 , wherein:

a weight for a distance-k3 device-link is greater than or equal to a weight for a distance-(k3+1) device-link.

19. The method of claim 18 , wherein:

two device-links are associated with two particular heterogeneous wireless devices such that wireless signals are sent in both directions between the two particular heterogeneous wireless devices, and TSCI are obtained at both of the two particular heterogeneous wireless devices; and

the two link-MS associated with the two device-links have identical weights in the computation of the loc-MS for the particular candidate location.

20. The method of claim 19 , further comprising:

replacing the two link-MS by a single link-MS which is equal to an aggregation of the two link-MS in the computation of the loc-MS for the particular candidate location.

21. The method of claim 20 , further comprising:

comparing a first collection of all the device-links in the wireless sensing system with a second collection of all possible device-links in a fully-connected configuration of the plurality of heterogeneous wireless devices;

determining at least one missing device-link which is a device-link present in the second collection but absent in the first collection; and

applying a correction to the weights of the device-links in the first collection in the computation of the loc-MS, based on a hypothetical weight for each missing device-link.

22. A system for wireless sensing, comprising:

a plurality of heterogeneous wireless devices forming a plurality of device-links in a venue, wherein each of the plurality of device-links comprises two of the heterogeneous wireless devices, wherein one of the two heterogeneous wireless devices functions as a transmitter and the other one of the two heterogeneous wireless devices functions as a receiver; and

at least one processor, wherein for each respective device-link of the plurality of device-links:

a respective transmitter of the respective device-link is configured to transmit a respective wireless signal through a wireless multipath channel of the venue,

the wireless multipath channel is impacted by a motion of an object in the venue,

a respective receiver of the respective device-link is configured to receive the respective wireless signal through the wireless multipath channel,

the respective received wireless signal differs from the respective transmitted wireless signal due to the wireless multipath channel of the venue and the motion of the object,

the at least one processor is configured to obtain a respective time series of channel information (TSCI) of the wireless multipath channel based on the respective received wireless signal of the respective device-link, and to compute a respective linkwise motion statistics (link-MS) for the respective device-link based on the respective TSCI,

each channel information comprises one of: channel state information (CSI), channel impulse response (CIR), or channel frequency response (CFR),

the respective link-MS is computed based on: (i) a similarity score between a pair of temporally adjacent CI of the respective TSCI, (ii) an autocorrelation function (ACF) of the respective TSCI, and (iii) a characteristics of the ACF,

wherein the at least one processor is further configured for:

performing a sensing task associated with the motion of the object based on at least one of: all the TSCI or all the link-MS,

determining a number of candidate locations, each candidate location being associated with a respective heterogeneous wireless device,

computing a respective location-wise motion statistics (loc-MS) for each respective candidate location based on respective multiple link-MS, wherein for each respective candidate location associated with the respective heterogeneous wireless device:

the respective loc-MS comprises a respective weighted sum or a respective weighted product of a respective plurality of link-based quantities, each respective link-based quantity associated with a respective device-link and a respective weight,

the respective weight is positive when the respective device-link is in a respective first group comprising device-links at a device-link-distance less than or equal to k1 from the respective device associated with the respective candidate location, and is negative when the respective device-link is in a respective second group comprising device-links at a device-link-distance greater than or equal to k2 from the respective device associated with the respective candidate location, k1 being an integer, k2 being an integer greater than k1,

each of the respective plurality of link-based quantities is a univariate monotonic function of the respective link-MS associated with the respective device-link,

analyzing the number of loc-MS and the plurality of link-MS, and

computing a location in the venue associated with the sensing task based on the analyzing of all the link-MS and the loc-MS.

Assignments (1)

Continuity (45)

References Cited (12)