Granted Patent B2

US 12,256,360 · App. 18/379,622 · Granted Mar 18, 2025

Inventors: Yuqian Hu (Greenbelt, MD); Guozhen Zhu (Greenbelt, MD); Beibei Wang (Clarksville, MD); K. J. Ray Liu (Potomac, MD); Oscar Chi-Lim Au (Rockville, MD)

Assignee: ORIGIN RESEARCH WIRELESS, INC.

H04W64/003G01S11/06

Abstract

Claims (128)

1. A method for wireless sensing, comprising:

transmitting, by a first wireless device, a wireless signal through a wireless multipath channel in a venue;

receiving, by a second wireless device, the wireless signal through the wireless multipath channel, wherein the received wireless signal differs from the transmitted wireless signal due to the wireless multipath channel and a movement of an object in the venue;

obtaining a time series of channel information (TSCI) of the wireless multipath channel based on the received wireless signal;

computing a spatial-temporal information (STI) based on a time-domain auto-correlation function (ACF) of channel information (CI) in a first sliding time window of the TSCI computed based on a first feature of each CI;

computing a gait score based on the STI;

computing a time series of resampled CI (TSRCI) by resampling the TSCI;

computing a proximity score based on a frequency-domain k-component correlation of resampled CI (RCI) in a second sliding time window of the TSRCI computed based on a second feature of each RCI; and

detecting a proximity state of the object to a target in the venue based on the gait score and the proximity score in a third sliding time window.

2. The method of claim 1 , further comprising:

computing, based on a first time trend of the gait score and a second time trend of the proximity score, a third time trend of the proximity state of the object to the target.

3. The method of claim 1 , further comprising:

computing the gait score repeatedly at a first repetition rate, each gait score being computed based on a respective first sliding window of the TSCI;

computing the proximity score repeatedly at a second repetition rate, each proximity score being computed based on a respective second sliding window of the TSCI; and

computing the proximity state of the object to the target repeatedly at a third repetition rate.

4. The method of claim 1 , wherein:

the time-domain ACF comprises a plurality of time-domain correlations.

5. The method of claim 4 ,

wherein the first feature comprises one of: a magnitude, a phase, a magnitude of a component of the CI, a phase of a component of the CI, a magnitude square, or a function of the magnitude.

6. The method of claim 4 , further comprising:

computing at least one characteristic point of either the time-domain ACF or a function of the time-domain ACF; and

computing the STI based on the at least one characteristic point,

wherein the at least one characteristic point comprises at least one of:

a global maximum, a global minimum, a constrained maximum, a constrained minimum, a maximum restricted to a positive argument of the ACF or the function of the ACF, a maximum restricted to a negative argument of the ACF or the function of the ACF, a minimum restricted to a positive argument of the ACF or the function of the ACF, a minimum restricted to a negative argument of the ACF or the function of the ACF, a local maximum, a local minimum, a first local maximum, a first local minimum, a second local maximum, a second local minimum, a third local maximum, a third local minimum, an inflection point, a zero-crossing point, a mean-crossing point, a first inflection point, a first zero-crossing point, a first mean-crossing point, a second inflection point, a second zero-crossing point, a second mean-crossing point, a third inflection point, a third zero-crossing point, or a third mean-crossing point;

wherein the function of the time-domain ACF comprises at least one of:

a linear function, a piecewise linear function, a nonlinear function, a polynomial function, an exponential function, a logarithmic function, a trigonometric function, a transcendental function, a derivative function, a first derivative, a second derivative, a third derivative, an integration function, a single integration, a double integration, a triple integration, an absolute function, a magnitude function, an indicator function, a thresholding function, a quantization function, or

a function obtained by filtering of the time-domain ACF, the filtering comprising at least one of: a lowpass filtering, a bandpass filtering, a highpass filtering, a smoothing filtering, or a weighted averaging.

7. The method of claim 1 , further comprising:

computing multiple characteristic points of either the time-domain ACF or the function of the time-domain ACF; and

computing the gait score based on the STI and an additional function of the multiple characteristic points.

8. The method of claim 7 , further comprising:

computing a local maximum as a first characteristic point of either the time-domain ACF or the function of the time-domain ACF;

computing a local minimum as a second characteristic point of either the time-domain ACF or the function of the time-domain ACF;

computing a difference of the first and second characteristic points by subtracting the local minimum from the local maximum; and

computing the gait score based on the STI and the difference.

9. The method of claim 8 , wherein:

the local maximum is the first local maximum with argument being positive; and

the local minimum is the first local minimum with argument being positive.

10. The method of claim 8 , wherein:

when at least one of the first characteristic point or the second characteristic point cannot be determined, the difference of the first and second characteristic points is computed as zero.

11. The method of claim 6 , further comprising:

computing the spatial-temporal information (STI) based on a third characteristic point of either the time-domain ACF or the function of the time-domain ACF, wherein the STI comprises one of: a location, a distance, a speed, or an acceleration;

computing a STI probability score based on the STI; and

computing the gait score based on the STI probability score.

12. The method of claim 11 , further comprising:

computing the STI probability score based on a STI probability density function (pdf).

13. The method of claim 12 , wherein:

the STI pdf comprises a mixture of pdf's, wherein at least one of the pdf's is a generalized Gaussian pdf obtained in a training phase.

14. The method of claim 11 , wherein:

the gait score is a monotonic non-decreasing function of the STI probability score and the difference of the first and second characteristic points.

15. The method of claim 1 , wherein the second feature comprises one of: a magnitude, a phase, a magnitude of a component of the RCI, a phase of a component of the RCI, a magnitude square, or a function of the magnitude.

16. The method of claim 1 , further comprising:

computing a plurality of frequency-domain k-component correlations, wherein:

each CI comprises a representation with a plurality of frequency-domain components,

each of the plurality of frequency-domain components is associated with a respective frequency index,

each of the plurality of k-component correlations is a correlation between a respective frequency-domain component of a CI and a respective adjacent frequency-domain component of the CI,

the frequency indices of the respective component and the respective adjacent component of the CI differ by k,

k is an integer greater than zero; and

computing the frequency-domain k-component correlation based on an aggregate of the plurality of k-component correlations, wherein the aggregate comprises at least one of: a sum, a weighted sum, a mean, an average, a weighted mean, a trimmed mean, a product, a weighted product, an arithmetic mean, a geometric mean, a harmonic mean, or another aggregate of any of the above.

17. The method of claim 16 , further comprising:

for each respective frequency-domain k-component correlation with respect to a respective CI:

computing the second feature of each frequency-domain component of the respective CI; and

computing the respective frequency-domain k-component correlation based on the second feature of the respective frequency-domain component and the second feature of the respective adjacent frequency-domain component.

18. The method of claim 16 , further comprising:

computing a first plurality of frequency-domain k1-component correlations, wherein k1 is a first integer greater than zero;

computing at least one first aggregate of the first plurality of frequency-domain k1-component correlations;

computing a second plurality of frequency-domain k2-component correlations, wherein k2 is a second integer greater than zero;

computing at least one second aggregate of the second plurality of frequency-domain k2-component correlations; and

computing the frequency-domain k-component correlation based on a third aggregate of the at least one first aggregate and the at least one second aggregate.

19. The method of claim 1 , further comprising:

determining at least four proximity states of the object to the target, wherein the at least four proximity states comprises:

a FAR-AWAY state, indicating that the object is far away from the target,

an APPROACHING state, indicating that the object is moving towards the target,

a NEAR state, indicating that the object is near the target, and

a LEAVING state, indicating that object is moving away from the target;

determining an initial proximity state to be one of the at least four proximity states; and

determining a next proximity state at a next time based on: a current proximity state at a current time, the gait score, and the proximity score.

20. The method of claim 19 , further comprising:

determining the initial proximity state to be the FAR-AWAY state.

21. The method of claim 19 , further comprising:

when the current proximity state at the current time is the FAR-AWAY state:

transitioning from the FAR-AWAY state to the APPROACHING state in response to a determination that a condition is met, wherein the condition comprises: (a) the gait score is greater than a first threshold and (b) a slope of the proximity score is greater than a second threshold; and

remaining in the FAR-AWAY state in response to a determination that the condition is not met.

22. The method of claim 19 , further comprising:

when the current proximity state at the current time is the APPROACHING state:

transitioning from the APPROACHING state to the NEAR state in response to a determination that a first condition is met, wherein the first condition comprises the proximity score is greater than a third threshold;

transitioning from the APPROACHING state to the LEAVING state in response to a determination that a second condition is met, wherein the second condition comprises: (a) the gait score is greater than a fourth threshold and (b) a slope of the proximity score is less than a fifth threshold, wherein the fifth threshold is a negative number;

remaining in the APPROACHING state in response to a determination that a third condition is met, wherein the third condition comprises: (c) the gait score is greater than a sixth threshold and (d) the slope of the proximity score is greater than a seventh threshold; and

transitioning from the APPROACHING state to the FAR-AWAY state in response to a determination that none of the first, second and third conditions is met.

23. The method of claim 19 , further comprising:

when the current proximity state at the current time is the NEAR state:

transitioning from the NEAR state to the LEAVING state in response to a determination that a condition is met, wherein the condition comprises: (a) the gait score is greater than an eighth threshold and (b) a slope of the proximity score is less than a ninth threshold, wherein the ninth threshold is a negative number; and

remaining in the NEAR state in response to a determination that the condition is not met.

24. The method of claim 19 , further comprising:

when the current proximity state at the current time is the LEAVING state:

transitioning from the LEAVING state to the FAR-AWAY state in response to a determination that a first condition is met, wherein the first condition comprises: the proximity score is less than a tenth threshold;

transitioning from the LEAVING state to the APPROACHING state in response to a determination that a second condition is met, wherein the second condition comprises: (a) the gait score is greater than an eleventh threshold and (b) a slope of the proximity score is greater than a twelfth threshold; and

remaining in the LEAVING state in response to a determination that none of the first and second conditions is met.

25. The method of claim 1 , wherein:

the target is near one of the first wireless device or the second wireless device.

26. The method of claim 1 , wherein:

the target is either the first wireless device or the second wireless device, such that the proximity of the object is relative to either the first wireless device or the second wireless device.

27. A system for wireless sensing, comprising:

a first wireless device configured to transmit a wireless signal through a wireless multipath channel in a venue;

a second wireless device configured to receive the wireless signal through the wireless multipath channel, wherein the received wireless signal differs from the transmitted wireless signal due to the wireless multipath channel and a movement of an object in the venue; and

a processor configured for:

obtaining a time series of channel information (TSCI) of the wireless multipath channel based on the received wireless signal,

computing a spatial-temporal information (STI) based on a time-domain auto-correlation function (ACF) of channel information (CI) in a first sliding time window of the TSCI computed based on a first feature of each CI,

computing a gait score based on the STI,

computing a time series of resampled CI (TSRCI) by resampling the TSCI,

computing a proximity score based on a frequency-domain k-component correlation of resampled CI (RCI) in a second sliding time window of the TSRCI computed based on a second feature of each RCI, and

detecting a proximity state of the object to a target in the venue based on the gait score and the proximity score in a third sliding time window.

28. The system of claim 27 , wherein the processor is further configured for:

computing the gait score repeatedly at a first repetition rate, each gait score being computed based on a respective first sliding window of the TSCI;

computing the proximity score repeatedly at a second repetition rate, each proximity score being computed based on a respective second sliding window of the TSCI; and

computing the proximity state of the object to the target repeatedly at a third repetition rate.

29. The system of claim 27 ,

wherein the first feature comprises one of: a magnitude, a phase, a magnitude of a component of the CI, a phase of a component of the CI, a magnitude square, or a function of the magnitude.

30. An apparatus for wireless sensing, comprising:

a receiver configured to receive a wireless signal transmitted by a transmitter through a wireless multipath channel in a venue, wherein the received wireless signal differs from the transmitted wireless signal due to the wireless multipath channel and a movement of an object in the venue;

a memory having a set of instructions stored therein; and

a processor communicatively coupled to the memory and configured for:

obtaining a time series of channel information (TSCI) of the wireless multipath channel based on the received wireless signal,

computing a spatial-temporal information (STI) based on a time-domain auto-correlation function (ACF) of channel information (CI) in a first sliding time window of the TSCI computed based on a first feature of each CI,

computing a gait score based on the STI,

computing a time series of resampled CI (TSRCI) by resampling the TSCI,

computing a proximity score based on a frequency-domain k-component correlation of resampled CI (RCI) in a second sliding time window of the TSRCI computed based on a second feature of each RCI, and

detecting a proximity state of the object to a target in the venue based on the gait score and the proximity score in a third sliding time window.

Assignments (1)

Continuity (25)

References Cited (3)

Cited By (1)

US 12,699,174