IP Library Granted Patent US 11,675,104
Granted Patent B2
US 11,675,104 · App. 16/835,911 · Granted Jun 13, 2023

In-baggage object detection using commodity Wi-Fi

Inventors: Yingying Chen (Piscataway, NJ); Chen Wang (North Brunswick, NJ); Jian Liu (North Brunswick, NJ); Hongbo Liu (Indianapolis, IN); Yan Wang (Binghamton, NY)
Assignees: Rutgers, The State University of New Jersey.; The Trustees of Indiana University; The Research Foundation for The State University of New York
G01V8/005G01V8/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,675,104
App. No.
16/835,911
Granted
Jun 13, 2023
Kind
B2
Abstract

A system and method for detecting a suspicious object, including a wireless signal transmitter with first and second transmitter antennas, a first wireless signal receiver on an opposite side of the object from the transmitter having first and second receiver antennas, and a second wireless signal receiver on a same side of the object as the transmitter having a third receiver antenna. The transmitter may emit wireless signals from each of the transmitter antennas. The signals emitted by the first transmitter antenna may be received at the first and second receiver antennas. The signals emitted by both transmitter antennas may be received at the third receiver antenna. The object's material type may be determined based on channel state information of the wireless signals received at first receiver. A size of the object may be determined based on channel state information of the wireless signals received at the second receiver.

Claims (93)

1. A method of detecting a suspicious object using at least:

at least one first communication element including a first antenna and a second antenna; and

at least two second communication elements wherein the at least two second communication elements include:

a first second communication element positioned on a side of the object that is opposite the first communication element and including a third antenna and a fourth antenna; and

a second second communication element positioned on a same side of the object as the first communication element and including a fifth antenna, and

wherein either (i) the first communication element is a wireless signal transmitter and each second communication element is a respective wireless signal receiver or (ii) the first communication element is a wireless signal receiver and each second communication element is a respective wireless signal transmitter,

the method comprising:

communicating a first wireless communication between the first antenna and the third antenna;

communicating a second wireless communication between the first antenna and the fourth antenna;

communicating a third wireless communication between the first antenna and the fifth antenna;

communicating a fourth wireless communication between the second antenna and the fifth antenna;

determining a type of material of the object based on channel state information of the first and second wireless communications;

determining a size of the object based on channel state information of the third and fourth wireless communications; and

determining whether the object is a suspicious object based on each of the type of material of the object and the size of the object.

2. The method of claim 1 , wherein determining the type of material of the object further comprises determining whether the object is (i) one of a metal or a liquid, or is (ii) a type of material other than a metal or a liquid.

3. The method of claim 2 , wherein determining the type of material of the object further comprises determining whether the object is a metal or is a liquid.

4. The method of claim 1 , wherein determining the type of material of the object further comprises:

determining a first complex value of the channel state information of the first wireless communication;

determining a second complex value of the channel state information of the second wireless communication; and

calculating a complex difference value that is a difference between the first complex value and the second complex value,

wherein determining the type of material of the object is based on the first complex value, the second complex value, and the complex difference value.

5. The method of claim 4 , wherein determining the type of material of the object further comprises:

comparing each of the first complex value, the second complex value and the complex difference value to a plurality of predetermined sets of first complex, second complex and complex difference values, each predetermined set of values corresponding to a type of material or a group of types of materials; and

selecting the type of material or the group of types of materials having the predetermined set of values closest to the first complex value, the second complex value and the complex difference value.

6. The method of claim 4 , wherein determining the first and second complex values further comprises:

performing phase error correction for the channel state information of the first wireless communication;

performing phase error correction for the channel state information of the second wireless communication; and

reconstructing a complex form of the first and second wireless communications based on the respective phase error corrections.

7. The method of claim 1 , further comprising:

at a calibration stage:

communicating a first calibration wireless signal between the first antenna and the fifth antenna;

communicating a second calibration wireless signal between the second antenna and the fifth antenna; and

determining each of a first estimated channel state of the first or fifth antenna transmitting the first calibration wireless signal and a second estimated channel state of the second or fifth antenna transmitting the second calibration wireless signal based on the first and second calibration wireless signals,

wherein determining the size of the object is further based on the first estimated channel state and the second estimated channel state.

8. The method of claim 7 , wherein determining the size of the object further comprises:

determining a first amplitude of the third wireless communication;

determining a second amplitude of the fourth wireless communication;

determining a weighted second amplitude that is the second amplitude multiplied by a ratio of the first estimated channel state to the second estimated channel state; and

calculating a reflection channel response that is a difference between the first amplitude and the weighted second amplitude,

wherein the size of the object is further based on the reflection channel response.

9. The method of claim 8 , wherein a greater reflection channel response is indicative of the size of the object being larger.

10. The method of claim 1 , wherein the first, second, third and fourth wireless communications are communicated while the object is moving.

11. The method of claim 10 , further comprising:

repeatedly determining a size of the object based on channel state information of the third and fourth wireless communications as the object is moving;

constructing a profile of the repeatedly determined size of the object;

comparing the constructed profile to a plurality of predetermined shape profiles, each predetermined shape profile corresponding to a type of shape; and

selecting the predetermined shape profile having a value closest to constructed profile; and

determining a shape of the object based on the selected predetermined shape profile,

wherein determining whether the object is a suspicious object is based further on the determined shape of the object.

12. The method of claim 1 , wherein the first communication element is a wireless signal transmitter and each of the at least two second communication elements is a respective wireless signal receiver.

13. The method of claim 1 , wherein the first communication element is a wireless signal receiver and each of the at least two second communication elements is a respective wireless signal transmitter.

14. A computer-readable non-transitory medium storing instructions for instructing a processor to execute a method for detecting a suspicious object as recited in claim 1 .

15. A system for detecting a suspicious object, the system comprising:

(a) at least one first communication element including a first antenna and a second antenna; and

(b) at least two second communication elements, wherein,

wherein the at least two second communication elements include:

a first second communication element positioned on a side of the object that is opposite the first communication element and including a third antenna and a fourth antenna; and

a second second communication element positioned on a same side of the object as the first communication element and including a fifth antenna,

wherein either (i) the first communication element is a wireless signal transmitter and each second communication element is a respective wireless signal receiver or (ii) the first communication element is a wireless signal receiver and each second communication element is a respective wireless signal transmitter; and

(c) a processor configured to:

obtain channel state information for each of a first wireless communication communicated between the first antenna and the third antenna, a second wireless communication communicated between the first antenna and the fourth antenna, a third wireless communication communicated between the first antenna and the fifth antenna, and a fourth wireless communication communicated between the second antenna and the fifth antenna;

determine a type of material of the object based on channel state information of the first and second wireless communications; and

determine a size of the object based on channel state information of the third and fourth wireless communications; and

determine whether the object is a suspicious object based on each of the type of material of the object and the size of the object.

16. The system of claim 15 , wherein the processor is further configured to:

determine a first complex value of the channel state information of the first wireless communication;

determine a second complex value of the channel state information of the second wireless communication; and

calculate a complex difference value that is a difference between the first complex value and the second complex value,

wherein the determined type of material of the object is based on the first complex value, the second complex value, and the complex difference value.

17. The system of claim 16 , wherein the processor is further configured to:

compare each of the first complex value, the second complex value and the complex difference value to a plurality of predetermined sets of first complex, second complex and complex difference values, each predetermined set of values corresponding to a type of material or a group of types of materials; and

select the type of material or the group of types of materials having the predetermined set of values closest to the first complex value, the second complex value and the complex difference value.

18. The system of claim 16 , wherein the processor is further configured to:

perform phase error correction for the channel state information of the first wireless communication;

perform phase error correction for the channel state information of the second wireless communication; and

reconstruct a complex form of the first and second wireless communications based on the respective phase error corrections.

19. The system of claim 15 , wherein the processor is further configured to, at a calibration stage, determine each of a first estimated channel state of the first or fifth antenna transmitting a first calibration wireless signal and a second estimated channel state of the second or fifth antenna transmitting a second calibration wireless signal based on the first and second calibration wireless signals,

wherein the size of the object is determined based further on the first estimated channel state and the second estimated channel state.

20. The system of claim 19 , wherein the processor is further configured to:

determine a first amplitude of the third wireless communication;

determine a second amplitude of the fourth wireless communication;

determine a weighted second amplitude that is the second amplitude multiplied by a ratio of the first estimated channel state to the second estimated channel state; and

calculate a reflection channel response that is a difference between the first amplitude and the weighted second amplitude,

wherein the size of the object is determined based further on the reflection channel response.

21. The system of claim 15 , wherein the processor is further configured to repeatedly determine the size of the object as the object moves.

22. The system of claim 21 , wherein the processor is further configured to:

repeatedly determine a size of the object based on channel state information of the third and fourth wireless communications as the object is moving;

construct a profile of the repeatedly determined size of the object;

compare the constructed profile to a plurality of predetermined shape profiles, each predetermined shape profile corresponding to a type of shape; and

select the predetermined shape profile having a value closest to constructed profile; and

determine a shape of the object based on the selected predetermined shape profile, wherein the processor is configured to determine whether the object is a suspicious object based further on the determined shape of the object.

23. The system of claim 15 , wherein the first communication element is the wireless signal transmitter and wherein each of the at least two second communication elements is a respective wireless signal receiver.

24. The system of claim 15 , wherein the first communication element is the wireless signal receiver and wherein each of the at least two second communication elements is a respective wireless signal transmitter.

Assignments (4)
CONFIRMATORY LICENSE Recorded Sep 28, 2024
From: STATE UNIVERSITY OF NEW JERSEY, RUTGERS
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 069067/0683 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2023
From: WANG, YAN
To: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK
Reel/Frame 062842/0505 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2023
From: CHEN, YINGYING; WANG, CHEN; LIU, JIAN
To: RUTGERS, THE STATE UNIVERSITY OF NEW JERSEY
Reel/Frame 062842/0749 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2020
From: LIU, HONGBO
To: THE TRUSTEES OF INDIANA UNIVERSITY
Reel/Frame 052473/0095 →
Continuity (2)
Provisional Application 62828151 · Apr 2, 2019
Related Publication 20200319371A1 · Oct 8, 2020