Granted Patent B2

US 12,066,572 · App. 17/539,058 · Granted Aug 20, 2024

Inventors: Sai Deepika Regani (College Park, MD); Qinyi Xu (Mountain View, CA); Beibei Wang (Clarksville, MD); Min Wu (Clarksville, MD); Oscar Chi-Lim Au (San Jose, CA); K. J. Ray Liu (Potomac, MD)

Assignee: ORIGIN RESEARCH WIRELESS, INC.

G01S7/412G01S7/006G01S7/415G01S13/003G06N3/04G06F2218/00

Abstract

Claims (142)

1. An apparatus in a venue for monitoring an object expression, comprising:

a receiver configured for:

receiving a wireless signal transmitted from a transmitter through a wireless multipath channel that is impacted by an expression of an object with respect to an adjustable setup in the venue, wherein the object has at least one movable part and the expression of the object is associated with one of a number of adjustment settings of the adjustable setup;

and

a processor configured for:

obtaining a time series of channel information (TSCI) of the wireless multipath channel based on the received wireless signal received by the receiver, wherein the received wireless signal differs from the transmitted wireless signal due to the expression of the object associated with the adjustment setting of the adjustable setup in the venue,

computing a radio biometric information (RBI) associated with the object based on the TSCI,

determining multiple candidate objects,

computing, based on the RBI, a plurality of similarity scores comprising a similarity score between the RBI and each of multiple groups of stored RBI,

wherein each group of stored RBI is associated with a respective candidate object of the multiple candidate objects,

wherein each stored RBI associated with a respective candidate object is pre-computed based on a respective TSCI of the wireless multipath channel obtained previously when the wireless multipath channel was impacted by a respective expression of the respective candidate object associated with a respective adjustment setting of the adjustable setup,

determining an identity of the object based on the plurality of similarity scores,

performing, based on the identity and the RBI associated with the object, a task associated with at least one of the object or the venue, and

updating at least one stored RBI with the RBI, based on the identity of the object,

wherein:

the expression comprises at least one of: an anticipated expression, a controlled expression, a pre-determined expression, a designated expression, a targeted expression, a predicted expression, and an expected expression,

the expression represents at least one of: a place in the venue, an identifiable place, a region, area, spatial coordinate, orientation, presentation, manifestation, dynamic expression, motion, static expression, positioning, scale, placement, state, gesture, pose, posture, body language, body expression, head expression, face expression, vocal expression, arm expression, hand expression, leg expression, and a sequence of expressions of the object.

2. The apparatus of claim 1 , wherein:

the venue is a vehicle;

each of the transmitter and the receiver has a fixed location in the vehicle;

the object is a driver of the vehicle;

the adjustable setup is a seat of the vehicle;

the adjustment settings are different seating positions of the seat; and

the processor is further configured for: performing a feature extraction to extract a feature from the TSCI, wherein:

the RBI associated with the object is computed based on the feature extracted from the TSCI,

the feature extraction is performed based on at least one of:

a projection, principal component analysis (PCA), eigen-decomposition, singular value decomposition (SVD), time-frequency decomposition, vector quantization, machine learning, neural network,

recognition, verification, identification, authentication, locationing, or tracking of at least one of: motion, fall-down, or human biometrics.

3. The apparatus of claim 2 , wherein:

the receiver is further configured for obtaining at least one training TSCI during a training period in which a training object similar to the object is expressed in the expression in the venue; and

the processor is further configured for training the feature extraction based on the at least one training TSCI.

4. The apparatus of claim 2 , wherein the processor is further configured for:

changing the feature extraction based on a recent window of channel information in the TSCI;

extracting a new feature from the TSCI based on the changed feature extraction;

computing a new information associated with the object based on at least one of: the TSCI, the new feature and the changed feature extraction, wherein changing the feature extraction comprises at least one of:

changing a quantity of features,

changing feature definition,

changing feature precision,

changing feature representation,

processing the feature,

retraining the feature extraction,

recomputing the feature extraction,

renewing the feature extraction,

synchronizing the changed feature extraction,

updating the feature extraction,

modifying the feature extraction,

adjusting the feature extraction,

expanding the feature extraction,

reducing the feature extraction, or

simplifying the feature extraction.

5. The apparatus of claim 2 , wherein the feature is a biometric feature derived from the TSCI.

6. The apparatus of claim 5 , wherein the machine learning model is trained based on a neural network.

7. The apparatus of claim 6 , wherein:

the receiver is further configured for obtaining the at least one training TSCI during the training period in which a training object similar to the object is expressed in the expression in the venue.

8. The apparatus of claim 1 , wherein the processor is further configured for changing, based on a recent window of channel information in the TSCI, the machine learning model and a parameter associated with the TSCI, wherein the changing comprises at least one of:

changing a particular parameter of at least one of: the neural network, the model, and the algorithm,

changing parameter precision, changing parameter representation,

changing at least one of: an input layer, a hidden layer, and an output layer, of the neural network,

changing a at least one of: a neuron, a node, a connection, an interconnection, a structure, a layer, an input layer, a hidden layer, an output layer, and an organization, of the neural network,

changing at least one of: a weight, a weighted sum, and a propagation function, of the neural network,

changing the model definition,

changing at least one element of the model,

changing the algorithm definition,

changing at least one step of the algorithm,

retraining, recomputing, renewing, synchronizing, updating, modifying, adjusting, expanding, reducing, or simplifying.

9. The apparatus of claim 8 , wherein:

the setup is a seat; and

the object is at least one of: a driver, operator, officer, or passenger, sitting on the seat in the vehicle.

10. The apparatus of claim 9 , wherein:

the task comprises at least one of:

adjusting at least one of: a position, legroom, height, width, length, angle, lumber support, firmness, arm-rest, head support, neck support, comfort setting, heating setting, health-related setting, ergonomic setting, and another setting, of the seat,

adjusting at least one of: a system, accessory and user-interface, around the seat,

adjusting at least one of: rear-view mirror, side mirror, steering wheel, steering column, dash panel, display, control panel, on-screen display, entertainment system, levers, and buttons,

communicating with at least one of: a device, smart device, smart phone, communicating device, tablet, laptop, computer, Bluetooth device, WiFi device, mesh device, LTE device, associated with the object,

communicating with at least one of: a network, wireless network, WiFi network, mesh network, 3G/4G/LTE/5G/6G/7G/8G network, garage, parking facility, refueling facility, storage facility, charging device, power transfer facility, smart device, facility automation system, home, house, building, facility, warehouse, factory, security system, remote device, remote server, another networked vehicle, and another networked device,

preparing for driving,

turning on at least one of: a device, and subsystem, of the vehicle,

adjusting at least one of: radio, streaming service, news, information source, information display, voice recognition, dialogue system, vehicle automation system, engine, lights, air conditioning, comfort features, safety features, cabin monitoring, entertainment system, communication system, and a subsystem of the vehicle, or

making an adjustment of at least one of: the vehicle, and the setup, such that the object is expressed in another expression based on the adjustment.

11. The apparatus of claim 8 , wherein:

a second transmitter is configured for transmitting a second wireless signal asynchronously through the wireless multipath channel in the venue; and

a second receiver is configured for:

receiving the second wireless signal through the wireless multipath channel, and

obtaining a second TSCI of the wireless multipath channel asynchronously based on the second wireless signal.

12. The apparatus of claim 11 , wherein at least one of the second transmitter and the second receiver is part of a transceiver that covers one of the transmitter and the receiver.

13. The apparatus of claim 11 , wherein the processor is further configured for:

computing a second information associated with the object individually based on the second TSCI; and

combining the RBI computed based on the TSCI and the second information computed based on the second TSCI.

14. The apparatus of claim 11 , wherein the processor is configured for:

computing the RBI associated with the object jointly based on the TSCI and the second TSCI.

15. A system for monitoring an object expression, comprising:

a first transceiver configured for transmitting a wireless signal through a wireless multipath channel that is impacted by an expression of an object with respect to an adjustable setup in a venue, wherein the object has at least one movable part and the expression of the object is associated with one of a number of adjustment settings of the adjustable setup;

a second transceiver configured for:

receiving the wireless signal through the wireless multipath channel

and

a processor configured for:

obtaining a time series of channel information (TSCI) of the wireless multipath channel based on the received wireless signal received by the second transceiver, wherein the received wireless signal differs from the transmitted wireless signal due to the expression of the object associated with the adjustment setting of the adjustable setup in the venue,

computing a radio biometric information (RBI) associated with the object based on the TSCI,

determining multiple candidate objects,

computing, based on the RBI, a plurality of similarity scores comprising a similarity score between the RBI and each of multiple groups of stored RBI,

wherein each group of stored RBI is associated with a respective candidate object of the multiple candidate objects,

wherein each stored RBI associated with a respective candidate object is pre-computed based on a respective TSCI of the wireless multipath channel obtained previously when the wireless multipath channel was impacted by a respective expression of the respective candidate object associated with a respective adjustment setting of the adjustable setup,

determining an identity of the object based on the plurality of similarity scores,

performing, based on the identity and the RBI associated with the object, a task associated with at least one of the object or the venue, and

updating at least one stored RBI with the RBI, based on the identity of the object.

16. The system of claim 15 , further comprising:

a sensor configured for receiving an input associated with the object,

wherein the processor is further configured for computing, based on the input associated with the object, at least one of: a prediction, a reference information and an auxiliary information,

wherein the RBI associated with the object is computed based on the TSCI and at least one of: the prediction, the reference information and the auxiliary information.

17. A method, implemented by a processor, a memory communicatively coupled with the processor, and a set of instructions stored in the memory to be executed by the processor for monitoring an object expression, comprising:

obtaining a time series of channel information (TSCI) of a wireless multipath channel based on a wireless signal, wherein

the wireless signal is transmitted from a first wireless device to a second wireless device through the wireless multipath channel that is impacted by an expression of an object with respect to an adjustable setup in a venue,

the object has at least one movable part, and

the expression of the object is associated with one of a number of adjustment settings of the adjustable setup;

computing a radio biometric information (RBI) associated with the object based on the TSCI;

determining multiple candidate objects;

computing, based on the RBI, a plurality of similarity scores comprising a similarity score between the RBI and each of multiple groups of stored RBI,

wherein each group of stored RBI is associated with a respective candidate object of the multiple candidate objects,

wherein each stored RBI associated with a respective candidate object is pre-computed based on a respective TSCI of the wireless multipath channel obtained previously when the wireless multipath channel was impacted by a respective expression of the respective candidate object associated with a respective adjustment setting of the adjustable setup;

determining an identity of the object based on the plurality of similarity scores;

performing, based on the identity and the RBI associated with the object, a task associated with at least one of the object or the venue; and

updating at least one stored RBI with the RBI, based on the identity of the object,

wherein:

the expression represents at least one of: a place in the venue, an identifiable place, a region, area, spatial coordinate, orientation, presentation, manifestation, dynamic expression, motion, static expression, positioning, scale, placement, state, gesture, pose, posture, body language, body expression, head expression, face expression, vocal expression, arm expression, hand expression, leg expression, and a sequence of expressions of the object,

the stored radio biometrics are trained using a machine learning model based on radio biometrics collected during a training period.

18. The method of claim 17 , further comprising:

computing the RBI repeatedly;

communicating a data to at least one of: the first wireless device, the second wireless device, a server, a local server, a cloud server, and a user device, in at least one of: a direct manner and an indirect manner, wherein the data comprises at least one of: the TSCI, an analysis of the TSCI, a data associated with the TSCI, the repeatedly computed information, an analysis of the information, a data associated with the information, a history of the information, a time trend of the information, a behavior of the information, a change, a second information computed based on the continuously computed information, a summary of the task, a report of task, a data associated with the task, an analysis of the task, and a data associated with an outcome of the task; and

providing, to a user device associated with the object, an analytics computed based on the data.

19. The method of claim 17 , further comprising configuring the first wireless device and the second wireless device such that:

the wireless signal transmitted through the multipath channel is compatible with at least one of:

a standard, wireless local area network (WLAN) standard, wireless communication standard, mobile communication standard, wireless network standard,

an international standard, national standard, industry standard, defacto standard,

an IEEE standard, IEEE 802 standard, 802.11, 802.11n, 802.11ac, 802.11ax, 802.11be, 802.15, 802.16, WiFi standard, mesh,

3GPP standard, LTE, 3G, 4G, 5G, 6G, 7G, 8G, UWB, Bluetooth, BLE, RFID, and another standard;

the wireless signal comprises at least one of:

a wireless communication signal, mobile communication signal, wireless network signal, mobile network signal, mesh signal, light signal, light communication, downlink signal, uplink signal, broadcast signal, multicast signal, unicast signal, bandlimited signal, standard compliant signal, wireless standard compliant signal,

a protocol signal, standardized wireless protocol, communication protocol, wireless communication network signal, cellular network signal, beacon signal, beacon wireless signal, pilot signal, probe signal, acknowledgement signal, response signal, reply signal, reference signal, source signal, wireless source signal, motion probes, motion detection signal, motion sensing signal, synchronization signal,

a standard compliant wireless frame, management frame, control frame, data frame, data frame with null data, 802.11 frame, 802.15 frame, 802.16 frame, LTE frame, 4G frame, 5G frame, 6G frame,

a 3GPP signal, LTE/3G/4G/5G/6G/7G/8G signal, WiFi signal, IEEE 802 signal, IEEE 802.11/15/16 signal, RFID signal, Bluetooth signal, BLE signal, UWB signal, Zigbee signal, WiMax signal, an RF signal in licensed band, an RF signal in unlicensed band, an RF signal in ISM band;

the wireless signal has a bandwidth and a carrier frequency supported by both the first wireless device and the second wireless device; and

the wireless signal is transmitted with N1 antennas of the first wireless device and received with N2 antennas of the second wireless device.

Assignments (1)

Continuity (43)