IP Library › Granted Patent US 12,200,660
Granted Patent B2
US 12,200,660 · App. 17/461,927 · Granted Jan 14, 2025

Unsupervised learning for simultaneous localization and mapping in deep neural networks using channel state information

Inventors: Arash Behboodi (Amsterdam, NL); Farhad Ghazvinian Zanjani (Almere, NL); Joseph Binamira Soriaga (San Diego, CA); Lorenzo Ferrari (Oakland, CA); Rana Ali Amjad (Amsterdam, NL); Max Welling (Bussum, NL); Taesang Yoo (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04W64/006G06N20/00H04B7/0626H04B7/086
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,660
App. No.
17/461,927
Granted
Jan 14, 2025
Kind
B2
Abstract

A method of training an artificial neural network (ANN), receives, from a base station, signal information for a radio frequency signal between the base station and a user equipment (UE). The artificial neural network is trained to determine a location of the UE and to map the environment based on the received signal information and in the absence of labeled data.

Claims (34)

1. A method of localization and mapping using an artificial neural network (ANN), comprising:

receiving, by the ANN, input signal information from one or more base stations for radio frequency signals between the one or more base stations and a user equipment (UE) in an environment;

determining, by the ANN, a location of the UE based on the input signal information; and

decoding, with a channel model, the location of the UE to generate reconstructed signal information based on a set of learned environment parameters corresponding to propagation effects in the environment and the location information determined by the ANN, the propagation effects including one or more of reflections or scattering of the radio frequency signals, the learned environment parameters based on a training loss computed from a difference between the input signal information and the reconstructed signal information the learned environment parameters being input to the channel model.

2. The method of claim 1 , in which the input signal information is channel state information, a time of flight or an angle of arrival.

3. The method of claim 1 , further comprising training the ANN using back propagation.

4. The method of claim 1 , in which the input signal information is unlabeled data.

5. The method of claim 1 , further comprising:

determining one or more virtual anchors based on the reflections of the radio frequency signals; and

jointly learning a position of the one or more virtual anchors and parameters of the ANN.

6. A method of localization and mapping using an artificial neural network (ANN), comprising:

receiving, via a base station, input signal information from one or more user equipments (UEs) for radio frequency signals between the one or more UEs and the base station in an environment;

determining locations of the one or more UEs based on the input signal information; and

decoding, with a channel model, the locations of the one or more UEs to generate reconstructed signal information based on a set of learned environment parameters corresponding to propagation effects in the environment and the determined locations of the one or more UEs, the propagation effects including one or more of reflections or scattering of the radio frequency signals, the learned environment parameters based on a training loss computed from a difference between the input signal information and the reconstructed signal information the learned environment parameters being input to the channel model.

7. The method of claim 6 , in which the input signal information is channel state information, a time of flight or an angle of arrival.

8. The method of claim 6 , further comprising training the ANN using back propagation.

9. The method of claim 6 , in which the input signal information is unlabeled data.

10. The method of claim 6 , further comprising:

determining one or more virtual anchors based on the reflections of the radio frequency signals; and

jointly learning a position of the one or more virtual anchors and parameters of the ANN.

11. An artificial neural network comprising:

an encoder configured to determine a location of one or more user equipments (UEs) based on input signal information from the one or more UEs for radio frequency signals between the one or more UEs and a base station in an environment; and

a decoder, comprising a channel model and configured to parameterize the environment of the one or more UEs and generate reconstructed signal information based at least in part on the location of the one or more UEs and a set of learned environment parameters corresponding to propagation effects in the environment for mapping the input signal information to location information, the propagation effects including one or more of reflections or scattering of the radio frequency signals, the learned environment parameters based on a training loss computed from a difference between the input signal information and the reconstructed signal information the learned environment parameters being input to the channel model.

12. The artificial neural network of claim 11 , in which the encoder comprises a second artificial neural network and the decoder includes the channel model.

13. The artificial neural network of claim 12 , in which the channel model comprises a function of the set of learned environment parameters.

14. The artificial neural network of claim 13 , in which the set of learned environment parameters comprise locations of one or more virtual nodes representing signal propagation effects associated with the radio frequency signals between the one or more UEs and the base station.

15. The artificial neural network of claim 12 , in which the channel model comprises a generative artificial neural network.

16. The artificial neural network of claim 12 , in which the encoder and the decoder are trained simultaneously using backpropagation.

17. A method of operating an artificial neural network (ANN), comprising:

receiving transmissions of radio frequency (RF) signals from one or more reference nodes in an environment;

inferring from the RF signals or input signal information derived from the RF signals, a location of a receiver of the RF signal transmissions relative to the one or more reference nodes; and

decoding, with a channel model, the location of the receiver to generate reconstructed signal information based on a set of learned environment parameters corresponding to propagation effects in the environment for mapping the input signal information to location information, the propagation effects including one or more of reflections or scattering of the RF signals, the learned environment parameters based on a training loss computed from a difference between the input signal information and the reconstructed signal information, the learned environment parameters being input to the channel model.

18. The method of claim 17 , in which the learned environment parameters are associated with one or more virtual node locations, the one or more virtual node locations corresponding to reflected signal transmissions from the one or more reference nodes received by the receiver.

19. The method of claim 18 , further comprising generating a mapping of the environment of the receiver of the RF signal transmission based on the location of the receiver and the learned environment parameters associated with the one or more virtual node locations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2021
From: BEHBOODI, ARASH; GHAZVINIAN ZANJANI, FARHAD; SORIAGA, JOSEPH BINAMIRA; FERRARI, LORENZO; AMJAD, RANA ALI; WELLING, MAX; YOO, TAESANG
To: QUALCOMM INCORPORATED
Reel/Frame 057791/0625 →
Continuity (2)
Provisional Application 63072821 · Aug 31, 2020
Related Publication 20220070822A1 · Mar 3, 2022
References Cited (14)
US 10762650B1 · Guo · 2020 [cited by examiner]
US 20040125013A1 · Haselsteiner · 2004 [cited by examiner]
US 20190051183A1 · Anderson · 2019 [cited by examiner]
US 20190188565A1 · O'Shea · 2019 [cited by examiner]
US 20190362237A1 · Choi · 2019 [cited by examiner]
US 20200275402A1 · Shi et al. · 2020 [cited by applicant]
US 20210004677A1 · Menick · 2021 [cited by examiner]
US 20210150061A1 · Goodsitt · 2021 [cited by examiner]
US 20210174209A1 · Zhuang · 2021 [cited by examiner]
US 20210255634A1 · Mancilla · 2021 [cited by examiner]
Partial International Search Report—PCT/US2021/048511—ISA/EPO—Mar. 18, 2022. [cited by applicant]
International Search Report and Written Opinion—PCT/US2021/048511—ISA/EPO—May 11, 2022. [cited by applicant]
Gentner C., et al., “Multipath Assisted Positioning with Simultaneous Localization and Mapping”, IEEE Transactions on Wireless Communications, vol. 15, No. 9, Sep. 2016, pp. 6104-6117. [cited by applicant]
Leitinger E., et al., “A Belief Propagation Algorithm for Multipath-Based SLAM”, IEEE Transactions on Wireless Communications, vol. 18, Issue: 12, Dec. 2019, pp. 1-18. [cited by applicant]
Cited By (1)
US 12,432,007