IP Library › Granted Patent US 12,389,200
Granted Patent B2
US 12,389,200 · App. 17/853,397 · Granted Aug 12, 2025

System and method for object localization in an indoor environment

Inventors: Paulo Mendes (Munich, DE); Thomas Multerer (Taufkirchen, DE); Fabien Geyer (Munich, DE)
Assignee: Airbus (S.A.S.)
H04W4/029H04W4/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,389,200
App. No.
17/853,397
Granted
Aug 12, 2025
Kind
B2
Abstract

A system for object localization in an indoor environment, such as a passenger cabin of a vehicle or an aircraft, includes a wireless communication infrastructure to facilitate wireless communication within the indoor environment via a wireless communication network and including at least one wireless access point to provide user devices access to the wireless communication network within the indoor environment. The wireless access point is adapted to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths. A computing element is configured to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying the position of objects located within the indoor environment.

Claims (32)

1. A system for object localization in an indoor environment, comprising:

a wireless communication infrastructure configured to facilitate wireless communication within the indoor environment via a wireless communication network and comprising at least one wireless access point adapted to provide user devices access to the wireless communication network within the indoor environment, wherein the wireless access point is configured to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and

a computing element configured to execute an algorithm to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying a position of objects located within the indoor environment, wherein the algorithm is based on test localization data corresponding to a predetermined test arrangement of test objects within the indoor environment;

wherein the algorithm is trained to extract localization data from signal propagation data using training data received from an external positioning system; and

wherein the algorithm is a machine-learning algorithm executed on the signal propagation data, wherein the machine-learning algorithm is configured to extract the position data based on training data being generated using at least the predetermined test object arrangement within the indoor environment.

2. The system according to claim 1 , wherein the wireless communication infrastructure comprises a plurality of wireless access points, wherein the signal propagation data comprise correlation data of the wireless access points.

3. The system according to claim 1 , wherein the signal propagation data comprise channel state information, CSI.

4. The system according to claim 1 , wherein the signal propagation data comprise at least one of spatial, frequency and temporal variations of the wireless signals within the indoor environment.

5. The system according to claim 1 , wherein each wireless access point is a standard commercial wireless device operating according to a IEEE 802.11 standard.

6. The system according to claim 1 , wherein the machine-learning algorithm is configured to extract locations of static objects within the indoor environment.

7. The system according to claim 1 , wherein the signal propagation data are provided as raw data on a physical layer of the wireless communication infrastructure.

8. The system according to claim 7 , wherein the system comprises:

a set of wireless access points; and

a data aggregation unit in wireless communication with the set of wireless access points and configured to collect the signal propagation data of the set of wireless access points and transfer it to the computing element, wherein each wireless access point in the set of wireless access points is configured to preprocess the raw data generated at the respective wireless access point and transfer it to the data aggregation unit.

9. The system of claim 8 , wherein pre-processing the raw data generated at the respective wireless access point includes a processing circuit on the wireless access point being configured to:

normalize the raw data according to a normalization process and extract relevant features from the normalized raw data; and

wherein the extracted relevant features are forwarded to the data aggregation unit to aggregate the extracted relevant features from the set of wireless access points.

10. The system of claim 7 , wherein the raw data on the physical layer of the wireless communication infrastructure is received in the form of IQ-samples.

11. The system according to claim 1 , wherein the indoor environment is a passenger cabin of a vehicle.

12. The system according to claim 11 , wherein the vehicle is an aircraft.

13. The system of claim 1 , wherein the external positioning system includes a computer vision based external positioning system or a positioning system that uses accelerometers or gyroscopes.

14. An aircraft having a passenger cabin equipped with a system according to claim 1 .

15. A method for object localization in an indoor environment, or in a passenger cabin of a vehicle or an aircraft, the method comprising:

providing a system for object localization in the indoor environment or the passenger cabin, the system comprising:

a wireless communication infrastructure configured to facilitate wireless communication within the indoor environment or the passenger cabin via a wireless communication network and comprising at least one wireless access point adapted to provide user devices access to the wireless communication network within the indoor environment or the passenger cabin, wherein the wireless access point is configured to acquire signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and

a computing element configured to execute an algorithm to analyze the signal propagation data and extract localization data from the signal propagation data, the localization data specifying a position of objects located within the indoor environment or the passenger cabin, wherein the algorithm is based on test localization data corresponding to a predetermined test arrangement of test objects within the indoor environment or the passenger cabin;

wherein the algorithm is trained to extract localization data from signal propagation data using training data received from an external positioning system; and

wherein the algorithm is a machine-learning algorithm executed on the signal propagation data, wherein the machine-learning algorithm is configured to extract the position data based on training data being generated using at least the predetermined test object arrangement within the indoor environment or the passenger cabin;

acquiring, using the system, signal propagation data of wireless signals transmitted over the wireless communication network along multiple propagation paths; and

analyzing, using the system, the signal propagation data and extracting localization data from the signal propagation data, the localization data specifying the position of objects located within the indoor environment or within the passenger cabin.

16. The method according to claim 15 , wherein the machine-learning algorithm extracts locations of static objects within the passenger cabin; and

wherein the training data is further generated using an object position measurement system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: AIRBUS DEFENCE AND SPACE GMBH
To: AIRBUS (S.A.S.)
Reel/Frame 061706/0548 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2022
From: MENDES, PAULO; MULTERER, THOMAS; GEYER, FABIEN
To: AIRBUS DEFENCE AND SPACE GMBH
Reel/Frame 060721/0650 →
Priority Claims (1)
DE 10 2019 220 630.1 · Dec 30, 2019 · national
Continuity (2)
Continuation PCTEP2020086744 · Dec 17, 2020
Related Publication 20220329980A1 · Oct 13, 2022
References Cited (33)
US 6556832B1 · Soliman · 2003 [cited by examiner]
US 10108903B1 · Piao et al. · 2018 [cited by applicant]
US 11644191B2 · Dableh · 2023 [cited by examiner]
US 20150163633A1 · Mishra · 2015 [cited by applicant]
US 20150237471A1 · Li · 2015 [cited by examiner]
US 20150312774A1 · Lau · 2015 [cited by examiner]
US 20160047890A1 · Ryan · 2016 [cited by examiner]
US 20160066158A1 · Xiao · 2016 [cited by examiner]
US 20190170869A1 · Kravets et al. · 2019 [cited by applicant]
US 20190349715A1 · Ghourchian · 2019 [cited by examiner]
US 20200228924A1 · Lelkens · 2020 [cited by examiner]
CN 104883732A · 2015 [cited by applicant]
CN 106131958A · 2016 [cited by applicant]
CN 106802404A · 2017 [cited by applicant]
KR 101711791B1 · 2017 [cited by applicant]
WO WO2016011433A2 · 2016 [cited by examiner]
WO WO2016011433A3 · 2016 [cited by examiner]
WO WO2020145949A1 · 2020 [cited by applicant]
An Example of Indoor Positioning Possibility Using WiFi Network and Mobile Phone—2022 (Year: 2022). [cited by examiner]
A Testbed For Device Free Indoor Localization System—2015 (Year: 2015). [cited by examiner]
IP movement detection and indoor positioning based on Integrating RFID and WLAN—2013 (Year: 2013). [cited by examiner]
CSI-Based Device-Free Indoor Localization Using Convolutional Neural Networks—2018 (Year: 2018). [cited by examiner]
Indoor Localization System Benchmark Based on Wireless Local Network Technologies—2014 (Year: 2014). [cited by examiner]
Cai Chenwai et al, “CSI-Based Device-Free Indoor Localization Using Convolutional Neural Networks,” 2018 IEEE 4th International Conference on Computer and Communications, IEEE, Dec. 7, 2018, pp. 753-757. [cited by applicant]
Rao Xinping et al, “MSDFL: a robust minimal hardware low-cost device-free WLAN localization system,” Neural Computing and Applications, Springer London, vol. 31, No. 12, Jan. 18, 2019, pp. 9261-9278. [cited by applicant]
German Office Action for Application No. 102019220630 dated Aug. 17, 2020. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/EP2020/086744 dated Feb. 24, 2021. [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/EP2020/086744 dated Jul. 5, 2022. [cited by applicant]
The State Intellectual Property Office of Peoples Republic of China Second Office Action in CN Application No. 202080090685.7, dated Jul. 3, 2024, 6 pages. [cited by applicant]
The State Intellectual Property Office of Peoples Republic of China Third Office Action for CN Application 202080090685.7, dated Sep. 20, 2024, 6 pages. [cited by applicant]
European Office Action in EP Application No. 20835767.3, dated Feb. 12, 2025, 8 pages. [cited by applicant]
Ma et al., “WiFi Sensing with Channel State Information: A Survey,” ACM Computer Survey, 35 pages (Jan. 2019). [cited by applicant]
Chinese First Office Action and Search Report in CN Application No. 202080090685.7, dated Mar. 13, 2024, 9 pages. [cited by applicant]