IP Library › Granted Patent US 12,253,596
Granted Patent B2
US 12,253,596 · App. 18/103,616 · Granted Mar 18, 2025

Ad hoc positioning of mobile devices using near ultrasound signals

Inventors: Wilfred Edwin Booij (Oslo, NO); Mattheus Franciscus Albertus Ten Veldhuis (Oslo, NO)
Assignee: Sonitor Technologies AS
G01S15/325G01S5/0009G01S5/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,253,596
App. No.
18/103,616
Granted
Mar 18, 2025
Kind
B2
Abstract

An approach for providing a lower cost real time location system in less trafficked areas of a building. This approach uses on-board audio capabilities of a mobile device to receive a room response trace resulting from a self-generated acoustic signal. By comparing the room response trace to a modeled room response trace, the location of the mobile device is determined.

Claims (39)

1. A method comprising:

modulating an acoustic signal to form a transmitted acoustic signal, the transmitted acoustic signal having a narrow autocorrelation function;

transmitting, by a speaker in a mobile device, the transmitted acoustic signal;

receiving, by a microphone within the mobile device, a received acoustic signal, the received acoustic signal resulting from an interaction by the transmitted acoustic signal with a local acoustic environment in which the mobile device is located;

deconvolving the received acoustic signal with the transmitted acoustic signal to generate a room response trace;

comparing the room response trace to a subset of a plurality of modeled room response traces, at least one of the subset of the plurality of modeled room response traces being calculated based on a model of a building in the local acoustic environment, each of the subset of the plurality of modeled room response traces being previously calculated and stored on one of the mobile device or a central server, wherein the subset of the plurality of modeled room response traces are identified as being likely acoustic environments based on a location history of the mobile device; and

determining a location of the mobile device based on the comparing the room response trace.

2. The method of claim 1 , further comprising:

correcting the room response trace prior to the comparing, the correcting including using spatial transmit characteristics for the speaker and spatial receive characteristics for the microphone.

3. The method of claim 1 , further comprising:

correcting the room response trace prior to the comparing, the correcting including estimating an orientation of the mobile device by using an on-board sensor of the mobile device to determine the orientation with respect to magnetic north or true north.

4. The method of claim 3 , wherein estimating the orientation of the mobile device further includes using the on-board sensor of the mobile device to determine the orientation for a time period during at least one of the transmitting by the speaker or the receiving by the microphone.

5. The method of claim 1 ,

wherein modulating the acoustic signal to form the transmitted acoustic signal includes modulating the acoustic signal using one of phase-shift keying modulation or QAM modulation.

6. The method of claim 1 , wherein transmitting the transmitted acoustic signal includes transmitting the transmitted acoustic signal in a specific time slot associated with the mobile device.

7. The method of claim 1 , wherein the comparing the room response trace to the subset of the plurality of modeled room response traces includes using a positioning algorithm that is a combination of analytic, numerical and machine learning algorithms.

8. The method of claim 1 , wherein the comparing the room response trace to the subset of the plurality of modeled room response traces includes using a positioning algorithm that is aided by sensor data fusion, the sensor data fusion including combined signals from one or more of accelerometers, gyroscopes, magnetometers and pressure sensors.

9. The method of claim 1 , wherein the comparing the room response trace to the subset of the plurality of modeled room response includes limiting search of potential acoustic environments based on location history and data fusion position results.

10. A mobile computing device comprising:

a processing device configured to modulate an acoustic signal to form a transmitted acoustic signal, the transmitted acoustic signal having a narrow autocorrelation function;

a speaker configured to transmit the transmitted acoustic signal;

a microphone configured to receive a received acoustic signal, wherein the received acoustic signal results from an interaction by the transmitted acoustic signal with a local acoustic environment in which the mobile computing device is located; and

the processing device further configured to:

deconvolve the received acoustic signal with the transmitted acoustic signal to generate a room response trace;

compare the room response trace to a subset of a plurality of modeled room response traces, at least one of the subset of the plurality of modeled room response traces being calculated based on a model of a building in the local acoustic environment, each of the subset of the plurality of modeled room response traces being previously calculated and stored on one of the mobile computing device or a central server, wherein the subset of the plurality of modeled room response traces are identified as being likely acoustic environments based on a location history of the mobile computing device; and

determine a location of the mobile computing device based on the comparison of the room response trace.

11. The mobile computing device of claim 10 , wherein the processing device is further configured to:

perform a correction of the room response trace prior to the comparison, wherein the correction includes using spatial transmit characteristics for the speaker and spatial receive characteristics for the microphone.

12. The mobile computing device of claim 10 , wherein the processing device is further configured to:

perform a correction of the room response trace prior to the comparison, wherein the correction includes an estimate of orientation of the mobile computing device by using an on-board sensor of the mobile computing device to determine the orientation with respect to magnetic north or true north.

13. The mobile computing device of claim 10 , wherein the transmitted acoustic signal is a modulated acoustic signal using one of phase-shift keying modulation or QAM modulation.

14. The mobile computing device of claim 10 , wherein the transmitted acoustic signal is transmitted in a specific time slot associated with the mobile computing device.

15. The mobile computing device of claim 10 , wherein the processing device is further configured to compare the room response trace to the subset of the plurality of modeled room response traces by using a positioning algorithm that is a combination of analytic, numerical and machine learning algorithms.

16. The mobile computing device of claim 10 , wherein the processing device is further configured to compare the room response trace to the subset of the plurality of modeled room response traces by using a positioning algorithm that is aided by sensor data fusion, the sensor data fusion including combined signals from one or more of accelerometers, gyroscopes, magnetometers and pressure sensors.

17. A method comprising:

receiving, by a microphone within a first mobile device, a received acoustic signal, the received acoustic signal resulting from an interaction by a transmitted acoustic signal within a local acoustic environment in which the first mobile device is located, wherein the transmitted acoustic signal is transmitted by a second mobile device, the transmitted acoustic signal being a modulated acoustic signal having a narrow autocorrelation function, the modulated acoustic signal being one of a PSK-modulated signal or a QAM-modulated signal;

receiving, by the first mobile device, supplemental information including a strength of the transmitted acoustic signal, an orientation of the second mobile device, one or more spatial characteristics of the second mobile device, timing information associated with the transmitted acoustic signal, and a location history of the first mobile device; and

determining a location of the first mobile device based on the received acoustic signal and the supplemental information.

18. The method of claim 17 , wherein the timing information provides timing data with respect to a common time frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2023
From: BOOIJ, WILFRED EDWIN; TEN VELDHUIS, MATTHEUS FRANCISCUS ALBERTUS
To: SONITOR TECHNOLOGIES AS
Reel/Frame 062551/0012 →
Continuity (3)
Continuation 16965506
Provisional Application 62623215 · Jan 29, 2018
Related Publication 20230314603A1 · Oct 5, 2023
References Cited (21)
US 7557703B2 · Yamada et al. · 2009 [cited by applicant]
US 8560012B2 · Ohnishi et al. · 2013 [cited by applicant]
US 10542367B2 · Daly · 2020 [cited by applicant]
US 11567195B2 · Booij et al. · 2023 [cited by applicant]
US 20110182148A1 · Radusch et al. · 2011 [cited by applicant]
US 20120016640A1 · Murphy · 2012 [cited by examiner]
US 20120019674A1 · Ohnishi et al. · 2012 [cited by applicant]
US 20120044786A1 · Booij et al. · 2012 [cited by applicant]
US 20140285338A1 · Davis et al. · 2014 [cited by applicant]
CN 102016632A · 2011 [cited by applicant]
CN 102301738A · 2011 [cited by applicant]
CN 102378918A · 2012 [cited by applicant]
CN 103503503A · 2014 [cited by applicant]
WO WO2018050913A1 · 2018 [cited by applicant]
International Search Report mailed Jul. 29, 2019 for Appl. No. PCT/IB2019/050680, 5 pages. [cited by applicant]
Written Opinion mailed Jul. 29, 2019 for Appl. No. PCT/IB2019/050680, 14 pages. [cited by applicant]
Mirco Rossi et al., “RoomSense: An Indoor Positioning System for SmartPhones using Active Sound Probing,” Mar. 7, 2013; Mar. 7, 2013-Mar. 8, 2013, Mar. 7, 2013 (Mar. 7, 2013), pp. 89-95, XP058014602, DOI: 10.1145/245923… [cited by applicant]
Jia Ruoxi et al., “SoundLoc: Accurate room-level indoor localization using acoustic signatures,” 2015 IEEE International Conference on Automation Science and Engineering (Case), IEEE, Aug. 24, 2015 (Aug. 24, 2015), pp. … [cited by applicant]
Suryanarayanan Nikhil: “Audio Based Location Fingerprinting for Mobile Devices”, Dec. 15, 2010 (Dec. 15, 2010), pp. 1-31, XPO55590472, Retrieved from the internet: URL:https://minds.wisconsin.edu/bistream/handle/1793/48… [cited by applicant]
Kunze et al,, “Symbolic Object Localization Through Active Sampling of Acceleration and Sound Signatures,” 2007, downloaded Jan. 19, 2022 from https://courses.cs.washington.edu/courses/cse590u/07au/papers/kunze.pdf, 18 … [cited by applicant]
Rossi et al., “RoomSense: an indoor positioning system for smartphones using active sound probing”, AH'13: Proceedings of the 4th Augmented Human International Conference, pp. 89-95, Mar. 7, 2013. [cited by applicant]