IP Library Granted Patent US 12,320,896
Granted Patent B1
US 12,320,896 · App. 17/483,697 · Granted Jun 3, 2025

Transmitter and receiver localization

Inventors: Jack Erdozain, Jr. (San Francisco, CA); Travis J. McQueen (Lee, NH)
Assignee: Apple Inc.
G01S17/06G01S17/89H04B10/116
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,320,896
App. No.
17/483,697
Granted
Jun 3, 2025
Kind
B1
Abstract

Methods and apparatus for transmitter and receiver localization within an environment. A transmitter transmits a signal that includes information (e.g., wavelength, polarization, and/or modulation) that varies based on observation angle. Receiver(s) may estimate direction of the transmitter in the environment based on the received signal. Intensity of the signal may be used to determine distance of the transmitter to the receiver(s). The receiver(s) may then convey the respective estimated distance and direction to the transmitter, for example via a wireless connection. The transmitter may then generate a map of the respective distances and directions to receiver(s) in the environment, and may convey absolute location and orientation of the transmitter in the environment to the receiver(s), for example via a wireless connection.

Claims (42)

1. A device, comprising:

a receiver configured to:

receive a signal from a transmitter in an environment, wherein the signal encodes digital information specific to the transmitter and includes a plurality of signal components, including:

(a) a plurality of directional signal components transmitted with different wave characteristics for different transmission directions, and

(b) a uniform signal component transmitted with a uniform wave characteristic in all transmission directions, the uniform wave characteristic being different from the different wave characteristics of the directional signal components; and

one or more processors configured to:

estimate a distance and a direction of the transmitter with respect to the receiver in the environment, wherein:

(a) the received signal is filtered to detect one or more of the directional signal components transmitted with the different wave characteristics in the received signal, that are dependent on the direction of the transmitter, and

(b) the detected one or more directional signal components are normalized based on the uniform signal component to estimate the direction; and

cause the estimated distance and direction of the transmitter with respect to the receiver to be conveyed to the transmitter.

2. The device as recited in claim 1 , wherein the device is further configured to receive information indicating absolute location and orientation of the transmitter in the environment from the transmitter.

3. The device as recited in claim 1 , wherein the distance and the direction of the transmitter are estimated in world coordinates of the transmitter.

4. The device as recited in claim 1 , wherein the device and the transmitter both include wireless technology, and wherein the one or more processors convey the estimated distance and direction to the transmitter via a wireless connection.

5. The device as recited in claim 1 , wherein the signal is a light signal, and wherein the one or more processors estimate the direction of the transmitter based on a wavelength of the one or more directional signal components detected at the receiver.

6. The device as recited in claim 1 , wherein the signal is an infrared, near-infrared, or visible light signal, and wherein the one or more processors estimate the direction of the transmitter based on a polarization of the one or more directional signal components detected at the receiver.

7. The device as recited in claim 1 , wherein the signal is an infrared, near-infrared, or visible light signal, and wherein the one or more processors estimate the direction of the transmitter based on modulation of the one or more directional signal components received at the receiver.

8. The device as recited in claim 1 , wherein the signal is an infrared, near-infrared, or visible light signal, and wherein the one or more processors estimate the distance of the transmitter based on intensity of the signal received at the receiver.

9. The device as recited in claim 1 , wherein the receiver includes a camera, and wherein the one or more processors estimate the distance to the transmitter based on a comparison of an image of the transmitter captured by the camera and a known size of the transmitter.

10. A device, comprising:

one or more processors; and

a transmitter configured to broadcast a light signal in an environment, wherein the light signal encodes digital information specific to the transmitter under control of the one or more processors, wherein the light signal conveys information and is transmitted with a plurality of signal components, including:

(a) a plurality of directional signal components transmitted with different wave characteristics for different transmission directions, and

(b) a uniform signal component transmitted with a uniform wave characteristic in all transmission directions, the uniform wave characteristic being different from the different wave characteristics of the directional signal components,

wherein the light signal is filtered to detect the one or more directional signal components with the different wave characteristics, and the one or more directional signal components are used normalized based on the uniform signal component at one or more receivers in the environment to determine respective distance and direction of the transmitter from the one or more receivers in world coordinates of the transmitter; and

wherein the device is configured to receive indications of respective determined distance and direction of the transmitter from the one or more receivers in the environment.

11. The device as recited in claim 10 , wherein the device and the one or more receivers include wireless technology, and wherein the device receives the indications of respective distance and direction from the one or more receivers via a wireless connection.

12. The device as recited in claim 10 , wherein the one or more processors are configured to generate a map of relative distances and directions of the one or more receivers with respect to the transmitter based on the received indications of respective distance and direction.

13. The device as recited in claim 10 , wherein the device stores an absolute location and orientation of the device in the environment, and wherein the device is further configured to convey the absolute location and orientation of the device to the one or more receivers.

14. The device as recited in claim 10 , wherein, to convey the information, the transmitter emits light at wavelengths that vary with a 1:1 correspondence to observation angle.

15. The device as recited in claim 10 , wherein, to convey the information, the transmitter emits light at polarizations that vary with a 1:1 correspondence to observation angle.

16. The device as recited in claim 10 , wherein, to convey the information, the transmitter emits light with modulation that varies with a 1:1 correspondence to observation angle.

17. The device as recited in claim 16 , wherein the modulation conveys data that indicates respective observation angles.

18. The device as recited in claim 10 , wherein, to convey the information, the transmitter emits light at frequencies that vary with a 1:1 correspondence to observation angle.

19. The device as recited in claim 10 , wherein the digital information encoded in the light signal varies according to the direction of the one or more receivers with respect to the transmitter.

20. A method, comprising:

receiving, at a receiver of a receiving device, a light signal from a transmitter in an environment, wherein the light signal encodes digital information specific to the transmitter and includes a plurality of signal components, including:

(a) a plurality of directional signal components transmitted with different wave characteristics for different transmission directions, and

(b) a uniform signal component transmitted with a uniform wave characteristic in all transmission directions, the uniform wave characteristic being different from the different wave characteristics of the directional signal components;

estimating, by one or more processors of the receiving device, a distance and a direction of the transmitter with respect to the receiver in the environment, wherein:

(a) the received light signal is filtered to detect one or more of the directional signal components with the different wave characteristics in the received signal, and

(b) the detected one or more directional signal components are normalized based on the uniform signal component to estimate the direction; and

conveying the estimated distance and direction of the transmitter with respect to the receiver to the transmitter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2021
From: ERDOZAIN, JACK, JR.; MCQUEEN, TRAVIS J.
To: APPLE INC.
Reel/Frame 057599/0791 →
Continuity (1)
Provisional Application 63083713 · Sep 25, 2020
References Cited (50)
US 3781886A · Lank · 1973 [cited by examiner]
US 5343212A · Rose · 1994 [cited by examiner]
US 5440390A · Tirri · 1995 [cited by examiner]
US 7415212B2 · Matsushita · 2008 [cited by applicant]
US 7435940B2 · Eliasson · 2008 [cited by examiner]
US 9779309B1 · Fink · 2017 [cited by applicant]
US 10725304B1 · Ratnam · 2020 [cited by applicant]
US 20010043626A1 · Sakanaka · 2001 [cited by applicant]
US 20060192078A1 · Yang · 2006 [cited by applicant]
US 20100086218A1 · Tateno · 2010 [cited by applicant]
US 20110043661A1 · Podoleanu · 2011 [cited by applicant]
US 20120032853A1 · Karkinen · 2012 [cited by examiner]
US 20120120070A1 · Baillot · 2012 [cited by applicant]
US 20140098379A1 · Smits · 2014 [cited by applicant]
US 20140218765A1 · Sawayanagi · 2014 [cited by applicant]
US 20140225916A1 · Theimer · 2014 [cited by applicant]
US 20140375982A1 · Jovicic · 2014 [cited by applicant]
US 20150215040A1 · Dickson · 2015 [cited by applicant]
US 20150310664A1 · Boussard · 2015 [cited by applicant]
US 20150349881A1 · Byers · 2015 [cited by applicant]
US 20160294472A1 · Palmer · 2016 [cited by applicant]
US 20160357158A1 · Barrows · 2016 [cited by applicant]
US 20170257594A1 · Goslin · 2017 [cited by applicant]
US 20170270637A1 · Perreault · 2017 [cited by applicant]
US 20170276767A1 · Ho · 2017 [cited by applicant]
US 20180081032A1 · Torruellas · 2018 [cited by examiner]
US 20180088208A1 · Gagrani · 2018 [cited by applicant]
US 20180191436A1 · Kadambala · 2018 [cited by applicant]
US 20180234137A1 · Qu · 2018 [cited by applicant]
US 20190004151A1 · Abediasl · 2019 [cited by applicant]
US 20190056634A1 · Hosseini et al. · 2019 [cited by applicant]
US 20190179426A1 · Ojala · 2019 [cited by applicant]
US 20190212106A1 · Bortz · 2019 [cited by applicant]
US 20190253701A1 · Himel · 2019 [cited by applicant]
US 20190369942A1 · Lucas · 2019 [cited by applicant]
US 20200049989A1 · Brown · 2020 [cited by applicant]
US 20200328808A1 · Yang · 2020 [cited by applicant]
US 20210049361A1 · Drrakes · 2021 [cited by applicant]
US 20210112647A1 · Coleman · 2021 [cited by examiner]
US 20220368098A1 · Kim · 2022 [cited by examiner]
US 20230224038A1 · Bluschke · 2023 [cited by applicant]
US 20230244828A1 · Wodrich · 2023 [cited by examiner]
JP 2019030623A · 2019 [cited by examiner]
U.S. Appl. No. 17/483,715, filed Sep. 23, 2021, Jack Erdozain Jr., et al. [cited by applicant]
U.S. Appl. No. 17/483,706, filed Sep. 23, 2021, Travis J. McQueen., et al. [cited by applicant]
Kleinfelder, Stuart, et al. “A 10000 frames/s CMOS digital pixel sensor.” IEEE Journal of Solid-State Circuits 36.12 (2001): 2049-2059. [cited by applicant]
Sgrott, Oreste, et al. “A 134-pixel CMOS sensor for combined time-of-flight and optical triangulation 3-D imaging.” IEEE Journal of Solid-State Circuits 45.7 (2010): 1354-1364. [cited by applicant]
Fisher-Levine, M., and Andrei Nomerotski. “TimepixCam: a fast optical imager with time-stamping.” 17th International Workshop on Radiation Imaging Detectors, Journal of Instrumentation 11.03 (2016 IOP Publishing Ltd for… [cited by applicant]
Buttgen, Bernhard, and Peter Seitz. “Robust optical time-of-flight range imaging based on smart pixel structures.” IEEE Transactions on Circuits and Systems I: Regular Papers 55.6 (2008): 1512-1525. [cited by applicant]
U.S. Appl. No. 18/890,637, filed Sep. 19, 2024, Travis J. McQueen., et al. [cited by applicant]
Cited By (1)
US 12,557,198