IP Library Granted Patent US 12,306,307
Granted Patent B2
US 12,306,307 · App. 17/863,412 · Granted May 20, 2025

Selection of pulse repetition intervals for sensing time of flight

Inventors: Moshe Laifenfeld (Haifa, IL); Harish Venkataraman (Half Moon Bay, CA); Cristiano L Niclass (San Jose, CA); Doron Shinbox (Tel Aviv, IL); Shingo Mandai (Mountain View, CA); Susan A. Thompson (Half Moon Bay, CA)
Assignee: Apple Inc.
G01S17/894G01S7/4815G01S7/484G01S7/4863G01S7/4865G01S17/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,306,307
App. No.
17/863,412
Granted
May 20, 2025
Kind
B2
Abstract

Sensing apparatus includes a radiation source, which emits pulses of optical radiation toward multiple points in a target scene. A receiver receives the optical radiation that is reflected from the target scene and outputs signals that are indicative of respective times of flight of the pulses to and from the points in the target scene. Processing and control circuitry selects a first pulse repetition interval (PRI), a second PRI, greater than the first PRI, and a third PRI, greater than the second PRI, from a permitted range of PRIs, drives the radiation source to emit sequences of the pulses at the first PRI, the second PRI, and the third PRI, and processes the signals output by the receiver in response to the first, second, and third sequences of the pulses in order to compute respective depth coordinates of the points in the target scene.

Claims (28)

1. Sensing apparatus, comprising:

a radiation source, which is configured to emit pulses of optical radiation toward multiple points in a target scene;

a receiver, which is configured to receive the optical radiation that is reflected from the target scene and to output signals, responsively to the received optical radiation, that are indicative of respective times of flight of the pulses to and from the points in the target scene; and

processing and control circuitry, which is configured to select a first pulse repetition interval (PRI), a second PRI, greater than the first PRI, and a third PRI, greater than the second PRI, from a permitted range of PRIs, and to drive the radiation source to emit a first sequence of the pulses at the first PRI, a second sequence of the pulses at the second PRI, and a third sequence of the pulses at the third PRI, and to process the signals output by the receiver in response to the first, second, and third sequences of the pulses in order to compute respective depth coordinates of the points in the target scene.

2. The apparatus according to claim 1 , wherein the radiation source comprises an array of vertical-cavity surface-emitting lasers (VCSELs).

3. The apparatus according to claim 1 , wherein the radiation source comprises an array of emitters, which are arranged in multiple banks, and wherein the processing and control circuitry is configured to drive the multiple banks sequentially so that each bank emits respective first, second, and third sequences of the pulses at the first, second, and third PRIs.

4. The apparatus according to claim 1 , wherein the receiver comprises an array of single-photon avalanche diodes (SPADs).

5. The apparatus according to claim 1 , wherein the first PRI defines a range limit, at which a time of flight of the pulses is equal to the first PRI, and wherein the processing and control circuitry is configured to compare the signals output by the receiver in response to the first, second, and third sequences of pulses in order to distinguish the points in the scene for which the respective depth coordinates are less than the range limit from the points in the scene for which the respective depth coordinates are greater than the range limit, thereby resolving range folding of the depth coordinates.

6. The apparatus according to claim 5 , wherein the processing and control circuitry is configured to compute, for each of the points in the scene, respective first, second, and third histograms of the times of flight of the pulses in the first, second, and third sequences, and to detect that range folding has occurred at a given point responsively to a difference between two or more of the first, second, and third histograms.

7. The apparatus according to claim 1 , and comprising a radio transceiver, which communicates over the air by receiving signals in an assigned frequency band, wherein the processing and control circuitry is configured to identify the permitted range of the PRIs responsively to the assigned frequency band.

8. The apparatus according to claim 7 , wherein the processing and control circuitry is configured to store a record of multiple groups of the PRIs, to identify an operating environment of the apparatus, and to select one of the groups to apply in driving the radiation source responsively to the identified operating environment.

9. The apparatus according to claim 1 , wherein the first, second, and third PRIs are co-prime relative to a time scale used in processing the signals.

10. The apparatus according to claim 1 , wherein the processing and control circuitry is configured to select the first, second, and third PRIs so as to maximize a range of the depth coordinates while maintaining a resolution of the depth coordinates to be no greater than a predefined resolution limit.

11. The apparatus according to claim 1 , wherein the processing and control circuitry is configured to drive the radiation source to emit the first, second, and third sequences of the pulses repetitively over a succession of frames having a predefined frame duration, and to select the first, second, and third PRIs so that a cumulative duration of the first, second, and third sequences of the pulses is no more than 80% of the frame duration.

12. The apparatus according to claim 11 , wherein the processing and control circuitry is configured to define a sleep period in each frame following emission of the first, second, and third sequences of the pulses, wherein the radiation source and the receiver operate in a low-power mode during the sleep period.

13. A method for sensing, comprising:

selecting a first pulse repetition interval (PRI) and a second PRI, greater than the first PRI, and a third PRI, greater than the second PRI, from a permitted range of PRIS;

driving a radiation source to emit a first sequence of pulses of optical radiation at the first PRI, a second sequence of the pulses of the optical radiation at the second PRI, and a third sequence of the pulses at the third PRI toward each of multiple points in a target scene;

receiving the optical radiation that is reflected from the target scene and outputting signals, responsively to the received optical radiation, that are indicative of respective times of flight of the pulses to and from the points in the target scene; and

processing the signals output in response to the first, second, and third sequences of the pulses in order to compute respective depth coordinates of the points in the target scene.

14. The method according to claim 13 , wherein the first PRI defines a range limit, at which a time of flight of the pulses is equal to the first PRI, and wherein processing the signals comprises comparing the signals output in response to the first, second, and third sequences of pulses in order to distinguish the points in the scene for which the respective depth coordinates are less than the range limit from the points in the scene for which the respective depth coordinates are greater than the range limit, thereby resolving range folding of the depth coordinates.

15. The method according to claim 14 , wherein processing the signals comprises computing, for each of the points in the scene, respective first, second, and third histograms of the times of flight of the pulses in the first, second, and third sequences, and detecting that range folding has occurred at a given point responsively to a difference between two or more of the first, second, and third histograms.

16. The method according to claim 13 , wherein selecting the first, second, and third PRIS comprises identifying the permitted range of the PRIs responsively to an assigned frequency band of a radio transceiver, which communicates over the air in the assigned frequency band in proximity to the radiation source, and choosing the first PRI and the second PRI from the permitted range.

17. The method according to claim 13 , wherein selecting the first, second, and third PRIs comprises storing a record of multiple groups of the PRIS, and selecting one of the groups to apply in driving the radiation source.

18. The method according to claim 13 , wherein the first, second, and third PRIs are co-prime relative to a time scale used in processing the signals.

19. The method according to claim 13 , wherein driving the radiation source comprises causing the radiation source to emit the first, second, and third sequences of the pulses repetitively over a succession of frames having a predefined frame duration, and

wherein selecting the first, second, and third PRIS comprises choosing the first, second, and third PRIs so that a cumulative duration of the first, second, and third sequences of the pulses is no more than 80% of the frame duration.

20. The method according to claim 19 , and comprising defining a sleep period in each frame following emission of the first, second, and third sequences of the pulses, wherein the radiation source and a receiver that receives the optical radiation operate in a low-power mode during the sleep period.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2022
From: VENKATARAMAN, HARISH; SHINBOX, DORON; THOMPSON, SUSAN A
To: APPLE INC.
Reel/Frame 060813/0746 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2022
From: LAIFENFELD, MOSHE; OGGIER, THIERRY; BUETTGEN, BERNHARD; NICLASS, CRISTIANO L; HEZAR, RAHMI; MANDAI, SHINGO; SHRESTHA, DARSHAN; CHUNG, GARY
To: APPLE INC.
Reel/Frame 060490/0306 →
Continuity (3)
Continuation In Part 16885316 · May 28, 2020
Provisional Application 62859211 · Jun 10, 2019
Related Publication 20220350026A1 · Nov 3, 2022
References Cited (87)
US 5373148A · Dvorkis et al. · 1994 [cited by applicant]
US 7800739B2 · Rohner et al. · 2010 [cited by applicant]
US 8279418B2 · Yee et al. · 2012 [cited by applicant]
US 8594425B2 · Gurman et al. · 2013 [cited by applicant]
US 8891068B2 · Fisele et al. · 2014 [cited by applicant]
US 9016849B2 · Fujisawa et al. · 2015 [cited by applicant]
US 9267787B2 · Shpunt et al. · 2016 [cited by applicant]
US 9386299B2 · Shpunt et al. · 2016 [cited by applicant]
US 11500094B2 · Oggier · 2022 [cited by examiner]
US 11693102B2 · Kudla et al. · 2023 [cited by applicant]
US 11733359B2 · Fine · 2023 [cited by examiner]
US 12140708B2 · Fine · 2024 [cited by examiner]
US 20040212863A1 · Schanz et al. · 2004 [cited by applicant]
US 20050018200A1 · Guillermo et al. · 2005 [cited by applicant]
US 20060044546A1 · Lewin et al. · 2006 [cited by applicant]
US 20060176469A1 · O'Connor et al. · 2006 [cited by applicant]
US 20070164004A1 · Matsuda et al. · 2007 [cited by applicant]
US 20080231498A1 · Menzer et al. · 2008 [cited by applicant]
US 20100309288A1 · Stettner et al. · 2010 [cited by applicant]
US 20110279366A1 · Lohbihler · 2011 [cited by applicant]
US 20120154542A1 · Katz et al. · 2012 [cited by applicant]
US 20140071433A1 · Eisele et al. · 2014 [cited by applicant]
US 20140162714A1 · Kim et al. · 2014 [cited by applicant]
US 20150204978A1 · Hammes et al. · 2015 [cited by applicant]
US 20150373322A1 · Goma et al. · 2015 [cited by applicant]
US 20160182101A1 · Marcovic et al. · 2016 [cited by applicant]
US 20170006278A1 · Vandame et al. · 2017 [cited by applicant]
US 20170068393A1 · Viswanathan et al. · 2017 [cited by applicant]
US 20170139041A1 · Drader · 2017 [cited by examiner]
US 20180081030A1 · McMahon et al. · 2018 [cited by applicant]
US 20180081061A1 · Mandai et al. · 2018 [cited by applicant]
US 20200249324A1 · Steinberg et al. · 2020 [cited by applicant]
US 20200386890A1 · Oggier · 2020 [cited by examiner]
US 20210165083A1 · Fine · 2021 [cited by examiner]
US 20220146647A1 · Sakazume · 2022 [cited by applicant]
US 20220350026A1 · Laifenfeld · 2022 [cited by examiner]
US 20230333217A1 · Fine · 2023 [cited by examiner]
CA 2605339C · 1994 [cited by applicant]
CN 201054040Y · 2008 [cited by applicant]
CN 101401107A · 2009 [cited by applicant]
CN 103983979A · 2014 [cited by applicant]
CN 104730535A · 2015 [cited by applicant]
CN 110235024A · 2019 [cited by examiner]
CN 110869804A · 2020 [cited by examiner]
DE 102015013710A1 · 2017 [cited by applicant]
EP 3285087A1 · 2018 [cited by examiner]
EP 3370080A1 · 2018 [cited by applicant]
EP 4050369A1 · 2022 [cited by examiner]
GB 2492848A · 2013 [cited by examiner]
JP 2011237215A · 2011 [cited by applicant]
JP 2020197457A · 2020 [cited by applicant]
JP 7383558B2 · 2023 [cited by applicant]
TW 202343020A · 2023 [cited by applicant]
WO 2007144565A2 · 2007 [cited by applicant]
WO 2011041040A1 · 2011 [cited by applicant]
WO 2012154356A1 · 2012 [cited by applicant]
WO 2014066178A1 · 2014 [cited by applicant]
WO 2016034408A1 · 2016 [cited by applicant]
WO 2017106875A1 · 2017 [cited by applicant]
WO WO2021113001A1 · 2021 [cited by examiner]
WO WO2022035549A1 · 2022 [cited by examiner]
WO 2022244322A1 · 2022 [cited by applicant]
U.S. Appl. No. 17/079,548 Office Action dated Mar. 3, 2023. [cited by applicant]
CN Application # 201780097602.5 Office Action dated Mar. 15, 2023. [cited by applicant]
CN Application # 202010063812.6 Office Action dated Mar. 18, 2023. [cited by applicant]
KR Application # 1020217025136 Office Action dated Apr. 4, 2023. [cited by applicant]
U.S. Appl. No. 17/026,365 Office Action dated Jan. 26, 2023. [cited by applicant]
CN Application # 201980090098.5 Office Action dated Dec. 4, 2023. [cited by applicant]
IN Application # 202117028974 Summons to Hearing dated Dec. 8, 2023. [cited by applicant]
CN Application # 202010521767.4 Office Action dated Dec. 8, 2023. [cited by applicant]
CN Application # 201980090030.7 Office Action dated Jan. 5, 2024. [cited by applicant]
Zhu et al., “Measurement Method for Real-Time Transmission of Optical Signal Based on Single Photon Detection,” Chinese Journal of Lasers, vol. 43, No. 2, pp. 1-6, year 2016. [cited by applicant]
Yang, “The Study of Phase-Demodulation Range-Finding Techniques Based o SPAD,” Chinese Master's Thesis Full-text Database, Engineering Science and Technology, Xiangtan University, pp. 1-63, May 2016. [cited by applicant]
Zhang, “Structured Light Based Fast and High Accuracy Depth Sensing,” China Doctoral Dissertations Full-text Database, Information Science and Technology, University of Science and Technology of China, pp. 1-110, Apr. 2… [cited by applicant]
Ionescu et al., “A 3D NIR Camera for Gesture Control of Video Game Consoles,” Conference Paper, 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Appli… [cited by applicant]
U.S. Appl. No. 16/769,346 Office Action dated Aug. 3, 2023. [cited by applicant]
CN Application # 202010063812.6 Office Action dated Aug. 1, 2023. [cited by applicant]
U.S. Appl. No. 16/679,360 Office Action dated Jun. 29, 2022. [cited by applicant]
EP Application # 22167103.5 Search Report dated Jul. 11, 2022. [cited by applicant]
CN Application # 201780058088.4 Office Action dated Aug. 23, 2022. [cited by applicant]
U.S. Appl. No. 16/885,316 Office Action dated Jun. 30, 2022. [cited by applicant]
U.S. Appl. No. 16/532,513 Office Action dated Aug. 4, 2022. [cited by applicant]
CN Application # 201810571820.4 Office Action dated Sep. 9, 2022. [cited by applicant]
KR Application # 1020220101419 Office Action dated Sep. 28, 2022. [cited by applicant]
U.S. Appl. No. 17/026,365 Office Action dated Nov. 7, 2022. [cited by applicant]
U.S. Appl. No. 16/532,513 Office Action dated Nov. 23, 2022. [cited by applicant]
U.S. Appl. No. 17/189,300 Office Action dated Jun. 4, 2024. [cited by applicant]