IP Library Granted Patent US 12,222,420
Granted Patent B2
US 12,222,420 · App. 18/192,349 · Granted Feb 11, 2025

Performance of a time of flight (ToF) laser range finding system using acoustic-based direction of arrival (DoA)

Inventors: Peter Shintani (San Diego, CA); Morio Usami (Fuchu, JP); Keith Resch (San Diego, CA)
Assignees: Sony Group Corporation; Sony Interactive Entertainment Inc.
G01S15/86G01S3/8006G01S7/521G01S15/42G01S15/876G01S2015/465
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,222,420
App. No.
18/192,349
Granted
Feb 11, 2025
Kind
B2
Abstract

An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.

Claims (31)

1. A device comprising:

at least one computer medium that is not a transitory signal and that comprises instructions executable by at least one processor to:

receive at least a first acoustic signal from a source of sound, the first acoustic signal comprising a sonic code generated by the source of sound identifying the source of sound;

determine at least an azimuthal direction to the source of sound from an origin based at least in part on the first acoustic signal; and

transmit at least a first range-finding beam based on the azimuthal direction determined based at least in part on the first acoustic signal.

2. The device of claim 1 , comprising the at least one processor.

3. The device of claim 2 , comprising at least one camera providing signals to the at least one processor representative of reflections of the first range-finding beam.

4. The device of claim 2 , comprising two and only two microphones providing signals to the at least one processor representative of the first acoustic signal.

5. The device of claim 2 , comprising at least one directional microphone providing signals to the at least one processor representative of the first acoustic signal.

6. The device of claim 1 , comprising at least two microphones on respective devices separate from each other and communicating with each other for providing signals to the at least one processor representative of the first acoustic signal.

7. The device of claim 1 , wherein the instructions are executable to determine at least an elevational direction to the source of sound from the origin based at least in part on the first acoustic signal.

8. The device of claim 1 , wherein the first range-finding beam comprises a laser range-finding beam, and the instructions are executable to determine a range to the object based on a time of transmission of the first laser range-finding beam and a time of reception of a reflection of the first laser range-finding beam.

9. The device of claim 1 , wherein the sonic code uniquely identifies the source of sound.

10. The device of claim 1 , wherein the source of sound comprises a mobile robot.

11. The device of claim 1 , comprising a robot configured for transmitting the first range-finding beam.

12. A method comprising:

determining at least an azimuthal direction to an object based on sound emitted by the object according to programming;

responsive to detecting the sound at a detecting device, energizing at least one laser apparatus of the detecting device; and

transmitting laser range-finding beams from the laser apparatus according to the determining of at least the azimuthal direction to the object.

13. The method of claim 12 , comprising determining at least an elevational direction to the object based on the sound received from the object.

14. The method of claim 12 , wherein the sound is ultrasonic.

15. The method of claim 12 , comprising moving a mount of a laser configured for transmitting laser range-finding beams to aim the laser in the azimuthal direction to the object as determined based on sound received from the object.

16. The method of claim 12 , wherein a laser configured for transmitting the laser range-finding beams is mounted on a robot, and the method comprises moving the robot to aim the laser in the azimuthal direction to the object as determined based on sound received from the object.

17. A device comprising:

at least one processor configured to:

receive at least a first acoustic signal from a source of sound, the first acoustic signal comprising information identifying the source of sound;

determine at least an azimuthal direction to the source of sound from an origin based at least in part on the first acoustic signal; and

transmit at least a first range-finding beam based on the azimuthal direction determined based at least in part on the first acoustic signal, wherein the information identifying the source of sound comprises a time of emission of the first acoustic signal being according to a schedule.

18. The device of claim 17 , comprising at least one camera providing signals to the at least one processor representative of reflections of the first range-finding beam.

19. The device of claim 17 , comprising at least two microphones on respective devices separate from each other and communicating with each other for providing signals to the at least one processor representative of the first acoustic signal.

20. The device of claim 17 , comprising at least one directional microphone providing signals to the at least one processor representative of the first acoustic signal.

Assignments (1)
CHANGE OF NAME Recorded May 17, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063693/0164 →
Continuity (2)
Continuation 15672456 · Aug 9, 2017
Related Publication 20230236318A1 · Jul 27, 2023
References Cited (10)
US 8706420B2 · Oppert · 2014 [cited by examiner]
US 8892413B2 · Routh · 2014 [cited by examiner]
US 9753119B1 · Velusamy · 2017 [cited by examiner]
US 20040114772A1 · Zlotnick · 2004 [cited by examiner]
US 20070076901A1 · Fischer · 2007 [cited by examiner]
US 20080192228A1 · Eaton · 2008 [cited by examiner]
US 20100270026A1 · Lazaratos · 2010 [cited by examiner]
US 20170150254A1 · Bakish · 2017 [cited by examiner]
US 20170282374A1 · Matula · 2017 [cited by examiner]
JP 2015109501A · 2015 [cited by examiner]