IP Library Granted Patent US 11,350,232
Granted Patent B1
US 11,350,232 · App. 16/818,681 · Granted May 31, 2022

Systems and methods for determining room impulse responses

Inventors: Philip Robinson (Seattle, WA); Paul Thomas Calamia (Redmond, WA)
Assignee: FACEBOOK TECHNOLOGIES, LLC
H04S7/301H04R1/406H04R3/005H04R5/027H04S2400/11H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,350,232
App. No.
16/818,681
Granted
May 31, 2022
Kind
B1
Abstract

A system for determining a room impulse response of an environment is disclosed. The system includes one or more microphones configured to detect acoustic energy in an area, an input/output interface configured to connect to a network, and one or more processors coupled to a non-transitory computer-readable storage medium. The system is configured to identify a sound detected by the one or more microphones, retrieve a copy of the sound via the network, and determine a room impulse response of the area based on the sound and the copy of the sound.

Claims (36)

1. A system comprising:

one or more microphones configured to detect acoustic energy in an area;

an input/output interface configured to connect to a network; and

one or more processors coupled to a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to:

identify a sound from a received signal detected by the one or more microphones;

retrieve a copy of the sound via the network; and

determine a room impulse response between a source of the sound and the system based on the sound and the copy of the sound.

2. The system of claim 1 , further comprising a memory coupled to the one or more processors configured to store one or more room impulse responses for multiple areas.

3. The system of claim 2 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to store the room impulse response within the memory.

4. The system of claim 1 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to determine a second room impulse response using the room impulse response based on a virtual sound-source position.

5. The system of claim 4 , further comprising one or more speakers coupled to the one or more processors and configured to emit acoustical sounds.

6. The system of claim 5 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to cause the one or more speakers to emit acoustical sounds at the virtual sound source position using the second room impulse response.

7. The system of claim 1 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to estimate a direction from which the sound was received by the one or microphones.

8. A device comprising:

one or more microphones configured to detect acoustic energy in a room in which the device is located;

an input/output interface configured to connect to a network; and

one or more processors coupled to a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to:

identify a sound from a received signal based on acoustic energy sensed by the one or more microphones;

retrieve a copy of the sound via the network; and

determine a room impulse response between the sound source and the device.

9. The device of claim 8 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to localize the source that emitted the sound relative to the one or more microphones, and wherein the room impulse response between the sound source and the device is further based on the localized sound source.

10. The device of claim 8 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to transmit the room impulse response and information indicative of the room to a server in the network to store the room impulse response.

11. The device of claim 8 , further comprising two or more speakers coupled to the one or more processors.

12. The device of claim 11 , the non-transitory computer-readable storage medium having further instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to cause the two or more speakers to output a virtual sound at a virtual sound point using the room impulse response and a virtual sound signal received via the network.

13. The device of claim 8 , wherein the sound is ambient music within the room, and wherein the copy of the sound is an electronic recording of the ambient music stored within a database.

14. The device of claim 13 , wherein to determine the room impulse response, the non-transitory computer-readable storage medium includes instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to deconvolve the copy of the sound from the sound.

15. The device of claim 8 , further comprising one or more cameras coupled to the one or more processors, and wherein the non-transitory computer-readable storage medium includes instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to identify a position of a speaker within the room that emitted the sound, and wherein the room impulse response is further based on the position of the speaker relative to the device.

16. A method of generating a room impulse response comprising:

detecting, via one or more microphones of a device, acoustical energy in a room;

identifying, via one or more processors of the device, from the acoustical energy a known sound;

retrieving, via the one or more processors of the device, a copy of the known sound via a network; and

determining, via the one or more processors of the device, a room impulse response between a source of the sound and the device based on the known sound and the copy of the known sound.

17. The method of claim 16 , wherein determining the room impulse response comprises de-convolving the copy of the sound from the known sound.

18. The method of claim 16 , further comprising generating a virtual sound, via two or more speakers, at a virtual sound point using the room impulse response and a sound signal received at the one or more processors.

19. The method of claim 16 , further comprising localizing the source of the sound within the room.

20. The method of claim 19 , wherein localizing the sound within the room comprises determining, via the one or more processors, a direction in which the sound was received by the one or more microphones.

Assignments (2)
CHANGE OF NAME Recorded Jul 22, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060816/0634 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2020
From: ROBINSON, PHILIP; CALAMIA, PAUL THOMAS
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 053646/0124 →
Cited By (1)
US 12,598,442