IP Library Granted Patent US 10,382,881
Granted Patent B2
US 10,382,881 · App. 16/158,210 · Granted Aug 13, 2019

Audio system and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,382,881
App. No.
16/158,210
Granted
Aug 13, 2019
Kind
B2
Abstract

Embodiments relate to, for a scene comprising a representation of at least one object and at least one sound source: obtaining a decomposition of the at least one object, the decomposition comprising at least one geometric component; modelling at least one interaction of the at least one object and the at least one sound source using the at least one geometric component; and, in dependence on the modelling of the at least one interaction, processing an audio input associated with the at least one sound source to obtain an audio output.

Claims (54)

1. A method comprising:

obtaining a decomposition of an object in a scene, the decomposed object comprising one or more geometric components;

modelling, using the geometric components, a reflection effect of the object on a sound source in the scene by determining a reflection coefficient for the sound source, the reflection coefficient representing a degree of reflection of the sound source against the object; and

processing, based on the modelling of the reflection effect, an audio input associated with the sound source to obtain an audio output.

2. The method of claim 1 , wherein obtaining the decomposition of the object comprises performing a convex hull decomposition on the object, and wherein the one or more geometric components comprise at least one convex hull.

3. The method of claim 1 , wherein modelling the reflection effect further comprises:

determining that one of the geometric components is positioned within a radial threshold distance from the listener position.

4. The method of claim 1 , wherein modelling the reflection effect further comprises:

determining that a reflecting face of a geometric component of the one or more geometric components is facing the listener position; and

determining that the reflecting face facing the listener position is also facing the sound source such that the reflecting face reflects the sound source to the listener position.

5. The method of claim 4 , wherein modelling the reflection effect further comprises:

determining two or fewer additional reflecting faces of the one or more geometric components is facing the listener position; and

determining that the two or fewer additional reflecting faces facing the listener position are also facing the sound source such that the additional reflecting faces reflect the sound source to the listener position.

6. The method of claim 4 , further comprising:

modelling, using the geometric components, a reflection effect of the object on the sound source in the scene, wherein modelling the reflection effect comprises:

determining a reflected ray from the sound source to the listener position via the reflecting face of the geometric component determined to face both the sound source and listener position, and

determining a reflection coefficient for the sound source, the reflection coefficient representing a reflection level associated with the reflection face of the geometric component.

7. The method of claim 6 , further comprising:

determining that the reflected ray is an occluded ray, an occluded ray having one or more occluding objects between the sound source and the listener position along the occluded ray; and

ignoring the reflection effect for the occluded ray when processing the audio input to obtain an audio output.

8. The method of claim 6 , wherein modelling the reflection effected comprises:

generating a reflecting plane, the reflecting plane an infinite plane coplanar with the reflecting face; and

creating an image sound source at an image location, the image location the location of the sound source reflected across the reflecting face.

9. The method of claim 8 , wherein modelling the reflection effect comprises:

calculating a reflection coordinate, the reflection coordinate located at an intersection between the reflecting plane and a line connecting the image location and the location of the sound source; and

determining the reflection coefficient at the reflection coordinate on the reflection face.

10. The method of claim 6 , wherein processing the audio input comprises applying a time delay to the audio input, the time delay determined based on a length of the reflected ray.

11. A non-transitory computer-readable storage medium storing computer program instructions executable by a processor to perform operations comprising:

obtaining a decomposition of an object in a scene, the decomposed object comprising one or more geometric components;

modelling, using the geometric components, a reflection effect of the object on a sound source in the scene by determining a reflection coefficient for the sound source, the reflection coefficient representing a degree of reflection of the sound source against the object and towards a listener position; and

processing, based on the modelling of the reflection effect, an audio input associated with the sound source to obtain an audio output.

12. The non-transitory computer-readable storage medium of claim 11 , wherein obtaining the decomposition of the object comprises performing a convex hull decomposition on the object, and wherein the one or more geometric components comprise at least one convex hull.

13. The non-transitory computer-readable storage medium of claim 11 , wherein modelling the reflection effect further comprises:

determining that one of the geometric components is positioned within a radial threshold distance from the listener position.

14. The non-transitory computer-readable storage medium of claim 11 , wherein modelling the reflection effect further comprises:

determining that a reflecting face of a geometric component of the one or more geometric components is facing the listener position; and

determining that the reflecting face facing the listener position is also facing the sound source such that the reflecting face reflects the sound source to the listener position.

15. The non-transitory computer-readable storage medium of claim 14 , wherein modelling the reflection effect further comprises:

determining two or fewer additional reflecting faces of the one or more geometric components is facing the listener position; and

determining that the two or fewer additional reflecting faces facing the listener position are also facing the sound source such that the additional reflecting faces reflect the sound source to the listener position.

16. The non-transitory computer-readable storage medium of claim 14 , further comprising:

modelling, using the geometric components, a reflection effect of the object on the sound source in the scene, wherein modelling the reflection effect comprises:

determining a reflected ray from the sound source to the listener position via the reflecting face of the geometric component determined to face both the sound source and listener position, and

determining a reflection coefficient for the sound source, the reflection coefficient representing a reflection level associated with the reflection face of the geometric component.

17. The non-transitory computer-readable storage medium of claim 16 , further comprising:

determining that the reflected ray is an occluded ray, an occluded ray having one or more occluding objects between the sound source and the listener position along the occluded ray; and

ignoring the reflection effect for the occluded ray when processing the audio input to obtain an audio output.

18. The non-transitory computer-readable storage medium of claim 16 , wherein modelling the reflection effected comprises:

generating a reflecting plane, the reflecting plane an infinite plane coplanar with the reflecting face; and

creating an image sound source at an image location, the image location the location of the sound source reflected across the reflecting face.

19. The non-transitory computer-readable storage medium of claim 18 , wherein modelling the reflection effect comprises:

calculating a reflection coordinate, the reflection coordinate located at an intersection between the reflecting plane and a line connecting the image location and the location of the sound source; and

determining the reflection coefficient at the reflection coordinate on the reflection face.

20. The non-transitory computer-readable storage medium of claim 16 , wherein processing the audio input comprises applying a time delay to the audio input, the time delay determined based on a length of the reflected ray.

Assignments (1)
CHANGE OF NAME Recorded Nov 18, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058897/0824 →