IP Library Granted Patent US 12,167,224
Granted Patent B2
US 12,167,224 · App. 17/849,148 · Granted Dec 10, 2024

Systems and methods for dynamic spatial separation of sound objects

Inventor: Warren Keith Edwards (Atlanta, GA)
Assignee: Adeia Guides Inc.
H04S7/303H04S3/008H04S2400/01H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,167,224
App. No.
17/849,148
Granted
Dec 10, 2024
Kind
B2
Abstract

Sound objects are identified within a content item and location metadata is extracted from the content item for each sound object. A reference layout is generated, relative to a user position, for the sound objects based on the location metadata. If a first sound object is within a threshold angle, relative to the user position, from a second sound object, a virtual position of either the first sound object or the second sound object is adjusted by an adjustment angle.

Claims (84)

1. A method for dynamic spatial separation of sound sources in a content item, the method comprising:

identifying, in the content item, a plurality of sound objects;

extracting location metadata for each sound object of the plurality of sound objects;

generating a reference layout, relative to a user position, for the plurality of sound objects based on the location metadata;

determining, based on the reference layout, that a first sound object is within a threshold angle, relative to the user position, of a second sound object; and

in response to determining that the first sound object is within the threshold angle of the second sound object, adjusting a virtual position of either the first sound object or the second sound object by an adjustment angle, relative to the user position.

2. The method of claim 1 , further comprising:

detecting that the virtual position of the sound object has been adjusted; and

in response to detecting that the virtual position of the sound object has been adjusted:

decreasing the threshold angle; and

decreasing the adjustment angle.

3. The method of claim 2 , further comprising:

determining, after adjusting the virtual position of either the first sound object or the second sound object, that a third sound object is within the decreased threshold angle, relative to the user position, of either the first sound object or the second sound object; and

in response to determining, after adjusting the virtual position of either the first sound object or the second sound object, that a third sound object is within the decreased threshold angle, relative to the user position, of either the first sound object or the second sound object, adjusting a virtual position of the third sound object by the decreased adjustment angle, relative to the user position.

4. The method of claim 1 , further comprising detecting a gaze of the user.

5. The method of claim 4 , further comprising:

identifying a subset of the plurality of sound objects, wherein each sound object of the subset of sound objects is located along a path defined by the gaze of the user; and

wherein the first sound object and the second sound object are members of the subset.

6. The method of claim 4 , further comprising:

detecting a second gaze of the user;

determining that a difference between the gaze of the user and the second gaze of the user is greater than a threshold difference; and

in response to determining that the difference is greater than a threshold difference:

identifying a sound object along a path defined by the second gaze of the user; and

enhancing audio of the sound object.

7. The method of claim 1 , further comprising:

scaling the threshold angle based on the distance between the user and a sound object.

8. The method of claim 1 , further comprising:

analyzing respective audio of each sound object; and

determining, based on the analyzing, that the first sound object contains a voice.

9. The method of claim 8 , wherein adjusting the virtual position of either the first sound object or the second sound object by an adjustment angle further comprises adjusting the virtual position of the second sound object by the adjustment angle.

10. The method of claim 1 , further comprising:

determining whether the first sound object is within a minimum angle, relative to the user position, of a third sound object; and

determining whether the second sound object is within the minimum angle, relative to the user position, of the third sound object.

11. The method of claim 10 , wherein adjusting the virtual position of either the first sound object or the second sound object by the adjustment angle further comprises:

in response to determining that the first sound object is within the minimum angle, relative to the user position, of the third sound object, and that the second sound object is not within the minimum angle, relative to the user position, of the third sound object, adjusting the virtual position of the first sound object.

12. The method of claim 10 , wherein adjusting the virtual position of either the first sound object or the second sound object by the adjustment angle further comprises:

in response to determining that the first sound object is not within the minimum angle, relative to the user position, of the third sound object, and that the second sound object is within the minimum angle, relative to the user position, of the third sound object, adjusting the virtual position of the second sound object.

13. The method of claim 10 , wherein adjusting the virtual position of either the first sound object or the second sound object by the adjustment angle further comprises:

in response to determining that both the first sound object and the second sound object are within the minimum angle, relative to the user position, of the third sound object:

adjusting a virtual position of the first sound object by an adjustment angle, relative to the user position, in a first direction that increases a distance between the first sound object and both the third sound object and the second sound object; and

adjusting a virtual position of the second sound object by an adjustment angle, relative to the user position, in a second direction that increases a distance between the second sound object and both the third sound object and the first sound object.

14. A system for dynamic spatial separation of sound sources in a content item, the system comprising:

input/output circuitry configured to receive the content item; and

control circuitry configured to:

identify, in the content item, a plurality of sound objects;

extract location metadata for each sound object of the plurality of sound objects;

generate a reference layout, relative to a user position, for the plurality of sound objects based on the location metadata;

determine, based on the reference layout, that a first sound object is within a threshold angle, relative to the user position, of a second sound object; and

in response to determining that the first sound object is within the threshold angle of the second sound object, adjust a virtual position of either the first sound object or the second sound object by an adjustment angle, relative to the user position.

15. The system of claim 14 , wherein the control circuitry is further configured to:

detect that the virtual position of the sound object has been adjusted; and

in response to detecting that the virtual position of the sound object has been adjusted:

decrease the threshold angle; and

decrease the adjustment angle.

16. The system of claim 15 , wherein the control circuitry is further configured to:

determine, after adjusting the virtual position of either the first sound object or the second sound object, that a third sound object is within the decreased threshold angle, relative to the user position, of either the first sound object or the second sound object; and

in response to determining, after adjusting the virtual position of either the first sound object or the second sound object, that a third sound object is within the decreased threshold angle, relative to the user position, of either the first sound object or the second sound object, adjust a virtual position of the third sound object by the decreased adjustment angle, relative to the user position.

17. The system of claim 14 , wherein the control circuitry is further configured to detect a gaze of the user.

18. The system of claim 17 , wherein the control circuitry is further configured to:

identify a subset of the plurality of sound objects, wherein each sound object of the subset of sound objects is located along a path defined by the gaze of the user; and

wherein the first sound object and the second sound object are members of the subset.

19. The system of claim 17 , wherein the control circuitry is further configured to:

detect a second gaze of the user;

determine that a difference between the gaze of the user and the second gaze of the user is greater than a threshold difference; and

in response to determining that the difference is greater than a threshold difference:

identify a sound object along a path defined by the second gaze of the user; and

enhance audio of the sound object.

20. The system of claim 14 , wherein the control circuitry is further configured to:

scale the threshold angle based on the distance between the user and a sound object.

21. The system of claim 14 , wherein the control circuitry is further configured to:

analyze respective audio of each sound object; and

determine, based on the analyzing, that the first sound object contains a voice.

22. The system of claim 21 , wherein the control circuitry configured to adjust the virtual position of either the first sound object or the second sound object by an adjustment angle is further configured to adjust the virtual position of the second sound object by the adjustment angle.

23. The system of claim 14 , wherein the control circuitry is further configured to:

determine whether the first sound object is within a minimum angle, relative to the user position, of a third sound object; and

determine whether the second sound object is within the minimum angle, relative to the user position, of the third sound object.

24. The system of claim 23 , wherein the control circuitry configured to adjust the virtual position of either the first sound object or the second sound object by the adjustment angle is further configured to:

in response to determining that the first sound object is within the minimum angle, relative to the user position, of the third sound object, and that the second sound object is not within the minimum angle, relative to the user position, of the third sound object, adjust the virtual position of the first sound object.

25. The system of claim 23 , wherein the control circuitry configured to adjust the virtual position of either the first sound object or the second sound object by the adjustment angle is further configured to:

in response to determining that the first sound object is not within the minimum angle, relative to the user position, of the third sound object, and that the second sound object is within the minimum angle, relative to the user position, of the third sound object, adjust the virtual position of the second sound object.

26. The system of claim 23 , wherein the control circuitry configured to adjust the virtual position of either the first sound object or the second sound object by the adjustment angle is further configured to:

in response to determining that both the first sound object and the second sound object are within the minimum angle, relative to the user position, of the third sound object:

adjust a virtual position of the first sound object by an adjustment angle, relative to the user position, in a first direction that increases a distance between the first sound object and both the third sound object and the second sound object; and

adjust a virtual position of the second sound object by an adjustment angle, relative to the user position, in a second direction that increases a distance between the second sound object and both the third sound object and the first sound object.

Assignments (4)
CHANGE OF NAME Recorded Sep 25, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069049/0212 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: EDWARDS, WARREN KEITH
To: ROVI GUIDES, INC.
Reel/Frame 060994/0318 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: EDWARDS, KEITH
To: ROVI GUIDES, INC.
Reel/Frame 060317/0735 →