IP Library Granted Patent US 11,205,435
Granted Patent B2
US 11,205,435 · App. 16/543,343 · Granted Dec 21, 2021

Spatial audio signal encoder

Inventor: Michael M. Goodwin (Scotts Valley, CA)
Assignee: DTS, Inc.
G10L19/00H03M7/6005H03M7/6011H04R5/027H04R5/04G10L2019/0001H04R2430/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,205,435
App. No.
16/543,343
Granted
Dec 21, 2021
Kind
B2
Abstract

A method to encode audio signals is provided for use with an audio capture device that includes multiple microphones having a spatial arrangement on the device, a method to encode audio signals comprising: receiving multiple microphone signals corresponding to the multiple microphones; determining a number and directions of arrival of directional audio sources represented in the one or more microphone signals; determining one of an active microphone signal component and a passive microphone signal component, based upon the determined number and directions of arrival; determining the other of the active microphone signal component and the passive microphone signal component, based upon the determined one of the active input spatial audio signal component and the passive input spatial audio signal component; encoding the active microphone signal component; encoding the passive microphone signal component.

Claims (57)

1. For use with an audio capture device that includes multiple microphones on the audio capture device, an audio signal encoder comprising:

a processor and a non-transitory computer readable medium operably coupled thereto, the non-transitory computer readable medium comprising a plurality of instructions stored in association therewith that are accessible to, and executable by, the processor, where the plurality of instructions comprises:

instructions that, when executed, determine a number and direction of arrival of directional audio sources represented in one or more microphone signals having a microphone spatial format;

instructions that when executed, determine one of an active microphone signal component and a passive microphone signal component, based upon the number and direction of arrival of directional audio sources represented in the one or more microphone signals having the microphone spatial format;

instructions that when executed, determine the other of the active microphone signal component and the passive microphone signal component;

instructions that when executed, encode the active microphone signal component, to a first output signal having a first spatial output format;

instructions that when executed, encode the passive microphone signal component, to a second output signal having a second spatial output format.

2. The audio signal encoder of claim 1 , wherein the first spatial output format is different from the second spatial output format.

3. The audio signal encoder of claim 1 , wherein the first spatial output format matches the second spatial output format.

4. The audio signal encoder of claim 1 , wherein the microphone spatial format corresponds to a spatial arrangement of the multiple microphones relative to a reference microphone at the audio capture device.

5. The audio signal encoder of claim 1 , wherein the instructions that, when executed to determine the number and direction of arrival of directional audio sources, determine a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the one or more microphone signals.

6. The audio signal encoder of claim 1 ,

wherein the instructions that, when executed to determine the number and direction of arrival of directional audio sources, determine a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the one or more microphone signals, based upon an optimality metric computed for direction vectors within the codebook.

7. The audio signal encoder of claim 6 , wherein the optimality metric includes one or more correlations between direction vectors within the codebook and one or more eigenvectors of a noise subspace of the one or more microphone signals.

8. The audio signal encoder of claim 6 , wherein the optimality metric includes a correlation between direction vectors within the codebook and the one or more microphone signals.

9. The audio signal encoder of claim 1 ,

wherein the instructions that, when executed to determine the number and direction of arrival of directional audio sources, determine a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the one or more microphone signals; and

wherein the instructions that, when executed to determine one of the active microphone signal component and the passive microphone signal component, determine based upon a mapping of the microphone signals onto the subspace of the codebook corresponding to the one or more direction vectors of the codebook.

10. The audio signal encoder of claim 1 ,

wherein the instructions that when executed to determine one of the active microphone signal component and the passive microphone signal component, determine the active microphone signal component.

11. The audio signal encoder of claim 1 further including:

instructions that, when executed, convert the one or more microphone signals from a time-domain representation to a time-frequency representation; and

instructions that, when executed, convert the first output signal having the first spatial output format and the second output signal having the second spatial output format from the time-frequency representation to the time-domain representation.

12. The audio signal encoder of claim 1 further including:

instructions that, when executed, combine the first output signal having the first spatial output format and the second output signal having the second spatial output format.

13. The audio signal encoder of claim 1 ,

wherein at least one of the first spatial output format and the second spatial output format includes an ambisonic format.

14. For use with an audio capture device that includes multiple microphones on the audio capture device, a method to encode audio signals comprising:

receiving multiple microphone signals corresponding to the multiple microphones;

determining a number and direction of arrival of directional audio sources represented in the multiple microphone signals having a microphone spatial format;

determining one of an active microphone signal component and a passive microphone signal component, based upon the number and direction of arrival of directional audio sources represented in the multiple microphone signals having the microphone spatial format;

determining the other of the active microphone signal component and the passive microphone signal component;

encoding the active microphone signal component, to a first output signal having a first spatial output format;

encoding the passive microphone signal component, to a second output signal having a second spatial output format.

15. The method of claim 14 ,

wherein the first spatial output format is different from the second spatial output format.

16. The method of claim 14 ,

wherein the first spatial output format matches the second spatial output format.

17. The method of claim 14 , wherein the microphone spatial format corresponds to a spatial arrangement of the multiple microphones relative to a reference microphone at the audio capture device.

18. The method of claim 14 , wherein determining the number and direction of arrival of directional audio sources includes determining a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the multiple microphone signals.

19. The method of claim 14 , wherein determining the number and direction of arrival of directional audio sources includes determining a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the multiple microphone signals, based upon an optimality metric computed for direction vectors within the codebook.

20. The method of claim 19 ,

wherein the optimality metric includes one or more correlations between direction vectors within the codebook and one or more eigenvectors of a noise subspace of the multiple microphone signals.

21. The method of claim 19 ,

wherein the optimality metric includes a correlation between direction vectors within the codebook and the multiple microphone signals.

22. The method of claim 14 ,

wherein determining the number and direction of arrival of directional audio sources includes determining a subspace of a codebook corresponding to one or more direction vectors of the codebook to represent the multiple microphone signals; and

wherein determining one of the active microphone signal component and the passive microphone signal component includes determining based upon a mapping of the multiple microphone signals onto the determined subspace of the codebook corresponding to the one or more direction vectors of the codebook.

23. The method of claim 14 ,

wherein determining one of the active microphone signal component and the passive microphone signal component includes determining the active microphone signal component.

24. The method of claim 14 further including:

converting the multiple microphone signals from a time-domain representation to a time-frequency representation; and

converting the first output signal having the first spatial output format and the second output signal having the second spatial output format from the time-frequency representation to the time-domain representation.

25. The method of claim 14 further including:

combining the first output signal having the first spatial output format and the second output signal having the second spatial output format.

26. The method of claim 14 ,

wherein at least one of the first spatial output format and the second spatial output format includes an ambisonic format.

Assignments (3)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: VEVEO LLC (F.K.A. VEVEO, INC.); DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 061786/0675 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2019
From: GOODWIN, MICHAEL M.
To: DTS, INC.
Reel/Frame 050181/0266 →
Cited By (1)
US 12,574,700