IP Library Granted Patent US 10,979,844
Granted Patent B2
US 10,979,844 · App. 15/844,096 · Granted Apr 13, 2021

Distributed audio virtualization systems

Inventors: Daekyoung Noh (Huntington Beach, CA); Jean-Marc Jot (Aptos, CA); Twafik Mohamed (Bangor, GB)
Assignee: DTS, Inc.
H04S7/304H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,979,844
App. No.
15/844,096
Granted
Apr 13, 2021
Kind
B2
Abstract

An audio signal processing system can be configured to provide virtualized audio information in a three-dimensional soundfield using at least a pair of loudspeakers or headphones. The system can include an audio input configured to receive audio program information that includes at least N discrete audio signals, a first virtualization processor circuit configured to generate intermediate virtualized audio information by filtering M of the N audio signals, and a second virtualization processor circuit configured to generate further virtualized audio information by differently filtering K of the N audio signals, wherein K, M, and N are integers. The system can include an audio signal combination circuit to combine the intermediate virtualized audio information with at least one of the N audio signals, other than the M audio signals, to render fewer than N audio signals for transmission to a second virtualization processor circuit.

Claims (49)

1. A method for providing virtualized audio information, the method comprising:

receiving surround sound audio program information comprising at least N discrete audio signals wherein the N discrete audio signals are configured for reproduction using respective ones of N different loudspeakers in different surround sound loudspeaker locations relative to a listener;

generating, using a first virtualization processor circuit, intermediate virtualized audio information using a portion of the received surround sound audio program information, the generating including:

applying a first virtualization filter to M of the N audio signals to provide a first virtualization filter output, wherein the first virtualization filter is based in part on a first transfer function characteristic; and

providing the intermediate virtualized audio information using the first virtualization filter output, wherein the intermediate virtualized audio information comprises J discrete audio signals; and

transmitting the intermediate virtualized audio information to a second virtualization processor circuit, wherein the second virtualization processor circuit is configured to generate further virtualized audio information by applying a second virtualization filter to one or more of the J audio signals, wherein the second virtualization filter is based in part on the same first transfer function characteristic, and wherein the first and second virtualization filters are different filters;

wherein N, M, and J are integers; and

wherein the first transfer function characteristic includes a combination of ipsilateral and contralateral head-related transfer functions for a virtual source.

2. The method of claim 1 , further comprising rendering K output signals based on the further virtualized audio information, wherein the K output signals are configured for reproduction using headphones.

3. The method of claim 1 , further comprising rendering K output signals based on the further virtualized audio information, wherein the K output signals are configured for reproduction using a pair of loudspeakers.

4. The method of claim 1 , wherein the surround sound audio program information comprises at least one height audio signal that includes audio information configured for reproduction using at least one elevated loudspeaker, and

wherein the applying the first virtualization filter includes applying a height virtualization filter to the at least one height audio signal.

5. The method of claim 4 , further comprising generating the further virtualized audio information using the second virtualization processor circuit, including applying a virtualization filter other than a height virtualization filter to one or more of the J audio signals.

6. The method of claim 1 ,

wherein the applying the first virtualization filter includes applying a horizontal-plane virtualization filter to one or more of the audio signals from the surround sound audio program; and

wherein the applying the second virtualization filter to the one or more of the J audio signals includes applying other than a horizontal-plane virtualization filter.

7. The method of claim 1 , wherein the surround sound audio program information comprises at least left and right front audio signals that include audio information configured for reproduction using respective front left and front right loudspeakers, and

wherein the applying the first virtualization filter includes applying a horizontal-plane virtualization filter to at least the left and right front audio signals.

8. The method of claim 1 , wherein M is less than or equal to N.

9. The method of claim 8 , wherein the providing the intermediate virtualized audio information using the first virtualization filter output includes combining the first virtualization filter output with one or more of the N audio signals that are other than the M audio signals.

10. The method of claim 1 , wherein J is less than N.

11. The method of claim 1 , further comprising:

receiving, at the second virtualization processor circuit, the intermediate virtualized audio information; and

generating, using the second virtualization processor circuit, the further virtualized audio information by applying the second virtualization filter to the one or more of the J audio signals;

wherein the generating the further virtualized audio information includes rendering K output signals for playback using at least K loudspeakers, wherein K is an integer less than J.

12. The method of claim 1 , wherein the virtual source includes a virtual loudspeaker.

13. A system comprising:

means for receiving a multiple-channel audio input that includes audio signals in an immersive audio program format, wherein the audio signals in the immersive audio program format are intended for reproduction using respective different loudspeakers in different locations relative to a listener;

means for applying first virtualization processing to one or more of the audio signals in the immersive audio program format to generate an intermediate virtualized signal;

means for combining the intermediate virtualized signal with at least one other of the audio signals in the immersive audio program format to provide a partially virtualized signal; and

means for applying second virtualization processing to the partially virtualized audio signal to generate a virtualized audio output signal, wherein the first and second virtualization processing include or use at least a portion of the same transfer function filter information for a virtual source, the transfer function filter information including information about a combination of ipsilateral and contralateral head-related transfer functions.

14. The system of claim 13 , further comprising means for transmitting the partially virtualized signal from a first device to a remote second device that comprises the means for applying the second virtualization processing;

wherein the audio signals in the immersive audio program format comprise at least N discrete signals; and

wherein the means for transmitting the partially virtualized signal comprises means for transmitting fewer than N signals.

15. The system of claim 13 , wherein the means for applying the first virtualization processing comprises means for applying one of horizontal-plane virtualization and vertical-plane virtualization, and wherein the means for applying the second virtualization processing comprises means for applying the other one of horizontal-plane virtualization and vertical-plane virtualization.

16. The system of claim 13 , further comprising means for decorrelating at least two of the audio signals to provide multiple decorrelated signals, and wherein the means for applying the first virtualization processing includes means for applying the first virtualization processing to a first one of the decorrelated signals.

17. The system of claim 13 , wherein the means for receiving the input that includes audio signals in an immersive audio program format includes means for receiving N discrete audio input signals;

wherein the means for combining the intermediate virtualized signal with at least one other of the audio signals in the immersive audio program format includes means to provide multiple partially virtualized signals; and

wherein the number of partially virtualized signals is fewer than N.

18. The system of claim 13 , wherein the means for receiving the multiple-channel audio input that includes audio signals in an immersive audio program format includes means for receiving audio signals in a surround sound format.

19. An audio signal processing system configured to provide virtualized audio information in a three-dimensional soundfield using at least a pair of loudspeakers or headphones, wherein the virtualized audio information is perceived by a listener as including audible information in other than a first anatomical plane of the listener, the system comprising:

an audio input configured to receive surround sound audio program information that includes at least N discrete audio signals wherein the N discrete audio signals are configured for reproduction using respective ones of N different loudspeakers in different surround sound loudspeaker locations relative to the listener;

a first virtualization processor circuit configured to generate intermediate virtualized audio information by applying a first virtualization filter to M of the N audio signals, wherein the first virtualization filter is based in part on a first transfer function characteristic;

a second virtualization processor circuit configured to generate further virtualized audio information by applying a second virtualization filter to K of the N audio signals, wherein the second virtualization filter is based in part on the same first transfer function characteristic, and wherein the second virtualization filter is different than the first virtualization filter; and

a decorrelation circuit configured to apply a decorrelation filter to one or more of the N discrete audio signals to provide corresponding one or more decorrelated signals to the first and/or second virtualization processor circuit;

wherein K, M, and N are integers; and

wherein the first transfer function characteristic includes a combination of ipsilateral and contralateral head-related transfer functions for a virtual source.

20. The system of claim 19 , further comprising an audio signal combination circuit configured to combine the intermediate virtualized audio information with at least one of the N audio signals, other than the M audio signals, to provide partially virtualized surround sound audio program information that includes fewer than N audio signals;

wherein the second virtualization processor circuit is configured to generate the further virtualized audio information using the partially virtualized surround sound audio program information.

Assignments (3)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: VEVEO LLC (F.K.A. VEVEO, INC.); DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 061786/0675 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2017
From: NOH, DAEKYOUNG; JOT, JEAN-MARC; MOHAMED, TWAFIK
To: DTS, INC.
Reel/Frame 044411/0143 →
Continuity (2)
Provisional Application 62468677 · Mar 8, 2017
Related Publication 20180262858A1 · Sep 13, 2018