IP Library Granted Patent US 10,027,994
Granted Patent B2
US 10,027,994 · App. 15/078,945 · Granted Jul 17, 2018

Interactive audio metadata handling

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,027,994
App. No.
15/078,945
Granted
Jul 17, 2018
Kind
B2
Abstract

A method and apparatus for processing object-based audio signals for reproduction through a playback system is provided. The apparatus receives a plurality of object-based audio signals in at least one audio frame. In addition, the apparatus receives at least one audio object command associated with at least one object-based audio signal of the plurality of object-based audio signals. In addition, the apparatus processes the at least one object-based audio signal based on the received at least one audio object command. Further, the apparatus renders a set of object-based audio signals of the plurality of object-based audio signals to a set of output signals based on the at least one audio object command. The at least one audio frame may be received from one of a set top box, an OD player, or a television. The apparatus may be an AV receiver or a television.

Claims (113)

1. A method of processing object-based audio signals for reproduction through a playback system, comprising:

receiving, from an external device, a plurality of encoded object-based audio signals in at least one audio frame;

receiving, from the external device, at least one audio object command associated with at least one object-based audio signal of the plurality of encoded object-based audio signals, wherein the at least one audio object command is not encoded;

sending together, from the external device to the playback system, at least some of the plurality of encoded object-based audio signals and the at least one audio object command that is not encoded;

processing the at least one object-based audio signal based on the received at least one audio object command; and

rendering a set of object-based audio signals of the plurality of encoded object-based audio signals to a set of output signals based on the at least one audio object command.

2. The method of claim 1 , wherein the at least one audio object command is received in the at least one audio frame with the plurality of encoded object-based audio signals.

3. The method of claim 2 , wherein the at least one audio object command is appended to an end of the plurality of encoded object-based audio signals in the at least one audio frame.

4. The method of claim 1 , wherein the at least one audio object command is received separately from the at least one audio frame including the plurality of encoded object-based audio signals.

5. The method of claim 1 , wherein each object-based audio signal of the plurality of encoded object-based audio signals includes audio waveform data and object metadata associated with the audio waveform data, the processing the at least one object-based audio signal based on the received at least one audio object command comprising modifying the object metadata of the at least one object-based audio signal based on the at least one audio object command.

6. The method of claim 1 , wherein the processing the at least one object-based audio signal based on the received at least one audio object command comprises at least one of:

modifying a volume associated with the at least one object-based audio signal, removing the at least one object-based audio signal from being rendered in the set of object-based audio signals,

adding the at least one object-based audio signal to being rendered in the set of object-based audio signals,

replacing a first object-based audio signal of the at least one object-based audio signal with a second object-based audio signal of the at least one object-based audio signal when rendering the set of object-based audio signals,

modifying a spatial location of the at least one object-based audio signal, or

changing an attribute of the at least one object-based audio signal.

7. The method of claim 1 , wherein the at least one audio frame is received from one of a set top box, an optical disk player, or a television.

8. The method of claim 1 , wherein the method is performed by one of an audio video (AV) receiver or a television.

9. A method of processing object-based audio signals for reproduction through a playback system, comprising:

receiving user selection information indicating at least one audio object command associated with at least one object-based audio signal;

obtaining the at least one audio object command based on the received user selection information, wherein the at least one audio object command is not encoded;

receiving a plurality of encoded object-based audio signals; and

sending together the at least one audio object command that is not encoded with the received plurality of encoded object-based audio signals.

10. The method of claim 9 , wherein the at least one audio object command is sent in at least one audio frame with the plurality of encoded object-based audio signals.

11. The method of claim 9 , further comprising appending the at least one audio object command to an end of the plurality of encoded object-based audio signals, the at least one audio object command and the plurality of encoded object-based audio signals being sent in at least one audio frame.

12. The method of claim 9 , wherein the at least one audio object command is sent separately from at least one audio frame including the plurality of encoded object-based audio signals.

13. The method of claim 9 , wherein the obtaining the at least one audio object command based on the received user selection information comprises generating the at least one audio object command based on the received user selection information.

14. The method of claim 9 , wherein the obtaining the at least one audio object command based on the received user selection information comprises:

sending the received user selection information to a network host; and

receiving the at least one audio object command from the network host, the at least one audio object command being based on the sent user selection information.

15. The method of claim 9 , wherein the at least one audio object command and the plurality of encoded object-based audio signals are sent to one of an audio video (AV) receiver or a television.

16. The method of claim 9 , wherein the method is performed by one of a set top box, an optical disk player, or a television.

17. An apparatus for processing object-based audio signals for reproduction through a playback system, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

receive, from an external device, a plurality of encoded object-based audio signals in at least one audio frame;

receive, from the external device, at least one audio object command associated with at least one object-based audio signal of the plurality of encoded object-based audio signals, wherein the at least one audio object command is not encoded;

send together, from the external device to the playback system, at least some of the plurality of encoded object-based audio signals and the at least one audio object command that is not encoded;

process the at least one object-based audio signal based on the received at least one audio object command; and

render a set of object-based audio signals of the plurality of encoded object-based audio signals to a set of output signals based on the at least one audio object command.

18. The apparatus of claim 17 , wherein the at least one audio object command is received in the at least one audio frame with the plurality of encoded object-based audio signals.

19. The apparatus of claim 18 , wherein the at least one audio object command is appended to an end of the plurality of encoded object-based audio signals in the at least one audio frame.

20. The apparatus of claim 17 , wherein the at least one audio object command is received separately from the at least one audio frame including the plurality of encoded object-based audio signals.

21. The apparatus of claim 17 , wherein each object-based audio signal of the plurality of encoded object-based audio signals includes audio waveform data and object metadata associated with the audio waveform data, and wherein to process the at least one object-based audio signal based on the received at least one audio object command, the at least one processor is configured to modify the object metadata of the at least one object-based audio signal based on the at least one audio object command.

22. The apparatus of claim 17 , wherein to process the at least one object-based audio signal based on the received at least one audio object command, the at least one processor is configured to perform at least one of:

modify a volume associated with the at least one object-based audio signal,

remove the at least one object-based audio signal from being rendered in the set of object-based audio signals,

add the at least one object-based audio signal to being rendered in the set of object-based audio signals,

replace a first object-based audio signal of the at least one object-based audio signal with a second object-based audio signal of the at least one object-based audio signal when rendering the set of object-based audio signals,

modify a spatial location of the at least one object-based audio signal, or

change an attribute of the at least one object-based audio signal.

23. The apparatus of claim 17 , wherein the at least one audio frame is received from one of a set top box, an optical disk player, or a television.

24. The apparatus of claim 17 , wherein the apparatus is one of an audio video (AV) receiver or a television.

25. An apparatus for processing object-based audio signals for reproduction through a playback system, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

receive user selection information indicating at least one audio object command associated with at least one object-based audio signal;

obtain the at least one audio object command based on the received user selection information, wherein the at least one audio object command is not encoded;

receive a plurality of encoded object-based audio signals; and

send together the at least one audio object command that is not encoded with the received plurality of encoded object-based audio signals.

26. The apparatus of claim 25 , wherein the at least one audio object command is sent in at least one audio frame with the plurality of encoded object-based audio signals.

27. The apparatus of claim 25 , wherein the at least one processor is further configured to append the at least one audio object command to an end of the plurality of encoded object-based audio signals, the at least one audio object command and the plurality of encoded object-based audio signals being sent in at least one audio frame.

28. The apparatus of claim 25 , wherein the at least one audio object command is sent separately from at least one audio frame including the plurality of encoded object-based audio signals.

29. The apparatus of claim 25 , wherein to obtain the at least one audio object command based on the received user selection information, the at least one processor is configured to generate the at least one audio object command based on the received user selection information.

30. The apparatus of claim 25 , wherein to obtain the at least one audio object command based on the received user selection information, the at least one processor is configured to:

send the received user selection information to a network host; and

receive the at least one audio object command from the network host, the at least one audio object command being based on the sent user selection information.

31. The apparatus of claim 25 , wherein the at least one audio object command and the plurality of encoded object-based audio signals are sent to one of an audio video (AV) receiver or a television.

32. The apparatus of claim 25 , wherein the apparatus is one of a set top box, an optical disk player, or a television.

33. An apparatus for processing object-based audio signals for reproduction through a playback system, comprising:

means for receiving, from an external device, a plurality of encoded object-based audio signals in at least one audio frame;

means for receiving, from the external device, at least one audio object command associated with at least one object-based audio signal of the plurality of encoded object-based audio signals, wherein the at least one audio object command is not encoded;

means for sending together, from the external device to the playback system, at least some of the plurality of encoded object-based audio signals and the at least one audio object command that is not encoded;

means for processing the at least one object-based audio signal based on the received at least one audio object command; and

means for rendering a set of object-based audio signals of the plurality of object-based audio signals to a set of output signals based on the at least one audio object command.

34. The apparatus of claim 33 , wherein the at least one audio object command is received in the at least one audio frame with the plurality of encoded object-based audio signals.

35. The apparatus of claim 34 , wherein the at least one audio object command is appended to an end of the plurality of encoded object-based audio signals in the at least one audio frame.

36. The apparatus of claim 33 , wherein the at least one audio object command is received separately from the at least one audio frame including the plurality of encoded object-based audio signals.

37. The apparatus of claim 33 , wherein each object-based audio signal of the plurality of encoded object-based audio signals includes audio waveform data and object metadata associated with the audio waveform data, the means for processing the at least one object-based audio signal based on the received at least one audio object command being configured to modify the object metadata of the at least one object-based audio signal based on the at least one audio object command.

38. The apparatus of claim 33 , wherein the means for processing the at least one object-based audio signal based on the received at least one audio object command is configured to perform at least one of:

modify a volume associated with the at least one object-based audio signal,

remove the at least one object-based audio signal from being rendered in the set of object-based audio signals,

add the at least one object-based audio signal to being rendered in the set of object-based audio signals,

replace a first object-based audio signal of the at least one object-based audio signal with a second object-based audio signal of the at least one object-based audio signal when rendering the set of object-based audio signals,

modify a spatial location of the at least one object-based audio signal, or

change an attribute of the at least one object-based audio signal.

39. The apparatus of claim 33 , wherein the at least one audio frame is received from one of a set top box, an optical disk player, or a television.

40. The apparatus of claim 33 , wherein the apparatus is one of an audio video (AV) receiver or a television.

41. An apparatus for processing object-based audio signals for reproduction through a playback system, comprising:

means for receiving user selection information indicating at least one audio object command associated with at least one object-based audio signal;

means for obtaining the at least one audio object command based on the received user selection information, wherein the at least one audio object command is not encoded;

means for receiving a plurality of encoded object-based audio signals; and

means for sending together the at least one audio object command that is not encoded with the received plurality of encoded object-based audio signals.

42. The apparatus of claim 41 , wherein the at least one audio object command is sent in at least one audio frame with the plurality of encoded object-based audio signals.

43. The apparatus of claim 41 , further comprising means for appending the at least one audio object command to an end of the plurality of encoded object-based audio signals, the at least one audio object command and the plurality of encoded object-based audio signals being sent in at least one audio frame.

44. The apparatus of claim 41 , wherein the at least one audio object command is sent separately from at least one audio frame including the plurality of encoded object-based audio signals.

45. The apparatus of claim 41 , wherein the means for obtaining the at least one audio object command based on the received user selection information is configured to generate the at least one audio object command based on the received user selection information.

46. The apparatus of claim 41 , wherein the means for obtaining the at least one audio object command based on the received user selection information is configured to:

send the received user selection information to a network host; and

receive the at least one audio object command from the network host, the at least one audio object command being based on the sent user selection information.

47. The apparatus of claim 41 , wherein the at least one audio object command and the plurality of encoded object-based audio signals are sent to one of an audio video (AV) receiver or a television.

48. The apparatus of claim 41 , wherein the apparatus is one of a set top box, an optical disk player, or a television.

49. A non-transitory computer-readable medium storing computer executable code for processing object-based audio signals for reproduction through a playback system, the computer-readable medium comprising code to:

receive, from an external device, a plurality of encoded object-based audio signals in at least one audio frame;

receive, from the external device, at least one audio object command associated with at least one object-based audio signal of the plurality of encoded object-based audio signals, wherein the at least one audio object command is not encoded;

send together, from the external device to the playback system, at least some of the plurality of encoded object-based audio signals and the at least one audio object command that is not encoded;

process the at least one object-based audio signal based on the received at least one audio object command; and

render a set of object-based audio signals of the plurality of object-based audio signals to a set of output signals based on the at least one audio object command.

50. A non-transitory computer-readable medium storing computer executable code for processing object-based audio signals for reproduction through a playback system, the computer-readable medium comprising code to:

receive user selection information indicating at least one audio object command associated with at least one object-based audio signal;

obtain the at least one audio object command based on the received user selection information, where in the as least one audio object command is not encoded;

receive a plurality of encoded object-based audio signals; and

send together the at least one audio object command that is not encoded with the received plurality of encoded object-based audio signals.

Assignments (5)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: VEVEO LLC (F.K.A. VEVEO, INC.); DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 061786/0675 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2020
From: ROYAL BANK OF CANADA
To: TESSERA, INC.; INVENSAS BONDING TECHNOLOGIES, INC. (F/K/A ZIPTRONIX, INC.); FOTONATION CORPORATION (F/K/A DIGITALOPTICS CORPORATION AND F/K/A DIGITALOPTICS CORPORATION MEMS); INVENSAS CORPORATION; TESSERA ADVANCED TECHNOLOGIES, INC; DTS, INC.; DTS LLC; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 052920/0001 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
SECURITY INTEREST Recorded Dec 2, 2016
From: INVENSAS CORPORATION; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; ZIPTRONIX, INC.; DIGITALOPTICS CORPORATION; DIGITALOPTICS CORPORATION MEMS; DTS, LLC; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 040797/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2016
From: MANESS, PHILLIP LEE; JOHNSON, MARK ROGERS
To: DTS, INC.
Reel/Frame 038387/0893 →