IP Library Granted Patent US 11,232,805
Granted Patent B2
US 11,232,805 · App. 16/970,968 · Granted Jan 25, 2022

Method and apparatus for processing of auxiliary media streams embedded in a MPEGH 3D audio stream

Inventors: Stephan Schreiner (Birgland, DE); Christof Fersch (Neumarkt, DE)
Assignee: Dolby International AB
G10L19/167G10L19/008H04N21/42615H04N21/434H04N21/4363H04N21/4394
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,805
App. No.
16/970,968
Filed
Aug 19, 2020
Granted
Jan 25, 2022
Kind
B2
Examiner
LE, PETER D
Art Unit
2488
USPC
375/240.25
Abstract

The disclosure relates to methods, apparatus and systems for side load processing of packetized media streams. In an embodiment, the apparatus comprises: a receiver for receiving a bitstream, and a splitter for identifying a packet type in the bitstream and splitting, based on the identification of a value of the packet type in the bit stream into a main stream and an auxiliary stream.

Claims (33)

1. An apparatus comprising:

a receiver configured to receive a merged packetized media bitstream which includes packets associated with a main stream and packets associated with an auxiliary stream, wherein the main stream comprises MPEG-H 3D audio data encapsulated as packets in an MHAS format, and wherein the auxiliary stream comprises additional audio data encapsulated as packets in the MHAS format, wherein a format of a packet payload of the packets associated with the auxiliary stream is different from the MPEG-H 3D audio format, and time offset packets in the MHAS format signaling an indication of a time offset of the auxiliary stream to the main stream and having a same packet label number assigned as the MHAS packets carrying the additional audio data said time offset packets;

a splitter configured to identify a packet type encapsulated in a header of the packets in the merged packetized media bitstream and configured to split, based on the identification of the packet type, the merged packetized media bitstream into the main stream and the auxiliary stream, wherein the packet types of the packets associated with the auxiliary stream are new MHAS packet types encapsulated in the packet header, wherein the new MHAS packet types are different from the MHAS packets, and

a time-alignment unit for time-aligning the additional audio data with the main audio data based on the signaled time offset.

2. Apparatus according to claim 1 , wherein the apparatus further comprises a primary decoder configured to decode the main stream according to the MPEG-H 3D audio format.

3. Apparatus according to claim 1 , wherein the packets associated with the auxiliary stream include a sub-header identifying the format of the packet payload.

4. Apparatus according to claim 1 , wherein the apparatus further comprises a secondary decoder configured to receive the auxiliary stream from the splitter and to decode the auxiliary stream according to said format being different from the MPEG-H 3D audio format.

5. Apparatus according to claim 1 , wherein the output signals obtained from the main and auxiliary stream are output simultaneously to a listener.

6. The apparatus of claim 1 , wherein the MHAS format is compatible to the ISO/IEC 23008-3 standard.

7. A method comprising:

receiving a merged packetized media bitstream which includes packets associated with a main stream and packets associated with an auxiliary stream, wherein the main stream comprises MPEG-H 3D audio data encapsulated as packets in an MHAS format, and wherein the auxiliary stream comprises additional audio data encapsulated as packets in the MHAS format, wherein a format of a packet payload of the packets associated with the auxiliary stream is different from the MPEG-H 3D audio format, and time offset packets in the MHAS format signaling an indication of a time offset of the auxiliary stream to the main stream and having a same packet label number assigned as the MHAS packets carrying the additional audio data said time offset packets;

identifying a packet type encapsulated in a header of the packets in the merged packetized media bitstream,

splitting, based on the identification of the packet type, the merged packetized media bitstream into the main stream and the auxiliary stream, wherein the packet types of the packets associated with the auxiliary stream are new MHAS packet types encapsulated in the packet header, wherein the new MHAS packet types are different from the MHAS packets, and

time-aligning the additional audio data with the main audio data based on the signaled time offset.

8. Method according to claim 7 , wherein the method further comprises decoding according to the MPEG-H 3D audio format, by a primary decoder, the main stream splitted from the merged packetized media bitstream.

9. Method according to claim 7 , wherein the packets associated with the auxiliary stream include a sub-header identifying the format of the packet payload.

10. Method according to claim 7 , wherein the method further comprises decoding, by a secondary decoder, the auxiliary stream splitted from the merged packetized bitstream according to said format being different from the MPEG-H 3D audio format.

11. Method according to claim 7 , wherein the method further comprises outputting signals obtained from the main and auxiliary stream simultaneously to a listener.

12. The method of claim 7 , wherein the MHAS format is compatible to the ISO/IEC 23008-3 standard.

13. An apparatus comprising:

an MPEG-H 3D Audio Core decoder configured to create audio data based on packets associated with a main stream of a merged packetized media bitstream comprising main MPEG-H 3D audio data encapsulated as packets in an MHAS format;

a format conversion unit configured to perform format conversion on additional audio data encapsulated as packets associated with an auxiliary stream of the merged packetized media bitstream, based on the identification of a packet type, wherein the packets are of a new MHAS packet type encapsulated in a header of the packets, wherein the new MHAS packet type is different from the MHAS format;

a sample rate converter configured to convert the sample rate of the additional audio data encapsulated in said packets; and optionally

a mixer configured to mix audio data created by the MPEG-H 3D Audio Core decoder and the audio data output by the sample rate converter.

14. The apparatus of claim 13 , wherein the MHAS format is compatible to the ISO/IEC 23008-3 standard.

15. An apparatus comprising:

an MPEG-H 3D Audio Core decoder configured to create audio data based on packets associated with a main stream of a merged packetized media bitstream comprising main MPEG-H 3D audio data encapsulated as packets in an MHAS format;

an additional decoder comprising means to decode additional audio data encapsulated as packets associated with an auxiliary stream in the merged packetized media bitstream, based on the identification of a packet type encapsulated in a header of the packets, wherein the packet type is a new MHAS type different from the MHAS format which cannot be decoded by the standardized MPEG-H 3D Audio Core decoder and which indicates a format of the packet payload;

a format conversion unit configured to perform format conversion on additional audio data encapsulated in said packets;

a sample rate converter configured to convert the sample rate of the additional audio data encapsulated in said packets; and optionally a mixer configured to mix audio data created by the MPEG-H 3D Audio Core decoder and the audio data output by the sample rate converter.

16. The apparatus according to claim 15 , wherein the additional decoder is further configured to receive information regarding mixing of the auxiliary stream with the main stream.

17. The apparatus according to claim 16 , wherein the mixing information relates to at least one of static gain(s) or dynamic gain(s) to perform gain adjustment of the additional audio data.

18. The apparatus of claim 15 , wherein the MHAS format is compatible to the ISO/IEC 23008-3 standard.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: SCHREINER, STEPHAN; FERSCH, CHRISTOF
To: DOLBY INTERNATIONAL AB
Reel/Frame 053878/0349 →
Priority Claims (1)
EP 18166319 · Apr 9, 2018 · regional
Continuity (4)
Provisional Application 62634136 · Feb 22, 2018
Provisional Application 62641098 · Mar 9, 2018
Provisional Application 62697536 · Jul 13, 2018
Related Publication 20200395027A1 · Dec 17, 2020
Cited By (1)
US 12,677,015