Multiplexing, synchronizing, and assembling multiple audio/video (A/V) streams in a media gateway
View Patent ↗A media gateway that services a plurality of client devices may be used to combine a plurality of encoded multimedia transport streams, which may comprise a buffered copy of received encoded broadcast multimedia transport stream and an encoded local multimedia transport stream that pertains to the broadcast transport stream. The media gateway may decode the encoded broadcast multimedia transport stream to extract broadcast multimedia content carried therein based on determination of capabilities of one or more client devices used in playback of the content. The encoded local multimedia transport stream may be generated based on local multimedia content generated and/or captured via one or more client devices. The buffering duration of the received encoded broadcast multimedia transport stream may be adaptively determined, to ensure that the encoded local multimedia transport stream and the encoded broadcast multimedia transport stream are synchronized when they are combined.
1. A method, comprising:
receiving, by a device, a first encoded multimedia transport stream from a service provider;
receiving, by the device, a first non-encoded multimedia transport stream from a client device;
encoding, by the device, the first non-encoded multimedia transport stream from the client device to generate a second encoded multimedia transport stream; and
multiplexing, by the device, the first encoded multimedia transport stream and the second encoded multimedia transport stream into an output multimedia transport stream.
2. The method of claim 1 , further comprising decoding the first encoded multimedia transport stream to generate a second non-encoded multimedia transport stream.
3. The method of claim 2 , further comprising determining a decoding time of the first encoded multimedia transport stream; and determining an encoding time of the first non-encoded multimedia transport stream.
4. The method of claim 3 , wherein multiplexing the first encoded multimedia transport stream and the second encoded multimedia transport stream is performed subsequent to the determined decoding time and encoded time.
5. The method of claim 2 , wherein the second non-encoded multimedia transport stream is provided to the client device for display.
6. The method of claim 5 , wherein receiving the first non-encoded multimedia transport stream from a client device is performed subsequent to display of the second non-encoded multimedia transport stream.
7. The method of claim 6 , wherein multiplexing the first encoded multimedia transport stream and the second encoded multimedia transport stream into the output multimedia transport stream further comprises delaying the first encoded multimedia transport stream until the second encoded multimedia transport stream is generated.
8. The method of claim 7 , wherein delaying the first encoded multimedia transport stream until the second encoded multimedia transport stream is generated further comprises synchronizing the first encoded multimedia transport stream and second encoded multimedia transport stream.
9. A system, comprising:
a device comprising one or more circuits configured to: receive a first encoded multimedia transport stream from a service provider,
receive a first non-encoded multimedia transport stream from a client device,
encode the first non-encoded multimedia transport stream from the client device to generate a second encoded multimedia transport stream, and
multiplex the first encoded multimedia transport stream and the second encoded multimedia transport stream into an output multimedia transport stream.
10. The system of claim 9 , wherein the one or more circuits are further configured to decode the first encoded multimedia transport stream to generate a second non-encoded multimedia transport stream.
11. The system of claim 10 , wherein the one or more circuits are further configured to determine a decoding time of the first encoded multimedia transport stream; and determine an encoding time of the first non-encoded multimedia transport stream.
12. The system of claim 11 , wherein the one or more circuits are further configured to multiplex the first encoded multimedia transport stream and the second encoded multimedia transport stream subsequent to the determined decoding time and encoded time.
13. The system of claim 10 , wherein the second non-encoded multimedia transport stream is provided to the client device for display.
14. The system of claim 13 , wherein the one or more circuits are further configured to receive the first non-encoded multimedia transport stream from a client device subsequent display of the second non-encoded multimedia transport stream.
15. The system of claim 14 , wherein the one or more circuits are further configured to delay the first encoded multimedia transport stream until the second encoded multimedia transport stream is generated.
16. The system of claim 14 , wherein the one or more circuits are further configured to synchronize the first encoded multimedia transport stream and second encoded multimedia transport stream.
17. A non-transitory computer-readable medium having executable instructions, the instructions operable to cause a processor to:
encode a first non-encoded multimedia transport stream received from a client device to generate a first encoded multimedia transport stream, and
multiplex the first encoded multimedia transport stream and a second encoded multimedia transport stream received from a service provider into an output multimedia transport stream.
18. The computer-readable medium of claim 17 , wherein the instructions are further operable to delay the second encoded multimedia transport stream until the first encoded multimedia transport stream is generated.
19. The computer-readable medium of claim 17 , wherein the instructions are further operable to decode the second encoded multimedia transport stream to generate a second non-encoded multimedia transport stream, provided to the client device for display.
20. The computer-readable medium of claim 19 , wherein the instructions are further operable to determine a decoding time of the second encoded multimedia transport stream; determine an encoding time of the first non-encoded multimedia transport stream; and multiplex the first encoded multimedia transport stream and the second encoded multimedia transport stream subsequent to the determined decoding time and encoded time.