Granted Patent B2

US 12,436,916 · App. 16/538,714 · Granted Oct 7, 2025

Inventors: Stephen Maynard (Thornton, CO); Trever Hallock (Westminster, CO); Nicholas Nielsen (Erie, CO); Ernest Biancarelli (Denver, CO)

Assignee: TIME WARNER CABLE ENTERPRISES LLC

G06F16/116G06F16/1794H04N19/23H04N19/40H04N19/46H04N19/42H04N19/436

Abstract

Claims (106)

1. A computerized method for transcoding media data encoded according to a first format into second media data compatible with a second format, the computerized method for transcoding comprising:

partially decoding of the media data, thereby resulting in decoded media data portions and a plurality of undecoded media data portions, wherein at least one of the decoded media data portions includes a plurality of video frames of the media data;

storing the decoded media data portions into an ephemeral storage apparatus, the ephemeral storage apparatus comprising an amount of storage to accommodate data to enable time-shifting for at least twice an amount of time required for all transformation operations for a given device to be completed, the all transformation operations comprising:

(i) removing header portions indicative of the first format from the plurality of video frames;

(ii) adding header portions indicative of a second format to the plurality of video frames, the second format comprising a high efficiency video coding (HEVC) format;

(iii) obtaining discrete cosine transform (DCT) coefficients of the plurality of video frames;

(iv) transforming the DCT coefficients to create new coefficients;

(v) re-encoding the plurality of video frames using the new coefficients; and

(vi) combining the plurality of undecoded media data portions with the re-encoded plurality of video frames to obtain the second media data.

2. The computerized method of claim 1 , wherein the re-encoding the plurality of video frames comprises re-encoding the plurality of video frames to context-adaptive binary arithmetic coding (CABAC).

3. The computerized method of claim 1 , further comprising repackaging each of the plurality of video frames as a video object having a single sequence, a single object, and a single layer, wherein the single layer is video object plane (VOP) layer 0, wherein utilization of the VOP layer 0 eliminates a need for any prediction between planes.

4. The computerized method of claim 3 , wherein the repackaging each of the plurality of video frames as the video object comprises setting I, B, and P frames of the plurality of video frames to respective I, B, and P video objects within VOP background layer.

5. The computerized method of claim 1 , further comprising assigning the decoded media data portions a single shape within the HEVC format, wherein the single shape is a rectangle.

6. The computerized method of claim 1 , wherein the re-encoding the plurality of video frames comprises specifying a four-sided shape which is to be used in subsequent decoding by a rendering device.

7. The computerized method of claim 1 , wherein the plurality of video frames of the media data do not include all video frames associated with the media data.

8. The computerized method of claim 1 , wherein the removing header portions indicative of the first format from the plurality of video frames and the adding header portions indicative of the second format to the plurality of video frames comprises, based at least on a determination that a group of pictures (GOP) header is present in the decoded media data portions:

extracting GOP header data from the GOP header;

generating a group of video objects (GOV) header using the GOP header data; and

removing the GOP header.

9. The computerized method of claim 1 , wherein the removing header portions indicative of the first format from the plurality of video frames and the adding of the header portions indicative of the second format to the plurality of video frames comprises, based at least on a determination that a GOP header is not present in the decoded media data portions and that a picture header is present in the decoded media data portions:

extracting picture header data from the picture header;

generating a video object plane (VOP) header using the picture header data; and

removing the picture header.

10. The computerized method of claim 1 , wherein the removing of the header portions indicative of the first format from the plurality of video frames and the adding of the header portions indicative of the second format to the plurality of video frames comprises, based at least on a determination that a GOP header and a picture present are not present in the decoded media data portions and that a slice header is present in the decoded media data portions:

adapting the slice header within the header portions indicative of the second format to the plurality of video frames.

11. The computerized method of claim 1 , wherein the transcoding of the media data encoded according to the first format into the second media data compatible with the HEVC format does not utilize multiple reference frames, and wherein the not utilizing the multiple reference frames enables the transcoding of the media data with a reduced bandwidth requirement relative to a bandwidth associated with utilizing the multiple reference frames.

12. The computerized method of claim 1 , wherein the HEVC format comprises H.265.

13. A reduced-complexity transcoder apparatus configured to transform content from a first format to a second format different from the first format, the reduced-complexity transcoder apparatus comprising:

at least one data interface configured for data communication with a premises network, the premises network in data communication with at least a computerized user device;

at least one backend interface configured for data communication with at least the computerized user device;

a digital processor apparatus; and

a storage apparatus in data communication with the digital processor apparatus and having at least one computer program disposed thereon, the at least one computer program being configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

access an ephemeral storage apparatus to obtain a plurality of intermediate data resulting from a partial decode of an input stream comprising the content, the ephemeral storage apparatus comprising an amount of storage to accommodate data to enable time-shifting for at least twice an amount of time required for completion of transformation operations necessary to transform the content from the first format to the second format, the transformation operations comprising a transcoding process, the transcoding process comprising:

a processing of the plurality of intermediate data;

application of entropy decoding to the processed plurality of intermediate data;

performance of a matrix retransformation process associated with the processed plurality of intermediate data; and

performance of a re-packaging process to output the content in the second format.

14. The reduced-complexity transcoder apparatus of claim 13 , wherein:

the processing of the plurality of intermediate data comprises:

obtainment of a plurality of video frames from the plurality of intermediate data;

obtainment of group of pictures (GOP) information from the plurality of intermediate data;

reclassification of the plurality of video frames as a plurality of video objects within a single video object plane (VOP); and

reclassification of the GOP information as group of video objects (GOV) information;

the application of the entropy decoding comprises:

a re-encoding of the plurality of intermediate data using the plurality of video objects and the GOV information to produce re-encoded content data; and

the performance of the re-packaging process comprises:

combination of the re-encoded content data into a plurality of undecoded content portions remaining from the partial decode of the input stream to produce second digital content compatible with the second format.

15. The reduced-complexity transcoder apparatus of claim 14 , wherein the second format comprises a High Efficiency Video Coding (HEVC) format, and the single VOP comprises a VOP background layer.

16. The reduced-complexity transcoder apparatus of claim 15 , wherein the second format further comprises an Advanced Video Coding (AVC) format.

17. The reduced-complexity transcoder apparatus of claim 14 , wherein the obtainment of the plurality of video frames comprises a process which does not utilize an inverse discrete cosine transform (DCT) algorithm, in order to conserve processing resources.

18. The reduced-complexity transcoder apparatus of claim 13 , wherein the at least one computer program is further configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

receive registration data associated with the computerized user device, the registration data instructing the reduced-complexity transcoder apparatus to automatically, upon detection that the computerized user device is in use, commence the transcoding process;

wherein the commencement of the transcoding process is effected based on the registration data.

19. The reduced-complexity transcoder apparatus of claim 13 , wherein the at least one computer program is configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

pre-scan the content to determine particular portions of the content associated with a delay corresponding to a time required to perform the transcoding process;

determine the delay using the particular portions of the content;

determine that the delay would not be detectable by a user of the computerized user device at a particular time; and

deliver the content in the second format to the computerized user device at the particular time.

20. The reduced-complexity transcoder apparatus of claim 19 , wherein the at least one computer program is configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

select the particular time for the delivery of the content in the second format to the computerized user device based on the determination that the delay would not be detectable by the user of the at least the computerized user device at the particular time.

21. The reduced-complexity transcoder apparatus of claim 13 , wherein the at least one computer program is further configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

identify the at least the computerized user device for the delivery of the content; and

select one or more transcoding profiles based on data related to the identified at least the computerized user device.

22. The reduced-complexity transcoder apparatus of claim 21 , wherein the at least one computer program is further configured to, when executed on the digital processor apparatus, cause the reduced-complexity transcoder apparatus to:

select the transcoding process based at least on the selected one or more transcoding profiles.

23. A computerized method providing digital media content to a plurality of computerized user devices located at a user premises, the computerized method comprising:

partially decoding media content data encoded in a first format, thereby resulting in intermediate media content data and undecoded media content data;

storing the intermediate media content data in a temporary storage apparatus, the temporary storage apparatus comprising an amount of storage to accommodate enough data to enable time-shifting for at least twice an amount of time required for completion of any transformation operations required to transform the media content data encoded in the first format to second digital content compatible with a second format, the transformation operations comprising a transcoding process;

accessing the temporary storage apparatus to obtain the intermediate media content data;

performing the transcoding process, the performing comprising processing the intermediate media content data to obtain processed data encoded in the second format; and

combining the undecoded media content data and the processed data to obtain the second digital content compatible with the second format.

24. The computerized method of claim 23 , further comprising:

accessing data relating to at least one entitlement; and

using the data relating to the at least one entitlement to determine that a first computerized user device of the plurality of computerized user devices is entitled to access the media content data;

wherein the accessing the temporary storage apparatus and obtaining the intermediate media content data is based on the determination.

25. The computerized method of claim 23 , further comprising:

determining particular portions of the intermediate media content data having bitrate requirements associated with a prescribed level of bitrates;

based on the determining of the particular portions of the intermediate media content data having the bitrate requirements, determining a particular time period at which a delay corresponding to an amount of time required to perform at least one transcoding process is non-detectable by one or more of the plurality of computerized user devices; and

determining a time at which to stream the second digital content compatible, the determining comprising adding the particular time period to an original broadcast of the media content data.

26. The computerized method of claim 23 , further comprising:

receiving registration data associated with a first computerized user device of the plurality of computerized user devices;

based on the registration data, determining a time, prior to a previously scheduled time of intended use of the media content data, at which to commence the transcoding process;

selecting a particular time period for delivery of the second digital content compatible with the second format to the first computerized user device;

wherein the performing of the transcoding process comprises performing the transcoding process at the time, prior to the previously scheduled time of the intended use of the digital media content; and

providing the second digital content to the first computerized user device during the particular time period.

27. The computerized method of claim 26 , further comprising:

performing determination that a delay corresponding to an amount of time required to perform at least one transcoding process is non-detectable by a user of the first computerized user device at the particular time period;

wherein the selecting the particular time period for the delivery of the second digital content to the first computerized user device is based at least on the performing the determination.

28. The computerized method of claim 23 , wherein the processing the intermediate media content data to obtain the processed data encoded in the second format comprises:

categorizing a plurality of video frames of the intermediate media content data as a plurality of High Efficiency Video Coding (HEVC) video objects, each of the plurality of HEVC video objects including a single sequence, a single object, and a single layer.

29. A computerized method for transcoding media data encoded according to a first format into second media data compatible with a second format, comprising:

partially decoding the media data, thereby obtaining at least one decoded media data portion and at least one undecoded media data portion, wherein the at least one decoded media data portion includes a plurality of video frames of the media data;

storing the at least one decoded media data portion in an ephemeral storage apparatus, the ephemeral storage apparatus comprising an amount of storage to accommodate data to enable time-shifting for at least twice an amount of time required for completion of one or more transformation operations necessary to transform the media data from the first format to the second format, the one or more transformation operations comprising a transcoding process; and

performing the transcoding process by:

processing of the at least one decoded media data portion;

applying entropy decoding to the at least one decoded media data portion;

performing a matrix retransformation process associated with the at least one decoded media data portion; and

performing a re-packaging process to output the second media data in the second format.

30. The computerized method of claim 29 , further comprising:

evaluating at least portions of the media data to predict a period of time of delay associated with the transcoding of the media data;

determining a time at which to stream the transcoded media data, the determining comprising adding the period of time of delay to a time of an original broadcast of the media data to determine a second time at which to stream the transcoded media data; and

cause streaming of the transcoded media data at the second time.

31. The computerized method of claim 30 , wherein the evaluating of the at least portions of the media data to predict the period of time of delay associated with the transcoding of the media data is based on one or more of: (i) in-bound quality, (ii) bandwidth availability, or (iii) bitrate requirements, of the at least portions of the media data.

32. The computerized method of claim 29 , further comprising selectively determining to at least intentionally skip use of one or more features of the second format as part of said transcoding, the one or more features of the second format comprising at least use of spatial prediction.

33. The computerized method of claim 32 , wherein the selectively determining is based at least in part on an identity of the first format and an identity of the second format.

34. The computerized method of claim 32 , wherein the selectively determining to at least intentionally skip the use of the one or more features of the second format comprises skipping use of multiple reference frames, the skipping which enables the transcoding of the media data with a reduced bandwidth requirement relative to a bandwidth associated with utilizing the multiple reference frames.

Assignments (4)

Continuity (2)

References Cited (298)