IP Library Granted Patent US 11,863,818
Granted Patent B2
US 11,863,818 · App. 17/298,562 · Granted Jan 2, 2024

Partial frame replacement enabling multiple versions in an integrated video package

Inventors: Shaun Lile (Burbank, CA); Tom David Stratton (Burbank, CA)
Assignee: WARNER BROS. ENTERTAINMENT INC.
H04N21/44029H04N21/2353H04N21/440245H04N21/26258H04N21/8543
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,863,818
App. No.
17/298,562
Granted
Jan 2, 2024
Kind
B2
Abstract

Multiple different versions of media content are contained in a single package of audio-video media content, using compression algorithms that reduce storage and bandwidth required for storing multiple full-resolution versions of the media. Portions of individual frames are replaced during playback so that only the pixels that differ between versions need to be stored.

Claims (36)

1. A computer-implemented method for playing out video content from a multi-version package enabled for substitution of partial-frame image data, the method comprising:

decoding, by at least one processor, a frame of video data from at least one of a source video stream or a source video file originating from the multi-version package, wherein the multi-version package comprises unique metadata documents each for a different one of versions that the multi-version package supports and the at least one of the source video stream or source video file for all the versions;

correlating, by the at least one processor, the frame of video data to unique metadata for the frame, wherein the unique metadata is contained in one of the metadata documents of the multi-version package for one of the versions being played and defines a substitution image for a region less than an entirety of the frame;

preparing, by the at least one processor, an altered frame at least in part by substituting the region of the frame with the substitution image; and

placing, by the at least one processor, the altered frame in a frame queue of a computer memory instead of the frame, for at least one of play-out or storage.

2. The method of claim 1 , further comprising repeating the decoding, the correlating, the preparing and the placing for each successive frame of the at least one of a source video stream or a source video file.

3. The method of claim 1 , further comprising decoding the substitution image.

4. The method of claim 1 , wherein the correlating comprises reading the one of the metadata documents comprising a playlist that identifies each frame correlated to a substitution image mapped to the region of the frame.

5. The method of claim 4 , wherein the playlist comprises an XML file.

6. The method of claim 1 , wherein the region of the frame comprises discontinuous sub-regions and the substitution image includes a portion corresponding to each of the sub-regions.

7. The method of claim 1 , wherein substituting the region of the frame with the substitution image comprises overwriting each pixel of the region with a pixel of the substitution image.

8. An apparatus for decoding video content enabling substitution of partial-frame image data during playback, the apparatus comprising at least one processor coupled to a memory for holding data and executable instructions that when executed by the at least one processor cause the apparatus to perform:

decoding a frame of video data from at least one of a source video stream or a source video file originating from a multi-version package, wherein the multi-version package comprises unique metadata documents each for a different one of versions that the multi-version package supports and the at least one of the source video stream or source video file for all the versions;

correlating the frame of video data to unique metadata for the frame, wherein the unique metadata is contained in one of the metadata documents of the multi-version package for one of the versions being played and defines a substitution image for a region less than an entirety of the frame;

preparing an altered frame at least in part by substituting the region of the frame with the substitution image; and

placing the altered frame in a frame queue of a computer memory instead of the frame, for at least one of play-out or storage.

9. The apparatus of claim 8 , wherein the memory holds further instructions for the reading the one of the metadata document comprising a playlist that identifies each frame correlated to a substitution image mapped to the region of the frame.

10. The apparatus of claim 8 , wherein the memory holds further instructions for the correlating and preparing for the region of the frame comprising discontinuous sub-regions and the substitution image comprising portions corresponding to each of the discontinuous sub-regions.

11. A computer-implemented method for producing a multi-version package comprising video content enabling substitution of partial-frame image data during playback, the method comprising:

encoding, by at least one processor, an image thereby producing an encoded frame of video data for at least one of a source video stream or a source video file;

defining, by the at least one processor, unique metadata for the encoded frame comprising a substitution image for a region less than an entirety of the encoded frame;

correlating, by the at least one processor, the unique metadata to the encoded frame and to a version of the multi-version package; and

placing, by the at least one processor, the frame of video data correlated to the unique metadata and the unique metadata in the multi-version package in a computer memory for later decoding and play-out, wherein the multi-version package comprises unique metadata documents each for a different one of versions that the multi-version package supports and the at least one of the source video stream or source video file for all the versions.

12. The method of claim 11 , further comprising repeating the encoding, the defining, the correlating and the placing for each successive frame of a source video content.

13. The method of claim 11 , further comprising encoding the substitution image.

14. The method of claim 11 , wherein the correlating comprises generating each of the metadata documents comprising a playlist that identifies each encoded frame correlated to a substitution image mapped to the region of the encoded frame.

15. The method of claim 14 , wherein the playlist comprises an XML file.

16. The method of claim 11 , wherein the region of the encoded frame comprises discontinuous sub-regions and the substitution image includes a portion corresponding to each of the sub-regions.

17. An apparatus for encoding a multi-version package comprising video content enabling substitution of partial-frame image data during playback, the apparatus comprising at least one processor coupled to a memory for holding data and executable instructions that when executed by the at least one processor cause the apparatus to perform:

encoding, by at least one processor, an image thereby producing an encoded frame of video data for at least one of a source video stream or a source video file;

defining, by the at least one processor, unique metadata for the encoded frame comprising a substitution image for a region less than an entirety of the encoded frame;

correlating, by the at least one processor, the unique metadata to the encoded frame and to a version of the multi-version package; and

placing, by the at least one processor, the frame of video data correlated to the unique metadata and the unique metadata in the multi-version package in a computer memory for later decoding and play-out, wherein the multi-version package comprises unique metadata documents each for a different one of versions that the multi-version package supports and the at least one of the source video stream or source video file for all the versions.

18. The apparatus of claim 17 , wherein the memory holds further instructions for generating each of the metadata documents comprising a playlist that identifies each encoded frame correlated to a substitution image mapped to the region of the encoded frame.

19. The apparatus of claim 17 , wherein the memory holds further instructions for generating the playlist comprising an XML file.

20. The apparatus of claim 17 , wherein the memory holds further instructions for defining the region of the encoded frame comprising discontinuous sub-regions and the substitution image comprising portions corresponding to each of the sub-regions.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: WARNER BROS. DISCOVERY, INC.; WARNER MEDIA, LLC; TURNER BROADCASTING SYSTEM, INC.; HOME BOX OFFICE, INC.; DISCOVERY COMMUNICATIONS, LLC; WARNERMEDIA DIRECT LLC; DISCOVERY.COM LLC; WARNER BROS. ENTERTAINMENT INC.; CNN INTERACTIVE GROUP, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 072995/0858 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2021
From: LILE, SHAUN
To: WARNER BROS. ENTERTAINMENT INC.
Reel/Frame 057008/0467 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2021
From: STRATTON, TOM DAVID
To: WARNER BROS. ENTERTAINMENT INC.
Reel/Frame 057008/0472 →
Continuity (2)
Provisional Application 62774064 · Nov 30, 2018
Related Publication 20220021931A1 · Jan 20, 2022