IP Library Granted Patent US 9,749,659
Granted Patent B2
US 9,749,659 · App. 15/174,765 · Granted Aug 29, 2017

Region-of-interest encoding enhancements for variable-bitrate mezzanine compression

Inventors: Michael Smith (Santa Monica, CA); Bradley Collar (Valencia, CA)
Assignee: WARNER BROS. ENTERTAINMENT INC.
H04N19/647H04N19/12H04N19/136H04N19/14H04N19/147H04N19/154H04N19/17H04N19/176H04N19/182H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,749,659
App. No.
15/174,765
Granted
Aug 29, 2017
Kind
B2
Abstract

A specification defining allowable luma and chroma code-values is applied in a region-of-interest encoding method of a mezzanine compression process. The method may include analyzing an input image to determine regions or areas within each image frame that contain code-values that are near allowable limits as specified by the specification. In addition, the region-of-interest method may comprise then compressing those regions with higher precision than the other regions of the image that do not have code-values that are close to the legal limits.

Claims (41)

1. A method comprising:

loading digital video data into a computer memory;

analyzing, by a computer, an input image comprising a portion of the digital video data, wherein the analyzing includes identifying pixels with code-values within allowable limits by no more than a first defined non-zero number of luma code-values or by no more than a second defined non-zero number of chroma code-values;

defining at least one region-of-interest within the input image based on containing the pixels having the code-values identified by the analyzing the input image, wherein defining the at least one region-of-interest includes creating a data set comprising bits each corresponding to one or more respective pixels of the input image;

setting the bits of the data set in response to said analyzing, wherein each of the bits indicates whether or not a corresponding pixel of the input image is within the allowable limits by no more than the first defined non-zero number of luma code-values or by no more than the second defined non-zero number of chroma code-values;

encoding the input image with higher precision in areas corresponding to the defined region-of-interest than in areas not corresponding to the defined region-of-interest using a compression method to provide compressed image data;

repeating the analyzing, defining, and encoding on successive portions of the video data, wherein the portions are converted into compressed video data; and

providing the compressed video data in a computer-readable medium.

2. The method of claim 1 , wherein the compression method comprises wavelet-based compression.

3. The method of claim 1 , wherein the compression method is selected from JPEG 2000 and H.264.

4. The method of claim 1 , further comprising capturing the input image comprising a resolution of a least 1920×1080, 10 bits per pixel, as a frame of a video image.

5. The method of claim 1 , wherein analyzing the input image comprises designating luma (Y′) code-values as within the first defined non-zero number of luma code-values of the allowable limits only if the luma code-values are within at least 12 units of the allowable limits for luma code-values according to the color space specification.

6. The method of claim 1 , wherein analyzing the input image comprises designating chroma (Cb/Cr) code-values as within the second defined non-zero number of chroma code-values of the allowable limits only if the chroma code-values are within at least 4 units of the allowable limits for the chroma code-values according to the color space specification.

7. The method of claim 1 , wherein encoding the input image further comprises selectively increasing distortion reduction for all coding passes within code-blocks contained within the region-of-interest by a factor that is greater than 1.

8. The method of claim 7 , wherein encoding the input image further comprises determining a threshold for distortion-length slope to meet a defined rate-control requirement, and selectively including coding passes that have a distortion-length slope greater than the determined distortion-length slope threshold to comprise the encoding.

9. An apparatus comprising at least one processor coupled to a memory, wherein the memory holds instructions that when executed by the least one processor cause the apparatus to perform:

loading digital video data into the computer memory;

analyzing an input image comprising a portion of the digital video data, wherein the analyzing includes identifying pixels with code-values within allowable limits by no more than a first defined non-zero number of luma code-values or by no more than a second defined non-zero number of chroma code-values;

defining at least one region-of-interest within the input image based on containing the pixels having the code-values identified by the analyzing the input image, wherein defining the at least one region-of-interest includes creating a data set comprising bits each corresponding to one or more respective pixels of the input image;

setting the bits of the data set in response to said analyzing, wherein each of the bits indicates whether or not a corresponding pixel of the input image is within the allowable limits by no more than the first defined non-zero number of luma code-values or by no more than the second defined non-zero number of chroma code-values;

encoding the input image with higher precision in areas corresponding to the defined region-of-interest than in areas not corresponding to the defined region-of-interest using a compression method to provide compressed image data;

repeating the analyzing, defining, and encoding on successive portions of the video data, wherein the portions are converted into compressed video data; and

providing the compressed video data in a computer-readable medium.

10. The apparatus of claim 9 , wherein the memory holds further instructions for performing the compression method at least in part by wavelet-based compression.

11. The apparatus of claim 9 , wherein the memory holds further instructions for performing the compression method at least in part by a method selected from JPEG 2000 and H.264.

12. The apparatus of claim 9 , wherein the memory holds further instructions for capturing the input image comprising a resolution of a least 1920×1080, 10 bits per pixel, as a frame of a video image.

13. The apparatus of claim 9 , wherein the memory holds further instructions for analyzing the input image at least in part by designating luma (Y′) code-values as within the first defined non-zero number of luma code-values of the allowable limits only if the luma code-values are within at least 12 units of the allowable limits for luma code-values according to the color space specification.

14. The apparatus of claim 9 , wherein the memory holds further instructions for analyzing the input image at least in part by designating chroma (Cb/Cr) code-values as within the second defined non-zero number of chroma code-values of the allowable limits only if the chroma code-values are within at least 4 units of the allowable limits for the chroma code-values according to the color space specification.

15. The apparatus of claim 9 , wherein the memory holds further instructions for encoding the input image at least in part by selectively increasing distortion reduction for all coding passes within code-blocks contained within the region-of-interest by a factor that is greater than 1.

16. The apparatus of claim 15 , wherein the memory holds further instructions for encoding the input image in part by determining a threshold for distortion-length slope to meet a defined rate-control requirement, and selectively including coding passes that have a distortion-length slope greater than the determined distortion-length slope threshold to comprise the encoding.

17. A non-transitory computer-readable medium encoded with instructions that when executed by least one processor cause a computer to perform:

loading digital video data into a computer memory;

analyzing an input image comprising a portion of the digital video data, wherein the analyzing includes identifying pixels with code-values within allowable limits by no more than a first defined non-zero number of luma code-values or by no more than a second defined non-zero number of chroma code-values;

defining at least one region-of-interest within the input image based on containing the pixels having the code-values identified by the analyzing the input image, wherein defining the at least one region-of-interest includes creating a data set comprising bits each corresponding to one or more respective pixels of the input image;

setting the bits of the data set in response to said analyzing, wherein each of the bits indicates whether or not a corresponding pixel of the input image is within the allowable limits by no more than the first defined non-zero number of luma code-values or by no more than the second defined non-zero number of chroma code-values;

encoding the input image with higher precision in areas corresponding to the defined region-of-interest than in areas not corresponding to the defined region-of-interest using a compression method to provide compressed image data;

repeating the analyzing, defining, and encoding on successive portions of the video data, wherein the portions are converted into compressed video data; and

providing the compressed video data in a computer-readable medium.

18. The non-transitory computer-readable medium of claim 17 , holding further instructions for analyzing the input image at least in part by designating luma (Y′) code-values as within the first defined non-zero number of luma code-values of the allowable limits only if the luma code-values are within at least one of 12 units or 4 units of the allowable limits for luma code-values according to the color space specification.

19. The non-transitory computer-readable medium of claim 17 , holding further instructions for encoding the input image at least in part by selectively increasing distortion reduction for all coding passes within code-blocks contained within the region-of-interest by a factor that is greater than 1.

20. The non-transitory computer-readable medium of claim 19 , holding further instructions for encoding the input image in part by determining a threshold for distortion-length slope to meet a defined rate-control requirement, and selectively including coding passes that have a distortion-length slope greater than the determined distortion-length slope threshold to comprise the encoding.

Assignments (2)
SECURITY INTEREST Recorded Oct 1, 2025
From: WARNER BROS. DISCOVERY, INC.; WARNER MEDIA, LLC; TURNER BROADCASTING SYSTEM, INC.; HOME BOX OFFICE, INC.; DISCOVERY COMMUNICATIONS, LLC; WARNERMEDIA DIRECT LLC; DISCOVERY.COM LLC; WARNER BROS. ENTERTAINMENT INC.; CNN INTERACTIVE GROUP, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 072995/0858 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2017
From: SMITH, MICHAEL D.; COLLAR, BRADLEY
To: WARNER BROS. ENTERTAINMENT INC.
Reel/Frame 043033/0885 →
Continuity (2)
Continuation 13096405 · Apr 28, 2011
Related Publication 20160286237A1 · Sep 29, 2016