IP Library Granted Patent US 10,595,028
Granted Patent B2
US 10,595,028 · App. 15/049,051 · Granted Mar 17, 2020

Encoding/transcoding based on subjective video quality preferences

Inventors: Noam Koren (Los Gatos, CA); Jeremy Cole Rosenberg (Huntingdon Valley, PA); Marcelo C. San Martin (Alviso, CA)
Assignee: Harmonic, Inc.
H04N19/40H04L67/306H04N19/115H04N19/147H04N19/154H04N19/162H04N19/172H04N19/184H04N19/46H04N19/593H04N21/2343H04N21/25891H04N21/2662H04N21/6582
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,595,028
App. No.
15/049,051
Granted
Mar 17, 2020
Kind
B2
Abstract

Approaches for encoding/transcoding of digital video based on subjective video quality preferences or display device characteristics or capabilities. A set of esthetic digital video preferences are received from a user via a user interface. The user may be associated with a supplier or provider of digital video or may be a viewer of the digital video. A video quality profile that describes the set of esthetic digital video preferences or the characteristics or capabilities of a display device is created and stored. Upon determining that a video quality profile is associated with a compressed digital video bit stream, a final rate of compression for the compressed digital video bit stream is determined using one or more video quality profiles. In this way, a user's subjective video quality preferences or the characteristics or capabilities of a display device can be considered in encoding/transcoding digital video.

Claims (42)

1. One or more non-transitory computer-readable storage mediums storing one or more sequences of instructions for encoding or transcoding a digital video, which when executed by one or more processors, cause:

receiving, from a user via a user interface, a set of user-supplied criteria about independent visual parameters for encoding or transcoding said digital video,

wherein said independent visual parameters are employed in a calculation of video quality measured by an encoder or transcoder, and wherein said independent visual parameters include one or more of: the amount of contrast, the amount of details, luminance, the sensitivity to black and white levels, and motion;

creating a video quality profile for said user that describes said set of user-supplied criteria about said independent visual parameters; and

upon determining that said video quality profile is associated with a compressed digital video bit stream, iteratively re-encoding or re-transcoding said compressed digital video bit stream to a final rate of compression, frame by frame, for said compressed digital video bit stream by using said video quality profile to ensure that the final rate of compression, for each frame, in said compressed digital video bit stream satisfies said user-supplied criteria about said independent visual parameters.

2. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein determining a final rate of compression for said compressed digital video bit stream using said video quality profile comprises:

upon determining that a measured video quality of said compressed digital video bit stream exceeds a target video quality, then re-encoding said compressed digital video bit stream using a higher rate of compression; and

upon determining that a measured video quality of said compressed digital video bit stream is lower than said target video quality, then re-encoding said compressed digital video bit stream using a lower rate of compression.

3. The one or more non-transitory computer-readable storage mediums of claim 2 , wherein said target video quality is based, at least in part, on said video quality profile.

4. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein determining said final rate of compression for said compressed digital video bit stream using said video quality profile comprises: consulting said video quality profile to determine a specific bit allocation for a particular visual parameter, configured by said user-supplied criteria described by said video quality profile, for said compressed digital video bit stream.

5. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said determining a final rate of compression for said compressed digital video bit stream comprising using a plurality of video quality profiles which includes said video quality profile.

6. The one or more non-transitory computer-readable storage mediums of claim 5 , wherein said plurality of video quality profiles each cause a different constant bit rate or average variable bit rate to be used in re-encoding said compressed digital video bit stream, and wherein execution of the one or more sequences of instructions further cause:

identifying a highest resolution and frame rate that provides a target video quality for bit rates associated with each of the plurality of video quality profiles.

7. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said user is associated with a supplier or provider of said digital video and is not a viewer of said digital video.

8. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said user is a viewer of said digital video.

9. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein said user is a viewer of said digital video, and wherein said compressed digital video bit stream is initially created using a first set of esthetic digital video preferences associated with a supplier or provider of digital video.

10. One or more non-transitory computer-readable storage mediums storing one or more sequences of instructions for encoding or transcoding a digital video, which when executed by one or more processors, cause:

creating a video quality profile that describes one or more of a set of features supported by a display device, wherein said set of features includes a physical screen size of said display device;

identifying that a display device, of a plurality of display devices, is intended to display said compressed digital video; and

upon determining that said video quality profile is associated with said display device, determining a final rate of compression, frame by frame, for said compressed digital video using said video quality profile and encoding or transcoding said digital video, frame by frame, in said final rate of compression.

11. The one or more non-transitory computer-readable storage mediums of claim 10 , wherein determining said final rate of compression for said compressed digital video bit stream using said video quality profile comprises:

consulting said video quality profile to determine a specific bit allocation for one or more visual parameters for said compressed digital video bit stream.

12. The one or more non-transitory computer-readable storage mediums of claim 10 , wherein said set of features supported by said display device further include support for a three dimensional display.

13. The one or more non-transitory computer-readable storage mediums of claim 10 , wherein said user is associated with a supplier or provider of said digital video and is not a viewer of said digital video.

14. The one or more non-transitory computer-readable storage mediums of claim 10 , wherein said user is a viewer of said digital video.

15. The one or more non-transitory computer-readable storage mediums of claim 10 , wherein said user is a viewer of said digital video, and wherein said compressed digital video bit stream is initially created using a first set of user-supplied criteria about visual parameters that may be used to encode or transcode said digital video whereby said user-supplied criteria are supplied by a supplier or provider of digital video.

16. An apparatus for encoding or transcoding a digital video, comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums storing one or more sequences of instructions, which when executed, cause:

receiving, from a user via a user interface, a set of user-supplied criteria about visual parameters used in encoding or transcoding said digital video,

wherein said individual visual parameters are employed in a calculation of video quality measured by an encoder or transcoder, and wherein said independent visual parameters include one or more of: the amount of contrast, the amount of details, luminance, the sensitivity to black and white levels, and motion;

creating a video quality profile for said user that describes said set of user-supplied criteria about visual parameters; and

upon determining that said video quality profile is associated with a compressed digital video bit stream, iteratively re-encoding or re-transcoding said compressed digital video bit stream to a final rate of compression, frame by frame, for said compressed digital video bit stream by using said video quality profile to ensure that the final rate of compression, for each frame, in said compressed digital video bit stream satisfies said individual visual parameters.

17. The apparatus of claim 16 , wherein said target video quality is based, at least in part, on said video quality profile.

18. A method for encoding or transcoding a digital video, comprising:

receiving, from a user via a user interface, a set of user-supplied criteria about visual parameters that are used in encoding or transcoding said digital video,

wherein said individual visual parameters are employed in a calculation of video quality measured by a encoder or transcoder, and wherein said independent visual parameters include one or more of: the amount of contrast, the amount of details, luminance, the sensitivity to black and white levels, and motion;

creating a video quality profile for said user that describes said set of user-supplied criteria about said visual parameters; and

upon determining that said video quality profile is associated with a compressed digital video bit stream, iteratively re-encoding or re-transcoding said compressed digital video bit stream to a final rate of compression, frame by frame, for said compressed digital video bit stream by using said video quality profile to ensure that the final rate of compression, for each frame, in said compressed digital video bit stream satisfies said individual visual parameters.

19. The method of claim 18 , wherein said target video quality is based, at least in part, on said video quality profile.

20. The one or more non-transitory computer-readable storage mediums of claim 1 , wherein execution of the one or more sequences of instructions further cause:

the user interface displaying in real-time the compressed digital video bit stream that satisfies said user-supplied criteria about said independent visual parameters.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 065937/0327 →
SECURITY INTEREST Recorded Dec 21, 2023
From: HARMONIC INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 066090/0906 →
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 066092/0633 →
SECURITY INTEREST Recorded Nov 10, 2020
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 054327/0688 →
SECURITY INTEREST Recorded Dec 20, 2019
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 051395/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2016
From: KOREN, NOAM; ROSENBERG, JEREMY COLE; SAN MARTIN, MARCELO C.
To: HARMONIC, INC.
Reel/Frame 038515/0145 →
Continuity (3)
Provisional Application 62118690 · Feb 20, 2015
Provisional Application 62118689 · Feb 20, 2015
Related Publication 20160316216A1 · Oct 27, 2016