IP Library Granted Patent US 10,554,972
Granted Patent B2
US 10,554,972 · App. 15/686,541 · Granted Feb 4, 2020

Adaptive pre-filtering based on video complexity, output bit rate, and video quality preferences

Inventor: Ganesh Yadav (Milpitas, CA)
Assignee: Harmonic, Inc.
H04N19/117H04N19/137H04N19/14H04N19/146H04N19/86
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,554,972
App. No.
15/686,541
Granted
Feb 4, 2020
Kind
B2
Abstract

Approaches for dynamic pre-filtering of digital video based on video complexity and output bit rate. An adaptive video preprocessor determines a current video complexity of the digital video and an output bit rate. Thereafter, the adaptive video preprocessor dynamically updates the strength of one or more preprocessing filters based on the current video complexity and the output bit rate for the digital video. The adaptive video preprocessor may update the strength of a preprocessing filter based, at least in part, upon selected values of a video quality preference category. A video quality preference category may be assigned natural language values which may each be translated into a particular strength value for at least one of the one or more preprocessing filters.

Claims (54)

1. A non-transitory computer-readable storage medium that stores one or more sequences of instructions for dynamic pre-filtering of digital video, which when executed by one or more processors, cause:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on (a) the current video complexity, (b) the output bit rate, and (c) a selected value of a video quality preference category, wherein the video quality preference category is assigned two or more natural language values which are each translatable into a particular strength value for at least one of the one or more preprocessing filters,

wherein dynamically updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a ratio of the current video complexity to the output bit rate for the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocessing filter and decreasing the strength of the sharpening preprocessing filter.

2. The non-transitory computer-readable storage medium of claim 1 , wherein execution of the one or more sequences of instructions further cause:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video.

3. The non-transitory computer-readable storage medium of claim 1 , wherein execution of the one or more sequences of instructions further cause:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

4. The non-transitory computer-readable storage medium of claim 1 , wherein the adaptive video preprocessor updates the strength of the one or more preprocessing filters based, at least in part, upon selected values of two or more video quality preference categories, wherein the two or more video quality preference categories each is assigned two or more natural language values which are each translatable into a particular strength value for at least one of the one or more preprocessing filters.

5. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the output bit rate is lower than a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters to increase the smoothing of edges of the digital video.

6. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that an amount of motion depicted by the digital video exceeds a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters responsible for smoothing edges of the digital video.

7. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a qscale value for the digital video exceeds a threshold, the adaptive video preprocessor dynamically increasing the strength of a smoothened picture preprocessing filter to reduce the qscale value of the digital video.

8. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

the adaptive video preprocessor employing a curve tracing strategy to use an algorithm to derive an updated filter strength for at least one of the one or more preprocessing filters.

9. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the horizontal low-pass preprocessing filter (HLPF).

10. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a selected combination of or video quality preference category values operate at cross-purposes with each other, the adaptive video preprocessor automatically changing the filter strength of at least one of the one or more preprocessing filters from a particular default filter strength designated by a user.

11. An apparatus for dynamic pre-filtering of digital video, comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums storing one or more sequences of instructions, which when executed, cause:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on (a) the current video complexity, (b) the output bit rate, and (c) a selected value of a video quality preference category, wherein the video quality preference category is assigned two or more natural language values which are each translatable into a particular strength value for at least one of the one or more preprocessing filters, wherein dynamically updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a ratio of the current video complexity to the output bit rate for the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocessing filter and decreasing the strength of the sharpening preprocessing filter.

12. The apparatus of claim 11 , wherein execution of the one or more sequences of instructions further cause:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video.

13. The apparatus of claim 11 , wherein execution of the one or more sequences of instructions further cause:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

14. The apparatus of claim 11 , wherein the adaptive video preprocessor updates the strength of the one or more preprocessing filters based, at least in part, upon selected values of two or more video quality preference categories, wherein the two or more video quality preference categories each may is assigned two or more natural language values which are each translatable into a particular strength value for at least one of the one or more preprocessing filters.

15. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the output bit rate is lower than a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters to increase the smoothing of edges of the digital video.

16. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that an amount of motion depicted by the digital video exceeds a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters responsible for smoothing edges of the digital video.

17. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a qscale value for the digital video exceeds a threshold, the adaptive video preprocessor dynamically increasing the strength of a smoothened picture preprocessing filter to reduce the qscale value of the digital video.

18. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

the adaptive video preprocessor employing a curve tracing strategy to use an algorithm to derive an updated filter strength for at least one of the one or more preprocessing filters.

19. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the horizontal low-pass preprocessing filter (HLPF).

20. The apparatus of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a selected combination of or video quality preference category values operate at cross-purposes with each other, the adaptive video preprocessor automatically changing the filter strength of at least one of the one or more preprocessing filters from a particular default filter strength designated by a user.

21. A method for dynamic pre-filtering of digital video, comprising:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on (a) the current video complexity, (b) the output bit rate, and (c) a selected value of a video quality preference category, wherein the video quality preference category is assigned two or more natural language values which are each translatable into a particular strength value for at least one of the one or more preprocessing filters,

wherein dynamically updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that a ratio of the current video complexity to the output bit rate for the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocessing filter and decreasing the strength of the sharpening preprocessing filter.

22. The method of claim 21 , further comprising:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video.

23. The method of claim 21 , further comprising:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 065937/0327 →
SECURITY INTEREST Recorded Dec 21, 2023
From: HARMONIC INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 066090/0906 →
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 066092/0633 →
SECURITY INTEREST Recorded Nov 10, 2020
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 054327/0688 →
SECURITY INTEREST Recorded Dec 20, 2019
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 051395/0836 →