IP Library Granted Patent US 9,787,987
Granted Patent B2
US 9,787,987 · App. 14/697,151 · Granted Oct 10, 2017

Adaptive pre-filtering based on video complexity and output bit rate

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,787,987
App. No.
14/697,151
Granted
Oct 10, 2017
Kind
B2
Abstract

Approaches for dynamic pre-filtering of digital video based on video complexity and output bit rate. An adaptive video preprocessor determines a current video complexity of the digital video and an output bit rate. Thereafter, the adaptive video preprocessor dynamically updates the strength of one or more preprocessing filters based on the current video complexity and the output bit rate for the digital video. The adaptive video preprocessor may update the strength of a preprocessing filter based, at least in part, upon selected values of a video quality preference category. A video quality preference category may be assigned natural language values which may each be translated into a particular strength value for at least one of the one or more preprocessing filters.

Claims (41)

1. A non-transitory computer-readable storage medium that stores one or more sequences of instructions for dynamic pre-filtering of digital video, which when executed by one or more processors, cause:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on the current video complexity and the output bit rate by performing:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video, and

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

2. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the output bit rate is lower than a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters to increase the smoothing of edges of the digital video.

3. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

the adaptive video preprocessor employing a curve tracing strategy to use an algorithm to derive an updated filter strength for at least one of the one or more preprocessing filters.

4. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocesing filter and decreasing the strength of the sharpening preprocesing filter.

5. The non-transitory computer-readable storage medium of claim 1 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the horizontal low-pass preprocessing filter (HLPF).

6. An apparatus for dynamic pre-filtering of digital video, comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums storing one or more sequences of instructions, which when executed, cause:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on the current video complexity and the output bit rate by performing:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video, and

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

7. The apparatus of claim 6 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the output bit rate is lower than a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters to increase the smoothing of edges of the digital video.

8. The apparatus of claim 6 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

the adaptive video preprocessor employing a curve tracing strategy to use an algorithm to derive an updated filter strength for at least one of the one or more preprocessing filters.

9. The apparatus of claim 6 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocesing filter and decreasing the strength of the sharpening preprocesing filter.

10. The apparatus of claim 6 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the horizontal low-pass preprocessing filter (HLPF).

11. A method for dynamic pre-filtering of digital video, comprising:

an adaptive video preprocessor determining a current video complexity of the digital video and an output bit rate; and

the adaptive video preprocessor dynamically updating a strength of one or more preprocessing filters based on the current video complexity and the output bit rate by performing:

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is higher than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to sharpen and enhance color of the digital video, and

upon the adaptive video preprocessor determining that the digital video has a complexity-output bit rate ratio that is lower than a threshold, the adaptive video preprocessor dynamically updating the strength of one or more preprocessing filters to preserve more color of the digital video and remove more noise and artifacts from the digital video.

12. The method of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the output bit rate is lower than a threshold, the adaptive video preprocessor increasing the filtering strength of at least one of the one or more preprocessing filters to increase the smoothing of edges of the digital video.

13. The method of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

the adaptive video preprocessor employing a curve tracing strategy to use an algorithm to derive an updated filter strength for at least one of the one or more preprocessing filters.

14. The method of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the motion compensated temporal preprocessing filter (MCTF), the mosquito noise reduction (MNR) preprocessing filter, and the deblocking preprocesing filter and decreasing the strength of the sharpening preprocesing filter.

15. The method of claim 11 , wherein updating the filtering strength of the one or more preprocessing filters comprises:

upon the adaptive video preprocessor determining that the stress level of the digital video exceeds a threshold at the output bit rate, the adaptive video preprocessor dynamically increasing the strength of the horizontal low-pass preprocessing filter (HLPF).

Assignments (4)
SECURITY INTEREST Recorded Dec 21, 2023
From: HARMONIC INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 066090/0906 →
RELEASE OF SECURITY INTEREST Recorded Dec 21, 2023
From: JPMORGAN CHASE BANK, N.A.
To: HARMONIC INC.
Reel/Frame 066092/0633 →
SECURITY INTEREST Recorded Dec 20, 2019
From: HARMONIC INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 051395/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2015
From: YADAV, GANESH
To: HARMONIC, INC.
Reel/Frame 035526/0039 →