IP Library Granted Patent US 12,058,381
Granted Patent B2
US 12,058,381 · App. 17/806,192 · Granted Aug 6, 2024

Joint clipping operating for filters for video coding

Inventors: Venkata Meher Satchit Anand Kotra (Munich, DE); Nan Hu (San Diego, CA); Vadim Seregin (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/82H04N19/117H04N19/132H04N19/85H04N19/423
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,058,381
App. No.
17/806,192
Granted
Aug 6, 2024
Kind
B2
Abstract

A video encoder or video decoder are configured to reconstruct the video data to generate reconstructed video data. The video encoder or video decoder may further perform a plurality of loop filter operations on the reconstructed video data in parallel, wherein the plurality of loop filter operations includes a first filter operation that is not a bilateral filter operation or a sample adaptive offset (SAO) filter operation, and perform a joint clipping operation on a first output of the first filter and a second output of a second loop filter operation of the plurality of loop filter operations. The first filter operation may be a cross-component sample adaptive offset (CCSAO) filter operation.

Claims (42)

1. A method of coding video data, the method comprising:

reconstructing video data to generate reconstructed video data;

performing a plurality of loop filter operations on the reconstructed video data in parallel, wherein the plurality of loop filter operations includes a first loop filter operation, a second loop filter operation, and a third loop filter operation, wherein the first loop filter operation is a cross-component sample adaptive offset (CCSAO) filter operation, the second loop filter operation is a bilateral filter operation, and the third loop filter operation is a sample adaptive offset (SAO) filter operation;

summing respective outputs of the CCSAO filter operation, the SAO filter operation, the bilateral filter operation, and a deblocking filter operation to generate a first sum; and

performing a joint clipping operation on the first sum.

2. The method of claim 1 , further comprising:

performing the deblocking filtering operation on the reconstructed video data prior to performing the plurality of loop filter operations.

3. The method of claim 1 , further comprising:

performing an adaptive loop filtering operation after performing the plurality of loop filter operations.

4. The method of claim 1 , wherein coding comprises encoding, and wherein reconstructing the video data to generate the reconstructed video data comprises:

reconstructing the video data in a reconstruction loop of a video encoder to generate the reconstructed video data.

5. The method of claim 1 , wherein coding comprises decoding, and wherein reconstructing the video data to generate the reconstructed video data comprises:

decoding the video data to generate the reconstructed video data.

6. An apparatus configured to code video data, the apparatus comprising:

a memory configured to store video data; and

one or more processors in communication with the memory, the one or more processors configured to:

reconstruct the video data to generate reconstructed video data;

perform a plurality of loop filter operations on the reconstructed video data in parallel, wherein the plurality of loop filter operations includes a first loop filter operation, a second loop filter operation, and a third loop filter operation, wherein the first loop filter operation is a cross-component sample adaptive offset (CCSAO) filter operation, the second loop filter operation is a bilateral filter operation, and the third loop filter operation is a sample adaptive offset (SAO) filter operation;

sum respective outputs of the CCSAO filter operation, the SAO filter operation, the bilateral filter operation, and a deblocking filter operation to generate a first sum; and

perform a joint clipping operation on the first sum.

7. The apparatus of claim 6 , wherein the one or more processors are further configured to:

perform the deblocking filtering operation on the reconstructed video data prior to performing the plurality of loop filter operations.

8. The apparatus of claim 6 , wherein the one or more processors are further configured to:

perform an adaptive loop filtering operation after performing the plurality of loop filter operations.

9. The apparatus of claim 6 , wherein the apparatus is a video encoder, and wherein to reconstruct the video data to generate the reconstructed video data, the one or more processors are further configured to:

reconstruct the video data in a reconstruction loop of the video encoder to generate the reconstructed video data.

10. The apparatus of claim 6 , wherein the apparatus is a video decoder, and wherein to reconstruct the video data to generate the reconstructed video data, the one or more processors are further configured to:

decode the video data to generate the reconstructed video data.

11. The apparatus of claim 6 , wherein the apparatus is a wireless communications device.

12. A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to code video data to:

reconstruct the video data to generate reconstructed video data;

perform a plurality of loop filter operations on the reconstructed video data in parallel, wherein the plurality of loop filter operations includes a first loop filter operation, a second loop filter operation, and a third loop filter operation, wherein the first loop filter operation is a cross-component sample adaptive offset (CCSAO) filter operation, the second loop filter operation is a bilateral filter operation, and the third loop filter operation is a sample adaptive offset (SAO) filter operation;

sum respective outputs of the CCSAO filter operation, the SAO filter operation, the bilateral filter operation, and a deblocking filter operation to generate a first sum; and

perform a joint clipping operation on the first sum.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the one or more processors are further configured to:

perform the deblocking filtering operation on the reconstructed video data prior to performing the plurality of loop filter operations.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the one or more processors are further configured to:

perform an adaptive loop filtering operation after performing the plurality of loop filter operations.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the non-transitory computer-readable storage medium is of a video encoder, and wherein to reconstruct the video data to generate the reconstructed video data, the one or more processors are further configured to:

reconstruct the video data in a reconstruction loop of the video encoder to generate the reconstructed video data.

16. The non-transitory computer-readable storage medium of claim 12 , wherein the non-transitory computer-readable storage medium is of a video decoder, and wherein to reconstruct the video data to generate the reconstructed video data, the one or more processors are further configured to:

decode the video data to generate the reconstructed video data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2022
From: KOTRA, VENKATA MEHER SATCHIT ANAND; HU, NAN; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 060772/0453 →
Continuity (2)
Provisional Application 63210438 · Jun 14, 2021
Related Publication 20220400292A1 · Dec 15, 2022