IP Library › Granted Patent US 10,958,928
Granted Patent B2
US 10,958,928 · App. 16/379,560 · Granted Mar 23, 2021

Decoder-side motion vector derivation for video coding

Inventors: Yung-Hsuan Chao (San Diego, CA); Yu-Chen Sun (Bellevue, WA); Wei-Jung Chien (San Diego, CA); Yi-Wen Chen (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: Qualcomm Incorporated
H04N19/513H04N19/176H04N19/44H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,958,928
App. No.
16/379,560
Granted
Mar 23, 2021
Kind
B2
Abstract

A method of decoding video data comprising performing a prediction process for one or more neighboring blocks of video data that are neighboring a current block of video data to obtain prediction pixel values for neighboring pixels of the current block of video data, deriving a template for the current block of video data using the prediction pixel values, performing a decoder-side motion vector derivation technique using the derived template to derive a motion vector for the current block of video data, and decoding the current block of video data using the derived motion vector.

Claims (51)

1. A method of decoding video data, the method comprising:

performing a prediction process for one or more neighboring blocks of video data that are neighboring a current block of video data to obtain prediction pixel values for neighboring pixels of the current block of video data;

deriving a template for the current block of video data using the prediction pixel values without reconstructing the one or more neighboring blocks of video data;

deriving the template for the current block of video data based on the prediction pixel values and the coding mode of the one or more neighboring blocks of video data

performing a decoder-side motion vector derivation technique using the derived template to derive a motion vector for the current block of video data; and

decoding the current block of video data using the derived motion vector.

2. The method of claim 1 , wherein the prediction process is intra prediction or inter prediction.

3. The method of claim 1 , wherein the template is a frame rate up conversion (FRUC) template, and the decoder-side motion vector derivation technique is FRUC template matching.

4. The method of claim 1 , wherein the decoder-side motion vector derivation technique is bilateral template matching.

5. The method of claim 1 , wherein the decoder-side motion vector derivation technique is pattern matched motion vector derivation.

6. The method of claim 1 , further comprising:

outputting the decoded current block of video data for display.

7. An apparatus configured to decode video data, the apparatus comprising:

a memory configured to store video data; and one or more processors in communication with the memory, the one or more processors configured to:

perform a prediction process for one or more neighboring blocks of video data that are neighboring a current block of video data to obtain prediction pixel values for neighboring pixels of the current block of video data;

derive a template for the current block of video data using the prediction pixel values without reconstructing the one or more neighboring blocks of video data;

derive the template for the current block of video data based on the prediction pixel values and the coding mode of the one or more neighboring blocks of video data;

perform a decoder-side motion vector derivation technique using the derived template to derive a motion vector for the current block of video data; and

decode the current block of video data using the derived motion vector.

8. The apparatus of claim 7 , wherein the prediction process is intra prediction or inter prediction.

9. The apparatus of claim 7 , wherein the template is a frame rate up conversion (FRUC) template, and the decoder-side motion vector derivation technique is FRUC template matching.

10. The apparatus of claim 7 , wherein the decoder-side motion vector derivation technique is bilateral template matching.

11. The apparatus of claim 7 , wherein the decoder-side motion vector derivation technique is pattern matched motion vector derivation.

12. The apparatus of claim 7 , wherein the one or more processors are further configured to:

output the decoded current block of video data for display.

13. The apparatus of claim 12 , further comprising:

a display configured to display decoded video data.

14. The apparatus of claim 7 , wherein the apparatus comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

15. An apparatus configured to decode video data, the apparatus comprising:

means for performing a prediction process for one or more neighboring blocks of video data that are neighboring a current block of video data to obtain prediction pixel values for neighboring pixels of the current block of video data;

means for deriving a template for the current block of video data using the prediction pixel values without reconstructing the one or more neighboring blocks of video data:

means for deriving the template for the current block of video data based on the prediction pixel values and the coding mode of the one or more neighboring blocks of video data, means for performing a decoder-side motion vector derivation technique using the derived template to derive a motion vector for the current block of video data; and

means for decoding the current block of video data using the derived motion vector.

16. The apparatus of claim 15 , wherein the prediction process is intra prediction or inter prediction.

17. The apparatus of claim 15 , wherein the decoder-side motion vector derivation technique is pattern matched motion vector derivation.

18. The apparatus of claim 15 , wherein the decoder-side motion vector derivation technique is bilateral template matching.

19. The apparatus of claim 15 , wherein the template is a frame rate up conversion (FRUC) template, and the decoder-side motion vector derivation technique is FRUC template matching.

20. The apparatus of claim 15 , further comprising:

means for outputting the decoded current block of video data for display.

21. A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors to:

perform a prediction process for one or more neighboring blocks of video data that are neighboring a current block of video data to obtain prediction pixel values for neighboring pixels of the current block of video data;

derive a template for the current block of video data using the prediction pixel values without reconstructing the one or more neighboring blocks of video data;

derive the template for the current block of video data based on the prediction pixel values and the coding mode of the one or more neighboring blocks of video data;

perform a decoder-side motion vector derivation technique using the derived template to derive a motion vector for the current block of video data; and

decode the current block of video data using the derived motion vector.

22. The non-transitory computer-readable storage medium of claim 21 , wherein the prediction process is intra prediction or inter prediction.

23. The non-transitory computer-readable storage medium of claim 21 , wherein the template is a frame rate up conversion (FRUC) template, and the decoder-side motion vector derivation technique is FRUC template matching.

24. The non-transitory computer-readable storage medium of claim 21 , wherein the decoder-side motion vector derivation technique is bilateral template matching.

25. The non-transitory computer-readable storage medium of claim 21 , wherein the decoder-side motion vector derivation technique is pattern matched motion vector derivation.

26. The non-transitory computer-readable storage medium of claim 21 , wherein the instructions further cause the one or more processors to:

output the decoded current block of video data for display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: CHAO, YUNG-HSUAN; SUN, YU-CHEN; CHIEN, WEI-JUNG; CHEN, YI-WEN; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 049383/0262 →
Continuity (2)
Provisional Application 62655718 · Apr 10, 2018
Related Publication 20190313115A1 · Oct 10, 2019
Cited By (1)
US 12,603,996