IP Library Granted Patent US 10,375,389
Granted Patent B2
US 10,375,389 · App. 15/919,350 · Granted Aug 6, 2019

Template matching for JVET intra prediction

Inventors: Krit Panusopone (San Diego, CA); Limin Wang (San Diego, CA); Koohyar Minoo (San Diego, CA)
Assignee: ARRIS Enterprises LLC
H04N19/107H04N19/105H04N19/149H04N19/176H04N19/647H04N19/91H04N19/11H04N19/197H04N19/503H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,375,389
App. No.
15/919,350
Granted
Aug 6, 2019
Kind
B2
Abstract

A method of decoding JVET video, comprising defining a coding unit (CU) template within a decoded area of a video frame, the CU template being positioned above and/or to the left of a current decoding position for which data was intra predicted, defining a search window within the decoded area, the search window being adjacent to the CU template, generating a plurality of candidate prediction templates based on pixel values in the search window, each of the plurality of candidate prediction templates being generated using different intra prediction modes, calculating a matching cost between the CU template and each of the plurality of candidate prediction templates, selecting an intra prediction mode that generated the candidate prediction template that had the lowest matching cost relative to the CU template, and generating a prediction CU for the current decoding position based on the intra prediction mode.

Claims (41)

1. A method of decoding Joint Video Experts Team (JVET) video, comprising:

defining a coding unit (CU) template within a decoded area of a video frame, said CU template being positioned above and/or to the left of a current decoding position for which data was intra predicted;

defining a search window within said decoded area, said search window being adjacent to said CU template;

generating a plurality of candidate prediction templates based on pixel values in said search window, each of said plurality of candidate prediction templates being generated using different intra prediction modes;

calculating a matching cost between said CU template and each of the plurality of candidate prediction templates;

selecting an intra prediction mode that generated the candidate prediction template that had the lowest matching cost relative to said CU template; and

generating a prediction CU for said current decoding position based on said intra prediction mode.

2. The method of claim 1 , wherein said CU template is shaped with a row of pixels immediately above the top of the current decoding position and a column of pixels immediately to the left of the current decoding position.

3. The method of claim 2 , wherein said row of pixels has a length that is one pixel less than the length of the current decoding position and said column of pixels has a height that is one pixel less than the height of the current decoding position.

4. The method of claim 1 , wherein calculating said matching costs comprises calculating the sum of absolute differences between said CU template and each of said plurality of candidate prediction templates.

5. The method of claim 1 , wherein said search window is spaced apart from the current decoding position by the CU template and extends beyond the ends of the CU template.

6. The method of claim 1 , wherein the steps of defining said CU template and said search window, calculating said matching costs, selecting intra prediction mode, and generating said prediction CU based on said intra prediction mode are performed when information identifying an intra prediction mode for the current decoding position is absent from a bitstream.

7. The method of claim 1 , further comprising adding said prediction CU to a reconstructed residual CU to generate a reconstructed CU for output video.

8. The method of claim 1 , wherein the different intra prediction modes for which candidate prediction templates are considered are at least a subset of the allowed JVET intra prediction modes.

9. A method of decoding Joint Video Experts Team (JVET) video, comprising:

defining a plurality of coding unit (CU) templates within a decoded area of a video frame, each of the CU templates being positioned above and/or to the left of a current decoding position for which data was intra predicted and being spaced apart from the current decoding position by a different number of reference lines;

defining a search window within said decoded area for each of said plurality of CU templates, each search window being within an associated reference line;

generating one or more candidate prediction templates for each of said plurality of CU templates based on pixel values in the search window associated with the CU template, each of said plurality of candidate prediction templates being generated using an intra prediction modes;

calculating a matching cost between each of said plurality of CU templates and each of said plurality of candidate prediction templates;

selecting an intra prediction mode that generated a candidate prediction template with a lowest matching cost relative to one of said plurality of CU templates; and

generating a prediction CU for said current decoding position based on said selected intra prediction mode.

10. The method of claim 9 , wherein each of said plurality of CU templates is shaped with a row of pixels immediately above an associated reference line and a column of pixels immediately to the left of the associated reference line.

11. The method of claim 9 , wherein calculating said matching costs comprises calculating the sum of absolute differences between the CU templates and their associated plurality of candidate prediction templates.

12. The method of claim 9 , wherein each search window extend beyond the ends of the associated CU template.

13. The method of claim 9 , wherein the steps of defining said CU templates and said search windows, calculating said matching costs, selecting said intra prediction mode, and generating said prediction CU based on said intra prediction mode are performed when in-formation identifying an intra prediction mode for the current decoding position is absent from a bitstream.

14. The method of claim 9 , further comprising adding said prediction CU to a reconstructed residual CU to generate a reconstructed CU for output video.

15. The method of claim 9 , wherein the different intra prediction modes for which candidate prediction templates are considered are at least a subset of the allowed JVET intra prediction modes.

16. A method of decoding Joint Video Experts Team (JVET) video, comprising:

receiving a bitstream identifying a plurality of coding units (CUs), at least some of which were encoded with intra prediction, wherein said bitstream omits an indication of which intra prediction mode was used to encode those CUs;

defining at least one CU template within a decoded area of a video frame, the at least one CU template being positioned above and/or to the left of a current decoding position for a coding unit encoded with intra prediction;

defining at least one search window within said decoded area, said at least one search window being adjacent to said at least one CU template within said decoded area;

generating a plurality of candidate prediction templates for said at least one CU template based on pixel values in the search window associated with said at least one CU template, each of said plurality of candidate prediction templates being generated using different intra prediction modes;

calculating a matching cost between said at least one CU template and each of said plurality of candidate prediction templates;

selecting an intra prediction mode that generated the candidate prediction template that had the lowest matching cost relative to said at least one CU template;

generating a prediction CU for said current decoding position based on said intra prediction mode;

decoding a reconstructed residual CU from said bitstream for said current decoding position; and

generating a reconstructed CU by adding said prediction CU to said reconstructed residual CU.

17. The method of claim 16 , wherein said at least one CU template is shaped with a row of pixels immediately above the top of the current decoding position and a column of pixels immediately to the left of the current decoding position.

18. The method of claim 16 , wherein each of said at least one CU templates is shaped with a row of pixels immediately above a different associated reference line and a column of pixels immediately to the left of the associated reference line.

19. The method of claim 16 , wherein calculating said matching costs comprises calculating the sum of absolute differences between said at least one CU template and each of said plurality of candidate prediction templates.

20. The method of claim 16 , wherein the different intra prediction modes for which candidate prediction templates are considered are at least a subset of the allowed JVET intra prediction modes.

Assignments (7)
SECURITY INTEREST Recorded Apr 8, 2026
From: ARRIS ENTERPRISES LLC; RUCKUS IP HOLDINGS LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075476/0814 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
Continuity (4)
Continuation 15597420 · May 17, 2017
Provisional Application 62341343 · May 25, 2016
Provisional Application 62337652 · May 17, 2016
Related Publication 20180241993A1 · Aug 23, 2018