IP Library Granted Patent US 12,328,442
Granted Patent B2
US 12,328,442 · App. 18/370,589 · Granted Jun 10, 2025

Systems and methods for spatial prediction

Inventors: Yan Ye (San Diego, CA); Qian Chen (San Jose, CA); Jie Dong (San Diego, CA)
Assignee: InterDigital VC Holdings, Inc.
H04N19/52H04N19/11H04N19/119H04N19/124H04N19/14H04N19/176H04N19/182H04N19/46H04N19/59H04N19/593H04N19/649H04N19/80H04N19/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,328,442
App. No.
18/370,589
Granted
Jun 10, 2025
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed relating to intra prediction of a video signal based on mode-dependent subsampling. A block of coefficients associated with a first sub block of a video block, one or more blocks of coefficients associated with one or more remaining sub blocks of the video block, and an indication of a prediction mode for the video block may be received. One or more interpolating techniques, a predicted first sub block, and the predicted sub blocks of the one or more remaining sub blocks may be determined. A reconstructed first sub block and one or more reconstructed remaining sub blocks may be generated. A reconstructed video block may be formed based on the prediction mode, the reconstructed first sub block, and the one or more reconstructed remaining sub blocks.

Claims (47)

1. A device for video decoding, comprising:

a processor configured to:

obtain intra prediction mode information associated with a video block;

determine an intra prediction mode of a plurality of intra prediction modes based on the intra prediction mode information;

obtain a first sub-block of the video block based on the intra prediction mode, wherein subsampling is used to obtain the first sub-block; and

decode a second sub-block of the video block based on the first sub-block of the video block, the intra prediction mode, and a parameter associated with the second sub-block.

2. The device of claim 1 , wherein the second sub-block of the video block is decoded based on interpolating the first sub-block of the video block.

3. The device of claim 1 , wherein the processor is further configured to:

obtain a sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a sample of the first sub-block of the video block, wherein the video block is decoded based on the sample of the second sub-block.

4. The device of claim 1 , wherein the processor is further configured to:

obtain a first sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a first sample of the first sub-block of the video block; and

obtain a second sample of the second sub-block based on interpolating the first sample of the first sub-block of the video block and a second sample of the first sub-block of the video block, wherein the video block is decoded based on the first sample and the second sample of the second sub-block.

5. The device of claim 4 , wherein the sample of the neighboring block of the video block comprises a sample of a left neighboring block of the video block, and wherein the sample of the left neighboring block of the video block is on the left of the first sample of the second sub-block.

6. The device of claim 4 , wherein the sample of the neighboring block of the video block comprises a sample of a top neighboring block of the video block, wherein the sample of the top neighboring block of the video block is above the first sample of the second sub-block, and the first sample of the first sub-block of the video block is below the first sample of the second sub-block.

7. The device of claim 1 , wherein the first sub-block of the video block is obtained further based on a neighboring block of the video block.

8. A device for video encoding, comprising:

a processor configured to:

obtain intra prediction mode information associated with a video block;

determine an intra prediction mode of a plurality of intra prediction modes based on the intra prediction mode information;

obtain a first sub-block of the video block based on the intra prediction mode, wherein subsampling is used to obtain the first sub-block; and

obtain encode a second sub-block of the video block based on the first sub-block of the video block, the intra prediction mode, and a parameter associated with the second sub-block.

9. The device of claim 8 , wherein the second sub-block of the video block is encoded based on interpolating the first sub-block of the video block.

10. The device of claim 8 , wherein the processor is further configured to:

obtain a sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a sample of the first sub-block of the video block, wherein the video block is encoded based on the sample of the second sub-block.

11. The device of claim 8 , wherein the processor is further configured to:

obtain a first sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a first sample of the first sub-block of the video block; and

obtain a second sample of the second sub-block based on interpolating the first sample of the first sub-block of the video block and a second sample of the first sub-block of the video block, wherein the video block is encoded based on the first sample and the second sample of the second sub-block.

12. The device of claim 8 , wherein the first sub-block of the video block is obtained further based on a neighboring block of the video block.

13. A method for video decoding, comprising:

obtaining intra prediction mode information associated with a video block;

determining an intra prediction mode of a plurality of intra prediction modes based on the intra prediction mode information;

obtaining a first sub-block of the video block based on the intra prediction mode, wherein subsampling is used to obtain the first sub-block; and

decoding a second sub-block of the video block based on the first sub-block of the video block, the intra prediction mode, and a parameter associated with the second sub-block.

14. The method of claim 13 , wherein the second sub-block of the video block is decoded based on interpolating the first sub-block of the video block.

15. The method of claim 13 , wherein the method further comprises:

obtaining a sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a sample of the first sub-block of the video block, wherein the video block is decoded based on the sample of the second sub-block.

16. The method of claim 13 , wherein the first sub-block of the video block is obtained further based on a neighboring block of the video block.

17. A method for video encoding, comprising:

obtaining intra prediction mode information associated with a video block;

determining an intra prediction mode of a plurality of intra prediction modes based on the intra prediction mode information;

obtaining a first sub-block of the video block based on the intra prediction mode, wherein subsampling is used to obtain the first sub-block; and

obtaining encoding a second sub-block of the video block based on the first sub-block of the video block, the intra prediction mode, and a parameter associated with the second sub-block.

18. The method of claim 17 , wherein the method further comprises:

obtaining a first sample of the second sub-block based on interpolating a sample of a neighboring block of the video block and a first sample of the first sub-block of the video block; and

obtaining a second sample of the second sub-block based on interpolating the first sample of the first sub-block of the video block and a second sample of the first sub-block of the video block, wherein the video block is encoded based on the first sample and the second sample of the second sub-block.

19. The method of claim 18 , wherein the sample of the neighboring block of the video block comprises a sample of a left neighboring block of the video block, and wherein the sample of the left neighboring block of the video block is on the left of the first sample of the second sub-block.

20. The method of claim 18 , wherein the sample of the neighboring block of the video block comprises a sample of a top neighboring block of the video block, wherein the sample of the top neighboring block of the video block is above the first sample of the second sub-block, and the first sample of the first sub-block of the video block is below the first sample of the second sub-block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
Continuity (5)
Continuation 17896350 · Aug 26, 2022
Continuation 15458919 · Mar 14, 2017
Continuation 13615925 · Sep 14, 2012
Provisional Application 61535043 · Sep 15, 2011
Related Publication 20240015321A1 · Jan 11, 2024
References Cited (49)
US 6654503B1 · Sudharsanan et al. · 2003 [cited by applicant]
US 9578331B2 · Ye et al. · 2017 [cited by applicant]
US 20070047656A1 · Kim · 2007 [cited by examiner]
US 20080101707A1 · Mukherjee et al. · 2008 [cited by applicant]
US 20080260027A1 · Karczewicz · 2008 [cited by applicant]
US 20090010333A1 · Tourapis et al. · 2009 [cited by applicant]
US 20090297053A1 · Nakamura et al. · 2009 [cited by applicant]
US 20100208802A1 · Tsukuba et al. · 2010 [cited by applicant]
US 20100278266A1 · Daian et al. · 2010 [cited by applicant]
US 20100290534A1 · Pandey · 2010 [cited by examiner]
US 20110001839A1 · Arimura et al. · 2011 [cited by applicant]
US 20110150087A1 · Kim et al. · 2011 [cited by applicant]
US 20110200095A1 · Kadono et al. · 2011 [cited by applicant]
US 20110310969A1 · Park · 2011 [cited by examiner]
CN 1722836A · 2006 [cited by applicant]
CN 1921630A · 2007 [cited by applicant]
CN 101668205A · 2010 [cited by applicant]
CN 101682770A · 2010 [cited by applicant]
JP 2000156868A · 2000 [cited by applicant]
JP 2003204555A · 2003 [cited by applicant]
JP 2005130417A · 2005 [cited by applicant]
JP 2006237970A · 2006 [cited by applicant]
JP 2009290498A · 2009 [cited by applicant]
JP 2010034802A · 2010 [cited by applicant]
JP 2010263301A · 2010 [cited by applicant]
JP 2011015117A · 2011 [cited by applicant]
TW 1287403B · 2007 [cited by applicant]
TW 200850009A · 2008 [cited by applicant]
TW 201036447A · 2010 [cited by applicant]
WO 2006004331A1 · 2006 [cited by applicant]
WO 2009004985A1 · 2009 [cited by applicant]
WO 2011108240A1 · 2011 [cited by applicant]
Cao, et al., “Report on Short Distance Intra Prediction Method”, JCTVC-E278, Apr. 2011. [cited by applicant]
Choi, et al., “H.264/AVC based Near Lossless Intra Codec using Line-Based Prediction and Modified CABAC”, Multimedia and Expo (ICME), 2011 IEEE International Conference, Jul. 11-15, 2011, 5 pages. [cited by applicant]
ITU-T, “Advanced Video Coding for Generic Audiovisual Services”, H.264, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Nov. 2007, 564 pages. [cited by applicant]
Kanumuri, et al., “Enhancements to Intra Coding”, JCTVC-D235, DoCoMo Communications Laboratories USA, Inc. & NTT DoComo, Inc., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/… [cited by applicant]
Lai, “Te 6.a: HiSilicon Report on Short Distance Intra Prediction”, JCTVC-C101, HiSilicon Technologies Co., Ltd., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 3rd Meeti… [cited by applicant]
Lee, et al., “A Novel Coding Scheme for Intra Pictures of H.264/AVC”, 28th Picture Coding Symposium, PCS2010, Nagoya, Japan, Dec. 8-10, 2010, pp. 62-65. [cited by applicant]
McCann, et al., “HEVC Test Model 3 (HM 3) Encoder Description”, JCTVC-E602, Apr. 2011. [cited by applicant]
Peng, et al., “TE6.a: Report of Line-Based Coding”, JCTVC-C270, Oct. 2010. [cited by applicant]
Piao, et al., “An Adaptive Divide-and-Predict Coding for Intra-Frame of H.264/AVC”, Image Processing (ICIP), 2009 16th IEEE International Conference, Nov. 7-10, 2009, pp. 3421-3424. [cited by applicant]
Sikora, et al., “Shape-Adaptive DCT for Generic Coding of Video”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 5, No. 1, Feb. 1995, 4 pages. [cited by applicant]
SMPTE, “VC-1 Compressed Video Bitstream Format and Decoding Process—Amendment 1”, Amendment 1-2007 to SMPTE 421M-2006, Nov. 29, 2007, 5 pages. [cited by applicant]
Sullivan, et al., “Rate-Distortion Optimization for Video Compression”, IEEE Signal Processing Magazine, Nov. 1998, pp. 74-90. [cited by applicant]
Tan, et al., “Intra-Prediction with Adaptive Sub-Sampling”, JCTVC-B025, Institute for Infocomm Research, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 2nd Meeting: Genev… [cited by applicant]
Tourapis, et al., “H.264/14496-10 AVC Reference Software Manual”, JVT-AE010, Dolby Laboratories Inc., Fraunhofer-Institute HHI, Microsoft Corporation, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC… [cited by applicant]
Wiegand, et al., “WD3: Working Draft 3 of High-Efficiency Video Coding”, JCTVC-E603, Editor, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting: Geneva, CH, Mar. … [cited by applicant]
Wu, et al., “Description of video coding technology proposal by Microsoft”, JCTVC-A118, Microsoft Research Asia, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 1st Meetin… [cited by applicant]
Yamamoto, et al., “A New Intra Mode Using Down-Sampled Macroblock”, ITU-T, Sharp Corporation, VCEG-AE12, Study Group 16 Question 6, Video Coding Experts Group (VCEG), 31st Meeting: Marrakech, MA, Jan. 15-16, 2007, 3 pag… [cited by applicant]