IP Library Granted Patent US 12,425,637
Granted Patent B2
US 12,425,637 · App. 18/660,738 · Granted Sep 23, 2025

Methods and apparatus for adaptive motion vector candidate ordering for video encoding and decoding

Inventors: Liwei Guo (Sunnyvale, CA); Peng Yin (Ithaca, NY); Yunfei Zheng (San Jose, CA); Joel Sole (San Diego, CA); Qian Xu (Folsom, CA); Xiaoan Lu (Princeton, NJ)
Assignee: INTERDIGITAL VC HOLDINGS, INC.
H04N19/52H04N19/139H04N19/44H04N19/567H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,425,637
App. No.
18/660,738
Granted
Sep 23, 2025
Kind
B2
Abstract

Methods and apparatus are provided for adaptive motion vector candidate ordering for video encoding and decoding. An apparatus includes a video encoder ( 100 ) for encoding a block in a picture by selecting an order of motion vector predictor candidates for the block responsive to a characteristic available at both the video encoder and a corresponding decoder. The characteristic excludes a mode in which the block is partitioned.

Claims (32)

1. An apparatus, comprising:

a video encoder for encoding a block in a picture by selecting an order of motion vector predictor candidates for the block, based on common information available at both an encoder and a corresponding decoder and wherein said common information is not transmitted in an encoded bitstream,

wherein said common information comprises a reference frame index of the motion vector predictor candidates for the block, not derived based on partitioning of the block; and

wherein the motion vector predictor candidates are from spatial or temporal blocks and the order of motion vector predictor candidates is determined based on a difference between a reference frame index of a motion vector predictor candidate and a reference frame index of the block.

2. The apparatus of claim 1 , wherein the common information further comprises a motion vector candidate selection frequency in a number of already encoded blocks.

3. The apparatus of claim 2 , wherein a category classification is performed to determine one of a plurality of categories to which the block belongs, and the motion vector candidate selection frequency is determined from the number of already encoded blocks that belong to the same one of the plurality of categories as the block.

4. The apparatus of claim 3 , wherein a criterion for the category classification is a block prediction type.

5. A method, comprising:

encoding a block in a picture by selecting an order of motion vector predictor candidates for the block, based on common information available at both an encoder and a corresponding decoder and wherein said common information is not transmitted in an encoded bitstream,

wherein said common information comprises a reference frame index of the motion vector predictor candidates for the block, not derived based on partitioning of the block; and

wherein the motion vector predictor candidates are from spatial or temporal blocks and the order of motion vector predictor candidates is determined based on a difference between a reference frame index of a motion vector predictor candidate and a reference frame index of the block.

6. The method of claim 5 , wherein the common information further comprises a motion vector candidate selection frequency in a number of already encoded blocks.

7. The method of claim 6 , wherein a category classification is performed to determine one of a plurality of categories to which the block belongs, and the motion vector candidate selection frequency is determined from the number of already encoded blocks that belong to the same one of the plurality of categories as the block.

8. The method of claim 7 , wherein a criterion for the category classification is a block prediction type.

9. An apparatus, comprising:

a video decoder for decoding a block in a picture by selecting an order of motion vector predictor candidates for the block, based on common information available at both an encoder and a corresponding decoder and wherein said common information is not in a received bitstream,

wherein said common information comprises a reference frame index of the motion vector predictor candidates for the block, not derived based on partitioning of the block; and

wherein the motion vector predictor candidates are from spatial or temporal blocks and the order of motion vector predictors candidates is determined based on a difference between a reference frame index of a motion vector predictor candidate and a reference frame index of the block.

10. The apparatus of claim 9 , wherein the common information further comprises a motion vector candidate selection frequency in a number of already encoded blocks.

11. The apparatus of claim 10 , wherein a category classification is performed to determine one of a plurality of categories to which the block belongs, and the motion vector candidate selection frequency is determined from the number of already encoded blocks that belong to the same one of the plurality of categories as the block.

12. The apparatus of claim 11 , wherein a criterion for the category classification is a block prediction type.

13. A method, comprising:

decoding a block in a picture by selecting an order of motion vector predictor candidates for the block, based on common information available at both an encoder and a corresponding decoder and wherein said common information is not in a received bitstream,

wherein said common information comprises a reference frame index of the motion vector predictor candidates for the blocks, not derived based on partitioning of the block; and

wherein the motion vector predictor candidates are from spatial or temporal blocks and the order of motion vector predictors candidates is determined based on a difference between a reference frame index of a motion vector predictor candidate and a reference frame index of the block.

14. The method of claim 13 , wherein the common information further comprises a motion vector candidate selection frequency in a number of already encoded blocks.

15. The method of claim 14 , wherein a category classification is performed to determine one of a plurality of categories to which the block belongs, and the motion vector candidate selection frequency is determined from the number of already encoded blocks that belong to the same one of the plurality of categories as the block.

16. The method of claim 15 , wherein a criterion for the category classification is a block prediction type.

17. A non-transitory computer readable storage media having instructions stored thereupon that when executed on a processor, cause the processor to perform the method of claim 13 .

18. The non-transitory computer readable storage media of claim 17 , wherein the common information further comprises a motion vector candidate selection frequency in a number of already encoded blocks.

19. The non-transitory computer readable storage media of claim 18 , wherein a category classification is performed to determine one of a plurality of categories to which the block belongs, and the motion vector candidate selection frequency is determined from the number of already encoded blocks that belong to the same one of the plurality of categories as the block.

20. The non-transitory computer readable storage media of claim 19 , wherein a criterion for the category classification is a block prediction type.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2024
From: GUO, LIWEI; YIN, PENG; ZHENG, YUNFEI; SOLE, JOEL; XU, QIAN; LU, XIAOAN
To: THOMSON LICENSING
Reel/Frame 067614/0624 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: THOMSON LICENSING
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 067419/0605 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: GUO, LIWEI; YIN, PENG; ZHENG, YUNFEI; XU, QIAN; LU, XIAOAN
To: THOMSON LICENSING
Reel/Frame 067420/0136 →
Continuity (7)
Continuation 17967154 · Oct 17, 2022
Continuation 16904695 · Jun 18, 2020
Continuation 16006914 · Jun 13, 2018
Continuation 15295354 · Oct 17, 2016
Division 13698468
Provisional Application 61346539 · May 20, 2010
Related Publication 20240298023A1 · Sep 5, 2024
References Cited (82)
US 6381277B1 · Chun et al. · 2002 [cited by applicant]
US 8085844B2 · Holcomb · 2011 [cited by examiner]
US 8385420B2 · Lee et al. · 2013 [cited by applicant]
US 8537897B2 · Lee et al. · 2013 [cited by applicant]
US 8842729B2 · Su · 2014 [cited by examiner]
US 8867621B2 · Lee et al. · 2014 [cited by applicant]
US 9008182B2 · Tsai et al. · 2015 [cited by applicant]
US 9131239B2 · Zheng · 2015 [cited by examiner]
US 9143782B2 · Yin · 2015 [cited by examiner]
US 9277241B2 · Chien · 2016 [cited by examiner]
US 9282338B2 · Zheng · 2016 [cited by examiner]
US 9288508B2 · Chien · 2016 [cited by examiner]
US 9300978B2 · Hallapuro · 2016 [cited by examiner]
US 9313494B2 · Zheng · 2016 [cited by examiner]
US 9451287B2 · Chien · 2016 [cited by examiner]
US 9510009B2 · Guo · 2016 [cited by examiner]
US 9521429B2 · Yin · 2016 [cited by examiner]
US 9525888B2 · Yin · 2016 [cited by examiner]
US 9565447B2 · Lee et al. · 2017 [cited by applicant]
US 10021412B2 · Guo · 2018 [cited by examiner]
US 10721490B2 · Guo · 2020 [cited by examiner]
US 12022108B2 · Guo · 2024 [cited by examiner]
US 20040047418A1 · Tourapis · 2004 [cited by examiner]
US 20040114817A1 · Jayant et al. · 2004 [cited by applicant]
US 20040264572A1 · Sato et al. · 2004 [cited by applicant]
US 20050008240A1 · Banerji · 2005 [cited by examiner]
US 20050013498A1 · Srinivasan et al. · 2005 [cited by applicant]
US 20050053137A1 · Holcomb · 2005 [cited by examiner]
US 20050111547A1 · Holcomb · 2005 [cited by examiner]
US 20050152452A1 · Suzuki · 2005 [cited by applicant]
US 20060083308A1 · Schwarz · 2006 [cited by examiner]
US 20070177674A1 · Yang · 2007 [cited by applicant]
US 20080159400A1 · Lee · 2008 [cited by examiner]
US 20080165849A1 · Moriya et al. · 2008 [cited by applicant]
US 20080240242A1 · Lainema · 2008 [cited by applicant]
US 20090034856A1 · Moriya et al. · 2009 [cited by applicant]
US 20090034857A1 · Moriya et al. · 2009 [cited by applicant]
US 20090123066A1 · Moriya et al. · 2009 [cited by applicant]
US 20090304084A1 · Hallapuro · 2009 [cited by examiner]
US 20100026903A1 · Tetsukawa et al. · 2010 [cited by applicant]
US 20100239017A1 · Lee et al. · 2010 [cited by applicant]
US 20110013697A1 · Choi et al. · 2011 [cited by applicant]
US 20110194609A1 · Rusert et al. · 2011 [cited by applicant]
US 20110211640A1 · Kim et al. · 2011 [cited by applicant]
US 20110235711A1 · Kondo et al. · 2011 [cited by applicant]
US 20110293017A1 · Suzuki · 2011 [cited by examiner]
US 20120027094A1 · Sato et al. · 2012 [cited by applicant]
US 20130064301A1 · Guo · 2013 [cited by examiner]
US 20130163668A1 · Chen · 2013 [cited by examiner]
US 20130272409A1 · Seregin · 2013 [cited by examiner]
US 20170041628A1 · Guo et al. · 2017 [cited by applicant]
CA 3063746 · 2018 [cited by applicant]
CA 3063746A1 · 2018 [cited by examiner]
CN 109417629 · 2019 [cited by applicant]
CN 109417629A · 2019 [cited by examiner]
EP 1528812 · 2005 [cited by applicant]
EP 1528812A1 · 2005 [cited by examiner]
KR 20050111547 · 2005 [cited by applicant]
KR 20070053842 · 2007 [cited by applicant]
WO WO2008082762 · 2008 [cited by applicant]
WO WO2009115901 · 2009 [cited by applicant]
WO WO2009115901A2 · 2009 [cited by examiner]
Paul et al: Adaptive Search Range Selection for Scalable Video Coding Extension of H.264/AVC, TENCON20008 IEEE Region 10 CONF., Nov. 19-21, 2008, pp. 1-4.—* cited in parent. [cited by applicant]
Kumar etal: “An Efficient Motion Vector Composition Scheme for Arbitrary Frame Down-Sampling Video Transcoder”, IEEE, vol. 16, No. 9, Sep. 2006, pp. 1148-1152.—* cited in parent. [cited by applicant]
Kim etal: “An efficient skip mode competion scheme based on vector clustering and object boundary detection”, Electronics EXpress, IEICE 2010, vol. 7, No. 6, pp. 447-453.—* cited in parent. [cited by applicant]
Huang etal: Analysis and Complexity reduction of Multiple Reference Frames Motion Estimation in H.264/AVC, IEEE, vol. 16, No. 4, Apr. 2006, pp. 507-522.—* cited in parent. [cited by applicant]
Lee et al: “Block Motion Estimation based on Selective Integral Projections”, Image Processing 2002, Int'l Conf., vol. 1, pp. I-689-I692.—* cited in parent. [cited by applicant]
Liao etal: “Enhanced Fast Mode Decision Based on Edge Map and Motion Detail Analysis For H.264/JVT”, 2005 IEEE May 28-30, 2005, pp. 187-190.—* cited in parent. [cited by applicant]
ITU-T; H.264 (Mar. 2005), “Advanced video coding for generic audiovisual services”, Series H: Audiovisual and Multimedia Systems—* cited in parent. [cited by applicant]
McCann et al: Samsung's Response to the Call for Proposals on Video Compression Technology, JCTVC-A124; Apr. 15-23, 2010.—* cited in parent. [cited by applicant]
Dai et al., “Motion Vector Coding Based on Optimal Predictor Selection”, Advances in Multimedia Information Processing—PCM 2009, Berlin, Heidelberg, Dec. 15, 2009, pp. 1040-1047.—* cited in parent. [cited by applicant]
Luo et al: Motion Vector Predictor Selection For The Enhancement Layer in the H.264/AVC Extension-Spatial SVC, Picture Coding Symposium, May 6-8, 2009, pp. 1-4.—* cited in parent. [cited by applicant]
Jakubowski et al: “Multi-Path Adaptive Computation-Aware Search Strategy for Block-Based Motion Estimation”, EUROCON Sep. 9-12, 2007 Int'l Conf. on “Computer as a Tool”, pp. 175-181.—* cited in parent. [cited by applicant]
Nisar et al: “Multiple Initial Point Prediction based Block Motion Estimation Algorithm”; Consumer Electronics, Jun. 20-23, 2007, IEEE Int'l Symposium, pp. 1-6.—* cited in parent. [cited by applicant]
Ates et al: “Rate-Distortion and Complexity Optimized Motion Estimation for H.264 Video Coding”, IEEE Transactions on Circuits . . . ; vol. 18, No. 2, Feb. 2008, pp. 159-171.—* cited in parent. [cited by applicant]
Laroche, et al., “RD Optimized Coding for Motion Vector Predictor Selection”, IEEE Transactions on Circuits and Systems, vol. 17, No. 12, Dec. 1, 2008, pp. 168-1691—* cited in parent. [cited by applicant]
Dai et al., Motion Vector Coding Based on Predictor Selection and Boundary-Matching Estimation, IEEE Multimedia Signal Processing Conference, MMSP '09, Oct. 5-7, 2009, pp. 1-5—* cited in parent. [cited by applicant]
Kamp et al., Decoder Side Motion Vector Derivation for Inter Frame Video Coding, Image Processing 2008, ICIP 2008, 15th IEEE International Conference, Oct. 12, 2008, pp. 1120-1123.—* cited in parent. [cited by applicant]
Liu et al., “Adaptive Motion Vector Prediction Based on Spatiotemporal Correlation”, 2006 International Conference on Wireless Communications, Networking and Mobile Computing, (WICOM 2006), Sep. 1, 2006, pp. 1-4.—* cite… [cited by applicant]
Park et al., CE9 Subtests N and O: Improvement on AMVP, JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/ WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011, Document JCTVC-E350—* cited in parent. [cited by applicant]
Zheng et al., Extended Motion Vector Prediction for Bi Predictive Mode, (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WVG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011, Document JCTVC-E343—* cited in parent. [cited by applicant]
Zheng et al., Unified Motion Vector Predictor Selection for Merge and AMVP, JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011, Document JCTVC-E396—* cited in parent. [cited by applicant]