IP Library › Granted Patent US 12,348,732
Granted Patent B2
US 12,348,732 · App. 18/483,175 · Granted Jul 1, 2025

Encoder, a decoder and corresponding methods using compact MV storage

Inventors: Maxim Borisovitch Sychev (Moscow, RU); Timofey Mikhailovich Solovyev (Munich, DE); Alexander Alexandrovich Karabutov (Munich, DE); Sergey Yurievich Ikonin (Moscow, RU); Jianle Chen (San Diego, CA)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/137H04N19/159H04N19/176H04N19/46H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,732
App. No.
18/483,175
Granted
Jul 1, 2025
Kind
B2
Abstract

The disclosure provides a motion vector compression method, comprising: obtaining a temporal motion vector; determining a compressed motion vector using a binary representation of the temporal motion vector comprising an exponent part and/or a mantissa part, wherein the exponent part comprises N bits, the mantissa part comprises M bits, and wherein N is a non-negative integer and M is a positive integer; and performing a temporal motion vector prediction (TMVP) using the compressed motion vector.

Claims (64)

1. A motion vector compression method, comprising:

obtaining an 18 bit temporal motion vector;

determining a compressed motion vector of the 18 bit temporal motion vector when an indicator indicates the 18 bit temporal motion vector need to be compressed, wherein a binary representation of the compressed motion vector comprising an exponent part or a mantissa part, wherein the exponent part comprises N bits, the mantissa part comprises M bits, wherein N is a non-negative integer and M is a positive integer, and wherein the representation of the compressed motion vector is 10 bits; and

performing a temporal motion vector prediction (TMVP) using the compressed motion vector;

wherein the determining a compressed motion vector, comprises:

removing least significant bits (LSB) by clipping the obtained temporal motion vector.

2. The motion vector compression method of claim 1 , wherein

the exponent part corresponds to most significant bit(s) (MSB) of the binary representation and the mantissa part corresponds to least significant bit(s) (LSB) of the binary representation; or,

the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation.

3. The motion vector compression method of claim 2 , further comprising: when the exponent part corresponds to MSB of the binary representation and the mantissa part corresponds to LSB of the binary representation, deriving a value of the compressed motion vector by:

deriving a first shift value by applying a right shift of M bit to the binary representation;

deriving last M bit of the binary representation as a first basic binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the first shift value to the first basic binary representation.

4. The motion vector compression method of claim 2 , further comprising: when the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation, deriving a value of a motion vector component by:

deriving last N bit of the binary representation as a second shift value;

deriving a second basic binary representation by applying a right shift of N bit to the binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the second shift value to the second basic binary representation.

5. The motion vector compression method of claim 1 , wherein the 18 bit temporal motion vector comprises a motion vector horizontal component and a motion vector vertical component.

6. A non-transitory computer-readable storage medium storing executable instructions for execution by a processing circuitry, wherein the executable instructions, when executed by the processing circuitry, configures the processing circuitry to carry out the method according to claim 1 .

7. A video data decoding device, comprising:

a memory storage, configured to store video data in a form of a bitstream; and

a video decoder, configured to perform the method according to claim 1 .

8. A encoder, comprising:

a circuitry configured to perform the method of claim 1 .

9. A video data encoding device, comprising:

a memory storage, configured to store video data in a form of a bitstream; and

a video decoder, configured to perform the method according to claim 1 .

10. A non-transitory storage medium storing a bitstream and one or more instructions executable by at least one processor to perform operations of encoding or decoding of the bitstream, the operations comprising:

obtaining an 18 bit temporal motion vector;

determining a compressed motion vector of the 18 bit temporal motion vector when an indicator indicates the 18 bit temporal motion vector need to be compressed, wherein a binary representation of the compressed motion vector comprising an exponent part or a mantissa part, wherein the exponent part comprises N bits, the mantissa part comprises M bits, wherein N is a non-negative integer and M is a positive integer, and wherein the representation of the compressed motion vector is 10 bits; and

performing a temporal motion vector prediction (TMVP) using the compressed motion vector;

wherein the determining a compressed motion vector, comprises:

removing least significant bits (LSB) by clipping the obtained temporal motion vector.

11. The storage medium of claim 10 , wherein

the exponent part corresponds to most significant bit(s) (MSB) of the binary representation and the mantissa part corresponds to least significant bit(s) (LSB) of the binary representation; or,

the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation.

12. The storage medium of claim 11 , wherein the operations further comprise: when the exponent part corresponds to MSB of the binary representation and the mantissa part corresponds to LSB of the binary representation, deriving a value of the compressed motion vector by:

deriving a first shift value by applying a right shift of M bit to the binary representation;

deriving last M bit of the binary representation as a first basic binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the first shift value to the first basic binary representation.

13. The storage medium of claim 11 , wherein the operations further comprise: when the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation, deriving a value of a motion vector component by:

deriving last N bit of the binary representation as a second shift value;

deriving a second basic binary representation by applying a right shift of N bit to the binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the second shift value to the second basic binary representation.

14. The storage medium of claim 10 , wherein the 18 bit temporal motion vector comprises a motion vector horizontal component and a motion vector vertical component.

15. A decoder, comprising:

a circuitry configured to perform operations of:

obtaining an 18 bit temporal motion vector;

determining a compressed motion vector of the 18 bit temporal motion vector when an indicator indicates the 18 bit temporal motion vector need to be compressed, wherein a binary representation of the compressed motion vector comprising an exponent part or a mantissa part, wherein the exponent part comprises N bits, the mantissa part comprises M bits, wherein N is a non-negative integer and M is a positive integer, and wherein the representation of the compressed motion vector is 10 bits; and

performing a temporal motion vector prediction (TMVP) using the compressed motion vector;

wherein the determining a compressed motion vector, comprises:

removing least significant bits (LSB) by clipping the obtained temporal motion vector.

16. The decoder of claim 15 , wherein

the exponent part corresponds to most significant bit(s) (MSB) of the binary representation and the mantissa part corresponds to least significant bit(s) (LSB) of the binary representation; or,

the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation.

17. The decoder of claim 16 , wherein the operations further comprise: when the exponent part corresponds to MSB of the binary representation and the mantissa part corresponds to LSB of the binary representation, deriving a value of the compressed motion vector by:

deriving a first shift value by applying a right shift of M bit to the binary representation;

deriving last M bit of the binary representation as a first basic binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the first shift value to the first basic binary representation.

18. The decoder of claim 16 , wherein the operations further comprise: when the exponent part corresponds to LSB of the binary representation and the mantissa part corresponds to MSB of the binary representation, deriving a value of a motion vector component by:

deriving last N bit of the binary representation as a second shift value;

deriving a second basic binary representation by applying a right shift of N bit to the binary representation; and

deriving the value of the compressed motion vector by applying a left shift of the second shift value to the second basic binary representation.

19. The decoder of claim 15 , wherein the 18 bit temporal motion vector comprises a motion vector horizontal component and a motion vector vertical component.

Continuity (5)
Continuation 17358572 · Jun 25, 2021
Continuation PCTRU2019050260 · Dec 27, 2019
Provisional Application 62786344 · Dec 29, 2018
Provisional Application 62786343 · Dec 29, 2018
Related Publication 20240040126A1 · Feb 1, 2024
References Cited (62)
US 10009610B2 · Puri · 2018 [cited by examiner]
US 10616598B2 · Takahashi · 2020 [cited by examiner]
US 20040008776A1 · Haskell et al. · 2004 [cited by applicant]
US 20040240557A1 · Haskell et al. · 2004 [cited by applicant]
US 20120207220A1 · Kim et al. · 2012 [cited by applicant]
US 20130315571A1 · Park et al. · 2013 [cited by applicant]
US 20130329795A1 · Tourapis et al. · 2013 [cited by applicant]
US 20140355665A1 · Wegener · 2014 [cited by applicant]
US 20150023405A1 · Joshi et al. · 2015 [cited by applicant]
US 20150195573A1 · Aflaki Beni et al. · 2015 [cited by applicant]
US 20160239265A1 · Duong · 2016 [cited by examiner]
US 20170201768A1 · Matsunobu et al. · 2017 [cited by applicant]
US 20170289566A1 · He · 2017 [cited by examiner]
US 20170332099A1 · Lee et al. · 2017 [cited by applicant]
US 20170347026A1 · Hannuksela · 2017 [cited by applicant]
US 20190034082A1 · Gonzalez et al. · 2019 [cited by applicant]
US 20190253492A1 · Gonzalez et al. · 2019 [cited by applicant]
US 20210021834A1 · Paluri et al. · 2021 [cited by applicant]
US 20220014779A1 · Misra · 2022 [cited by examiner]
US 20220150529A1 · Lim et al. · 2022 [cited by applicant]
US 20220286704A1 · Misra · 2022 [cited by examiner]
CN 101221490A · 2008 [cited by applicant]
CN 104620582A · 2015 [cited by applicant]
CN 105900425A · 2016 [cited by applicant]
CN 107517384A · 2017 [cited by applicant]
CN 108076666A · 2018 [cited by applicant]
CN 108293131A · 2018 [cited by applicant]
JP 2014509479A · 2014 [cited by applicant]
JP 2017532885A · 2017 [cited by applicant]
JP 2021518084A · 2021 [cited by applicant]
RU 2658883C1 · 2018 [cited by applicant]
WO 2004100556A2 · 2004 [cited by applicant]
WO 2014034480A1 · 2014 [cited by applicant]
WO 2015010037A1 · 2015 [cited by applicant]
WO 2015052064A1 · 2015 [cited by applicant]
WO 2015104456A1 · 2015 [cited by applicant]
WO 2017197126A1 · 2017 [cited by applicant]
WO 2019194436A1 · 2019 [cited by applicant]
WO 2020100988A1 · 2020 [cited by applicant]
Benjamin Bross et al:“Versatile Video Coding (Draft 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, Document: JVET-L1001-v7 (Year: 2018). [cited by examiner]
Jianle Chen et al: “Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1002-v3 (version 3) “JVET-K1002-v2… [cited by examiner]
Bossen (Bossentech) Fet Al, Non-CE4: Temporal Motion Buffer Compression , 13.Ih JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 / \ND ITU-TSG. 16). No. JV… [cited by applicant]
Document: JVET-L0001-v1, Gary J_ Sullivan et al., Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ EC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, total 3 pages. [cited by applicant]
Document: JVET-K0086-v4, Hyeongmun Jang et al., [non-CE] Temporal motion vector data storage reduction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul… [cited by applicant]
Bross Bet Al: Versatile Video Coding (Draft 4) , 13. JVET Meeti Ng; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ). No. JVET-M1001-v4, KP030202597, … [cited by applicant]
Document: JVET-L0168, Hyeongmun Jang et al., Motion vector representing bit reduction, Joint Video Experts Team JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, total 3 … [cited by applicant]
Bross B et al: Versatile Video Coding(Drafl 3) , 12th. Jvet Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-L 1001-v6, KP030251958, 20… [cited by applicant]
Document: JVET-L0169, Hyeongmun Jang et al., CE4.8.1 Temporal motion data storage reduction, Joint Video Expert! ?earn (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, … [cited by applicant]
ITU-T H.261 (03/93), Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p x 64 kbils, total 29 pages. [cited by applicant]
ITU-T H.264(Apr. 2017), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, total 812 pages. [cited by applicant]
TU-T H.265(Feb. 2018), Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services-Coding of moving video, High efficiency video coding, total 692 pages. [cited by applicant]
Lok Ming Lui et al., “Texture Map and Video Compression Using Beltrami Representation”,2013 Society for Industrial and Applied Mathematics, total:23pages. [cited by applicant]
Wang, P. et al., “The alpha parallelogram predictor: A lossless compression method for motion capture data”, Information Sciences: an International Journal, vol. 232, May 2013, pp. 1 10. [cited by applicant]
Document: JCIVC-J0225, Alistair Goudie et al., Restrictions to the maximum motion vector range, Joint Collaborative 1 Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: Stockh… [cited by applicant]
Document: JVET-M0512_r2, F. Bossen et al, Non-CE4: On Temporal Motion Buffer Compression, Joint Video Experts 2 Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019… [cited by applicant]
Irvine, K. R., “Tutorial: Floating-Point Binary”, 2000 [retrieved from internet on Nov. 15, 2022] URL: hllps://web.archive.org/web/20170420191926/hllp://csll-csm .semo.edu/xzhang/Class%20Folder/CS280/Workbook _ HTMU rLO… [cited by applicant]
Pengjie Wang et al., “The alpha parallelogram predictor: A lossless compression method for motion capture data”, vol. 232, May 20, 2013, pp. 1-10,total:10pages. [cited by applicant]
Jingying Li et al., “Analysis of DvD (Digital Video Disc) System”, Oct. 17, 1998, total:6pages. [cited by applicant]
Zhao huan, Study on Digital Rights Management Based on P2P Stream-media, Jun. 2009, 2 pages (abstract). [cited by applicant]
W.-J. Han et al., “Improved Video Compression Efficiency Through Flexible Unit Representation and Corresponding Extension of Coding Tools,” in IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, No.… [cited by applicant]
Benjamin Bross et al.:“Versatile Video Coding (Draft 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, Document: JVET-L1001-v7, total 223 p… [cited by applicant]
Jianle Chen et al: “Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1002-v3 (version 3) “JVET-K1002-v2… [cited by applicant]