IP Library Granted Patent US 12,323,601
Granted Patent B2
US 12,323,601 · App. 18/502,954 · Granted Jun 3, 2025

Reducing motion vector information transmission in bi-directional temporal prediction

Inventors: Krit Panusopone (San Diego, CA); Yue Yu (San Diego, CA); Limin Wang (San Diego, CA)
Assignee: ARRIS Enterprises LLC
H04N19/159H04N19/137H04N19/174H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,601
App. No.
18/502,954
Granted
Jun 3, 2025
Kind
B2
Abstract

A method for inter-coding video is provided in which transmission bandwidth requirements associated with second motion vectors for bi-directional temporal prediction is reduced. In the method motion vector information for only one of the two motion vectors for bi-directional temporal prediction can be transmitted together with information on how to derive or construct the second motion vector. Thus, rather than sending express information regarding two motion vectors, express information related to only one motion vector along with information related to reconstruction/derivation of the second motion vector is transmitted, thus reducing bandwidth requirements and increasing coding efficiency.

Claims (27)

1. A method of decoding a video with a decoder that includes a processor included in a bitstream comprising:

(a) receiving a rectangular coding unit of a coding tree unit of luma samples included in a bi-predictive B-slice of a current frame of said video;

(b) receiving a first motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally previous reference slice of a temporally previous reference frame relative to said current frame of said coding unit;

(c) receiving a second motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally future reference slice of a temporally future reference frame relative to said current frame of said coding unit;

(d) applying an optical flow between said temporally previous reference slice and said temporally future reference slice to perform a sample based motion modification using a corrective motion vector applied to predicted arrays based upon at least one of said first motion vector and said second motion vector; and

(e) decoding said coding unit based upon said sample based motion modification as a result of said applying said optical flow between said temporally previous reference slice and said temporally future reference slice.

2. The method of decoding of claim 1 wherein said modifying comprises information sufficient to reconstruct an MVP index and an MVD of said second motion vector.

3. The method of decoding of claim 1 wherein said modifying comprises a scaling factor.

4. The method of decoding of claim 1 wherein said modifying comprises said second motion vector is a mirror image of said first motion vector.

5. The method of decoding of claim 1 wherein said coding unit is greater than a predefined size.

6. The method of decoding of claim 1 wherein said second motion vector is partially derived based upon said first motion vector.

7. The method of decoding of claim 1 wherein said second motion vector is fully derived based upon said first motion vector.

8. The method of decoding of claim 1 wherein said second motion vector is a scaled version of said first motion vector.

9. The method of decoding of claim 1 wherein said first motion vector is stored in a reference list.

10. The method of decoding of claim 9 wherein said second motion vector is stored in a reference list.

11. A bitstream of compressed video for decoding by a decoder that includes a processor, including a non-transitory computer readable storage medium storing the compressed video, the method comprising:

(a) said bitstream containing data indicating a rectangular coding unit of a coding tree unit of luma samples included in a bi-predictive B-slice of a current frame of said video;

(b) said bitstream containing data indicating a first motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally previous reference slice of a temporally previous reference frame relative to said current frame of said coding unit;

(c) said bitstream containing data indicating a second motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally future reference slice of a temporally future reference frame relative to said current frame of said coding unit;

(d) said bitstream containing data indicating an optical flow between said temporally previous reference slice and said temporally future reference slice to perform a sample based motion modification using a corrective motion vector applied to predicted arrays based upon at least one of said first motion vector and said second motion vector; and

(e) said bitstream containing data indicating said coding unit based upon said sample based motion modification as a result of said applying said optical flow between said temporally previous reference slice and said temporally future reference slice.

12. A method of encoding a video included in a bitstream by an encoder that includes a processor comprising:

(a) providing an encoded bitstream including a rectangular coding unit of a coding tree unit of luma samples included in a bi-predictive B-slice of a current frame of said video;

(b) providing an encoded bitstream including a first motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally previous reference slice of a temporally previous reference frame relative to said current frame of said coding unit;

(c) providing an encoded bitstream including a second motion vector associated with said coding unit of said bi-predictive B-slice of said current frame of said video referencing a temporally future reference slice of a temporally future reference frame relative to said current frame of said coding unit;

(d) providing an encoded bitstream including an optical flow between said temporally previous reference slice and said temporally future reference slice to perform a sample based motion modification using a corrective motion vector applied to predicted arrays based upon at least one of said first motion vector and said second motion vector; and

(e) providing an encoded bitstream including said coding unit based upon said sample based motion modification as a result of said applying said optical flow between said temporally previous reference slice and said temporally future reference slice.

Assignments (2)
SECURITY INTEREST Recorded Apr 8, 2026
From: ARRIS ENTERPRISES LLC; RUCKUS IP HOLDINGS LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075476/0814 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
Continuity (6)
Continuation 17983301 · Nov 8, 2022
Continuation 17163059 · Jan 29, 2021
Continuation 16377833 · Apr 8, 2019
Provisional Application 62656144 · Apr 11, 2018
Provisional Application 62654073 · Apr 6, 2018
Related Publication 20240146937A1 · May 2, 2024
References Cited (28)
US 9300943B2 · Sugio · 2016 [cited by examiner]
US 9445120B2 · Sugio · 2016 [cited by examiner]
US 9456214B2 · Sugio · 2016 [cited by examiner]
US 9584823B2 · Chen · 2017 [cited by examiner]
US 10044466B2 · Schmidt · 2018 [cited by examiner]
US 10171813B2 · Zheng · 2019 [cited by examiner]
US 10171828B2 · Yu · 2019 [cited by examiner]
US 10178383B2 · Jeon · 2019 [cited by examiner]
US 10448010B2 · Chen · 2019 [cited by examiner]
US 10469869B1 · Li · 2019 [cited by examiner]
US 10560712B2 · Zou · 2020 [cited by examiner]
US 10681370B2 · Chen · 2020 [cited by examiner]
US 20050141612A1 · Abe et al. · 2005 [cited by applicant]
US 20050152682A1 · Kang et al. · 2005 [cited by applicant]
US 20050152452A1 · Suzuki · 2005 [cited by applicant]
US 20110080954A1 · Bossen · 2011 [cited by examiner]
US 20130003851A1 · Yu · 2013 [cited by examiner]
US 20170332095A1 · Zou · 2017 [cited by examiner]
US 20170339405A1 · Wang et al. · 2017 [cited by applicant]
US 20190313091A1 · Xu · 2019 [cited by examiner]
US 20190320180A1 · Yu · 2019 [cited by examiner]
CN 107113424A · 2017 [cited by applicant]
WO 2011041321A1 · 2011 [cited by applicant]
PCT International Search Report & Written Opinion, Re: Application No. PCT/US2019/026315, dated Jun. 3, 2019. [cited by applicant]
X. Ji, et al., “New Bi-prediction techniques for B pictures coding”, 2004 IEEE International Conference on Multimedia and Expo, Taipei, Taiwan, vol. 1, Jun. 27, 2004, pp. 101-104. [cited by applicant]
H. Lakshman, et al., “Adaptive motion model selection using a cubic spline based estimation framework”, 2010 17th IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, China, Sep. 26, 2010, pp. 805-8… [cited by applicant]
J. Chen, E. Alshina, G.J. Sullivan, J.-R. Ohm, J. Boyce, “Algorithm description of Joint Exploration Test Model 7 (JEM7)”, JVET-G1001, Jul. 2017. [cited by applicant]
Office Action in Chinese Patent Application No. 201980031144.4 dated Jul. 29, 2023. [cited by applicant]