IP Library Granted Patent US 10,958,944
Granted Patent B2
US 10,958,944 · App. 16/729,748 · Granted Mar 23, 2021

Video coding with embedded motion

Inventor: Donald Martin Monro (Beckington, GB)
Assignee: Xylon LLC
H04N19/97H04N19/31H04N19/537H04N19/61H04N19/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,958,944
App. No.
16/729,748
Granted
Mar 23, 2021
Kind
B2
Abstract

Implementations related to coding and/or decoding image data employing video coding with embedded motion are disclosed.

Claims (45)

1. A method for producing a bitstream by an encoder, the encoder including a processor and a memory, the method comprising:

receiving image data comprising a first image frame and a second image frame;

performing a wavelet transform on the image data to generate a wavelet-transformed first image frame and a wavelet-transformed second image frame, wherein performing the wavelet transform includes undertaking the wavelet transform over a plurality of scales;

identifying a first basis function, selected from a dictionary of basis functions, that represents at least, in part, a portion of the wavelet-transformed first image frame that includes two or more pixels of the wavelet-transformed first image frame;

identifying a portion of the wavelet-transformed second image frame that is represented at least by the first basis function and that includes two or more pixels of the wavelet-transformed second image frame;

determining a displacement between the portion of the wavelet-transformed first image frame and the portion of the wavelet-transformed second image frame;

associating motion data with the first basis function, wherein the motion data indicates the displacement; and

producing the bitstream including information indicative of the first basis function as well as information indicative of the motion data.

2. The method of claim 1 , wherein the information indicative of the first basis function comprises a coded atom.

3. The method of claim 2 , wherein the bitstream also includes additional information associated with the coded atom, the additional information indicative of whether the motion data comprises one of a motion vector or a correction to a motion vector.

4. The method of claim 1 , wherein the motion data comprises a motion vector.

5. The method of claim 1 , wherein the associating motion data with the first basis function comprises predicting the motion data based on the first basis function.

6. The method of claim 1 , wherein the motion data comprises a correction to a motion vector.

7. The method of claim 1 , wherein identifying the first basis function that represents at least, in part, the portion of the wavelet-transformed first image frame comprises performing a matching pursuits process on the wavelet-transformed first image frame.

8. The method of claim 1 , wherein performing the wavelet transform includes using a plurality of bands.

9. An apparatus, comprising:

an encoder comprising a processor and a memory, the encoder being adapted to:

receive image data comprising a sequence of one or more image frames, wherein the one or more image frames include a first image frame and a second image frame;

perform a wave let transform on the image data to generate a wavelet-transformed first image frame and a wavelet-transformed second image frame, wherein performing the wavelet transform includes undertaking the wavelet transform over a plurality of scales;

identify a first atom that represents at least, in part, a first portion of the wavelet-transformed first image frame;

identify a second portion of the wavelet-transformed second image frame that is represented at least by the first atom;

determine a displacement between the first portion of the wavelet-transformed first image frame and the second portion of the wavelet-transformed second image frame;

associate motion data with the first atom, wherein the motion data indicates the displacement; and

generate a transmission bitstream using the first atom and the motion data,

wherein the first portion includes two or more pixels of the wavelet-transformed first image frame,

wherein the second portion includes two or more pixels of the wavelet-transformed second image frame, and

wherein the first atom is selected by the encoder from a dictionary of atoms.

10. The apparatus of claim 9 , wherein the encoder is further adapted to produce a bitstream including coded atoms and coded motion data.

11. The apparatus of claim 10 , wherein the bitstream includes additional information associated with at least one of the coded atoms, the additional information indicating whether the coded motion data is associated with the at least one of the coded atoms.

12. The apparatus of claim 11 , wherein when the additional information indicates the coded motion data is associated with the at least one of the coded atoms, the additional information further indicates whether the motion data associated with the at least one of the coded atoms comprises one of a motion vector ora correction to a motion vector.

13. The apparatus of claim 10 , wherein the encoder is further adapted to intersperse the coded motion data with the coded atoms in the bitstream.

14. The apparatus of claim 9 , wherein the encoder s further adapted to perform the wavelet transform by using a plurality of bands.

15. An apparatus, comprising:

a decoder comprising a processor and a memory, the decoder being adapted to:

receive a bitstream, the bitstream representing a wavelet-transformed first image frame and a wavelet-transformed second image frame in a sequence of image frames, the bitstream including coded motion data associated with a first coded atom, wherein the wavelet-transformed first image frame and the wavelet-transformed second image frame result from a wavelet transformation of a first original image frame and a second original image frame respectively, the wavelet transformation including performing wavelet transformation over a plurality of scales;

extract the first coded atom from the bitstream, the first coded atom representing a first portion of the wavelet-transformed first image frame;

extract the coded motion data from the bitstream, wherein the coded motion data indicates a displacement between the first portion of the wavelet-transformed first image frame and a second portion of the wavelet-transformed second image frame, wherein the first coded atom represents the second portion of the wavelet-transformed second image frame; and

generate the wavelet-transformed first image frame and the wavelet-transformed second image frame based on the first coded atom and the displacement,

wherein the first coded atom represents two or more pixels of the wavelet-transformed first image frame, and wherein the first coded atom is included in a dictionary of atoms.

16. The apparatus of claim 15 , wherein the coded motion data includes a correction to a motion vector previously predicted by the decoder, and wherein the decoder is further adapted to use the correction to modify the motion vector.

17. The apparatus of claim 16 , wherein the motion vector comprises a predicted motion vector.

18. The apparatus of claim 15 , wherein:

the bitstream includes additional information indicating whether the first coded atom is associated with the coded motion data; and

the decoder is further adapted to predict a motion vector when the additional information indicates that the first coded atom is not associated with the coded motion data.

19. The apparatus of claim 18 , wherein when the additional information indicates that the first coded atom is associated with the coded motion data, the additional information further indicates whether the coded motion data codes for one of the motion vector or a correction to the motion vector, and wherein the decoder is further adapted to modify the motion vector when the additional information indicates that the coded motion data codes for the correction to the motion vector.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2020
From: MONRO, DONALD M.
To: INTELLECTUAL VENTURES HOLDING 35 LLC
Reel/Frame 051398/0649 →
MERGER Recorded Jan 2, 2020
From: INTELLECTUAL VENTURES HOLDING 35 LLC
To: XYLON LLC
Reel/Frame 051458/0685 →
Continuity (3)
Continuation 16259867 · Jan 28, 2019
Continuation 11678479 · Feb 23, 2007
Related Publication 20200382814A1 · Dec 3, 2020
Cited By (1)
US 12,457,370