IP Library Granted Patent US 7,023,923
Granted Patent B2
US 7,023,923 · App. 10/218,214 · Granted Apr 4, 2006

Motion compensated temporal filtering based on multiple reference frames for wavelet based coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,023,923
App. No.
10/218,214
Granted
Apr 4, 2006
Kind
B2
Abstract

The present invention is directed to a method and device for encoding a group of video frames. According to the present invention, regions in at least one frame in the group are matched to regions in multiple reference frames. The difference between pixel values of the regions in the at least one frame and the regions in the multiple reference frames is calculated. The difference is transformed into wavelet coefficients. The present invention is also directed to a method and device for decoding a group of frames by performing the inverse of the above described encoding.

Claims (51)

1. A method for encoding a group of video frames, comprising the steps of:

matching regions in at least one frame in the group to regions in multiple reference frames;

calculating a difference between pixel values of the regions in the at least one frame and the regions in the multiple reference frames forming a frame with a single sideband only;

transforming the frame into wavelet coefficients.

2. The method of claim 1 , wherein the multiple reference frames are previous frames in the group.

3. The method of claim 1 , wherein the multiple reference frames are proceeding frames in the group.

4. The method of claim 1 , wherein the multiple reference frames are previous and proceeding frames in the group.

5. The method of claim 1 , which further includes dividing the difference between pixels in the regions in the at least frame and the regions in the multiple frames by a scaling factor.

6. The method of claim 1 , which further includes encoding the wavelet coefficients according to significance information.

7. The method of claim 1 , which further includes entropy encoding the wavelet coefficients.

8. A computer readable memory medium including code for encoding a group of video frames, the code comprising:

a code for matching regions in at least one frame in the group to regions in multiple reference frames;

a code for calculating a difference between pixel values of the regions in the at least one frame and the regions in the multiple reference frames forming a frame with a single sideband only;

a code for transforming the frame into wavelet coefficients.

9. A device for encoding a video sequence, comprising:

a partition unit for dividing the video sequence into groups of frames;

a unit for motion compensated temporally filtering at least one frame in each group using multiple reference frames forming frame with a single sideband only; and

a spatial decomposition unit for transforming each group into wavelet coefficients.

10. The device of claim 9 , wherein the motion compensated temporally filtering unit includes:

a motion estimation unit for matching regions in the at least one frame to regions in the multiple reference frames; and

a temporal filtering unit for calculating a difference between pixel values of the regions in the at least frame and the regions in the multiple reference frames forming the frame with the single sideband only.

11. The device of claim 9 , wherein the multiple reference frames are previous frames in the same group.

12. The device of claim 9 , wherein the multiple reference frames are proceeding frames in the same group.

13. The device of claim 9 , wherein the multiple reference frames are previous and proceeding frames in the same group.

14. The device of claim 10 , wherein the temporal filtering unit divides the difference between pixels in the regions in the at least one frame and the regions in the multiple reference frames by a scaling factor.

15. The device of claim 9 , which further includes a unit for encoding the wavelet coefficients according to significance information.

16. The device of claim 9 , which further includes an entropy encoding unit for encoding the wavelet coefficients into a bit-stream.

17. A method of decoding a bit-stream including a group of encoded video frames, comprising the steps of:

entropy decoding the bit-stream to produce wavelet coefficients;

transforming the wavelet coefficients into partially decoded frames including at least one frame including a single sideband only; and

inverse temporal filtering the at least one frame using multiple reference frames.

18. The method of claim 17 , wherein the inverse temporal filtering includes:

retrieving regions from the multiple reference frames previously matched to regions in the at least one frame; and

adding pixel values of the regions in the multiple reference frames to pixel values of the regions in the at least one frame.

19. The method of claim 18 , wherein the step of retrieving regions from multiple reference frames is performed according to motion vectors and frame numbers included in the bit-stream.

20. The method of claim 17 , wherein the multiple reference frames are previous frames in the group.

21. The method of claim 17 , wherein the multiple reference frames are proceeding frames in the group.

22. The method of claim 17 , wherein the multiple reference frames are previous and proceeding frames in the group.

23. The method of claim 17 , which further includes multiplying the at least one frame by a scaling factor.

24. The method of claim 17 , which further includes decoding the wavelet coefficients according to significance information.

25. A computer readable memory medium including code for decoding a bit-stream including a group of encoded video frames, the code comprising:

a code for entropy decoding the bit-stream to produce wavelet coefficients;

a code for transforming the wavelet coefficients into partially decoded frames including at least one frame including a single sideband only; and

a code for inverse temporal filtering the at least one frame using multiple reference frames.

26. A device for decoding a bit-stream including a group of encoded video frames, comprising:

an entropy decoding unit for decoding the bit-stream into wavelet coefficients;

a spatial recomposition unit for transforming the wavelet coefficients into partially decoded frames including at least one frame including a single sideband only; and

an inverse temporal filtering unit for retrieving regions from multiple reference frames previously matched to regions in at least one frame and adding pixel values of the regions in the multiple reference frames to pixel values of the regions in the at least one frame.

27. The device of claim 26 , wherein the retrieving regions from multiple reference frames is performed according to motion vectors and frame numbers included in the bit-stream.

28. The device of claim 26 , wherein the inverse temporal filtering unit multiplies the at least one frame by a scaling factor.

29. The device of claim 26 , which further includes a significance decoding unit for decoding the wavelet coefficients according to significance information.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2011
From: IPG ELECTRONICS 503 LIMITED
To: FUNAI ELECTRIC CO., LTD.
Reel/Frame 027497/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2009
From: KONINKLIJKE PHILIPS ELECTRONICS N.V.
To: IPG ELECTRONICS 503 LIMITED
Reel/Frame 022203/0791 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2002
From: TURAGA, DEEPAK S.; VAN DER SCHAAR, MIHAELA
To: KONINKLIJKE PHILIPS ELECTRONICS N.V.
Reel/Frame 013208/0265 →