IP Library Granted Patent US 7,991,051
Granted Patent B2
US 7,991,051 · App. 10/580,103 · Granted Aug 2, 2011

Interframe wavelet coding apparatus and method capable of adjusting computational complexity

Assignees: Electronics and Telecommunications Research Institute; Industry Academic Cooperation Foundation of Kyunghee University
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,991,051
App. No.
10/580,103
Granted
Aug 2, 2011
Kind
B2
Abstract

Provided is an inter-frame wavelet coding apparatus that can reduce the computation complexity of a decoder by adjusting a decomposition level and a filter length based on the information amount of a frame during wavelet transform and a method therefor. The inter-frame wavelet coding apparatus includes: a Motion Compensated Temporal Filtering (MCTF) unit for computing a motion vectors of a group of pictures (GOP) and filtering the GOP with respect to the temporal axis, to thereby obtain filtered frame; a wavelet transforming unit for performing spatial wavelet transform on the filtered frame and outputting a wavelet coefficient; a quantization unit for quantizing the wavelet coefficient; an entropy coding unit for entropy-coding the motion vector computed in the MCTF unit and the quantized wavelet coefficient, to thereby generate an entropy-coded bit stream; and a wavelet filter managing unit for selecting a decomposition level and a filter length for the wavelet transforming unit based on motion estimation information of the GOP video computed in the MCTF unit, wherein the decomposition level and the filter length are included in the entropy-coded bit stream.

Claims (72)

1. An inter-frame wavelet coding apparatus, comprising:

a Motion Compensated Temporal Filtering (MCTF) unit for computing motion vectors of a group of pictures (GOP), and performing a lowpass filtering and a highpass filtering the GOP with respect to a first temporal axis using the motion vectors, in order to obtain a lowpass and a highpass filtered frames;

wherein the MCTF unit performs the lowpass filtering and the highpass filtering on the lowpass filtered frame of the first temporal axis for at least one or more second temporal axis;

a wavelet transforming unit for performing spatial wavelet transform on each of the highpass filtered frames and a final lowpass filtered frame and outputting wavelet coefficients of each temporal level for each of the highpass filtered frames and the final lowpass filtered frame;

a quantization unit for quantizing the wavelet coefficients;

an entropy coding unit for entropy-coding the motion vectors and the quantized wavelet coefficients, in order to generate an entropy-coded bit stream; and

a wavelet filter managing unit for selecting a decomposition level and a filter length for the wavelet transforming unit based on motion estimation information of the GOP, which are obtained by performing the lowpass filtering and the highpass filtering the GOP in the MCTF unit;

wherein the wavelet filter managing unit respectively selects the decomposition level and the filter length for each of the highpass filtered frames and the final lowpass filtered frame;

wherein the decomposition level and the filter length for each of the highpass filtered frames are selected properly to the amount of information of each frame based on the motion estimation information;

wherein the decomposition level and the filter length for the final lowpass filtered frame are selected a maximum decomposition level and a maximum filter length;

wherein the decomposition level and the filter length are included in the entropy-coded bit stream.

2. The inter-frame wavelet coding apparatus as recited in claim 1 , wherein the wavelet filter managing unit selects the decomposition level and the filter length based on a computing capability of a decoding apparatus to minimize a decoding computation of the decoding apparatus by having an optimum computation amount.

3. The inter-frame wavelet coding apparatus as recited in claim 1 , wherein the wavelet transforming unit includes:

a first wavelet transformer having the maximum decomposition level and the maximum filter length, and wavelet-transforming the final lowpass-filtered frame; and

a second wavelet transformer having a decomposition level and a filter length equal to or smaller than the decomposition level and the filter length of the first wavelet transformer, and wavelet-transforming each of the highpass filtered frames.

4. The inter-frame wavelet coding apparatus as recited in claim 3 , wherein the wavelet filter managing unit selects a 9/7 filter having a three or four-stage decomposition level as the first wavelet transformer.

5. The inter-frame wavelet coding apparatus as recited in claim 3 , wherein the wavelet filter managing unit selects a 5/3 filter having a three or four-stage decomposition level as the first wavelet transformer.

6. The inter-frame wavelet coding apparatus as recited in claim 3 , wherein the wavelet filter managing unit selects a Haar filter having one-stage decomposition level as the second wavelet transformer.

7. An inter-frame wavelet encoding apparatus, comprising:

a Motion Compensated Temporal Filtering (MCTF) unit for computing motion vectors of a group of pictures (GOP), and repeatedly performing a lowpass filtering and a highpass filtering the GOP with respect to a first temporal axis using the motion vectors, in order to obtain a lowpass and a highpass filtered frames;

wherein the MCTF unit performs lowpass filtering and highpass filtering on the lowpass filtered frame of the first temporal axis for at least one or more second temporal axis;

a first wavelet transformer having a maximum decomposition level and a maximum filter length, and wavelet-transforming a final lowpass-filtered frame;

a second wavelet transformer for each of the highpass filtered GOP frames

a second wavelet transformer having a decomposition level and a filter length equal to or smaller than the decomposition level and the filter length of the first wavelet transformer, and wavelet-transforming each of the highpass filtered frames;

a quantization unit for quantizing wavelet coefficients of each temporal level for each of the highpass filtered frames and the final lowpass filtered frame; and

wherein the wavelet coefficients are outputted from the first and second wavelet transformer by the wavelet-transforming; an entropy coding unit for entropy-coding the motion vectors and the quantized wavelet coefficients;

wherein the decomposition level and the filter length of the first and second wavelet transformer are controlled based on motion estimation information of the GOP, which are obtained by performing the lowpass filtering and the highpass filtering the GOP in the MCTF unit;

wherein the decomposition level and the filter length of the second wavelet transformer for each of the highpass filtered frames are controlled properly to the amount of information of each frame based on the motion estimation information;

wherein the decomposition level and the filter length of the first wavelet transformer for the final lowpass filtered frame are controlled the maximum decomposition level and the maximum filter length.

8. The inter-frame wavelet coding apparatus as recited in claim 7 , wherein the first wavelet transformer includes a 9/7 filter having a three or four-stage decomposition level.

9. The inter-frame wavelet coding apparatus as recited in claim 8 , wherein the first wavelet transformer includes a 5/3 filter having a three or four-stage decomposition level.

10. The inter-frame wavelet coding apparatus as recited in claim 8 , wherein the second wavelet transformer includes a Haar filter having a one-stage decomposition level.

11. An inter-frame wavelet video decoding apparatus, comprising:

an entropy decoding unit for entropy-decoding bit stream including information on a decomposition level and a filter length for inverse wavelet transform;

an inverse quantization unit for inverse quantizing quantized wavelet coefficients which is outputted from the entropy decoding unit;

an inverse wavelet transforming unit for performing wavelet transform on the wavelet coefficients outputted from the inverse quantization unit based on the decomposition level and the filter length; and

a Motion Compensated Temporal Filtering (MCTF) combining unit for performing MCTF combination on motion vectors of the entropy decoding unit, and outputting a group of pictures (GOP);

wherein the GOP is performed a lowpass filtering and a highpass filtering with respect to a first temporal axis using the motion vectors based on the MCTF, in order to obtain a lowpass and a highpass filtered frames;

wherein the GOP is performed the lowpass filtering and the highpass filtering on the lowpass filtered frame of the first temporal axis for at least one or more second temporal axis

wherein the decomposition level and the filter length for each of highpass filtered frames and a final lowpass filtered frame are respectively controlled based on motion estimation information of the GOP;

wherein the decomposition level and the filter length for each of the highpass filtered frames are controlled properly to the amount of information of each frame based on the motion estimation information;

wherein the decomposition level and the filter length for the final lowpass filtered frame are controlled a maximum decomposition level and a maximum filter length.

12. An inter-frame wavelet coding method, comprising the steps of:

a) computing motion vectors of a group of pictures (GOP), and performing Motion Compensated Temporal Filtering (MCTF) the GOP;

wherein the MCTF performs a lowpass filtering and a highpass filtering the GOP with respect to a first temporal axis using the motion vectors, in order to obtain a lowpass and a highpass filtered frames;

wherein the MCTF performs the lowpass filtering and the highpass filtering on the lowpass filtered frame of the first temporal axis for at least one or more second temporal axis;

b) performing spatial wavelet transform on each of the highpass filtered frames and a final lowpass filtered frame, and outputting wavelet coefficients of each temporal level for each of the highpass filtered frames and the final lowpass filtered frame;

c) quantizing the wavelet coefficients;

d) performing entropy-encoding on the motion vectors and the quantized wavelet coefficients, in order to generate an entropy-coded bit stream;

e) selecting a decomposition level and a filter length for the spatial wavelet transform based on motion estimation information of the GOP obtained by computed the MCTF; and

f) including information on the decomposition level and the filter length in the entropy-coded bit stream;

wherein the step e) respectively selects the decomposition level and the filter length for each of the highpass filtered frames and the final lowpass filtered frame;

wherein the decomposition level and the filter length for each of the highpass filtered frames are selected properly to the amount of information of each frame based on the motion estimation information;

wherein the decomposition level and the filter length for the final lowpass filtered frame are selected a maximum decomposition level and a maximum filter length.

13. The inter-frame wavelet coding method as recited in claim 12 , wherein

the step e) selects the decomposition level and the filter length based on a computing capability of a decoding apparatus to minimize a decoding computation of the decoding apparatus by having an optimum computation amount.

14. The inter-frame wavelet coding method as recited in claim 12 , wherein the step b) includes the steps of:

b1) performing wavelet transform on the final lowpass-filtered frame by using a first wavelet transformer which has the maximum decomposition level and the maximum filter length; and

b2) performing wavelet transform on each of the highpass filtered frames by using a second wavelet transformer, which has decomposition level and a filter length equal to or smaller than the decomposition level and the filter length of the first wavelet transformer.

15. The inter-frame wavelet coding method as recited in claim 14 , wherein in the step e) a 9/7 filter having a three or four-stage decomposition level is selected as the first wavelet transformer.

16. The inter-frame wavelet coding method as recited in claim 14 , wherein in the step e) a 5/3 filter having a three or four-stage decomposition level is selected as the first wavelet transformer.

17. The inter-frame wavelet coding method as recited in claim 14 , wherein in the step e) a Haar filter having a one-stage decomposition level is selected as the second wavelet transformer.

18. An inter-frame wavelet decoding method, comprising the steps of:

a) performing entropy-decoding on bit stream including information on a decomposition level and a filter length for inverse wavelet transform;

b) inverse-quantizing quantized wavelet coefficients generated in the step a);

c) performing inverse wavelet transform on wavelet coefficients generated in the step b) based on the information on the decomposition level and the filter length; and

d) performing a Motion Compensated Temporal Filtering (MCTF) combination based on motion vectors obtained in the step a), and outputting a group of pictures (GOP);

wherein the GOP is performed a lowpass filtering and a highpass filtering with respect to a first temporal axis using the motion vectors based on the MCTF, in order to obtain a lowpass and a highpass filtered frames;

wherein the GOP is performed the lowpass filtering and the highpass filtering on the lowpass filtered frame of the first temporal axis for at least one or more second temporal axis

wherein the decomposition level and the filter length for each of highpass filtered frames and a final lowpass filtered frame are respectively controlled based on motion estimation information of the GOP;

wherein the decomposition level and the filter length for each of the highpass filtered frames are controlled properly to the amount of information of each frame based on the motion estimation information;

wherein the decomposition level and the filter length for the final lowpass filtered frame are controlled a maximum decomposition level and a maximum filter length.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE TYPOGRAPHICAL ERROR IN THE GIVEN NAME OF THE THIRD ASSIGNOR PREVIOUSLY RECORDED ON REEL 019333 FRAME 0806. ASSIGNOR(S) HEREBY CONFIRMS THE SPELLING OF THE GIVEN NAME OF THE THIRD ASSIGNOR. Recorded Jun 13, 2007
From: JEONG, SE-YOON; KIM, KYU-HEON; KIM, WONHA; KIM, JIN-WOONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; INDUSTRY ACADEMIC COOPERATION FOUNDATION OF KYUNGHEE UNIVERSITY
Reel/Frame 019423/0728 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TYPOGRAPHICAL ERROR IN THE NAME OF THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 019267 FRAME 0499. ASSIGNOR(S) HEREBY CONFIRMS THE SPELLING OF THE ASSIGNEE AS INDICATED IN THE ASSIGNMENT DOCUMENT. Recorded May 23, 2007
From: JEONG, SE-YOON; KIM, KYU-HEON; KIM, WONHA; KIM, JIN-WOON
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; INDUSTRY ACADEMIC COOPERATION FOUNDATION OF KYUNGHEE UNIVERSITY
Reel/Frame 019333/0806 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TYPOGRAPHICAL ERROR IN THE NAME OF THE SECOND ASSIGNEE PREVIOUSLY RECORDED ON REEL 019166 FRAME 0534. ASSIGNOR(S) HEREBY CONFIRMS THE SPELLING OF THE SECOND ASSIGNEE AS INDICATED IN THE ASSIGNMENT DOCUMENT. Recorded May 9, 2007
From: JEONG, SE-YOON; KIM, KYU-HEON; KIM, WONHA; KIM, JIN-WOONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; INDUSTY ACADEMIC COOPERATION FOUNDATION OF KYUNGHEE UNIVERSITY
Reel/Frame 019267/0499 →
CORRECTION TO THE WORD COOPERATION IN THE SECOND ASSIGNEE'S NAME ON REEL 017932, FRAME 0843 Recorded Apr 9, 2007
From: JEONG, SE-YOON; KIM, KYU-HEON; KIM, WONHA; KIM, JIN-WOONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; INDUSTRY ACADEMIC COOERATION FOUNDATION OF KYUNGHEE UNIVERSITY
Reel/Frame 019166/0534 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2006
From: JEONG, SE-YOON; KIM, KYU-HEON; KIM, WONHA; KIM, JIN-WOONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; INDUSTRY ACADEMIC COOERATION FOUNDATION OF KYUNGHEE UNIVERSITY
Reel/Frame 017932/0843 →
Priority Claims (2)
KR 10-2003-0083015 · Nov 21, 2003 · national
KR 10-2004-0014032 · Mar 2, 2004 · national
Continuity (1)
Related Publication 20070081593A1 · Apr 12, 2007