Image processing of DCT-based video sequences in compressed domain
View Patent ↗This invention relates to a method for applying at least one of contrast adjustment and brightness adjustment to a compressed, motion compensated DCT-based video sequence corresponding to an image processing operation, comprising the steps of providing the compressed, motion compensated DCT-based video sequence, applying the image processing operation on the video sequence in compressed domain resulting in an image processed, compressed video sequence, wherein the applying is executed by adjusting of DCT-components defining the DCT-based video sequence.
1. A method comprising:
providing a compressed, motion compensated discrete cosine transform-based video sequence; and
applying an image processing operation via a processing component on said video sequence in compressed domain resulting in an image processed, compressed video sequence,
wherein said applying is executed by adjusting discrete cosine transform-components defining said discrete cosine transform-based video sequence and said image processing operation comprises applying at least one of contrast adjustment and brightness adjustment, and
wherein shadow effect compensation is provided on the basis of said applying of said image processing of said discrete cosine transform-based video sequence.
2. The method according to claim 1 , wherein said adjusting of discrete cosine transform-components is provided by partial decoding and encoding said discrete cosine transform-based video sequence.
3. The method according to claim 1 , wherein said shadow compensation is provided by compensating residuals when out-of-range pixels are detected in a previous frame.
4. The method according to claim 3 , wherein said out-of-range pixels are detected in the discrete cosine transform-based video sequence by setting thresholds for direct current and alternating current coefficients.
5. The method according to claim 3 , wherein said shadow effect compensation is provided by partially decoding of certain blocks of the frame, where a possibility for out-of-bound coefficients exists.
6. The method according to claim 1 , wherein said video sequence is a digital H.263 bit-stream representing said sequence, wherein the H.263 bit-stream is variable length code decoded, discrete cosine transform coefficients in the bit-stream are de-quantized, and the image processing operations are applied to the discrete cosine transform coefficients.
7. The method according to claim 1 , wherein an amount of change in pixel intensity is exactly the same amount of change in direct current coefficient by applying said brightness adjustment of said sequence for intra-coded macroblocks if said sequence corresponds to said H.263 bit-stream.
8. The method according to claim 1 , wherein said video sequence is a digital MPEG-4 bit-stream representing said sequence, wherein the MPEG-4 bit-stream is variable length code decoded, discrete cosine transform coefficients in the bit-stream are de-quantised, and the image processing operations are applied to the discrete cosine transform coefficients.
9. The method according to claim 1 , wherein said contrast adjustment in said sequence represented by said MPEG-4 bit-stream is provided as a one-pass process for intra-coded macroblocks.
10. A computer readable medium stored with computer program code, which, when executed by a processor of an apparatus, cause said apparatus to at least perform
providing a compressed, motion compensated discrete cosine transform-based video sequence; and
applying an image processing operation on said video sequence in compressed domain resulting in an image processed, compressed video sequence,
wherein said applying is executed by adjusting discrete cosine transform-components defining said discrete cosine transform-based video sequence and said image processing operation comprises applying at least one of contrast adjustment and brightness adjustment, and
wherein shadow effect compensation is provided on the basis of said applying of said image processing of said discrete cosine transform-based video sequence.
11. A module comprising:
a component configured to provide a compressed, motion compensated discrete cosine transform-based video sequence; and
a component for applying said image processing operation on said video sequence in compressed domain resulting to an image processed, compressed video sequence,
wherein said applying is executed by adjusting of discrete cosine transform-components defining said discrete cosine transform-based video sequence and said image processing operation comprises applying at least one of contrast adjustment and brightness adjustment, and
wherein shadow effect compensation is provided on the basis of said applying of said image processing of said discrete cosine transform-based video sequence.
12. The module according to claim 11 , wherein said contrast adjustment is based on the following expression:
Y
′
(
n
,
m
)
=
{
λ
·
Y
(
n
,
m
)
+
(
λ
-
1
)
·
Y
DC
_
m
=
n
=
0
λ
·
Y
(
n
,
m
)
m
≠
0
or
n
≠
0
(
7
)
where:
m,n are frequency domain coordinates;
Y′(n,m) is the discrete cosine transform transformation of the edited image;
λ is a contrast scaling factor;
Y(n,m) is the discrete cosine transform transformation of the original image; and
Y DC is the average of the direct current coefficients of all blocks within the image.
13. The module according to claim 11 , wherein said brightness adjustment is based on the following expression:
Y
q
′
(
n
,
m
)
=
{
Y
q
(
n
,
m
)
+
K
′
;
m
=
n
=
0
Y
q
(
n
,
m
)
;
else
wherein K′ corresponds to the value of the brightness adjustment in the compressed domain and it is given by:
K
′
=
{
8
·
K
/
Q
DC
;
m
=
n
=
0
0
;
else
(
5
)
where:
m,n are frequency domain coordinates;
Y′ q (n,m) is the discrete cosine transform transformation of the edited image;
Y q (n,m) is the discrete cosine transform transformation of the original image; and
Q DC is the quantization scale for direct current coefficient.
14. The module according to claim 11 , wherein said video sequence is a digital MPEG-4 bit-stream representing said sequence, wherein the MPEG-4 bit-stream is variable length code decoded, discrete cosine transform coefficients in the bit-stream are de-quantised, and the image processing operations are applied to the discrete cosine transform coefficients.
15. The module according to claim 11 , wherein said contrast adjustment in said sequence represented by said MPEG-4 bit-stream is provided as one-pass process for intra-coded macroblocks.
16. An apparatus comprising:
at least one memory including computer program code; and
at least one processor
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:
providing a compressed, motion compensated discrete cosine transform-based video sequence; and
applying an image processing operation on said video sequence in compressed domain resulting in an image processed, compressed video sequence,
wherein said applying is executed by adjusting discrete cosine transform-components defining said discrete cosine transform-based video sequence and said image processing operation comprises applying at least one of contrast adjustment and brightness adjustment, and
wherein shadow effect compensation is provided on the basis of said applying of said image processing of said discrete cosine transform-based video sequence.