IP Library Granted Patent US 11,756,233
Granted Patent B2
US 11,756,233 · App. 17/947,756 · Granted Sep 12, 2023

Method for image processing and apparatus for implementing the same

Inventors: Elie Mora (Malakoff, FR); Anthony Nasrallah (Puteaux, FR)
Assignee: ATEME
G06T9/00H04N19/11H04N19/119H04N19/14H04N19/159H04N19/174H04N19/176H04N19/593H04N19/136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,233
App. No.
17/947,756
Granted
Sep 12, 2023
Kind
B2
Abstract

A method of processing an image divided into a plurality of pixel blocks which are processed according to a processing sequence is provided, which comprises, for a current pixel block: determining an application area consisting of a set of pixels in blocks preceding the current block in the processing sequence, for each pixel of the application area, computing a gradient representing a directional change of an intensity at the pixel, and selecting, based on at least one of the computed gradients, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for encoding and/or decoding the current block.

Claims (65)

1. A method comprising, by a processor of an encoder side:

performing a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

providing, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for encoding and/or decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and

wherein the DIMD image processing method is performed by a processor of an image encoder of the encoder side, and further comprises, at the image encoder: encoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

2. A method comprising, by a processor of a decoder side:

receiving, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

performing the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and,

wherein the DIMD image processing method is performed by a processor of an image decoder of the decoder side, and further comprises, at the image decoder: decoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

3. The method according to claim 2 , wherein the performing the gradient analysis comprises: for each of the at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the at least one pixel, and wherein the selecting is based on at least one of the computed gradients.

4. The method according to claim 2 , wherein the performing the gradient analysis further comprises: computing a first gradient value representing an estimate magnitude of the directional change of the intensity at each of the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at each of the at least one pixel.

5. The method according to claim 2 , wherein the performing the gradient analysis comprises: generating respective estimates of derivatives of an intensity level at the at least one pixel in the horizontal and vertical directions by performing a convolution of a source matrix of pixels of the image with horizontal and vertical filter matrices, respectively.

6. The method according to claim 3 , wherein the selecting the intra prediction video coding mode comprises: for each of the at least one pixel of the application area, mapping the computed gradient to an intra prediction mode among the plurality of intra prediction video coding modes.

7. The method according to claim 6 , wherein the performing the gradient analysis further comprises: computing a first gradient value representing an estimate magnitude of the directional change of the intensity at each of the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at each of the at least one pixel, and wherein the mapping is performed by mapping the second gradient value to a directional intra prediction mode among the plurality of intra prediction video coding modes.

8. The method according to claim 1 , wherein the performing the gradient analysis comprises: for each of the at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the at least one pixel, and wherein the selecting is based on at least one of the computed gradients, wherein the selecting the intra prediction video coding mode comprises: for each of the at least one pixel of the application area, mapping the computed gradient to an intra prediction mode among the plurality of intra prediction video coding modes, and wherein the weight value for an intra prediction video coding mode is determined based on the one or more computed gradient mapped to the intra prediction video coding mode.

9. The method according to claim 1 , wherein the performing the gradient analysis further comprises: computing a first gradient value representing an estimate magnitude of the directional change of the intensity at each of the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at each of the at least one pixel, wherein the performing the gradient analysis comprises: for each of the at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the pixel, and wherein the selecting is based on at least one of the computed gradients, wherein the selecting the intra prediction video coding mode comprises: for each of the at least one pixel of the application area, mapping the computed gradient to an intra prediction mode among the plurality of intra prediction video coding modes, and wherein the weight value for an intra prediction video coding mode is determined by combining respective first gradient values of computed gradients mapped to the intra prediction video coding mode.

10. The method according to claim 1 , wherein the intra prediction video coding mode is selected based on its weight value.

11. An apparatus of an encoder side, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the processor is configured to:

perform a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

provide, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for encoding and/or decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and

wherein the DIMD image processing method is performed by a processor of an image encoder of the encoder side, and further comprises, at the image encoder: encoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

12. An apparatus of a decoder side, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the processor is configured to:

receive, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

perform the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and,

wherein the DIMD image processing method is performed by a processor of an image decoder of the decoder side, and further comprises, at the image decoder: decoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

13. A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus of an encoder side comprising a processor operatively coupled with a memory, to:

perform a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

provide, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for encoding and/or decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and

wherein the DIMD image processing method is performed by a processor of an image encoder of the encoder side, and further comprises, at the image encoder: encoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

14. A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus of a decoder side comprising a processor operatively coupled with a memory, to:

receive, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

perform the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting, based on results of the gradient analysis, an intra prediction video coding mode among a plurality of intra prediction video coding modes usable for decoding the current pixel block, wherein the selecting the intra prediction video coding mode further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area, and,

wherein the DIMD image processing method is performed by a processor of an image decoder of the decoder side, and further comprises, at the image decoder: decoding, via the processor, the current pixel block according to the selected intra prediction video coding mode.

15. The apparatus according to claim 12 , wherein the processor is further configured to, for each of the at least one pixel of the application area, compute a gradient representing a directional change of an intensity at the at least one pixel, and wherein the selecting is based on at least one of the computed gradients.

16. The apparatus according to claim 12 , wherein the processor is further configured to compute a first gradient value representing an estimate magnitude of the directional change of the intensity at each of the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at each of the at least one pixel.

17. The non-transitory computer-readable medium according to claim 14 , wherein the performing the gradient analysis comprises: for each of the at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the at least one pixel, and wherein the selecting is based on at least one of the computed gradients.

Priority Claims (1)
EP 18306269 · Sep 27, 2018 · regional
Continuity (2)
Continuation 16584144 · Sep 26, 2019
Related Publication 20230011999A1 · Jan 12, 2023
Cited By (1)
US 12,604,021