IP Library › Granted Patent US 12,388,974
Granted Patent B2
US 12,388,974 · App. 17/946,442 · Granted Aug 12, 2025

Method for image processing and apparatus for implementing the same

Inventors: Elie Mora (Malakoff, FR); Mohsen Abdoli (Rennes, FR); Thomas Guionnet (Rennes, FR)
Assignee: ATEME
H04N19/103G06F17/16G06N7/01G06T7/11G06T7/90G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,388,974
App. No.
17/946,442
Granted
Aug 12, 2025
Kind
B2
Abstract

A method of processing an image divided into a plurality of pixel blocks which are processed according to a processing sequence is provided, which comprises, for a current pixel block: determining an application area comprising a set of pixels in blocks preceding the current block in the processing sequence; performing a gradient analysis on at least one pixel of the application area; selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis; determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and generating a predictor of the current pixel block based on the determined plurality of predictors.

Claims (74)

1. A method comprising, by a processor of an encoder side:

performing a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

providing, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

2. A method comprising, by a processor of a decoder side:

receiving, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

performing the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

3. The method according to claim 2 , wherein the DIMD image processing method further comprises: determining an application area comprising a plurality of pixels in blocks preceding the current pixel block in the processing sequence; and performing the gradient analysis on at least two pixels of the application area.

4. The method according to claim 2 , wherein the DIMD image processing method further comprises: determining weights that are respectively associated with the selected intra prediction video coding modes, and combining the determined predictors using the determined weights.

5. The method according to claim 2 , wherein the at least two intra prediction video coding modes are selected based on the gradient analysis.

6. The method according to claim 2 , further comprising: discarding at least one duplicate in the selected intra prediction video coding modes.

7. The method according to claim 2 , wherein a plurality of intra prediction video coding modes are selected based on the gradient analysis, the DIMD image processing method further comprising: replacing a discarded intra prediction video coding modes that was selected based on the gradient analysis, by selecting another intra prediction video coding mode based on the gradient analysis.

8. The method according to claim 2 , wherein a number of intra prediction video coding modes selected based on the gradient analysis is based on a size of the current pixel block.

9. The method according to claim 2 , wherein the performing the gradient analysis comprises: for at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the pixel, and wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis is based on at least one of the computed gradients.

10. The method according to claim 1 , wherein the DIMD image processing method is performed by a processor of an image encoder of the encoder side, and further comprises, at the image encoder: encoding, via the processor, the current pixel block according to the at least one intra prediction video coding mode selected based on the gradient analysis.

11. The method according to claim 2 , wherein the DIMD image processing method is performed by a processor of an image decoder of the decoder side, and further comprises, at the image decoder: decoding, via the processor, the current pixel block according to the at least one intra prediction video coding mode selected based on the gradient analysis.

12. The method according to claim 11 , wherein the at least one intra prediction video coding mode selected based on the gradient analysis used at the encoder side for encoding the current pixel block is used at the decoder side for decoding the current pixel block.

13. The method according to claim 2 , wherein the performing the gradient analysis further comprises: computing a first gradient value representing an estimate magnitude of the directional change of the intensity at the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at the at least one pixel.

14. The method according to claim 9 , wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis comprises: for the at least one pixel of the application area, mapping the computed gradient to an intra prediction mode among the plurality of intra prediction video coding modes.

15. The method according to claim 2 , wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area.

16. The method according to claim 15 , wherein the weight value for an intra prediction video coding mode is determined based on the one or more computed gradient mapped to the intra prediction video coding mode, and wherein at least one of the at least one intra prediction video coding mode selected based on the gradient analysis is selected based on its weight value.

17. An apparatus of an encoder side, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the processor is configured to:

perform a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

provide, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

18. An apparatus of a decoder side, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the processor is configured to:

receive, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

perform the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

19. A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus of an encoder side comprising a processor operatively coupled with a memory, to:

perform a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

provide, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

20. A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus of a decoder side comprising a processor operatively coupled with a memory, to:

receive, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and

perform the DIMD image processing method for processing the current pixel block of the image;

wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,

and wherein the DIMD image processing method comprises, for the current pixel block of the image:

determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;

performing a gradient analysis on at least one pixel of the application area;

selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;

determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and

generating a predictor of the current pixel block based on the determined plurality of predictors.

Priority Claims (1)
EP 19305293 · Mar 12, 2019 · regional
Continuity (2)
Continuation 16815567 · Mar 11, 2020
Related Publication 20230009360A1 · Jan 12, 2023
References Cited (44)
US 8559512B2 · Paz · 2013 [cited by applicant]
US 9955171B2 · Tsukuba et al. · 2018 [cited by applicant]
US 10448011B2 · Liu et al. · 2019 [cited by applicant]
US 20120170652A1 · Guo · 2012 [cited by examiner]
US 20120269263A1 · Bordes et al. · 2012 [cited by applicant]
US 20120314766A1 · Chien et al. · 2012 [cited by applicant]
US 20150016521A1 · Peng et al. · 2015 [cited by applicant]
US 20150172719A1 · Guo · 2015 [cited by examiner]
US 20160014421A1 · Cote · 2016 [cited by examiner]
US 20170272745A1 · Liu · 2017 [cited by examiner]
US 20170353730A1 · Liu · 2017 [cited by examiner]
US 20170366807A1 · Thoreau et al. · 2017 [cited by applicant]
US 20170374369A1 · Chuang · 2017 [cited by examiner]
US 20180176582A1 · Zhao · 2018 [cited by examiner]
US 20180310001A1 · Choi · 2018 [cited by examiner]
US 20190020888A1 · Liu et al. · 2019 [cited by applicant]
US 20190158828A1 · Chang · 2019 [cited by examiner]
US 20190166370A1 · Xiu · 2019 [cited by examiner]
US 20190174128A1 · Jang · 2019 [cited by examiner]
US 20190208198A1 · Pettersson et al. · 2019 [cited by applicant]
US 20190281290A1 · Lee · 2019 [cited by examiner]
US 20190335199A1 · Joshi et al. · 2019 [cited by applicant]
US 20200045311A1 · Yoo · 2020 [cited by examiner]
US 20200045322A1 · Ye · 2020 [cited by examiner]
US 20200145668A1 · Kotra · 2020 [cited by examiner]
US 20200228800A1 · Joshi et al. · 2020 [cited by applicant]
US 20210274214A1 · Moon · 2021 [cited by examiner]
US 20230262223A1 · Ghaznavi Youvalari · 2023 [cited by examiner]
EP 2375750A1 · 2011 [cited by applicant]
KR 1020180069606 · 2018 [cited by examiner]
WO 2013067435A1 · 2013 [cited by applicant]
Bross et al., “High Efficiency Video Coding (HEVC) text specification draft 7,” Document JCTVC-11003, JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 9th Meeting, Geneva, CH, Apr. 27-May 7, 2012, 280 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Document JVET-G1001-v1, JVET of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting, Torino, IT, Jul. 13-21, 2017, 50 pages. [cited by applicant]
Cisco Corp., “Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2017-2022,” White Paper, 2017, updated Feb. 2019, downloaded from Internet website: https://www.cisco.com/c/en/us/solutions/collat… [cited by applicant]
Jiang et al., “Gradient Based Fast Mode Decision Algorithm for Intra Prediction in HEVC,” 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNET), IEEE, Apr. 21, 2012, pp. 1836-18… [cited by applicant]
Kau et al., “A Gradient Intensity-Adapted Algorithm With Adaptive Selection Strategy for the Fast Decision of H.264/AVC Intra-Prediction Modes,” IEEE Transactions on Circuits and Systems for Video Technology, Jun. 2015,… [cited by applicant]
Mora et al., “CE3-related: Decoder-side Intra Mode Derivation,” Document JVET-L0164, JVET of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 12th Meeting, Macao, CN, Oct. 3-12, 2018, 8 pages. [cited by applicant]
Mora et al., “CE3: Decoder-side Intra Mode Derivation (tests 3.1.1, 3.1.2., 3.1.3 and 3.1.4),” Document JVET-M0094, JVET of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 13th Meeting, Marrakech, MA, Jan. 9-18, 2019, 7 page… [cited by applicant]
Pan et al., “Fast Mode Decision Algorithm for Intraprediction in H.264/AVC Video Coding,” IEEE Transactions on Circuits and Systems for Video Technology, Institute of Electrical and Electronics Engineers, US, Jul. 2005,… [cited by applicant]
Ramezanpour et al., “Fast HEVC I-frame coding based on strength of dominant direction of CUs,” Journal of Real-Time Image Processing, Springer, DE, vol. 12(2), Mar. 30, 2016, pp. 397-406. [cited by applicant]
Su et al., “An Optimized Template Matching Approach to Intra Coding in Video/Image Compression,” Proceedings of SPIE-IS&T Electronic Imaging, SPIE vol. 9029, 2014, pp. 902904-1-902904-6. [cited by applicant]
Xiu et al., “EE8: Decoder-side intra mode derivation,” Document JVE-D0097, JVET of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Chengdu, CN, Oct. 15-21, 2016, 7 pages. [cited by applicant]
Search Report issued in European patent application EP 19305293.3, Jul. 15, 2019, 4 pages. [cited by applicant]
Search Report issued in European patent application EP 18306269.4, Apr. 1, 2019, 10 pages. [cited by applicant]