IP Library Granted Patent US 11,159,803
Granted Patent B2
US 11,159,803 · App. 16/753,139 · Granted Oct 26, 2021

Image data encoding and decoding

Inventors: Karl James Sharman (Basingstoke, GB); Stephen Mark Keating (Basingstoke, GB); Magali Kimlee Miri Philippe (Basingstoke, GB)
Assignee: SONY CORPORATION
H04N19/159H04N19/105H04N19/11H04N19/167H04N19/176H04N19/45H04N19/513H04N19/593H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,159,803
App. No.
16/753,139
Granted
Oct 26, 2021
Kind
B2
Abstract

An image encoding apparatus comprises a selector configured to select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples; an intra-image predictor configured to derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples; in which, for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region; a detector configured to detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region and, if any of the two or more parallel linear arrays of reference samples are unavailable, to inhibit selection, by the selector, of a candidate prediction operation dependent upon the unavailable reference samples.

Claims (67)

1. An image encoding apparatus comprising:

circuitry configured to:

select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;

derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples, wherein for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;

detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region; and

if any of the two or more parallel linear arrays of reference samples are unavailable, inhibit selection of a candidate prediction operation dependent upon the unavailable reference samples, wherein

for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values, and

the circuitry is further configured to:

detect for the current region of the current image if none of the two or more parallel linear arrays is available for use in the prediction of samples of the current region; and

allow selection, as the prediction operation, of a candidate prediction operation for the current region dependent upon the one or more predetermined values as reference samples.

2. The apparatus according to claim 1 , wherein the circuitry is further configured to:

detect for the current region of the current image which, if any, of the two or more parallel linear arrays are available for use in the prediction of samples of the current region; and

allow selection, as the prediction operation of a candidate prediction operation dependent upon at least one of the available parallel linear arrays.

3. The apparatus according to claim 1 , wherein the circuitry configured to detect whether the samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in the prediction of samples of the current region based an image location of the current region.

4. The apparatus according to claim 3 , wherein the circuitry is configured to detect whether the current region is adjacent an edge of the current region such that sample locations corresponding to at least some of the two or more parallel linear arrays of reference samples lie outside the current image.

5. The apparatus according to claim 3 , wherein:

the image encoding apparatus is configured to encode the current image as successive coding units of samples;

the image encoding apparatus comprises a sample storage to store samples corresponding to a region of the current image other than the current region; and

the circuitry is configured to detect whether, for an image region at a location within a coding unit adjacent to a previous coding unit, any of the two or more parallel linear arrays of reference samples are held by the sample storage.

6. The apparatus according to claim 1 , wherein the circuitry is configured to:

detect, separately for reference sample positions disposed vertically with respect to the current image region and for reference sample positions disposed horizontally with respect to the current image region, whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in the prediction of samples of the current region; and

if any of the two or more parallel linear arrays of reference samples are unavailable for the reference sample positions disposed vertically with respect to the current image region or the reference sample positions disposed horizontally with respect to the current image region inhibit selection of a candidate prediction operation dependent upon the unavailable reference samples.

7. The apparatus according to claim 1 , wherein the circuitry is responsive to configuration data defining one or more parameters of a decoding apparatus to detect whether the samples corresponding to any of the two or more parallel linear arrays of reference samples will be available for use in the prediction of samples of the current region at the decoding apparatus.

8. A video storage, capture, transmission, or reception apparatus comprising the apparatus according to claim 1 .

9. An image decoding apparatus comprising:

circuitry configured to:

select, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;

derive predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples, wherein for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;

detect whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region; and

if any of the two or more parallel linear arrays of reference samples are unavailable, inhibit selection of a candidate prediction operation dependent upon the unavailable reference samples, wherein

for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values, and

the circuitry is further configured to:

detect for the current region of the current image if none of the two or more parallel linear arrays is available for use in the prediction of samples of the current region; and

allow selection, as the prediction operation, of a candidate prediction operation for the current region dependent upon the one or more predetermined values as reference samples.

10. The apparatus according to claim 9 , wherein the circuitry is further configured to:

detect for the current region of the current image which, if any, of the two or more parallel linear arrays are unavailable for use in the prediction of samples of the current region; and

allow selection, as the prediction operation of a candidate prediction operation dependent upon at least one of the available parallel linear arrays.

11. The apparatus according to claim 9 , wherein the circuitry is configured to detect whether the samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in the prediction of samples of the current region based an image location of the current region.

12. The apparatus according to claim 11 , wherein the circuitry is configured to detect whether the current region is adjacent an edge of the current region such that sample locations corresponding to at least some of the two or more parallel linear arrays of reference samples lie outside the current image.

13. The apparatus according to claim 11 , wherein:

the image decoding apparatus is configured to decode the current image as successive coding units of samples;

the image decoding apparatus comprises a sample storage to store samples corresponding to a region of the current image other than the current region; and

the circuitry is configured to detect whether, for an image region at a location within a coding unit adjacent to a previous coding unit, any of the two or more parallel linear arrays of reference samples are held by the sample storage.

14. The apparatus according to claim 9 , wherein the circuitry is configured to:

detect, separately for reference sample positions disposed vertically with respect to the current image region and for reference sample positions disposed horizontally with respect to the current image region, whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in the prediction of samples of the current region; and

if any of the two or more parallel linear arrays of reference samples are unavailable for reference sample positions disposed vertically with respect to the current image region or the reference sample positions disposed horizontally with respect to the current image region inhibit selection of a candidate prediction operation dependent upon the unavailable reference samples.

15. A video storage, capture, transmission, or reception apparatus comprising the apparatus according to claim 9 .

16. An image encoding method comprising:

selecting, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;

deriving intra-image predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples, wherein for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;

detecting whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region; and

inhibiting selection by the selecting step, if any of the two or more parallel linear arrays of reference samples are unavailable, of a candidate prediction operation dependent upon the unavailable reference samples, wherein

for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values, and

the method further comprises:

detecting for the current region of the current image if none of the two or more parallel linear arrays is available for use in the prediction of samples of the current region; and

allowing selection, as the prediction operation, of a candidate prediction operation for the current region dependent upon the one or more predetermined values as reference samples.

17. A non-transitory computer readable medium including computer program instructions, which when executed by a computer, cause the computer to perform the method of claim 16 .

18. An image decoding method comprising:

selecting, from a set of candidate prediction operations each defining at least a prediction direction, a prediction operation for prediction of samples of a current region of a current image, the current region comprising an array of two or more rows and two or more columns of samples;

deriving intra-image predicted samples of the current region with respect to one or more of a group of reference samples of the same image in dependence upon a prediction direction, defined by the selected prediction operation, between a current sample to be predicted and a reference position amongst the reference samples, wherein for at least some of the candidate prediction operations, the group of reference samples comprises two or more parallel linear arrays of reference samples disposed at different respective separations from the current region;

detecting whether samples corresponding to any of the two or more parallel linear arrays of reference samples are unavailable for use in prediction of samples of the current region; and

inhibiting selection by the selecting step, if any of the two or more parallel linear arrays of reference samples are unavailable, of a candidate prediction operation dependent upon the unavailable reference samples, wherein

for at least some of the candidate prediction operations, the group of reference samples comprises one or more predetermined values, and

the method further comprises:

detecting for the current region of the current image if none of the two or more parallel linear arrays is available for use in the prediction of samples of the current region; and

allowing selection, as the prediction operation, of a candidate prediction operation for the current region dependent upon the one or more predetermined values as reference samples.

19. A non-transitory computer readable medium including computer program instructions, which when executed by a computer, cause the computer to perform the method of claim 18 .

Assignments (3)
CHANGE OF NAME Recorded Nov 14, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 065564/0820 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2021
From: SONY EUROPE LIMITED
To: SONY CORPORATION
Reel/Frame 057018/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2021
From: SHARMAN, KARL JAMES; KEATING, STEPHEN MARK; PHILIPPE, MAGALI KIMLEE MIRI
To: SONY EUROPE LIMITED
Reel/Frame 056955/0612 →
Priority Claims (2)
GB 1717684 · Oct 27, 2017 · national
GB 1809024 · Jun 1, 2018 · national
Continuity (1)
Related Publication 20200267410A1 · Aug 20, 2020