IP Library › Granted Patent US 12,159,434
Granted Patent B2
US 12,159,434 · App. 17/058,015 · Granted Dec 3, 2024

Image processing apparatus and method

Inventors: Toshinori Ihara (Tokyo, JP); Takuya Kitamura (Tokyo, JP); Takefumi Nagumo (Tokyo, JP)
Assignee: SONY CORPORATION
G06T9/00G06T3/40H04N5/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,159,434
App. No.
17/058,015
Granted
Dec 3, 2024
Kind
B2
Abstract

The present disclosure relates to an image processing apparatus and an image processing method capable of reducing an increase in a load imposed by processing of multispectral image data. Multispectral image data including components in four or more wavelength bands is simple-coded at a fixed compression rate. Alternatively, coded data generated by simple coding at a fixed compression rate for multispectral image data including components in four or more wavelength bands is simple-decoded. For example, the present disclosure is applicable to an image processing apparatus, an image coding apparatus, an image decoding apparatus, an imaging element, an imaging apparatus, or the like.

Claims (50)

1. An image processing apparatus, comprising:

a pixel array configured to image an object and generate multispectral image data, wherein

the pixel array includes plural pixel patterns,

each of the plural pixel patterns including five or more pixels, and

the five or more pixels are arranged under a predetermined rule and photoelectrically converting light in wavelength bands different from each other; and

a Central Processing Unit (CPU) configured to perform simple coding at a fixed compression rate for the multispectral image data including components in four or more wavelength bands, wherein

the simple coding for the multispectral image data is performed by using a system that codes different image data generated by a different pixel array where plural different pixel patterns each different from the plural pixel patterns of the pixel array in pixel arrangement and number of constituent pixels are arranged, with use of a difference in pixel data between a pair of pixels belonging to the different pixel patterns different from each other and included in an identical wavelength band.

2. The image processing apparatus according to claim 1 , further comprising:

a transmission unit configured to transmit coded data generated by the simple coding performed for the multispectral image data by the CPU.

3. The image processing apparatus according to claim 1 , further comprising:

a storage unit configured to store coded data generated by the simple coding performed for the multispectral image data by the CPU.

4. The image processing apparatus according to claim 1 , wherein

each of the pixel patterns of the pixel array includes 16 pixels that photoelectrically convert light in the wavelength bands different from each other and are arranged such that pixels, of the five or more pixels, photoelectrically converting light in adjoining wavelength bands are arranged two pixels away from each other, and

the CPU is further configured to perform the simple coding for the multispectral image data generated by the pixel array, with use of a difference in pixel data between a pair of pixels arranged two pixels away from each other.

5. An image processing method, comprising:

imaging, by a pixel array, an object and generating multispectral image data, wherein

the pixel array includes plural pixel patterns,

each of the plural pixel patterns including five or more pixels, and

the five or more pixels are arranged under a predetermined rule and photoelectrically converting light in wavelength bands different from each other; and

simple coding, by a Central Processing Unit (CPU), at a fixed compression rate for the multispectral image data including components in four or more wavelength bands, wherein

the simple coding for the multispectral image data is performed by using a system that codes different image data generated by a different pixel array where plural different pixel patterns each different from the plural pixel patterns of the pixel array in pixel arrangement and number of constituent pixels are arranged, with use of a difference in pixel data between a pair of pixels belonging to the different pixel patterns different from each other and included in an identical wavelength band.

6. An image processing apparatus, comprising:

a pixel array configured to image an object and generate multispectral image data, wherein

the pixel array includes plural pixel patterns,

each of the plural pixel patterns including five or more pixels, and

the five or more pixels are arranged under a predetermined rule and photoelectrically converting light in wavelength bands different from each other; and

a Central Processing Unit (CPU) configured to:

perform simple coding at a fixed compression rate for the multispectral image data generated by the pixel array, to generate coded data, and

perform simple decoding for the coded data generated by the simple coding at the fixed compression rate for multispectral image data including components in four or more wavelength bands, wherein

the simple coding for the multispectral image data is performed by using a system that codes different image data generated by a different pixel array where plural different pixel patterns each different from the plural pixel patterns of the pixel array in pixel arrangement and number of constituent pixels are arranged, with use of a difference in pixel data between a pair of pixels belonging to the different pixel patterns different from each other and included in an identical wavelength band, and

the simple decoding for the coded data is performed by using a system that decodes coded data of the different image data with use of the difference in pixel data between the pair of pixels belonging to the different pixel patterns different from each other and included in the identical wavelength band.

7. The image processing apparatus according to claim 6 , further comprising:

a reception unit configured to receive the coded data, wherein

the CPU is further configured to perform the simple decoding for the coded data received by the reception unit.

8. The image processing apparatus according to claim 6 , further comprising:

a storage unit configured to store the coded data, wherein

the CPU is further configured to perform the simple decoding for the coded data read from the storage unit.

9. The image processing apparatus according to claim 6 , wherein

each of the pixel patterns of the pixel array includes 16 pixels that photoelectrically convert light in the wavelength bands different from each other and are arranged such that pixels, of the five or more pixels, photoelectrically converting light in adjoining wavelength bands are arranged two pixels away from each other,

the CPU is further configured to perform the simple coding for the multispectral image data generated by the pixel array, with use of a difference in pixel data between a pair of pixels arranged two pixels away from each other, and

perform the simple decoding for the coded data, with use of the difference in pixel data between the pair of pixels arranged two pixels away from each other.

10. An image processing method, comprising:

imaging, by a pixel array, an object and generate multispectral image data, wherein

the pixel array includes plural pixel patterns,

each of the plural pixel patterns including five or more pixels, and

the five or more pixels are arranged under a predetermined rule and photoelectrically converting light in wavelength bands different from each other; and

simple coding, by a Central Processing Unit (CPU), at a fixed compression rate for the multispectral image data generated by the pixel array, to generate coded data, and

simple decoding, by the CPU, for the coded data generated by the simple coding at the fixed compression rate for multispectral image data including components in four or more wavelength bands, wherein

the simple coding for the multispectral image data is performed by using a system that codes different image data generated by a different pixel array where plural different pixel patterns each different from the plural pixel patterns of the pixel array in pixel arrangement and number of constituent pixels are arranged, with use of a difference in pixel data between a pair of pixels belonging to the different pixel patterns different from each other and included in an identical wavelength band, and

the simple decoding for the coded data is performed by using a system that decodes coded data of the different image data with use of the difference in pixel data between the pair of pixels belonging to the different pixel patterns different from each other and included in the identical wavelength band.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 23, 2020
From: IHARA, TOSHINORI; KITAMURA, TAKUYA; NAGUMO, TAKEFUMI
To: SONY CORPORATION
Reel/Frame 054448/0755 →
Priority Claims (1)
JP 2018-106012 · Jun 1, 2018 · national
Continuity (1)
Related Publication 20210375003A1 · Dec 2, 2021