IP Library › Granted Patent US 12,081,919
Granted Patent B2
US 12,081,919 · App. 16/973,792 · Granted Sep 3, 2024

Image processing apparatus and imaging device

Inventor: Yuichiro Shima (Kanagawa, JP)
Assignee: MAXELL FRONTIER CO., LTD.
H04N9/43G06T1/20G06T3/4015H04N9/67H04N23/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,081,919
App. No.
16/973,792
Granted
Sep 3, 2024
Kind
B2
Abstract

An image processing apparatus 1 includes a pre-processor 10 and a main processor 30 . The pre-processor 10 generates pre-processing data by performing a pre-processing of Bayer data outputted from an imaging device 91 , and outputs the generated pre-processing data. The main processor 30 performs an image processing based on the pre-processing data.

Claims (84)

1. An image processing system comprising:

an imaging device;

a pre-processor generating pre-processing data based on Bayer data inputted from the imaging device; and

a main processor inputting the pre-processing data generated by the pre-processor, and performing an image processing based on the pre-processing data, wherein the pre-processor comprises:

a camera interface inputting the Bayer data from the imaging device;

an RGB data converter generating RGB data based on the Bayer data;

an RGB-density converter generating grayscale data by adjusting a density of each color based on the RGB data;

a data array converter generating array convert data based on the Bayer data or the grayscale data; and

a data superimposer superimposing one or more of the RGB data, the grayscale data, and the array convert data on the Bayer data to output it as the pre-processing data, and

wherein the main processor separates the pre-processing data into the Bayer data and the one or more of the RGB data, the grayscale data, and the array convert data to perform an image processing.

2. The image processing system according to claim 1 ,

wherein the main processor comprises:

a video input interface inputting the pre-processing data from the pre-processor, and separating the pre-processing data into the Bayer data and the one or more of the RGB data, the grayscale data, and the array convert data;

an image memory storing image data;

a memory controller controlling an input/output of the image data with respect to the image memory;

a video output interface for outputting the image data to an external device;

a storage interface outputting the pre-processing data to an external storage;

a CPU controlling the video input interface, the memory controller, the video output interface, and the storage interface to perform the image processing.

3. The image processing system according to claim 2 ,

wherein the video input interface, the memory controller, the video output interface, the storage interface, and the CPU are configured as one chip of a SoC (System on Chip).

4. The image processing system according to claim 1 ,

wherein the pre-processor has a multiplexer that inputs the RGB data, the grayscale data, and the array convert data, and

the multiplexer selects any one of the RGB data, the grayscale data, and the array convert data, and outputs the selected one of the RGB data, the grayscale data, and the array convert data to the data superimposer.

5. The image processing system according to claim 1 ,

wherein the RGB-density converter has: a bit selector that selects the predetermined number of bits from the RGB data and generates selection bit data composed of the selected bits; and a convert table that converts the selection bit data into the grayscale data having the number of bits less than the predetermined number.

6. The image processing system according to claim 5 ,

wherein the bit selector generates the selection bit data of 18 bits from the RGB data of 24 bits, and

the convert table converts the grayscale data of 18 bits into the selection bit data of 8 bits.

7. The image processing system according to claim 5 ,

wherein the convert table has a LUT (Look Up Table) that associates an address of the selection bit selected by the bit selector with predetermined convert data.

8. The image processing system according to claim 5 ,

wherein the bit selector generates the selection bit data in which each ratio of color is different depending on color of a subject.

9. The image processing system according to claim 1 ,

wherein the data array converter converts the grayscale data of a two-dimensional array into the array convert data of a one-dimensional array.

10. The image processing system according to claim 9 ,

wherein the data array converter converts the grayscale data of the two-dimensional array with 3×3 into the array convert data of the one-dimensional array with 1×9.

11. An image processing apparatus comprising:

a pre-processor generating pre-processing data based on inputted Bayer data; and

a main processor inputting the pre-processing data generated by the pre-processor, and performing an image processing based on the pre-processing data;

wherein the pre-processor comprises:

a camera interface inputting the Bayer data;

an RGB data converter generating RGB data based on the Bayer data;

an RGB-density converter generating grayscale data by adjusting a density of each color based on the RGB data;

a data array converter generating array convert data based on the Bayer data or the grayscale data; and

a data superimposer superimposing one or more of the RGB data, the grayscale data, the array convert data on the Bayer data to output it as the pre-processing data, and

the main processor separates the pre-processing data into the Bayer data and the one or more of the RGB data, the grayscale data, and the array convert data to perform the image processing.

12. The image processing apparatus according to claim 11 ,

wherein the main processor comprises:

a video input interface inputting the pre-processing data from the pre-processor, and separating the pre-processing data into the Bayer data and the one or more of the RGB data, the grayscale data, and the array convert data;

an image memory storing image data;

a memory controller controlling an input/output of the image data with respect to the image memory;

a video output interface for outputting the image data to an external device;

a storage interface outputting the pre-processing data to an external storage; and

a CPU controlling the video input interface, the memory controller, the video output interface, and the storage interface to perform the image processing.

13. The image processing apparatus according to claim 12 ,

wherein the video input interface, the memory controller, the video output interface, the storage interface, and the CPU are configured as one chip of a SoC (System on Chip).

14. The image processing apparatus according to claim 13 ,

wherein the pre-processor has a multiplexer that inputs the RGB data, the grayscale data, and the array convert data, and

the multiplexer selects any one of the RGB data, the grayscale data, and the array convert data, and outputs the selected data.

15. The image processing apparatus according to claim 12 ,

wherein the RGB-density converter has: a bit selector that selects the predetermined number of bits from the RGB data and generates selection bit data composed of the selected bits; and a convert table that converts the selection bit data into the grayscale data having the number of bits less than the predetermined number.

16. The image processing apparatus according to claim 15 ,

wherein the bit selector generates the selection bit data of 18 bits from the RGB data of 24 bits, and

the convert table converts the grayscale data of 18 bits into the selection bit data of 8 bits.

17. The image processing apparatus according to claim 15 ,

wherein the convert table has a LUT (Look Up Table) that associates an address of the selection bit selected by the bit selector with predetermined convert data.

18. The image processing apparatus according to claim 15 ,

wherein the bit selector generates the selection bit data in which each ratio of color is different depending on color of a subject.

19. The image processing apparatus according to claim 13 ,

wherein the data array converter converts the grayscale data of a two-dimensional array into the array convert data of a one-dimensional array.

20. The image processing apparatus according to claim 19 ,

wherein the data array converter converts the grayscale data of the two-dimensional array with 3×3 into the array convert data of the one-dimensional array with 1×9.

21. A pre-processing method of an image processing apparatus configured by: a pre-processor generating pre-processing data based on inputted Bayer data; and a main processor inputting the pre-processing data generated by the pre-processor and performing an image processing based on the pre-processing data, the pre-processing method comprising:

the pre-processor performing the steps of:

inputting Bayer data;

performing any one of three steps of:

generating RGB data based on the Bayer data;

generating grayscale data by adjusting a density of each color based on the RGB data; and

generating array convert data based on the Bayer data or the grayscale data;

superimposing one or more of the RGB data, the grayscale data, and the array convert data on the Bayer data to output it to the main processor as the pre-processing data; and

the main processor performing the steps of:

separating the pre-processing data inputted from the pre-processor into the Bayer data and the one or more of the RGB data, the grayscale data, and the array convert data; and

performing an image processing.

22. The image processing method according to claim 21 , further comprising the step of photographing an image by an imaging device and generating the Bayer data.

Assignments (2)
CHANGE OF COMPANY ADDRESS Recorded Mar 3, 2022
From: MAXELL FRONTIER CO., LTD.
To: MAXELL FRONTIER CO., LTD.
Reel/Frame 060574/0867 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2021
From: SHIMA, YUICHIRO
To: MAXELL FRONTIER CO., LTD.
Reel/Frame 055460/0429 →
Priority Claims (1)
JP 2018-112296 · Jun 12, 2018 · national
Continuity (1)
Related Publication 20210258552A1 · Aug 19, 2021