IP Library › Granted Patent US 10,165,207
Granted Patent B2
US 10,165,207 · App. 15/346,181 · Granted Dec 25, 2018

Image processing apparatus and image processing system

Inventor: Jee-Hong Lee (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO. LTD.
H04N5/357G06T1/20G06T3/403G06T3/4015H04N5/217H04N5/2258H04N5/247H04N5/3765H04N9/045H04N13/204G06T2207/10021G06T2207/10024G06T2207/10028H04N9/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,165,207
App. No.
15/346,181
Granted
Dec 25, 2018
Kind
B2
Abstract

An image processing apparatus includes a pre-processor configured to generate information relating to image positions based on Bayer image signals obtained by cameras. The image processing apparatus further includes an independent image signal processor (IISP) configured to perform a first image signal processing operation for generating first image data of an RGB format from a first one of the Bayer image signals obtained by a first one of the cameras. The IISP is further configured to generate image processing information calculated during the first image signal processing operation. The image processing apparatus further includes a dependent image signal processor configured to perform a second image signal processing operation for generating second image data of the RGB format from a second one of the Bayer image signals obtained by a second one of the cameras using the image processing information and the information relating to the image positions.

Claims (34)

1. An image processing apparatus, comprising:

a pre-processor configured to generate information relating to image positions based on a plurality of Bayer image signals obtained by a plurality of cameras;

an independent image signal processor (IISP) configured to perform a first image signal processing operation for generating first image data of an RGB format from a first one of the plurality of Bayer image signals obtained by a first one of the plurality of cameras, and generate image processing information calculated during the first image signal processing operation; and

a dependent image signal processor (DISP) configured to perform a second image signal processing operation for generating second image data of the RGB format from a second one of the plurality of Bayer image signals obtained by a second one of the plurality of cameras using the image processing information and the information relating to the image positions.

2. The image processing apparatus of claim 1 , wherein the information relating to the image positions comprises image registration information indicating an image disparity, wherein the image disparity indicates differences in the plurality of Bayer image signals.

3. The image processing apparatus of claim 1 , wherein the plurality of cameras comprise stereo-type or array-type camera devices.

4. The image processing apparatus of claim 1 , wherein the image processing information comprises information predicted or estimated during at least one of a denoising operation and a demosaicing operation.

5. The image processing apparatus of claim 4 , wherein the image processing information comprises interpolation direction information obtained during the demosaicing operation.

6. The image processing apparatus of claim 1 , wherein the IISP comprises:

a preliminary calculation processor configured to perform a partial calculation operation for denoising the first Bayer image signal or demosaicing the first Bayer image signal, and to generate the image processing information based on at least one of information predicted or estimated during the partial calculation operation,

wherein the IISP is configured to perform a color interpolation operation using the image processing information.

7. The image processing apparatus of claim 6 , wherein the IISP is configured to eliminate noise using the image processing information.

8. The image processing apparatus of claim 1 , wherein the image processing information comprises information predicted or estimated during the first image signal processing operation and pixel coordinate information, and the image processing information is position-adjusted using the information relating to the image positions.

9. The image processing apparatus of claim 8 , wherein the image processing information is position-adjusted by the IISP or the DISP.

10. The image processing apparatus of claim 1 , wherein the DISP skips a calculation operation for generating the image processing information.

11. An image processing system, comprising:

a plurality of cameras configured to generate a plurality of Bayer images;

a pre-processor configured to generate information relating to image positions based on a plurality of Bayer image signals generated by the plurality of cameras;

an independent image signal processor (IISP) configured to perform a first image signal processing operation for generating first image data of an RGB format from a first one of the plurality of Bayer image signals generated by a first camera from among the plurality of cameras, and to generate image processing information calculated during the first image signal processing operation;

a dependent image signal processor (DISP) configured to perform a second image signal processing operation for generating second image data of the RGB format from a second one of the plurality of Bayer image signals generated by a second camera from among the plurality of cameras using the image processing information and the information relating to the image positions;

a timing controller configured to control output time points of the pre-processor, the IISP, and the DISP; and

a post-processor configured to post-process the first image data generated by the IISP and the second image data generated by the DISP.

12. The image processing system of claim 11 , wherein the timing controller generates a synchronous signal to synchronize time points at which image data having an initialized unit size is output from the IISP and the DISP.

13. The image processing system of claim 11 , wherein the information relating to the image positions comprises image registration information indicating an image disparity, wherein the image disparity indicates differences in the plurality of Bayer image signals.

14. The image processing system of claim 11 , wherein the image processing information comprises information predicted or estimated during a process of demosaicing each pixel or information predicted or estimated during a process of denoising each pixel.

15. The image processing system of claim 11 , wherein the DISP skips a calculation process for generating the image processing information.

16. An image processing apparatus, comprising:

a pre-processor configured to generate information relating to image positions based on a plurality of Bayer image signals obtained by a plurality of cameras;

an independent image signal processor (IISP) configured to receive information relating to image positions and to perform a first image signal processing operation for generating first image data from a first one of the plurality of Bayer image signals obtained by a first one of the plurality of cameras, and generate image processing information calculated during the first image signal processing operation, wherein the image processing information is position-adjusted based on the information relating to the image positions; and

a dependent image signal processor (DISP) configured to perform a second image signal processing operation for generating second image data from a second one of the plurality of Bayer image signals, obtained by a second one of the plurality of cameras, using the position-adjusted image processing information.

17. The image processing apparatus of claim 16 , wherein the image processing information includes pixel coordinate information that is position-adjustable based on the information relating to the image positions.

18. The image processing apparatus of claim 16 , wherein the IISP is configured to eliminate noise using the image processing information, and to perform a color interpolation operation using the image processing information.

19. The image processing apparatus of claim 16 , wherein the IISP comprises a preliminary calculation processor configured to perform a partial calculation operation for denoising the first Bayer image signal or demosaicing the first Bayer image signal, and to generate the image processing information based on at least one of information predicted or estimated during the partial calculation operation.

20. The image processing apparatus of claim 16 , wherein the information relating to the image positions comprises at least one of image registration information and depth map information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2016
From: LEE, JEE-HONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 040256/0284 →
Priority Claims (1)
KR 10-2015-0180191 · Dec 16, 2015 · national
Continuity (1)
Related Publication 20170180656A1 · Jun 22, 2017