Camera system with a plurality of image sensors
View Patent ↗Active areas of image sensors are determined by one or more parameters defining a mergeline or memory addresses where image data is stored. Image data generated by active areas of different image sensors are combined to create a panoramic image. Image distortion is detected in image data generated by an active area of an image sensor. Distortion in image data is addressed by configured image processing instructions. A group of one or more processors is assigned to at least each image sensor. At least one set of instructions assures that image data generated by different image sensors creates a combined image of a video with a substantially seamless transition between areas. Curved image sensors limit distortion. Cameras are fixedly held in a calibrated body.
1. A camera system, comprising:
at least a first and a second camera fixed in a single body, each of the at least first and second cameras including a lens and an image sensor;
a first processor group of one or more processing units to process image data from image sensor elements in an active area of the image sensor of the first camera, the active area of the image sensor in the first camera being smaller than a total area of image sensor elements of the image sensor in the first camera, the active area the active area of the image sensor in the first camera being determined by one or more parameters stored on a memory;
an instruction memory storing instructions for the processing units of the first processor group to process image data from the active area of the image sensor of the first camera to modify at least part of the image data from the active area of the image sensor of the first camera based on the one or more parameters being stored on the memory;
a display memory to store processed image data from active areas of the at least first and second cameras; and
a display to display the processed image data from active areas of the at least first and second cameras as a panoramic image.
2. The camera system of claim 1 , further comprising a second processor group of one or more processing units to process image data from image sensor elements in an active area of the image sensor of the second camera, the active area of the image sensor in the second camera being smaller than a total area of image sensor elements of the image sensor in the second camera, the active area the active area of the image sensor in the second camera being determined by one or more parameters stored on a memory.
3. The camera system of claim 1 , wherein a processing unit is selected from the group consisting of a single processor, a core of a processor, a graphics processing unit (GPU) or a Field Programmable Gate Array (FPGA).
4. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a modification of an intensity of image data.
5. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a warping of image data.
6. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a correction of an identified distortion.
7. The camera system of claim 1 , further comprising 3 or more cameras, each camera including a lens and an image sensor.
8. The camera system of claim 1 , wherein the panoramic image is part of a video image with an frame rate of at least 12 frames per second.
9. The camera system of claim 1 , wherein the image sensor of the first camera is a curved image sensor.
10. The camera system of claim 1 , wherein the first and the second camera are fixedly held in a calibrated body.
11. The camera system of claim 1 , wherein the one or more parameters are determined during a calibration.
12. The camera system of claim 11 , further comprising:
a processor executing instructions of image stitching to determine a stitchline; and
the processor executing instructions that map the stitchline in an image to a mergeline on the active area of the image sensor of the first camera.
13. The camera system of claim 1 , wherein the camera system is part of a smartphone.
14. A method for image processing, comprising:
reading image data from image sensor elements in an active area of an image sensor of a first camera being part of a camera system in a body with at least the first and a second camera, each camera having at least an image sensor and a lens, the active area of the image sensor in the first camera being smaller than a total area of image sensor elements of the image sensor in the first camera, one or more parameters determining the active area of the image sensor in the first camera being stored on a memory;
storing instructions on an instruction memory for a first processor group of one or more processing units to process image data from the active area of the image sensor of only the first camera to modify at least part of the image data from the active area of the image sensor of the first camera based on the one or more parameters determining the active area of the image sensor in the first camera;
displaying on a display the processed image data from active areas of the at least first and second cameras as a panoramic image in a video.
15. The method of claim 14 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a modification of an intensity of image data.
16. The method of claim 14 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a warping of image data.
17. The method of claim 14 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a correction of an identified distortion.
18. The method of claim 14 , further comprising 3 or more cameras, each camera including a lens and an image sensor.
19. The method of claim 14 , wherein the image sensor of the first camera is a curved image sensor.
20. The camera system of claim 14 , wherein the first and the second camera are fixedly held in a calibrated body.