IP Library Granted Patent US 11,119,396
Granted Patent B1
US 11,119,396 · App. 16/814,719 · Granted Sep 14, 2021

Camera system with a plurality of image sensors

Inventor: Peter Lablans (Morris Township, NJ)
Assignee: Spatial Cam LLC
G03B35/00H04N5/23238H04N5/2624H04N13/239H04N13/246H04M1/72409H04M1/72412H04M2250/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,119,396
App. No.
16/814,719
Granted
Sep 14, 2021
Kind
B1
Abstract

Active areas of image sensors are determined by one or more parameters defining a mergeline or memory addresses where image data is stored. Image data generated by active areas of different image sensors are combined to create a panoramic image. Image distortion is detected in image data generated by an active area of an image sensor. Distortion in image data is addressed by configured image processing instructions. A dedicated image processor is assigned to at least each image sensor. At least one set of instructions assures that connecting image data generated by different image sensors is smoothed and/or blended to create a combined image with a substantially seamless transition between areas.

Claims (29)

1. A camera system, comprising:

at least a first and a second camera fixed in a single body, each of the at least first and second cameras including a lens and an image sensor;

a processor to process image data from image sensor elements in an active area of the image sensor of the first camera, the active area of the image sensor in the first camera being smaller than a total area of image sensor elements of the image sensor in the first camera, the active area of the image sensor in the first camera being determined by one or more parameters being stored on a memory;

an instruction memory storing instructions for the processor to processing image data from the active area of the image sensor of the first camera to modify at least part of the image data from the active area of the image sensor of the first camera based on the one or more parameters being stored on the memory;

a display memory to store processed image data from active areas of the at least first and second cameras; and

a display to display the processed image data from active areas of the at least first and second cameras as a panoramic image.

2. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a modification of an intensity of image data.

3. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a warping of image data.

4. The camera system of claim 1 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a processing of an identified distortion.

5. The camera system of claim 1 , further comprising 3 or more cameras, each camera including a lens and an image sensor.

6. The camera system of claim 1 , wherein each image sensor active area is associated with a dedicated instruction memory and with a dedicated processor configured to perform instructions retrieved from the dedicated instruction memory.

7. The camera system of claim 1 , wherein the panoramic image is a video image.

8. The camera system of claim 1 , wherein the camera system is part of a smartphone.

9. A method for image processing, comprising:

reading image data from image sensor elements of an image sensor of a first camera only in an active area of the image sensor of the first camera being part of a camera system in a body with at least the first and a second camera, each camera having at least an image sensor and a lens, the active area of the image sensor in the first camera being smaller than a total area of image sensor elements of the image sensor in the first camera, one or more parameters determining the active area of the image sensor in the first camera being stored on a memory;

storing instructions on an instruction memory for a processor dedicated to processing image data from the active area of the image sensor of the first camera to modify at least part of the image data from the active area of the image sensor of the first camera based on the one or more parameters determining the active area of the image sensor in the first camera;

a display memory to store processed image data from active areas of the at least first and second cameras; and

a display to display the processed image data from active areas of the at least first and second cameras as a panoramic image.

10. The method of claim 9 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a modification of an intensity of image data.

11. The method of claim 9 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a warping of image data.

12. The method of claim 9 , wherein a modification of at least part of the image data from the active area of the image sensor of the first camera includes a processing of an identified distortion.

13. The method of claim 9 , further comprising 3 or more cameras, each camera including a lens and an image sensor.

14. The method of claim 9 , wherein each image sensor active area is associated with a dedicated instruction memory and with a dedicated processor configured to perform instructions retrieved from the dedicated instruction memory.

15. The method of claim 9 , wherein the panoramic image is a video image.

16. The method of claim 9 , wherein the camera system is part of a smartphone.

17. The camera system of claim 1 , wherein the processor stitches at least image data read only from active areas of the image sensors of the first and second camera into image data of the panoramic image.

18. The camera system of claim 1 , further comprising at least a third camera that provides image data for the panoramic image.

19. The method of claim 9 , further comprising stitching by the processor of at least image data read only from active areas of the image sensors of the first and second camera into image data of the panoramic image.

20. The method of claim 9 , further comprising incorporating at least a third camera that provides image data for the panoramic image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: SPATIAL CAM LLC
To: LABLANS, PETER, MR.
Reel/Frame 066130/0108 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2021
From: LABLANS, PETER, MR
To: SPATIAL CAM LLC
Reel/Frame 057114/0503 →
Continuity (19)
Continuation In Part 16011319 · Jun 18, 2018
Continuation In Part 15836815 · Dec 8, 2017
Continuation 12983168 · Dec 31, 2010
Continuation In Part 12435624 · May 5, 2009
Continuation In Part 16814719
Continuation In Part 16508031 · Jul 10, 2019
Continuation In Part 15645545 · Jul 10, 2017
Continuation In Part 14147569 · Jan 5, 2014
Continuation In Part 13844626 · Mar 15, 2013
Continuation In Part 12983168 · Dec 31, 2010
Continuation In Part 12634058 · Dec 9, 2009
Provisional Application 61365347 · Jul 18, 2010
Provisional Application 61322875 · Apr 11, 2010
Provisional Application 61291861 · Jan 1, 2010
Provisional Application 61106768 · Oct 20, 2008
Provisional Application 61106025 · Oct 16, 2008
Provisional Application 61089727 · Aug 18, 2008
Provisional Application 61055272 · May 22, 2008
Provisional Application 61054290 · May 19, 2008
Cited By (2)
US 12,260,532 US 12,425,739