IP Library Granted Patent US 10,419,672
Granted Patent B2
US 10,419,672 · App. 15/913,476 · Granted Sep 17, 2019

Methods and apparatus for supporting burst modes of camera operation

Inventors: Rajiv Laroia (Far Hills, NJ); Nitesh Shroff (Millbrae, CA); Sapna A. Shroff (Sunnyvale, CA)
Assignee: Light Labs Inc.
H04N5/23245G06T7/20G06T11/60H04N5/2254H04N5/2257H04N5/2258H04N5/2353H04N5/2356H04N5/23216H04N5/23229H04N5/265G06T2207/10144G06T2207/10148G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,419,672
App. No.
15/913,476
Granted
Sep 17, 2019
Kind
B2
Abstract

In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Claims (39)

1. A method of capturing images using a camera device including a plurality of optical chains including a first optical chain and at least a second optical chain, the method comprising:

operating the first optical chain to capture images of a first scene area at a first image capture rate during a first period of time, said first optical chain having a first focal length; and

operating the second optical chain to capture images of a second scene area at a second image capture rate during said first period of time, said second optical chain having a second focal length which is larger than said first focal length, said second scene area being smaller than said first scene area and being a portion of said first scene area, said second image capture rate being faster than said first image capture rate.

2. The method of claim 1 , wherein operating the second optical chain to capture images includes operating the second optical chain in a synchronized manner with said first optical chain.

3. The method of claim 1 , wherein said first and second optical chains use different exposure times when capturing images.

4. The method of claim 3 ,

wherein said camera device supports a first mode of operation in which multiple optical chains are used in parallel to capture images at the same image capture rate and a second mode of operation during which different numbers of optical chains are used to capture images at different rates and wherein said first time period is a time period during which said camera device is operating in said second mode of operation.

5. The method of claim 1 , further comprising:

generating a sequence of composite images by combining an image captured by said first optical chain during said first period of time with multiple images captured by said second optical chain during said first period of time.

6. The method of claim 5 , wherein generating a sequence of composite images includes:

generating both a first composite image and a second composite image from a first image captured by the first optical chain during the first period of time.

7. The method of claim 6 ,

wherein generating the first composite image includes combining the first image captured by the first optical chain during the first period of time with a first image captured by the second optical chain during the first period of time; and

wherein generating the second composite image includes combining the first image captured by the first optical chain during the first period of time with a second image captured by the second optical chain during the first period of time.

8. The method of claim 6 , further comprising:

operating a third optical chain, having a focal length which is larger than said first focal length, to capture images during said first period of time at the same rate as said second optical chain; and

wherein generating the first composite image includes combining the first image captured by the first optical chain during the first period of time with a first image captured by the second optical chain during the first period of time and a first image captured by the third optical chain during said first period of time; and

wherein generating the second composite image includes combining the first image captured by the first optical chain during the first period of time with a second image captured by the second optical chain during the first period of time and a second image captured by the third optical chain during said first period of time.

9. The method of claim 8 , wherein the first image captured by the first optical chain includes portions of a field of view which are not captured by optical chains with which the first image captured by the first optical chain is combined to generate said first composite image and said second composite image.

10. The method of claim 7 ,

wherein the camera device includes a third optical chain having a third focal length which is different from said first and second focal lengths.

11. The method of claim 10 , further comprising:

operating said first, second and third optical chains to operate at different image capture rates; and

wherein optical chains having larger focal lengths have higher image capture rates than optical chains having smaller focal lengths.

12. The method of claim 1 , further comprising:

operating a third optical chain of said camera device to capture images during said first period of time at a third image capture rate, said third optical chain having a larger focal length than said first and second optical chains.

13. The method of claim 12 , wherein said third image capture rate is the same as said second image capture rate, said second and third optical chains capturing different portions of a scene area which overlap portions of the first scene area captured by said first optical chain.

14. The method of claim 12 , wherein optical chains corresponding to a larger focal length are operated to capture images at a faster rate than the first optical chain which has a smaller focal length.

15. A camera device comprising:

a plurality of optical chains including a first optical chain and a second optical chain, said first optical chain having a first focal length, said second optical chain having a second focal length which is larger than said first focal length; and

a control device configured to control the first optical chain to capture images of a first scene area at a first image capture rate during a first period of time and to control the second optical chain to capture images of a second scene area at a second image capture rate during said first period of time, said second scene area being smaller than said first scene area and being a portion of said first scene area, said second image capture rate being faster than said first image capture rate.

16. The camera device of claim 15 , wherein said control device is further configured to synchronize capture of images by said first and second optical chains.

17. The camera device of claim 15 , wherein said control device is a processor.

18. The camera device of claim 17 ,

wherein said camera device is a multi-mode handheld camera device including at least one optical chain having said first focal length, at least four optical chains having said second focal length and at least four optical chains have a third focal length, said third focal length being larger than said second focal length; and

wherein said control device is further configured to control said second optical chain to use a shorter exposure time than an exposure time used by said first optical chain.

19. A non-transitory computer readable medium including computer executable instructions which when executed by a processor control a camera device including a plurality of optical chains including a first optical chain and at least a second optical chain to:

operate the first optical chain to capture images of a first scene area at a first image capture rate during a first period of time; and

operate the second optical chain to capture images of a second scene area at a second image capture rate during said first period of time, said second optical chain having a second focal length which is larger than said first focal length, said second scene area being smaller than said first scene area and being a portion of said first scene area, said second image capture rate being faster than said first image capture rate.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022
From: LGT (ABC), LLC
To: BLUE RIVER TECHNOLOGY INC.
Reel/Frame 061770/0923 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022
From: LIGHT LABS INC.
To: LGT (ABC), LLC
Reel/Frame 061770/0945 →
CHANGE OF ADDRESS Recorded Mar 6, 2019
From: LIGHT LABS INC.
To: LIGHT LABS INC.
Reel/Frame 048524/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2018
From: SHROFF, SAPNA A
To: THE LIGHTCO INC.
Reel/Frame 045211/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2018
From: LAROIA, RAJIV; SHROFF, NITESH
To: THE LIGHTCO INC.
Reel/Frame 045211/0392 →
CHANGE OF NAME Recorded Mar 14, 2018
From: THE LIGHTCO INC.
To: LIGHT LABS INC.
Reel/Frame 045602/0518 →