IP Library Granted Patent US 10,397,476
Granted Patent B2
US 10,397,476 · App. 15/711,128 · Granted Aug 27, 2019

Panoramic camera with multiple image sensors using timed shutters

Inventors: Richard Francis Lyon (Los Altos, CA); Gary Embler (Redwood City, CA); Iain Richard Tyrone McClatchie (Los Altos, CA); Jason Holt (Mountain View, CA)
Assignee: Google LLC
H04N5/23238H04N5/2353H04N5/23203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,397,476
App. No.
15/711,128
Granted
Aug 27, 2019
Kind
B2
Abstract

The present invention relates to the field of panoramic still and motion photography. In a first embodiment, a camera apparatus for panoramic photography includes a first image sensor positioned to capture a first image. The first image sensor has a rolling-shutter readout arranged in portrait orientation. The camera apparatus also includes second image sensor positioned to capture a second image. The second image sensor has a rolling-shutter readout arranged in portrait orientation. Finally, the camera apparatus includes a controller configured to signal the second image sensor to start capturing the second image before the first image sensor finishes capturing the first image. At least a portion of the first image is in front of the second image relative to a forward direction of the camera apparatus.

Claims (30)

1. A system for capturing images, comprising:

a camera apparatus, the camera apparatus including:

a first camera configured to capture a first image; and

a second camera configured to capture a second image; and

a controller in communication with the camera apparatus configured to:

receive a velocity of a movable structure, the velocity of the movable structure corresponding to a movement of the camera apparatus at a given speed; and

while moving the camera apparatus at the given speed:

start to expose the first image using the first camera at a time T 1 ;

start to expose the second image using the second camera at a time T 2 , wherein T 2 is after T 1 ; and

complete exposure of the first image at a time T 3 after the time T 2 such that the first image and the second image include overlapping fields of view captured by the camera apparatus between time T 2 and T 3 ,

wherein a same object at a same location within the first and second images is captured by each of the first and second cameras at different times due to the movement of the camera apparatus.

2. The system for capturing images of claim 1 , wherein a delay time determined by the controller is due to a distance between entrance pupils of the first and second cameras and is offset based on the velocity of the system.

3. The system for capturing images of claim 1 , wherein a delay time determined by the controller is due to a distance between entrance pupils of the first and second cameras and is offset based on an average velocity of the system.

4. The system for capturing images of claim 1 , wherein prior to start exposing the second image, the controller is configured to determine the time T 2 based on the given speed.

5. The system for capturing images of claim 1 , further comprising the controller configured to complete exposure of the first image in order to reduce a likelihood that an object in the overlapping fields of view has moved between times T 2 and T 3 .

6. The system for capturing images of claim 1 , wherein the velocity value of the system is determined in real-time based at least in part, on data from a GPS sensor affixed to the system, a speedometer of the system, or a wheel encoder that detects movement of a wheel of the system.

7. The system for capturing images of claim 2 , wherein the camera apparatus includes a set of cameras including the first and second cameras, and while moving the camera apparatus, capturing additional images using the set of cameras where each additional image has an overlapping field of view with at least one other of the additional images.

8. The system for capturing images of claim 1 , wherein the first camera includes a first image sensor and the second camera includes a second image sensor and different portions of the first and second image sensors are exposed at different times in order to capture the first and second images.

9. The system for capturing images of claim 1 , wherein the first and second cameras each includes a set of photodiode columns arranged in a portrait orientation relative to a ground surface.

10. The system for capturing images of claim 7 , wherein the delay time offset applies to cameras of the set of cameras pointed sideways from a motion of the system.

11. The system for capturing images of claim 1 , wherein the camera apparatus is configured to capture a panoramic image.

12. The system for capturing images of claim 1 , wherein a difference in time between T 2 and T 3 is proportionate to a size of the overlapping fields of view.

13. The system of claim 1 , further comprising the movable structure, and wherein the camera apparatus is attached to the movable structure, and wherein movement of the movable structure causes the camera apparatus to move.

14. The system of claim 13 , wherein the movable structure is a vehicle.

15. The system of claim 14 , wherein the camera apparatus is attached to a top portion of the vehicle.

16. The system of claim 1 , wherein the first camera and the second camera are arranged as a camera rosette.

17. The system of claim 16 , wherein the first camera and the second camera are adjacent to one another in the rosette.

18. The system of claim 16 , wherein each camera of the rosette includes a rolling-shutter image sensor arranged in a portrait orientation.

19. The system of claim 16 , wherein each camera of the rosette includes a rolling-shutter image sensor arranged in a landscape orientation.

20. The system of claim 16 , wherein the rosette includes at least eight cameras, and wherein the eight cameras includes the first camera and the second camera.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2017
From: LYON, RICHARD FRANCIS; EMBLER, GARY; MCCLATCHIE, IAIN RICHARD TYRONE; HOLT, JASON
To: GOOGLE INC.
Reel/Frame 043664/0698 →
Continuity (5)
Continuation 15006449 · Jan 26, 2016
Continuation 13780493 · Feb 28, 2013
Division 12368014 · Feb 9, 2009
Provisional Application 61027237 · Feb 8, 2008
Related Publication 20180077351A1 · Mar 15, 2018