IP Library Granted Patent US 9,509,894
Granted Patent B1
US 9,509,894 · App. 14/728,570 · Granted Nov 29, 2016

Capturing images using controlled vibration

Inventor: Jonny Dyer (Menlo Park, CA)
Assignee: Google Inc.
H04N5/23203G01C11/02G06K9/00791G06K9/20H04N5/2251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,509,894
App. No.
14/728,570
Granted
Nov 29, 2016
Kind
B1
Abstract

Systems and methods of capturing imagery are provided. In particular, vibration can be induced in an imaging platform to eliminate blur in one or more images captured by the imaging platform. For instance, vibration having one or more predetermined characteristics can be induced in the imaging platform. The induced vibration can correlate to a sine wave. A collect period can then be identified corresponding to at least a portion of the period of the sine wave wherein the line of sight of the imaging platform approximates an ideal line of sight for eliminating relative motion between the imaging platform and a region of interest. One or more images of the region of interest can be captured by the imaging platform during the collect period. The one or more captured images can then be sent to a remote computing device for processing.

Claims (33)

1. A computer-implemented method of capturing imagery, the method comprising:

identifying, by one or more computing devices, vibration characteristics for an imaging platform, the vibration characteristics associated with an amplitude and a frequency of a sine wave, the frequency of the sine wave being determined based at least in part on a frame rate associated with one or more image capture devices associated with the imaging platform;

inducing, by one or more computing devices, vibration in the imaging platform causing at least a portion of the imaging platform to move about a reference point according to the vibration characteristics;

identifying, by the one or more computing devices, a collect period corresponding to a period of time wherein motion of a region of interest relative to the imaging platform is reduced; and

controlling, by the one or more computing devices, a collection of data by the one or more image capture devices based at least in part on the collect period.

2. The computer-implemented method of claim 1 , wherein the induced vibration causes a line of sight of the one or more image capture devices to change in accordance with the sine wave.

3. The computer-implemented method of claim 1 , wherein the frequency is determined to be an integer multiple of the frame rate.

4. The computer-implemented method of claim 1 , wherein the amplitude of the sine wave corresponds to an angular displacement of the one or more image capture devices.

5. The computer-implemented method of claim 1 , wherein the amplitude of the sine wave is derived at least in part using a least squares technique, a secant technique, or a tangent technique.

6. The computer-implemented method of claim 1 , wherein controlling the collection of data comprises capturing one or more images during the collect period using the one or more image capture devices.

7. The computer-implemented method of claim 6 , wherein controlling the collection of data further comprises closing a shutter associated with the one or more image capture devices outside of the collect period, such that no images are captured outside of the collect period.

8. The computer-implemented method of claim 7 , wherein controlling the collection of data comprises capturing a plurality of images of the region of interest, the plurality of images being captured in succession, such that neighboring images contain overlapping measurements of the region of interest, and wherein the computer-implemented method further comprises providing, by the one or more computing devices, the plurality of captured images to a remote computing device for processing, wherein the processing comprises registering neighboring imaging frames and reconstructing an image of the region of interest.

9. The computer-implemented method of claim 1 , wherein the vibration in the imaging platform is induced at least in part using one or more mechanical actuators associated with the imaging platform.

10. The computer-implemented method of claim 9 , wherein the one or more computing devices comprise a controller configured to control the one or more mechanical actuators.

11. The computer-implemented method of claim 1 , wherein the collect period corresponds to the time wherein a line of sight angle of the one or more image capture devices is within a threshold range of an ideal line of sight angle for eliminating relative motion.

12. The computer-implemented method of claim 1 , wherein the imaging platform comprises one of a satellite, airplane, helicopter, unmanned aerial vehicle, drone, or balloon.

13. The computer-implemented method of claim 1 , further comprising providing the collected data to a remote computing device for image processing.

14. An imaging platform, comprising:

one or more image capture devices;

one or more memory devices; and

one or more processors, the processors storing computer-readable instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:

identifying vibration characteristics for the imaging platform, the characteristics associated with an amplitude and a frequency of a sine wave, the frequency of the sine wave being determined based at least in part on a frame rate associated with the one or more image capture devices;

inducing vibration in the imaging platform causing at least a portion of the imaging platform to move about a reference point according to the vibration characteristics;

identifying at least one collect period, each collect period corresponding to a period of time wherein motion of a region of interest relative to the imaging platform is within a target range; and

controlling a collection of data by the one or more image capture devices based at least in part on the at least one collect period.

15. The imaging platform of claim 14 , wherein controlling the collection of data comprises capturing images of the region of interest only during the at least one collect period.

16. The imaging platform of claim 14 , wherein controlling the collection of data comprises capturing a plurality of images of the region of interest during the at least one collect period, the plurality of images being captured in succession, such that neighboring images contain overlapping measurements of the region of interest, and wherein the one or more operations further comprise providing the plurality of captured images to a remote computing device for processing, wherein the processing comprises registering neighboring imaging frames and reconstructing an image of the region of interest.

17. One or more tangible, non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processing devices cause the one or more processing devices to perform operations, the operation comprising:

identifying vibration characteristics for an imaging platform, the vibration characteristics comprising a frequency, the frequency being determined based at least in part on a frame rate associated with one or more image capture devices associated with the imaging platform;

inducing vibration in the imaging platform causing at least a portion of the imaging platform to move about a reference point according to the vibration characteristics;

identifying at least one collect period, each collect period corresponding to a period of time wherein motion of a region of interest relative to the imaging platform is reduced; and

controlling a collection of data by the one or more image capture devices based at least in part on the collect period.

18. The one or more tangible non-transitory computer-readable media of claim 17 , wherein the at least one collect period is identified based at least in part on a deviation of a line of sight angle of the imaging platform from an ideal line of sight angle for reducing motion of the region of interest relative to the imaging platform.

Assignments (10)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
MERGER AND CHANGE OF NAME Recorded May 5, 2022
From: PLANET LABS INC.; PLANET LABS PBC
To: PLANET LABS PBC
Reel/Frame 059857/0587 →
RELEASE OF SECURITY INTEREST Recorded Dec 10, 2021
From: SILICON VALLEY BANK
To: PLANET LABS INC.; TERRA BELLA TECHNOLOGIES INC.; PL FOREIGN HOLDCO, INC.
Reel/Frame 058359/0501 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 21, 2019
From: PLANET LABS INC.; PL INTERMEDIATE TB, INC.; PLANET LABS TB, INC.; TERRA BELLA TECHNOLOGIES INC.; PLANET LABS LLC; PL FOREIGN HOLDCO, INC.
To: SILICON VALLEY BANK
Reel/Frame 049558/0515 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2017
From: PLANET LABS TB, INC.
To: PLANET LABS, INC.
Reel/Frame 044243/0896 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NO. 15/061,851 PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043661/0060 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 17, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043409/0837 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2017
From: GOOGLE INC.
To: PLANT LABS TB, INC.
Reel/Frame 043277/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2015
From: DYER, JONNY
To: GOOGLE INC.
Reel/Frame 035784/0125 →