IP Library Granted Patent US 10,432,866
Granted Patent B2
US 10,432,866 · App. 15/230,785 · Granted Oct 1, 2019

Controlling a line of sight angle of an imaging platform

Inventors: M. Dirk Robinson (Menlo Park, CA); Jonathan Dyer (Menlo Park, CA); Joshua Levine (San Jose, CA); Brendan Hermalyn (San Francisco, CA); Ronny Votel (San Jose, CA); Matt William Messana (Sunnyvale, CA)
Assignee: Planet Labs, Inc.
H04N5/23287G01C11/02G02B27/64H04N5/2328H04N5/23254H04N5/23258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,432,866
App. No.
15/230,785
Filed
Aug 8, 2016
Granted
Oct 1, 2019
Kind
B2
Examiner
WANG, XI
Art Unit
2696
USPC
348/208.11
Abstract

Systems and methods of capturing imagery are provided. In particular, an imaging platform can be configured to capture imagery using a dual-axis steering mirror and one or more image capture devices. The line of sight angle of the imaging platform can be controlled by controlling the motion of the steering mirror in accordance with a motion profile. In example embodiments, the motion profile can correspond to a sawtooth wave. The imaging platform can further include one or more position sensors used to determine a position and/or orientation of the imaging platform along a path on which the imaging platform travels. The motion of the steering mirror can then be controlled to rotate about a first axis and a second axis to compensate for line of sight errors based at least in part on the determined position and/or orientation.

Claims (69)

1. A computer-implemented method of controlling an imaging platform, the method comprising:

determining, by one or more computing devices, a motion profile for a dual-axis steering mirror associated with an imaging platform;

determining, by the one or more computing devices, position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

determining, by the one of more computing devices, a plurality of integration time periods based at least in part on the motion profile;

capturing, by the one or more computing devices, a sequence of image frames of at least a portion of a region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path;

identifying, by the one or more computing devices, blur in at least one of the captured image frames; and

controlling, by the one or more computing devices, the motion of the steering mirror based at least in part on the motion profile, the position information, and the identified blur, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis.

2. The computer-implemented method of claim 1 , further comprising:

registering, by the one or more computing devices, the sequence of image frames to provide an image of the region of interest.

3. The computer-implemented method of claim 1 , further comprising:

identifying, by the one or more computing devices, one or more misalignments between neighboring image frames in the sequence of captured image frames; and

controlling, by the one or more computing devices, the motion of the steering mirror based at least in part on the identified misalignments.

4. The computer-implemented method of claim 1 , wherein each integration period corresponds to a period of time wherein relative motion between the imaging platform and the region of interest is reduced below a threshold.

5. The computer-implemented method of claim 1 , wherein the motion profile comprises a sawtooth wave according to which the steering mirror is to be moved.

6. The computer-implemented method of claim 5 , wherein controlling the motion of the steering mirror based at least in part on the motion profile comprises controlling the motion of the steering mirror such that a line of sight angle of the imaging platform travels from a first line of sight angle to a second line of sight angle at a first angular rate.

7. The computer-implemented method of claim 6 , wherein controlling the motion of the steering mirror based at least in part on the motion profile further comprises, once the line of sight angle of the imaging platform reaches the second line of sight angle, controlling the motion of the steering mirror such that the line of sight of the imaging platform travels from the second line of sight angle to the first line of sight angle at a second angular rate.

8. The computer-implemented method of claim 7 , wherein the second angular rate is a higher angular rate than the first angular rate.

9. A computing system, comprising:

one or more processors; and

one or more memory devices, the one or more memory devices storing computer-readable instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:

determining a motion profile for a dual-axis steering mirror associated with an imaging platform;

determining position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

determining a plurality of integration time periods based at least in part on the motion profile;

capturing a sequence of image frames of at least a portion of a region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path;

identifying blur in at least one of the captured image frames; and

controlling the motion of the steering mirror based at least in part on the motion profile, the position information, and the identified blur, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis.

10. The computing system of claim 9 , wherein neighboring image frames in the sequence of image frames comprise overlapping measurements of the region of interest, the operations further comprising:

registering the sequence of image frames to provide a mosaicked image of the region of interest based at least in part on the overlapping measurements.

11. The computing system of claim 10 , the operations further comprising:

identifying one or more misalignments between neighboring image frames in the sequence of captured image frames; and

controlling the motion of the steering mirror based at least in part on the identified misalignments.

12. The computing system of claim 9 , wherein each integration period corresponds to a period of time wherein relative motion between the imaging platform and the region of interest is reduced below a threshold.

13. One or more tangible, non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

determining a motion profile for a dual-axis steering mirror associated with an imaging platform;

determining position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

determining a plurality of integration time periods based at least in part on the motion profile;

capturing a sequence of image frames of at least a portion of a region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path;

identifying blur in at least one of the captured image frames; and

controlling the motion of the steering mirror based at least in part on the motion profile, the position information, and the identified blur, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis.

14. The one or more tangible, non-transitory computer-readable media of claim 13 , wherein neighboring image frames in the sequence of image frames comprise overlapping measurements of the region of interest, the operations further comprising:

registering the sequence of image frames to provide a mosaicked image of the region of interest based at least in part on the overlapping measurements.

15. The one or more tangible, non-transitory computer-readable media of claim 14 , the operations further comprising:

identifying one or more misalignments between neighboring image frames in the sequence of captured image frames; and

controlling the motion of the steering mirror based at least in part on the identified misalignments.

16. The one or more tangible, non-transitory computer-readable media of claim 13 , wherein controlling the motion of the steering mirror based at least in part on the motion profile comprises controlling the motion of the steering mirror such that a line of sight angle of the imaging platform travels from a first line of sight angle to a second line of sight angle at a first angular rate.

17. The one or more tangible, non-transitory computer-readable media of claim 13 , wherein controlling the motion of the steering mirror based at least in part on the motion profile further comprises, once the line of sight angle of the imaging platform reaches the second line of sight angle, controlling the motion of the steering mirror such that the line of sight of the imaging platform travels from the second line of sight angle to the first line of sight angle at a second angular rate.

18. A computer-implemented method of controlling an imaging platform, the method comprising:

determining, by one or more computing devices, a motion profile for a dual-axis steering mirror associated with an imaging platform;

controlling, by the one or more computing devices, the motion of the steering mirror based at least in part on the motion profile;

determining, by the one or more computing devices, position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

controlling, by the one or more computing devices, the motion of the steering mirror based at least in part on the position information, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis;

determining, by the one or more computing devices, a plurality of integration time periods based at least in part on the motion profile, wherein each integration period corresponds to a period of time wherein relative motion between the imaging platform and a region of interest is reduced below a threshold; and

capturing, by the one or more computing devices, a sequence of image frames of at least a portion of the region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path.

19. A computing system, comprising:

one or more processors; and

one or more memory devices, the one or more memory devices storing computer-readable instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:

determining a motion profile for a dual-axis steering mirror associated with an imaging platform;

controlling the motion of the steering mirror based at least in part on the motion profile;

determining position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

controlling the motion of the steering mirror based at least in part on the position information, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis;

determining a plurality of integration time periods based at least in part on the motion profile, wherein each integration period corresponds to a period of time wherein relative motion between the imaging platform and a region of interest is reduced below a threshold; and

capturing a sequence of image frames of at least a portion of the region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path.

20. One or more tangible, non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

determining a motion profile for a dual-axis steering mirror associated with an imaging platform;

controlling the motion of the steering mirror based at least in part on the motion profile;

determining position information indicative of an orientation of the imaging platform at one or more points along a path on which the imaging platform travels;

controlling the motion of the steering mirror based at least in part on the position information, wherein controlling the motion of the steering mirror comprises controlling the steering mirror to rotate about a first axis and a second axis;

determining a plurality of integration time periods based at least in part on the motion profile, wherein each integration period corresponds to a period of time wherein relative motion between the imaging platform and a region of interest is reduced below a threshold; and

capturing a sequence of image frames of at least a portion of the region of interest during at least a subset of the plurality of integration time periods as the imaging platform travels along the path.

Assignments (10)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
MERGER AND CHANGE OF NAME Recorded May 5, 2022
From: PLANET LABS INC.; PLANET LABS PBC
To: PLANET LABS PBC
Reel/Frame 059857/0587 →
RELEASE OF SECURITY INTEREST Recorded Dec 10, 2021
From: SILICON VALLEY BANK
To: PLANET LABS INC.; TERRA BELLA TECHNOLOGIES INC.; PL FOREIGN HOLDCO, INC.
Reel/Frame 058359/0501 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 21, 2019
From: PLANET LABS INC.; PL INTERMEDIATE TB, INC.; PLANET LABS TB, INC.; TERRA BELLA TECHNOLOGIES INC.; PLANET LABS LLC; PL FOREIGN HOLDCO, INC.
To: SILICON VALLEY BANK
Reel/Frame 049558/0515 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2017
From: PLANET LABS TB, INC.
To: PLANET LABS, INC.
Reel/Frame 044260/0159 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NO. 15/061,851 PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043661/0060 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 17, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043409/0837 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2017
From: GOOGLE INC.
To: PLANT LABS TB, INC.
Reel/Frame 043277/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2016
From: ROBINSON, M. DIRK; DYER, JONATHAN; LEVINE, JOSHUA; HERMALYN, BRENDAN; VOTEL, RONNY; MESSANA, MATT WILLIAM
To: GOOGLE INC.
Reel/Frame 039369/0189 →
Continuity (2)
Provisional Application 62202391 · Aug 7, 2015
Related Publication 20170041548A1 · Feb 9, 2017