IP Library Granted Patent US 10,061,474
Granted Patent B2
US 10,061,474 · App. 13/886,055 · Granted Aug 28, 2018

Overhead image viewing systems and methods

Inventors: Greg Bertoldo (Oakland, CA); Carlos Cervantes (San Mateo, CA); Richard J. Cirminello, Jr. (San Jose, CA); James Long (Santa Clara, CA); Julian Mann (Menlo Park, CA); Daniel Berkenstock (Menlo Park, CA); Oliver Guinan (Redwood City, CA); Ching-Yu Hu (Menlo Park, CA); Adam Wegel (San Francisco, CA); Christopher Kelley (Mountain View, CA)
Assignee: Planet Labs, Inc.
G06F3/0482G06F3/04847
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,061,474
App. No.
13/886,055
Granted
Aug 28, 2018
Kind
B2
Abstract

Systems and methods for providing a user interface for searching, browsing, and ordering overhead (e.g. aircraft or satellite) imagery are provided. The user interface provides a map and search bar for searching and browsing images. Images may be presented to a user based on a selected and/or displayed geographic region of interest. Browsing to a different geographic region of interest may dynamically and automatically update the images presented. The user interface allows the user to select an image for viewing and/or purchase. Selection of an image overlays the image on the map, aligned with the geographic region which the image captures. Closing the selected image re-centers and re-zooms to the original display. Presented images can be filtered based on several criteria. Images can include still images and/or videos.

Claims (52)

1. A computer-implemented method for providing an overhead image browsing user interface, the computer-implemented method comprising:

under control of an overhead image viewing system comprising computing hardware including one or more processors:

receiving a first user input selecting a first geographic region of interest;

in response to the first user input, outputting for display (1) a master image of the geographic region of interest, and (2) a representation of one or more overhead images that are separate images from the master image and available for selection to be displayed over the master image aligned with the geographic region of interest,

wherein each of the one or more overhead images depict a portion of the first geographic region of interest, and wherein the one or more images comprise images captured by satellites that depict a smaller area of the first geographic region of interest than the master image of the first geographic region of interest, the smaller area being contained within the first geographic region of interest,

wherein the one or more overhead images comprise ortho-rectified images, and

wherein each of the one or more overhead images comprise metadata that provides geolocation information for matching to the first geographic region of interest;

receiving a second user input selecting one of the one or more overhead images of the representation;

responding to the second user input by outputting for display the master image in a first scale and repositioned visually with the selected overhead image and the selected overhead image superimposed directly over a portion of the master image that geographically corresponds to the selected overhead image such that the geographically-corresponding portion of the master image is no longer visible and the smaller area of the first geographic region of interest of the selected image is in more detail than the first geographic region of interest of the master image wherein the first scale corresponds to the selected overhead image;

receiving a third user input selecting a second geographic region of interest different from the first geographic region of interest;

generating an updated representation in response to the third user input, wherein the updated representation comprises at least one overhead image that depicts a portion of the second geographic region of interest and comprises metadata that provides geolocation information for matching to the second geographic region of interest; and

outputting the updated representation for display, wherein the at least one overhead image is available for selection to be superimposed in a second scale with the second geographic region of interest and wherein the second scale corresponds to the at least one overhead image.

2. The computer-implemented method of claim 1 , wherein outputting for display the master image with the selected overhead image further comprises outputting for display a second master image corresponding to the selected overhead image, the second master image replacing the master image of the geographic region of interest.

3. The computer-implemented method of claim 1 , wherein the overhead images comprise one or more of: (1) static images, (2) still-frame or freeze-frame images from a video, or (3) videos.

4. The computer-implemented method of claim 1 , wherein the representation of the one or more overhead images comprises a filmstrip image viewer that includes the representation of the one or more overhead images.

5. The computer-implemented method of claim 4 , wherein the filmstrip image viewer is configured for one or more of the following: selecting a representation of a particular overhead image or scrolling the representations of the one or more overhead images within the filmstrip image viewer.

6. An interactive system for overhead image browsing, the system comprising:

a physical computing system comprising one or more computing devices that provides network-based access to an electronic catalog of overhead images, said computing system providing a user interface that includes functionality for users to browse overhead images; and

an overhead image viewing service that enables the users to browse a set of overhead images with a map of a first geographic region of interest, the set of overhead images being separate images from the map, wherein each of the set of overhead images depict a portion of the first geographic region of interest and comprise images captured by satellites that depict a smaller area of the first geographic region of interest than the map of the first geographic region of interest, the smaller area being contained within the first geographic region of interest,

wherein the set of overhead images comprise ortho-rectified images, and

wherein each of the set of overhead images comprise metadata that provides geolocation information for matching to the first geographic region of interest;

the computing system configured to:

receive a first user input selecting the first geographic region of interest,

generate, for a user, a page that provides functionality for the user to browse the map of the first geographic region of interest and a representation of one or more of the set of overhead images,

receive a second user input selecting an overhead image,

in response to the second user input, output for display the selected overhead image superimposed directly over a portion of the map that geographically corresponds to the selected overhead image such that the portion of the map is no longer visible, wherein the map is repositioned visually with the selected overhead image and in a first scale with the selected overhead image and the smaller area of the first geographic region of interest of the selected overhead image is in more detail than shown in the map of the first geographic region of interest, wherein the first scale corresponds to the selected overhead image;

receive a third user input selecting a second geographic region of interest different from the first geographic region of interest;

generating an updated representation in response to the third user input, wherein the updated representation comprises at least one overhead image that depicts a portion of the second geographic region of interest and comprises metadata that provides geolocation information for matching to the second geographic region of interest; and

outputting the updated representation for display, wherein the at least one overhead image is available for selection to be superimposed in a second scale with the second geographic region of interest and wherein the second scale corresponds to the at least one overhead image.

7. The interactive system of claim 6 , wherein the computing system is further configured to generate the updated representation in response to the user browsing the map to the second geographic region of interest.

8. The interactive system of claim 6 , wherein the generated page includes a second map of the geographic region of interest corresponding to the selected overhead image, the second map replacing the map on the page.

9. The interactive system of claim 6 , wherein the representation comprises a filmstrip that includes the one or more overhead images.

10. The interactive system of claim 6 , wherein the overhead images comprise one or more of: (1) static images, (2) still-frame or freeze-frame images from a video, or (3) videos.

11. The interactive system of claim 6 , wherein the user interface is configured for display on a touch sensitive computing device.

12. Non-transitory computer storage that stores a user interface that provides functionality for a user to browse overhead images, the user interface including:

a map displaying a representation of a first geographic region of interest;

a user-selectable representation of a set of overhead images that are separate images from the map, the user-selectable representation corresponding to the first geographic region of interest, and wherein each of the set of overhead images depict a portion of the first geographic region of interest and comprise images captured by satellites that depict a smaller area than the map of the first geographic region of interest, the smaller area being contained within the first geographic region of interest,

wherein the set of overhead images comprise ortho-rectified images, and

wherein each of the set of overhead images comprise metadata that provides geolocation information for matching to the first geographic region of interest;

at least one display element for selecting one of the overhead images; and

executable code that is:

responsive to a first user input associated with a selection of at least one overhead image by displaying the map repositioned visually with the selected overhead image and in a first scale with the selected overhead image and displaying the selected overhead image superimposed directly over a portion of the map that geographically corresponds to the selected overhead image such that the geographically-corresponding portion of the map is no longer visible and the smaller area of the first geographic region of interest of the selected image is in more detail than shown in the map of the first geographic region of interest, wherein the first scale corresponds to the selected overhead image; and

responsive to another user input selecting a second geographic region of interest different from the first geographic region of interest by displaying an updated representation, wherein the updated representation comprises at least one overhead image that depicts a portion of the second geographic region of interest and comprises metadata that provides geolocation information for matching to the second geographic region of interest, wherein the at least one overhead image is available for selection to be superimposed in a second scale with the second geographic region of interest and wherein the second scale corresponds to the at least one overhead image.

13. The non-transitory computer storage of claim 12 , wherein the user-selectable representation of the set of overhead images corresponding to the first geographic region of interest comprises a filmstrip that includes the representation of the set of overhead images, wherein each overhead image within the filmstrip is user-selectable to cause display of the overhead image superimposed over the geographically-corresponding portion of the map.

14. The non-transitory computer storage of claim 12 , wherein the user interface comprises a web page.

15. The non-transitory computer storage of claim 12 , wherein the user interface is embodied in a mobile application.

16. The non-transitory computer storage of claim 12 , wherein the user interface is configured for display on a touch sensitive computing device.

17. The non-transitory computer storage of claim 12 , wherein the user interface is generated by an overhead image viewing system.

18. The non-transitory computer storage of claim 12 , wherein the overhead images comprise one or more of: (1) static images, (2) still-frame or freeze-frame images from a video, or (3) videos.

19. The computer-implemented method of claim 1 , wherein the one or more overhead images are filtered based at least in part on at least one of an image rating, user feedback, or a user tag.

20. The computer-implemented method of claim 1 , further comprising:

outputting for display a heat map corresponding to the first geographic region of interest, wherein the heat map is indicative of a density of the overhead images per area in the first geographic region of interest.

Assignments (9)
MERGER AND CHANGE OF NAME Recorded May 5, 2022
From: PLANET LABS INC.; PLANET LABS PBC
To: PLANET LABS PBC
Reel/Frame 059857/0587 →
RELEASE OF SECURITY INTEREST Recorded Dec 10, 2021
From: SILICON VALLEY BANK
To: PLANET LABS INC.; TERRA BELLA TECHNOLOGIES INC.; PL FOREIGN HOLDCO, INC.
Reel/Frame 058359/0501 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 21, 2019
From: PLANET LABS INC.; PL INTERMEDIATE TB, INC.; PLANET LABS TB, INC.; TERRA BELLA TECHNOLOGIES INC.; PLANET LABS LLC; PL FOREIGN HOLDCO, INC.
To: SILICON VALLEY BANK
Reel/Frame 049558/0515 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2017
From: TERRA BELLA TECHNOLOGIES, INC.
To: PLANET LABS, INC.
Reel/Frame 044261/0748 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NO. 15/061,851 PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043661/0060 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 043277 FRAME: 0669. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 17, 2017
From: GOOGLE INC.
To: PLANET LABS TB, INC.
Reel/Frame 043409/0837 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2017
From: GOOGLE INC.
To: PLANT LABS TB, INC.
Reel/Frame 043277/0669 →
CHANGE OF NAME Recorded Oct 24, 2016
From: SKYBOX IMAGING, INC.
To: TERRA BELLA TECHNOLOGIES INC.
Reel/Frame 040260/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2014
From: BERTOLDO, GREG; CERVANTES, CARLOS; CIRMINELLO, RICHARD J., JR.; LONG, JAMES; MANN, JULIAN; BERKENSTOCK, DANIEL; GUINAN, OLIVER; HU, CHING-YU; WEGEL, ADAM; KELLEY, CHRISTOPHER
To: SKYBOX IMAGING, INC.
Reel/Frame 033946/0053 →
Continuity (3)
Provisional Application 61689794 · Jun 12, 2012
Provisional Application 61642766 · May 4, 2012
Related Publication 20130298083A1 · Nov 7, 2013