IP Library › Granted Patent US 9,671,938
Granted Patent B2
US 9,671,938 · App. 14/564,688 · Granted Jun 6, 2017

Navigating visual data associated with a point of interest

Inventors: Steven Maxwell Seitz (Seattle, WA); Andrew Ofstad (San Francisco, CA)
Assignee: Google Inc.
G06F3/04842G06F3/04815G06F17/30G06F17/30244G06T11/00G06T11/20G06T15/205G06T17/05G06T19/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,671,938
App. No.
14/564,688
Granted
Jun 6, 2017
Kind
B2
Abstract

Systems and methods for navigating an imagery graph are provided. In some aspects, a first image is provided for display, where the first image corresponds to a first image node within an imagery graph, where the imagery graph comprises image nodes corresponding to images from a plurality of different imagery types, and where each image node in the imagery graph is associated with geospatial data. An indication of a selection of a predetermined region within the first image is received, where the predetermined region is associated with a position in the first image that corresponds to geospatial data associated a second image node within the imagery graph. A second image corresponding to the second image node is provided for display in response to the indication of the selection of the predetermined region.

Claims (40)

1. A computer-implemented method for navigating imagery graphs, the method comprising:

receiving, by one or more processors, an indication of a selection of a region within a first image, wherein the region is associated with a position in the first image that corresponds to first geospatial data;

accessing, by the one or more processors, a data store containing an imagery graph, the imagery graph including at least one imagery set, each imagery set having one or more image nodes, and each image node including an image that is associated with one or more of a geographic location, a viewpoint orientation and a field of view, wherein the first image corresponds to a first image node within the imagery graph;

identifying, by the one or more processors, a second image node within the imagery graph based on a comparison of the first geospatial data to second geospatial data associated with the second image node; and

providing, by the one or more processors, a second image corresponding to the second image node for display in response to receiving the indication of the selection of the region within the first image and the identification of the second image node.

2. The method of claim 1 , wherein the imagery graph includes representations of geospatial relationships between images of the imagery graph and identifying the second image node is further based on the representations.

3. The method of claim 1 , wherein the first image node and the second image node are included in different imagery sets of the imagery graph.

4. The method of claim 3 , wherein the different imagery sets store different types of imagery including at least one of a street view panorama, an aerial image, a satellite image, an image from a photograph sharing service, or an image from a video.

5. The method of claim 1 , wherein the imagery graph comprises a single data structure including a plurality of image nodes and edges representing connections between the images, wherein identifying the image node is further based on at least one of the edges.

6. The method of claim 1 , further comprising:

receiving indicia of a cursor being hovered within the region; and

providing a notification that the second image is available responsive to the indicia of the cursor being hovered within the region.

7. The method of claim 6 , wherein the notification comprises a transformation of a shape of the cursor.

8. The method of claim 1 , wherein images are organized within the imagery graph based on at least one of their respective geographic location, viewpoint orientation, or field of view.

9. The method of claim 1 , wherein the geographic location of a given image in the imagery graph is be based on a geographic tag within the given image.

10. A system for navigating imagery graphs, the system comprising one or more processors configured to:

receive an indication of a selection of a region within a first image, wherein the region is associated with a position in the first image that corresponds to first geospatial data;

access a data store containing an imagery graph, the imagery graph including at least one imagery set, each imagery set having one or more image nodes, and each image node including an image that is associated with one or more of a geographic location, a viewpoint orientation and a field of view, wherein the first image corresponds to a first image node within the imagery graph;

identify a second image node within the imagery graph based on a comparison of the first geospatial data to second geospatial data associated with the second image node; and

provide a second image corresponding to the second image node for display in response to receiving the indication of the selection of the region within the first image and the identification of the second image node.

11. The system of claim 10 , wherein the imagery graph includes representations of geospatial relationships between images of the imagery graph and the one or more processors are further configured to identify the second image node further based on the representations.

12. The system of claim 10 , wherein the first image node and the second image node are included in different imagery sets of the imagery graph.

13. The system of claim 12 , wherein the different imagery sets store different types of imagery including at least one of a street view panorama, an aerial image, a satellite image, an image from a photograph sharing service, or an image from a video.

14. The system of claim 10 , wherein the imagery graph comprises a single data structure including a plurality of image nodes and edges representing connections between the images, and the one or more processors are further configured to the image node is further based on at least one of the edges.

15. The system of claim 10 , the one or more processors are further configured to:

receive indicia of a cursor being hovered within the region; and

provide a notification that the second image is available responsive to the indicia of the cursor being hovered within the region.

16. The system of claim 15 , wherein the notification comprises a transformation of a shape of the cursor.

17. A non-transitory, tangible computer readable medium on which instructions are stored, the instructions when executed by one or more processors, cause the one or more processors to perform a method for navigating imagery graphs, the method comprising:

receiving an indication of a selection of a region within a first image, wherein the region is associated with a position in the first image that corresponds to first geospatial data;

accessing a data store containing an imagery graph, the imagery graph including at least one imagery set, each imagery set having one or more image nodes, and each image node including an image that is associated with one or more of a geographic location, a viewpoint orientation and a field of view, wherein the first image corresponds to a first image node within the imagery graph;

identifying a second image node within the imagery graph based on a comparison of the first geospatial data to second geospatial data associated with the second image node; and

providing a second image corresponding to the second image node for display in response to receiving the indication of the selection of the region within the first image and the identification of the second image node.

18. The medium of claim 17 , wherein the imagery graph includes representations of geospatial relationships between images of the imagery graph and identifying the second image node is further based on the representations.

19. The medium of claim 17 , wherein the first image node and the second image node are included in different imagery sets of the imagery graph.

20. The medium of claim 19 , wherein different imagery sets store different types of imagery including at least one of a street view panorama, an aerial image, a satellite image, an image from a photograph sharing service, or an image from a video.

21. The medium of claim 17 , wherein the imagery graph comprises a single data structure including a plurality of image nodes and edges representing connections between the images, wherein identifying the image node is further based on at least one of the edges.

22. The medium of claim 17 , wherein the method further comprises:

receiving indicia of a cursor being hovered within the region; and

providing a notification that the second image is available responsive to the indicia of the cursor being hovered within the region.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2014
From: SEITZ, STEVEN MAXWELL; OFSTAD, ANDREW
To: GOOGLE INC.
Reel/Frame 034458/0546 →
Continuity (3)
Continuation 13691697 · Nov 30, 2012
Provisional Application 61712729 · Oct 11, 2012
Related Publication 20150095831A1 · Apr 2, 2015