IP Library Granted Patent US 11,568,551
Granted Patent B2
US 11,568,551 · App. 17/390,410 · Granted Jan 31, 2023

Method and system for obtaining pair-wise epipolar constraints and solving for panorama pose on a mobile device

Inventors: Alan Sheridan (Apex, NC); Scott Benjamin Satkin (Palo Alto, CA); Vivek Verma (Oakland, CA)
Assignee: Google LLC
G06T7/337G06F3/0488G06F3/04817G06F3/04845G06T3/4038G06T7/74G06T2200/32G06T2207/20101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,568,551
App. No.
17/390,410
Granted
Jan 31, 2023
Kind
B2
Abstract

Aspects of the disclosure generally relate to connecting panoramic images. One or more computing devices may load and display a first panoramic image captured at a first location and receive a selection of an area on the first panoramic image, the area corresponding to where a connection to other panoramic images may be made. The one or more computing devices may identify and display one or more nearby panoramic images which were captured near the first location and receive a selection of one of the one or more nearby panoramic images. The one or more computing devices may display the selected panoramic image and the first panoramic image and align the selected panoramic image with the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image. The one or more computing devices may connect the selected panoramic image with the first panoramic image.

Claims (50)

1. A computer implemented method for connecting panoramic images, the method comprising:

receiving, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location;

displaying, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image;

overlaying, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image;

aligning, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic image is displayed in the same display location relative to the alignment indicator; and

connecting, by the one or more computing devices, the selected panoramic image with the first panoramic image.

2. The method of claim 1 , further comprising:

displaying a navigation icon overlaid on the first panoramic image at the selected area;

receiving a selection of the navigation icon; and

transitioning the display from the first panoramic image to the selected panoramic image.

3. The method of claim 2 , wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image.

4. The method of claim 2 , wherein the nearby images include similar image data to image data in the first panoramic image.

5. The method of claim 1 , wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image.

6. The method of claim 1 , further comprising:

receiving an input responsive to an interactive portion of the alignment indicator, the input indicating when the first panoramic image and selected panoramic image are aligned.

7. The method of claim 1 , further comprising:

after aligning the selected panoramic image and the first panoramic image, optimizing the location and orientation of the images.

8. A system for connecting panoramic images, the system comprising:

one or more computing devices having one or more processors coupled to memory, the one or more processors being configured to:

receive, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location;

display, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image;

overlay, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image;

align, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic image is displayed in the same display location relative to the alignment indicator; and

connect, by the one or more computing devices, the selected panoramic image with the first panoramic image.

9. The system of claim 8 , wherein the processors are further configured to:

display a navigation icon overlaid on the first panoramic image at the selected area;

receive a selection of the navigation icon; and

transition the display from the first panoramic image to the selected panoramic image.

10. The system of claim 9 , wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image.

11. The system of claim 9 , wherein the nearby images include similar image data to image data in the first panoramic image.

12. The system of claim 8 , wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image.

13. The system of claim 8 , wherein the processors are further configured to:

receive an input responsive to an interactive portion of the alignment indicator, the input indicating when the first panoramic image and selected panoramic image are aligned.

14. The system of claim 8 , wherein the processors are further configured to:

after aligning the selected panoramic image and the first panoramic image, optimizing the location and orientation of the images.

15. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors, cause the one or more processors to:

receive, by the one or more computing devices, a selection of one of two or more panoramic images, wherein the two or more panoramic images were captured near a first geographic location;

display, with the one or more computing devices, the selected panoramic image and a first panoramic image captured near the first geographic location on a display, wherein the first panoramic image is overlaid on at least a portion of the selected image;

overlay, on the display, an alignment indicator on top of the selected panoramic image and the first panoramic image;

align, by the one or more computing devices, the selected panoramic image and the first panoramic image such that the selected panoramic image is oriented in the same direction as the first panoramic image on the display, such that similar imagery in the selected panoramic image and the first panoramic image is displayed in the same display location relative to the alignment indicator; and

connect, by the one or more computing devices, the selected panoramic image with the first panoramic image.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the one or more processors to:

display a navigation icon overlaid on the first panoramic image at the selected area;

receive a selection of the navigation icon; and

transition the display from the first panoramic image to the selected panoramic image.

17. The non-transitory computer-readable medium of claim 16 , wherein the transitioning is done such that the selected panoramic image is displayed in the same direction as the first panoramic image.

18. The non-transitory computer-readable medium of claim 16 , wherein the nearby images include similar image data to image data in the first panoramic image.

19. The non-transitory computer-readable medium of claim 15 , wherein displaying the selected panoramic image and the first panoramic image includes displaying the selected panoramic image above the first panoramic image.

20. The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the one or more processors to:

after aligning the selected panoramic image and the first panoramic image, optimize the location and orientation of the images.

Assignments (2)
CHANGE OF NAME Recorded Nov 2, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 057991/0192 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: SHERIDAN, ALAN; SATKIN, SCOTT BENJAMIN; VERMA, VIVEK
To: GOOGLE INC.
Reel/Frame 057978/0851 →
Continuity (3)
Continuation 15310325
Provisional Application 62331273 · May 3, 2016
Related Publication 20220044429A1 · Feb 10, 2022