IP Library Granted Patent US 11,468,654
Granted Patent B2
US 11,468,654 · App. 17/081,480 · Granted Oct 11, 2022

Determining compass orientation of imagery

Inventors: Andrew Gallagher (Brooktondale, NY); Shuchang Zhou (Beijing, CN); Zhiheng Wang (Beijing, CN)
Assignee: Google LLC
G06V10/242G01C17/34G06T7/73G06V10/243G06V10/44G06V20/38G06T2207/10004G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,654
App. No.
17/081,480
Granted
Oct 11, 2022
Kind
B2
Abstract

The orientation of imagery relative to a compass bearing may be determined based on the position of the sun or other information relating to celestial bodies captured in the image.

Claims (37)

1. A system comprising:

one or more processors; and

memory storing instructions executable by the one or more processors to perform a method comprising:

identifying a first position of a first feature in imagery based on a visual similarity of the first feature to a celestial object;

identifying a second position of a second feature in the imagery based on a visual similarity of the second feature to an object associated with a known geographic location;

determining, based on the first position relative to the second position, an azimuth angle, including determining an azimuth associated with a position 180 degrees from the second position of the second feature;

associating a portion of the imagery with the determined azimuth angle; and

determining, based at least partially on the azimuth angle and the azimuth, an orientation of the imagery.

2. The system of claim 1 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a road.

3. The system of claim 2 wherein determining an azimuth angle comprises determining a set of possible azimuth locations of the celestial object.

4. The system of claim 1 wherein determining an azimuth angle comprises determining potential azimuth angles associated with the second position and comparing the potential azimuth angles to the first position.

5. The system of claim 1 wherein the imagery is a photo sphere and the celestial object is the sun.

6. The system of claim 1 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a sidewalk.

7. The system of claim 1 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to bodies of water.

8. The system of claim 1 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a forest.

9. The system of claim 1 wherein the imagery is a photo sphere and the celestial object is the moon.

10. The system of claim 1 wherein the imagery is a photo sphere and the celestial object is a star.

11. A method, comprising:

identifying, with one or more processors, a first position of a first feature in imagery based on a visual similarity of the first feature to a celestial object;

identifying, with one or more processors, a second position of a second feature in the imagery based on a visual similarity of the second feature to an object associated with a known geographic location;

determining, with one or more processors based on the first position relative to the second position, an azimuth angle, including determining an azimuth associated with a position 180 degrees from the second position of the second feature;

associating, with one or more processors, a portion of the imagery with the determined azimuth angle; and

determining, based at least partially on the azimuth angle and the azimuth an orientation of the imagery.

12. The method of claim 11 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a road.

13. The method of claim 12 wherein determining an azimuth angle comprises determining a set of possible azimuth locations of the celestial object.

14. The method of claim 11 wherein determining an azimuth angle comprises determining potential azimuth angles associated with the second position and comparing the potential azimuth angles to the first position.

15. The method of claim 11 wherein the imagery is a photo sphere and the celestial object is the sun.

16. The method of claim 11 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a sidewalk.

17. The method of claim 11 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to bodies of water.

18. The method of claim 11 wherein identifying a second position of a second feature comprises determining the visual similarity of the second feature to a forest.

19. The method of claim 11 wherein the imagery is a photo sphere and the celestial object is the moon.

20. A non-transitory computer-readable medium storing instructions executable by one or more processors to perform a method, comprising:

identifying a first position of a first feature in imagery based on a visual similarity of the first feature to a celestial object;

identifying a second position of a second feature in the imagery based on a visual similarity of the second feature to an object associated with a known geographic location;

determining, based on the first position relative to the second position, an azimuth angle, including determining an azimuth associated with a position 180 degrees from the second position of the second feature;

associating a portion of the imagery with the determined azimuth angle; and

determining, based at least partially on the azimuth angle and the azimuth an orientation of the imagery.

Assignments (2)
CHANGE OF NAME Recorded Oct 29, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 054249/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: GALLAGHER, ANDREW; ZHOU, SHUCHANG; WANG, ZHIHENG
To: GOOGLE INC.
Reel/Frame 054197/0644 →
Continuity (3)
Division 16005955 · Jun 12, 2018
Division 14761200
Related Publication 20210042552A1 · Feb 11, 2021
Cited By (1)
US 12,646,155