IP Library Granted Patent US 11,232,149
Granted Patent B2
US 11,232,149 · App. 16/520,998 · Granted Jan 25, 2022

Establishment anchoring with geolocated imagery

Inventors: Brian Edmond Brewington (Superior, CO); Kirk Johnson (Boulder, CO)
Assignee: Google LLC
G06F16/5866G06F16/29G06F16/51G06F16/951G06F16/9537G06K9/00664G06K2209/25G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,149
App. No.
16/520,998
Granted
Jan 25, 2022
Kind
B2
Abstract

The technology relates to determining an establishment's presence at a geolocation. A computing device may receive a first image including location data associated with the first image's capture. A set of images, which include location information and one or more identification marks associated with one or more establishments may also be received. The computing device may compare the first image to the set of images to determine whether the first image contains one of the one or more identification marks, and determine that one of the one or more establishments, associated with the one of the one or more identification marks contained in the first image, is currently located within a set proximity of the first image location. The computing device may also update a location database by associating the one of the one or more establishments with a location within a set proximity of the first image location.

Claims (56)

1. A computer implemented method for determining and updating an establishment's presence at a geographic location, the method comprising:

receiving, with one or more processing devices, a first image including location data, wherein the location data includes a first image location;

generating, with the one or more processing devices, one or more variants of the first image;

receiving a collection of images;

assigning a label to each image in the collection of images which contain at least one identification mark;

receiving, with the one or more processing devices, a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;

performing an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;

determining, by the one or more processing devices, based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;

determining, by the one or more processing devices, that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and

updating, by the one or more processing devices, a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

2. The method of claim 1 , wherein the one or more variants of the first image include:

a high-contrast version of the first images;

a color inverted version of the first images;

a black and white version of the first images; and/or

a black and white inverted version of the first images.

3. The method of claim 1 , wherein the listed location retrieved from the authoritative webpage includes an address.

4. The method of claim 1 , wherein the first image geographic location information includes a longitude and latitude reading corresponding to a location the first image was captured.

5. The method of claim 1 , wherein determining that the first image location is within the set proximity of the listed location includes determining the first image location is within a set radius of the listed location.

6. A system for determining and updating an establishment's presence at a geographic location, the system comprising:

one or more computing devices having one or more processors; and

memory storing instructions, the instructions executable by the one or more processors;

wherein the instructions comprise:

receiving a first image including location data, wherein the location data includes a first image location;

generating one or more variants of the first image;

receiving a collection of images;

assigning a label to each image in the collection of images which contain at least one identification mark;

receiving a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;

performing an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;

determining based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;

determining that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and

updating a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

7. The system of claim 6 , wherein the one or more variants of the first image include:

a high-contrast version of the first images;

a color inverted version of the first images;

a black and white version of the first images; and/or

a black and white inverted version of the first images.

8. The system of claim 6 , wherein the listed location retrieved from the authoritative webpage includes an address.

9. The system of claim 6 , wherein the first image geographic location information includes a longitude and latitude reading corresponding to a location the first image was captured.

10. The system of claim 6 , wherein determining that the first image location is within the set proximity of the listed location includes determining the first image location is within a set radius of the listed location.

11. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors, cause the one or more processors to:

receive a first image including location data, wherein the location data includes a first image location;

generate one or more variants of the first image;

receive a collection of images;

assign a label to each image in the collection of images which contain at least one identification mark;

receive a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;

perform an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;

determine based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;

determine that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and

update a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

12. The non-transitory computer-readable medium of claim 11 , wherein the one or more variants of the first image include:

a high-contrast version of the first images;

a color inverted version of the first images;

a black and white version of the first images; and/or

a black and white inverted version of the first images.

13. The non-transitory computer-readable medium of claim 11 , wherein the listed location retrieved from the authoritative webpage includes an address.

14. The non-transitory computer-readable medium of claim 11 , wherein determining that the first image location is within the set proximity of the listed location includes determining the first image location is within a set radius of the listed location.

Assignments (2)
CHANGE OF NAME Recorded Jul 26, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 049881/0048 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2019
From: BREWINGTON, BRIAN EDMOND; JOHNSON, KIRK
To: GOOGLE INC.
Reel/Frame 049861/0189 →
Continuity (2)
Continuation 14816574 · Aug 3, 2015
Related Publication 20190347289A1 · Nov 14, 2019