IP Library Granted Patent US 10,223,732
Granted Patent B2
US 10,223,732 · App. 15/256,048 · Granted Mar 5, 2019

Identifying items in images

Inventors: Matthew Thomas Short (San Jose, CA); Mary Elizabeth Hamilton (San Mateo, CA); Robert Dooley (Dublin, CA); David T. Nguyen (San Jose, CA); Leeann Chau Tuyet Dang (San Jose, CA)
Assignee: Accenture Global Solutions Limited
G06Q30/0633G06F3/0482G06F3/0488G06F3/04842G06F17/3087G06F17/30241G06F17/30268G06K9/6288G06Q10/02G06Q30/0202G06Q30/0261G06Q50/12G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,223,732
App. No.
15/256,048
Granted
Mar 5, 2019
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using location data to identify and provide services in association with items appearing in captured images. One of the methods includes receiving, from a device, an image and location data representing the device's physical location, determining, based on the location data, that a particular set of one or more locations are within a threshold distance of the device's physical location, accessing, for each of the one or more locations in the particular set, item information that indicates one or more items that are associated with the location, determining, based on the accessed item information, that the image likely shows a particular item that is associated with one or more locations in the particular set, and providing, to the device, instructions for presentation of information about (i) the particular item and (ii) one or more locations in the particular set that are associated with the particular item.

Claims (77)

1. A computer-implemented method comprising:

receiving, from a device, (i) an image, and (ii) device location data;

determining, based on the device location data, that a particular set of one or more store locations are within a threshold distance of the device;

accessing, for each of the one or more store locations in the particular set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;

determining, based on the accessed item information, that the image likely shows a particular item that is designated as being eligible for retrieval at one or more store locations in the particular set;

determining, for each of the one or more store locations at which the particular item is designated as being eligible for retrieval, a predicted amount of time that a task of retrieving one or more items at the store location would take;

ranking the one or more store locations based at least on the predicted amounts of time;

generating a set of instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, ordered based on the ranking, at which the particular item is designated as being eligible for retrieval; and

providing, to the device, the generated set of instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set at which the particular item is designated as being eligible for retrieval.

2. The method of claim 1 ,

wherein determining, for each of the one or more store locations, a predicted amount of time that a task of retrieving one or more items at the store location would take comprises:

determining, for a first store location associated with the particular item, a first predicted amount of time that a task of retrieving one or more items at the first store location is predicted to take;

determining, for a second store location associated with the particular item, a second predicted amount of time that a task of retrieving one or more items at the second store location is predicted to take;

wherein the method further comprises:

determining that the first predicted amount of time is less than the second predicted amount of time; and

wherein ranking the one or more store locations associated with the particular item based on the predicted amounts of time comprises:

ranking the one or more store locations based on determining that the first predicted amount of time is less than the second predicted amount of time.

3. The method of claim 2 , wherein ranking the one or more store locations based on determining that the first predicted amount of time is less than the second predicted amount of time comprises:

based on determining that the first predicted amount of time is less than the second predicted amount of time, assigning the first store location a higher ranking than the second store location.

4. The method of claim 2 , further comprising:

determining, based on the device location data, that the device is located a first distance away from the first store location;

determining, based on the device location data, that the device is located a second distance away from the second store location;

determining that the first distance is greater than the second distance;

based on determining that the first predicted amount of time is less than the second predicted amount of time and determining that the first distance is greater than the second distance, determining an incentive that is to be provided for retrieving the particular item at the first store location; and

wherein providing the generated set of instructions to the device comprises:

providing, to the device, additional instructions for presentation of information about (a) the particular item, (b) the first store location, (c) the second store location, and (d) the determined incentive.

5. The method of claim 4 , further comprising:

at a particular time after providing the instructions for presentation of information to the device, receiving, from the device, updated device location data;

determining, based on the updated device location data, that the device is at the first store location; and

in response to providing the additional instructions for presentation of information to the device and determining that the device is at the first store location, providing, to the device, further instructions for presentation of one or more graphical or textual elements indicating an offer to redeem the determined incentive.

6. The method of claim 1 , further comprising:

determining, based on the device location data, that a first set of one or more store locations are within a first threshold distance of a physical location that is associated with the device;

accessing, for each of the one or more store locations in the first set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;

determining, based on the accessed item information for the one or more store locations in the first set, that the image does not satisfy a threshold likelihood for any of the one or more items that are designated as being eligible for retrieval at the one or more store locations in the first set; and

in response to determining that the image does not show any of the one or more items that are designated as being eligible for retrieval at the one or more store locations in the first set, identifying a second threshold distance that is greater than the first threshold distance, wherein determining, based on the device location data, that the particular set of one or more store locations are within the threshold distance of the device's physical location comprises:

after identifying the second threshold distance, determining, based on the device location data, that a second set of one or more store locations are within the second threshold distance of the physical location of the device, the second set of one or more store locations being different from the first set of one or more store locations.

7. The method of claim 1 , further comprising:

determining, based on the device location data, that the device is located within a geographic region that is occupied by a particular venue or park, wherein determining, based on the device location data, that the particular set of one or more store locations are within the threshold distance of a physical location of the device comprises:

determining, based on the device location data, that the particular set of one or more store locations are (i) within the threshold distance of the device's physical location, and (ii) positioned within the geographic region that is occupied by the particular venue or park.

8. The method of claim 7 , further comprising:

determining that the device is associated with a particular user; and

accessing user information indicating one or more characteristics of the particular user and a visit to the particular venue or park by the particular user.

9. The method of claim 1 , further comprising:

for each item that is associated with one or more store locations in the particular set, accessing, based on the accessed item information, imaging data that is associated with the item; and

evaluating the image against the accessed imaging data.

10. The method of claim 1 , further comprising:

after providing, to the device, instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, receiving, from the device, data indicating a user selection of a particular one of the one or more store locations indicated in the instructions; and

in response to receiving data indicating the user selection of the particular store location, providing, to one or more devices that are associated with the particular store location, instructions for presentation of a notification about the particular item.

11. The method of claim 1 , further comprising:

in response to determining that the image likely shows the particular item, accessing attribute information indicating one or more physical attributes of the particular item.

12. The method of claim 1 , further comprising:

before providing, to the device, the generated instructions for presentation of information about (i) the particular item and (ii) one or more locations in the particular set that are associated with the particular item:

generating a first set of instructions for presentation of information about (i) a set of one or more items and (ii) the one or more store locations; and

providing the first set of instructions to another, different device; and

based on providing the first set of instructions to the other, different device, generating a second set of instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set that are associated with the particular item, wherein providing, to the device, instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set that are associated with the particular item comprises:

providing the second set of instructions to the device.

13. The method of claim 1 , wherein accessing, for each of the one or more store locations in the particular set, item information that indicates one or more items that are designated as being eligible for retrieval at the location comprises:

accessing, for each of the one or more store locations in the particular set, an inventory of items at the location or a catalog of one or more items that are designated as being eligible for retrieval at the location.

14. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

receiving, from a device, (i) an image, and (ii) device location data;

determining, based on the device location data, that a particular set of one or more store locations are within a threshold distance of the device;

accessing, for each of the one or more store locations in the particular set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;

determining, based on the accessed item information, that the image likely shows a particular item that is designated as being eligible for retrieval at one or more store locations in the particular set;

determining, for each of the one or more store locations at which the particular item is designated as being eligible for retrieval, a predicted amount of time that a task of retrieving one or more items at the store location would take;

ranking the one or more store locations based at least on the predicted amounts of time:

generating a set of instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, ordered based on the ranking, at which the particular item is designated as being eligible for retrieval; and

providing, to the device, the generated set of instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set at which the particular item is designated as being eligible for retrieval.

15. A computer program product, encoded on one or more non-transitory computer storage media, comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

receiving, from a device, (i) an image, and (ii) device location data;

determining, based on the device location data, that a particular set of one or more store locations are within a threshold distance of the device;

accessing, for each of the one or more store locations in the particular set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;

determining, based on the accessed item information, that the image likely shows a particular item that is designated as being eligible for retrieval at one or more store locations in the particular set;

determining, for each of the one or more store locations at which the particular item is designated as being eligible for retrieval, a predicted amount of time that a task of retrieving one or more items at the store location would take;

ranking the one or more store locations based at least on the predicted amounts of time;

generating a set of instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, ordered based on the ranking, at which the particular item is designated as being eligible for retrieval; and

providing, to the device, the generated set of instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set at which the particular item is designated as being eligible for retrieval.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2016
From: SHORT, MATTHEW THOMAS; HAMILTON, MARY ELIZABETH; DOOLEY, ROBERT; NGUYEN, DAVID T.; DANG, LEEANN CHAU
To: ACCENTURE GLOBAL SOLUTIONS LIMITED
Reel/Frame 039920/0313 →
Continuity (2)
Provisional Application 62214562 · Sep 4, 2015
Related Publication 20170068872A1 · Mar 9, 2017