Method and system for item identification
The method for item identification preferably includes determining visual information for an item; calculating a first encoding using the visual information; calculating a second encoding using the first encoding; determining an item identifier for the item using the second encoding; optionally presenting information associated with the item to a user; and optionally registering a new item.
1. A system for item recognition, comprising:
a storage device; and
a processing system coupled to the storage device, the storage device storing software instructions that, when executed, cause the processing system to perform a method, comprising:
capturing an image of an item;
calculating an item encoding using a model trained to determine item identifiers from the image; and
determining an item identifier for the item based on a similarity between the item encoding and a set of predetermined encodings for each of a set of items.
2. The system of claim 1 , wherein the item encoding is output by an intermediate layer of the model.
3. The system of claim 1 , wherein the model comprises an item classifier and a combination classifier, wherein calculating the item encoding comprises:
determining a first encoding from an intermediate layer of the item classifier based on the image; and
determining a second encoding from an intermediate layer of the combination classifier based on the first encoding.
4. The system of claim 1 , wherein the set of predetermined encodings comprise item encodings for each of the set of items that were extracted by the model.
5. The system of claim 4 , wherein an updated set of predetermined encodings is determined each time the model is retrained at a central system, wherein a difference between a prior set of predetermined encodings and the updated set of predetermined encodings is transmitted to each local system.
6. The system of claim 5 , wherein the central system comprises a cloud computing system, remote from each local system.
7. The system of claim 5 , wherein the image is not transmitted from the central system to the local system.
8. The system of claim 1 , wherein the method is performed by a local system communicatively connected to a remote system, wherein the remote system stores:
a database of items and associated images thereof;
a set of entities and items associated therewith; and
a set of models and item encodings extracted by each model for each entity, wherein each model is trained to identify the items associated with the respective entity.
9. The system of claim 1 , wherein the system further comprises a camera configured to capture the image from at least one of: a right, left, top, front, or back side of a measurement volume.
10. The system of claim 1 , wherein the method further comprises facilitating item purchase based on the item identifier.
11. The system of claim 1 , wherein the method further comprises:
receiving a set of images and a new item identifier for a new item;
extracting a new item encoding from the set of images using the model; and
storing the new item encoding with the new item identifier, wherein the new item encoding is subsequently used to identify the new item.
12. The system of claim 11 , wherein the method is performed by a local system, wherein the method further comprises sending the set of images and the new item identifier for the new item to a central system communicatively connected to a plurality of local systems.
13. A method for item recognition, comprising:
capturing an image of an item;
calculating an item encoding using a model trained to determine item identifiers from images; and
determining an item identifier for the item based on a similarity between the item encoding and a set of predetermined encodings for known items.
14. The method of claim 13 , further comprising, determining an updated set of predetermined encodings at a central system, wherein a difference between a prior set of predetermined encodings and the updated set of predetermined encodings is transmitted to a local system.
15. The method of claim 13 , wherein the method is performed by a local system, wherein the model is trained by a central system on images of the item and sent to the local system.
16. The method of claim 15 , wherein the central system does not send the images to the local system.
17. The method of claim 15 , wherein the model is retrained when new images of new items are received at the central system.
18. The method of claim 13 , wherein the item encoding is output by an intermediate layer of the model.
19. The method of claim 13 , further comprising determining a price for the item using the item identifier; and requesting payment from a user using the price.
20. The method of claim 13 , wherein the method is repeated at each local system of a plurality of local systems.