Universal product labeling for vision-based commerce
A system and method for computer vision assisted physical-labels functions to use functional, large format product labeling for better computer vision (CV) identification. The product labels and detection capabilities of the system and method enhance product label detection and interpretation for use with image sensing at a distance. The product labels are non-obtrusive and can mitigate changes to sizing or visual appearance of packaging of goods or products. The system and method can enable universal product labeling for vision-based commerce and other applications.
1. A method for sensor detectable physical labels comprising:
generating, a product label, which comprises:
receiving a product identifier of a product,
encoding a partial product identifier, associated with the product identifier, into a graphical machine-readable code defined through an arrangement of graphical data elements in different states, wherein the partial product identifier is unique for a local classification group;
printing a physical product label with the graphical machine-readable code, wherein the size of the graphical data elements is calibrated to an imaging resolution of imaging devices of an imaging system within an environment;
at the imaging devices of the imaging system, collecting image data;
detecting, processing the image data using a code detection computer vision model, an imaged product label with an imaged graphic machine readable code;
decoding the imaged graphic machine-readable code into an imaged partial identifier;
determining a classification group of the imaged product label; and
compiling a product identifier output from the imaged partial identifier and the classification group of the imaged product label.
2. The method of claim 1 , wherein each graphical data element is sized in the physical product label greater than one centimeter in one dimension.
3. The method of claim 1 , wherein graphical data elements are each in one of a set of three or more color states.
4. The method of claim 1 , wherein the classification group is based on location; wherein determining a classification group of the imaged product label comprises determining location of the imaged graphic machine readable code and selecting the classification group of the imaged product label based on the location of the imaged graphic machine readable code.
5. The method of claim 1 , wherein the partial product identifier represents a weight property.
6. The method of claim 1 , further comprising storing a data record in a product label management data system, where the data record associates the partial product identifier to the product identifier.
7. The method of claim 6 , further comprising detecting, through processing of image data, the product satisfying an end of use condition and in response updating the product label management system to free usage of the partial product identifier for a new product identifier.
8. The method of claim 1 , wherein determining a classification group of the imaged product label may include: detecting, through processing of the image data using a computer vision model, a product property, wherein the product property is associated with the local classification group.
9. The method of claim 1 , wherein determining a classification group of the imaged product label comprises: detecting, through processing of the image data using a computer vision model, a classifier graphical code and decoding the classifier graphical code into an identifier of the classification group thereby determining the classification group.
10. A system for product label detection comprising:
a computer vision monitoring system with a plurality of imaging devices distributed in an environment, the computer vision monitoring system configured to collect image data,
a label management system comprising one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause a computing platform to perform operations comprising:
receiving a product identifier of a product,
encoding a partial product identifier, associated with the product identifier, into a graphical machine-readable code defined through an arrangement of graphical data elements in different states, wherein the partial product identifier is unique for a local classification group;
printing a physical product label with the graphical machine-readable code, wherein the size of the graphical data elements is calibrated to an imaging resolution of imaging devices of an imaging system within an environment;
detecting, processing the image data using a code detection computer vision mode, an imaged product label with an imaged graphic machine readable code;
decoding the imaged graphic machine-readable code into an imaged partial identifier;
determining a classification group of the imaged product label; and
compiling a product identifier output from the imaged partial identifier and the classification group of the imaged product label.
11. The system of claim 10 , wherein each graphical data element is sized in the physical product label greater than one centimeter in one dimension.
12. The system of claim 10 , wherein the classification group is based on location; wherein determining a classification group of the imaged product label comprises determining location of the imaged graphic machine readable code and selecting the classification group of the imaged product label based on the location of the imaged graphic machine readable code.
13. The system of claim 10 , further comprising storing a data record in a product label management data system, where the data record associates the partial product identifier to the product identifier.
14. The system of claim 13 , further comprising detecting, through processing of image data, the product satisfies an end of use condition and in response updating the product label management system to free usage of the partial product identifier for a new product identifier.
15. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing platform, cause the computing platform to:
receiving a product identifier of a product,
encoding a partial product identifier, associated with the product identifier, into a graphical machine-readable code defined through an arrangement of graphical data elements in different states, wherein the partial product identifier is unique for a local classification group;
printing a physical product label with the graphical machine-readable code, wherein the size of the graphical data elements is calibrated to an imaging resolution of imaging devices of an imaging system within an environment;
at the imaging devices of the imaging system, collecting image data;
detecting, processing the image data using a code detection computer vision model, an imaged product label with an imaged graphic machine readable code;
decoding the imaged graphic machine-readable code into an imaged partial identifier;
determining a classification group of the imaged product label; and
compiling a product identifier output from the imaged partial identifier and the classification group of the imaged product label.
16. The non-transitory computer-readable medium of claim 15 , wherein each graphical data element is sized in the physical product label greater than one centimeter in one dimension.
17. The non-transitory computer-readable medium of claim 15 , wherein graphical data elements are each in one of a set of three or more color states.
18. The non-transitory computer-readable medium of claim 15 , wherein the classification group is based on location; wherein determining a classification group of the imaged product label comprises determining location of the imaged graphic machine readable code and selecting the classification group of the imaged product label based on the location of the imaged graphic machine readable code.
19. The non-transitory computer-readable medium of claim 15 , further comprising storing a data record in a product label management data system, where the data record associates the partial product identifier to the product identifier.
20. The non-transitory computer-readable medium of claim 19 , further comprising detecting, through processing of image data, the product satisfies an end of use condition and in response updating the product label management system to free usage of the partial product identifier for a new product identifier.