System and method for asset serialization through image detection and recognition of unconventional identifiers
An embodiment of the present invention is directed to a combination of two deep-learning computer vision models—customized with post-processing—wrapped in a mobile application that is backed by an Application Programming Interface (API) supporting concurrent mobile users to accomplish asset serialization tasks in a warehouse or other storage environment.
1. A computer-implemented system for unique asset serialization, the system comprising:
an interactive user interface that is configured to receive one or more inputs;
a database interface that communicates with a database that stores and manages asset data; and
a processor executing on a mobile device and coupled to the interface and the database interface, the processor further configured to perform the steps of:
receiving, via an input interface, one or more images of a unique asset;
detecting, via a computer vision detection model, one or more unique serial number candidates on the unique asset in the received one or more images of the unique asset;
performing, via a prediction model, text recognition on the one or more unique serial number candidates and identifying one or more predicted unique serial numbers with corresponding confidence levels;
performing post processing on the one or more predicted unique serial numbers to improve prediction accuracy;
displaying, via the interactive user interface executing on the mobile device, the one or more predicted unique serial numbers;
receiving one or more user inputs responsive to the one or more predicted unique serial numbers; and
improving the prediction model based on the one or more user inputs.
2. The system of claim 1 , wherein the user interface comprises a dashboard that supports user management features, scans, inventory and documents.
3. The system of claim 1 , wherein the user interface provides asset level data comprising one or more of: asset identifier, asset type, asset location, asset quantity.
4. The system of claim 1 , wherein the asset comprises one or more of: a unique non-traditional healthcare asset and government issued weaponry.
5. The system of claim 1 , wherein the scan of the image is taken from one or more of: the mobile device, a drone device and a scanning structure.
6. The system of claim 1 , wherein the post processing comprises applying heuristics to improve text recognition.
7. The system of claim 1 , wherein the prediction model is configured by a set of configuration parameters customized by a user.
8. The system of claim 1 , wherein the prediction model performs a cross reference with a shipping document related to the asset.
9. The system of claim 1 , wherein an alert is generated when an event occurs, the event comprising one or more of: an unexpected asset is identified and an asset is missing.
10. The system of claim 1 , wherein a remote processor performs asset data analysis to generate new datasets and train the prediction model.
11. A computer-implemented method for unique asset serialization, the method comprising the steps of:
receiving, via an input interface, one or more images of a unique asset;
detecting, via a computer vision detection model, one or more unique serial number candidates on the unique asset in the received one or more images of the unique asset;
performing, via a prediction model, text recognition on the one or more unique serial number candidates and identifying one or more predicted unique serial numbers with corresponding confidence levels;
performing post processing on the one or more predicted unique serial numbers to improve prediction accuracy;
displaying, via an interactive user interface executing on the mobile device, the one or more predicted unique serial numbers;
receiving one or more user inputs responsive to the one or more predicted unique serial numbers; and
improving the prediction model based on the one or more user inputs.
12. The method of claim 11 , wherein the user interface comprises a dashboard that supports user management features, scans, inventory and documents.
13. The method of claim 11 , wherein the user interface provides asset level data comprising one or more of: asset identifier, asset type, asset location, asset quantity.
14. The method of claim 11 , wherein the asset comprises one or more of: a unique non-traditional healthcare asset and government issued weaponry.
15. The method of claim 11 , wherein the scan of the image is taken from one or more of: the mobile device, a drone device and a scanning structure.
16. The method of claim 11 , wherein the post processing comprises applying heuristics to improve text recognition.
17. The method of claim 11 , wherein the prediction model is configured by a set of configuration parameters customized by a user.
18. The method of claim 11 , wherein the prediction model performs a cross reference with a shipping document related to the asset.
19. The method of claim 11 , wherein an alert is generated when an event occurs, the event comprising one or more of: an unexpected asset is identified and an asset is missing.
20. The method of claim 11 , wherein a remote processor performs asset data analysis to generate new datasets and train the prediction model.