Systems and methods for machine vision based object recognition
The present disclosure is related to object recognition and tracking using multi-camera driven machine vision. In one aspect, a method includes capturing, via a multi-camera system, a plurality of images of a user, each of the plurality of images representing the user from a unique angle; identifying, using the plurality of images, the user; detecting, throughout a facility, an item selected by the user; creating a visual model of the item to track movement of the item throughout the facility; determining, using the visual model, whether the item is selected for purchase; and detecting that the user is leaving the facility; and processing a transaction for the item when the item is selected for purchase and when the user has left the facility.
1. A computer-implemented method comprising:
receiving one or more images captured by cameras associated with a facility;
applying one or more image-recognition algorithms to the one or more images to determine a presence of a user within the facility;
detecting a selection of an item by the user, wherein the item is located within the facility;
generating a three-dimensional representation of the selected item;
tracking in real-time a movement of the selected item throughout the facility, wherein tracking includes determining a location of the three-dimensional representation relative to the facility;
determining one or more characteristics associated with the user based on the movement of the selected item, wherein the one or more characteristics include a time spent by the user within the facility;
storing the one or more characteristics in a profile associated with the user; and
determining targeted content to be transmitted to the user based on the profile.
2. The computer-implemented method of claim 1 , wherein detecting the selection includes applying a convolutional neural network to additional images captured by the cameras, and wherein the additional images are associated with the item.
3. The computer-implemented method of claim 1 , wherein tracking the movement includes determining that the user has left the facility based on the tracked movement of the selected item.
4. The computer-implemented method of claim 1 , wherein determining the location of the three-dimensional representation includes transposing the three-dimensional representation into a two-dimensional model of the selected item.
5. The computer-implemented method of claim 1 , wherein tracking the movement includes:
identifying a location coordinate of the selected item; and
determining whether the location coordinate is within a distance threshold associated with an entrance of the facility.
6. A system comprising:
one or more processors; and
memory storing thereon instructions that, as a result of being executed by the one or more processors, cause the system to perform operations comprising:
receiving one or more images captured by cameras associated with a facility;
applying one or more image-recognition algorithms to the one or more images to determine a presence of a user within the facility;
detecting a selection of an item by the user, wherein the item is located within the facility;
generating a three-dimensional representation of the selected item;
tracking in real-time a movement of the selected item throughout the facility, wherein tracking includes determining a location of the three-dimensional representation relative to the facility;
determining one or more characteristics associated with the user based on the movement of the selected item, wherein the one or more characteristics include a time spent by the user within the facility;
storing the one or more characteristics in a profile associated with the user; and
determining targeted content to be transmitted to the user based on the profile.
7. The system of claim 6 , wherein detecting the selection includes applying a convolutional neural network to additional images captured by the cameras, and wherein the additional images are associated with the item.
8. The system of claim 6 , wherein tracking the movement includes determining that the user has left the facility based on the tracked movement of the selected item.
9. The system of claim 6 , wherein determining the location of the three-dimensional representation includes transposing the three-dimensional representation into a two-dimensional model of the selected item.
10. The system of claim 6 , wherein tracking the movement includes:
identifying a location coordinate of the selected item; and
determining whether the location coordinate is within a distance threshold associated with an entrance of the facility.
11. A non-transitory, computer-readable storage medium storing thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to perform operations comprising:
receiving one or more images captured by cameras associated with a facility;
applying one or more image-recognition algorithms to the one or more images to determine a presence of a user within the facility;
detecting a selection of an item by the user, wherein the item is located within the facility;
generating a three-dimensional representation of the selected item;
tracking in real-time a movement of the selected item throughout the facility, wherein tracking includes determining a location of the three-dimensional representation relative to the facility;
determining one or more characteristics associated with the user based on the movement of the selected item, wherein the one or more characteristics include a time spent by the user within the facility;
storing the one or more characteristics in a profile associated with the user; and
determining targeted content to be transmitted to the user based on the profile.
12. The non-transitory, computer-readable storage medium of claim 11 , wherein detecting the selection includes applying a convolutional neural network to additional images captured by the cameras, and wherein the additional images are associated with the item.
13. The non-transitory, computer-readable storage medium of claim 11 , wherein tracking the movement includes determining that the user has left the facility based on the tracked movement of the selected item.
14. The non-transitory, computer-readable storage medium of claim 11 , wherein determining the location of the three-dimensional representation includes transposing the three-dimensional representation into a two-dimensional model of the selected item.
15. The non-transitory, computer-readable storage medium of claim 11 , wherein tracking the movement includes:
identifying a location coordinate of the selected item; and
determining whether the location coordinate is within a distance threshold associated with an entrance of the facility.