Image recognition system
Systems and methods for predicting items within content and using improved, fine-grained image classification techniques to produce images used to identify consumer products in the real-world by allowing for the recognition of a product using an image captured under a variety of conditions and environments, such as angles, lighting, camera settings, and the like.
1. A method, comprising:
retrieving, by a computing device, image capture rules for operating one or more image capturing devices;
obtaining image data corresponding to an object;
extracting, from the image data, one or more image frames;
modifying the one or more image frames to extract background information;
determining, based on the one or more modified image frames, object classification settings; and
using the determined object classification settings to classify the object.
2. The method of claim 1 , further comprising:
generating, by the computing device, a user interface to view the object.
3. The method of claim 2 , further comprising:
presenting, via the user interface, a visual indication providing instructions to capture, based on the retrieved image capture rules, the image data corresponding to the object.
4. The method of claim 1 , further comprising:
sending, to a second computing device, the image data corresponding to the object to verify a classification of the object.
5. The method of claim 4 , wherein sending the image data further comprises:
determining that a processing threshold for the computing device has been exceeded; and
sending, to the second computing device, the image data corresponding to the object.
6. The method of claim 1 , wherein modifying the one or more image frames to extract background information further comprises:
using at least a first image frame to determine a pixel boundary of the object.
7. The method of claim 1 , wherein using the determined object classification settings to classify the object further comprises:
comparing the image data corresponding to the object with a plurality of product images.
8. The method of claim 1 , wherein obtaining the image data corresponding to the object further comprises:
capturing, via an image capturing device, a plurality of images of the object at a plurality of different viewing angles.
9. An apparatus comprising:
one or more processors; and
memory storing instructions that, when executed, cause the apparatus to:
retrieve image capture rules for operating one or more image capturing devices;
obtain image data corresponding to an object;
extract, from the image data, one or more image frames;
modify the one or more image frames to extract background information;
determine, based on the one or more modified image frames, object classification settings; and
use the determined object classification settings to classify the object.
10. The apparatus of claim 9 , wherein the instructions, when executed, further cause the apparatus to:
generate a user interface to view the object.
11. The apparatus of claim 10 , wherein the instructions, when executed, further cause the apparatus to:
present, via the user interface, a visual indication providing instructions to capture, based on the retrieved image capture rules, the image data corresponding to the object.
12. The apparatus of claim 9 , wherein the instructions, when executed, further cause the apparatus to:
sending, to a first computing device, the image data corresponding to the object to verify a classification of the object.
13. The apparatus of claim 12 , wherein the instructions, when executed, further cause the apparatus to send the image data by causing the apparatus to:
determine that a processing threshold for the apparatus has been exceeded; and
send, to a computing device, the image data corresponding to the object.
14. The apparatus of claim 9 , wherein the instructions, when executed, further cause the apparatus to modify the one or more image frames to extract background information by causing the apparatus to:
use at least a first image frame to determine a pixel boundary of the object.
15. The apparatus of claim 9 , wherein the instructions, when executed, further cause the apparatus to use the determined object classification settings to classify the object by causing the apparatus to:
compare the image data corresponding to the object with a plurality of product images.
16. The apparatus of claim 9 , further comprising an image capturing device, wherein the instructions, when executed, further cause the apparatus to obtain the image data corresponding to the object by causing the apparatus to:
capture, via the image capturing device, a plurality of images of the object at a plurality of different viewing angles.
17. A non-transitory machine readable medium storing instructions that, when executed, cause a first computing device to:
retrieve image capture rules for operating one or more image capturing devices;
obtain image data corresponding to an object;
extract, from the image data, one or more image frames;
modify the one or more image frames to extract background information;
determine, based on the one or more modified image frames, object classification settings; and
use the determined object classification settings to classify the object.
18. The non-transitory machine readable medium of claim 17 , wherein the instructions, when executed, further cause the first computing device to modify the one or more image frames to extract background information by:
using at least a first image frame to determine a pixel boundary of the object.
19. The non-transitory machine readable medium of claim 17 , wherein the instructions, when executed, further cause the first computing device to:
sending, to a first computing device, the image data corresponding to the object to verify a classification of the object.
20. The non-transitory machine readable medium of claim 19 , wherein the instructions, when executed, further cause the first computing device to send the image data by:
determining that a processing threshold for the first computing device has been exceeded; and
sending, to a second computing device, the image data corresponding to the object.
21. The non-transitory machine readable medium of claim 17 , wherein the instructions, when executed, further cause the first computing device to:
generate a user interface to view the object.
22. The non-transitory machine readable medium of claim 21 , wherein the instructions, when executed, further cause the first computing device to:
present, via the user interface, a visual indication providing instructions to capture, based on the retrieved image capture rules, the image data corresponding to the object.
23. The non-transitory machine readable medium of claim 17 , wherein the instructions, when executed, further cause the first computing device to use the determined object classification settings to classify the object by causing the first computing device to:
compare the image data corresponding to the object with a plurality of product images.
24. The non-transitory machine readable medium of claim 17 , wherein the instructions, when executed, further cause the first computing device to obtain the image data corresponding to the object by causing the first computing device to:
capture, via an image capturing device, a plurality of images of the object at a plurality of different viewing angles.