Image based browser navigation
A system to navigate a browser based on image data may perform operations that include: receiving a scan request from a client device, the scan request including an image that comprises image data; identifying an object depicted within the image based on the image data; determining a classification of the object; and navigating a browser associated with the client device to a resource based on the classification.
1. A method comprising:
receiving a scan request from a client device, the scan request including an image that comprises a depiction of an object;
receiving a tactile input that selects a set of image features that corresponds with the depiction of the object within the image, the tactile input comprising an input attribute that comprises a value;
determining that the value of the input attribute transgresses a threshold;
performing image recognition upon the set of image features that correspond with the depiction of the object within the image responsive to the value of the input attribute transgressing the threshold, the portion of the image including the depiction of the object;
identifying the object depicted within the image based on the performing the image recognition upon the set of image features that correspond with the depiction of the object within the image;
generating a bounding box that encompasses the portion of the image that includes the depiction of the object;
determining a classification of the object based on the portion of the image within the bounding box;
accessing information associated with the object from within a database based on the classification of the object;
causing display of a presentation of a notification at the client device, the notification including at least the classification;
receiving a selection of the notification from the client device; and
causing display of the information-content at the client device.
2. The method of claim 1 , wherein the object comprises dimensions, and the generating the bounding box includes:
generating the bounding box based on the dimensions of the object and the tactile input that selects the position, the bounding box encompassing the portion of the image data.
3. The method of claim 1 , wherein the navigating the browser to the resource includes:
accessing a database that comprises an address of the resource;
selecting the address of the resource based on the classification of the object; and
navigating the browser to the resource based on the address.
4. The method of claim 3 , wherein the navigating the browser to the resource includes:
presenting a notification that includes a hyperlink to the resource at the client device, the hyperlink comprising the address of the resource;
receiving an input that selects the notification; and
navigating the browser to the resource in response to the selection.
5. The method of claim 1 , wherein the receiving the scan request from the client device further comprises:
causing display of a feature carousel at the client device, the feature carousel comprising a plurality of icons that include an icon associated with the scan request;
receiving an input that selects the icon associated with the scan request;
presenting a scan interface at the client device in response to the input that selects the icon associated with the scan request;
capturing the image data via the scan interface; and
generating the scan request based on the image data.
6. The method of claim 1 , wherein the determining the classification of the object includes:
determining a match score of the classification, the match score comprising a percentage value;
determining the match score transgresses a threshold value; and
selecting the classification in response to the match score of the classification transgressing the threshold value.
7. The method of claim 1 , wherein the navigating the browser associated with the client device to the resource based on the classification includes:
determining a match score of the classification, the match score comprising a percentage value;
determining that the match score transgresses a threshold value; and
navigating the browser to the resource in response to the match score of the classification transgressing the threshold value.
8. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
receiving a scan request from a client device, the scan request including an image that comprises a depiction of an object;
receiving a tactile input that selects a set of image features that corresponds with the depiction of the object within the image, the tactile input comprising an input attribute that comprises a value;
determining that the value of the input attribute transgresses a threshold;
performing image recognition upon the set of image features that correspond with the depiction of the object within the image responsive to the value of the input attribute transgressing the threshold, the portion of the image including the depiction of the object;
identifying the object depicted within the image based on the performing the image recognition upon the set of image features that correspond with the depiction of the object within the image;
generating a bounding box that encompasses the portion of the image that includes the depiction of the object;
determining a classification of the object based on the portion of the image within the bounding box;
accessing information associated with the object from within a database based on the classification of the object;
causing display of a presentation of a notification at the client device, the notification including at least the classification;
receiving a selection of the notification from the client device; and
causing display of the information at the client device.
9. The system of claim 8 , wherein the object comprises dimensions, and the generating the bounding box includes:
generating the bounding box based on the dimensions of the object and the tactile input that selects the position, the bounding box encompassing the portion of the image data.
10. The system of claim 8 , wherein the navigating the browser to the resource includes:
accessing a database that comprises an address of the resource;
selecting the address of the resource based on the classification of the object; and
navigating the browser to the resource based on the address.
11. The system of claim 10 , wherein the navigating the browser to the resource includes:
presenting a notification that includes a hyperlink to the resource at the client device, the hyperlink comprising the address of the resource;
receiving an input that selects the notification; and
navigating the browser to the resource in response to the selection.
12. The system of claim 8 , wherein the receiving the scan request from the client device further comprises:
causing display of a feature carousel at the client device, the feature carousel comprising a plurality of icons that include an icon associated with the scan request;
receiving an input that selects the icon associated with the scan request;
presenting a scan interface at the client device in response to the input that selects the icon associated with the scan request;
capturing the image data via the scan interface; and
generating the scan request based on the image data.
13. The system of claim 8 , wherein the determining the classification of the object includes:
determining a match score of the classification, the match score comprising a percentage value;
determining the match score transgresses a threshold value; and
selecting the classification in response to the match score of the classification transgressing the threshold value.
14. The system of claim 8 , wherein the navigating the browser associated with the client device to the resource based on the classification includes:
determining a match score of the classification, the match score comprising a percentage value;
determining that the match score transgresses a threshold value; and
navigating the browser to the resource in response to the match score of the classification transgressing the threshold value.
15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including:
receiving a scan request from a client device, the scan request including an image that comprises a depiction of an object;
receiving a tactile input that selects a set of image features that corresponds with the depiction of the object within the image, the tactile input comprising an input attribute that comprises a value;
determining that the value of the input attribute transgresses a threshold;
performing image recognition upon the set of image features that correspond with the depiction of the object within the image responsive to the value of the input attribute transgressing the threshold, the portion of the image including the depiction of the object;
identifying the object depicted within the image based on the performing the image recognition upon the set of image features that correspond with the depiction of the object within the image;
generating a bounding box that encompasses the portion of the image that includes the depiction of the object;
determining a classification of the object based on the portion of the image within the bounding box;
accessing information associated with the object from within a database based on the classification of the object;
causing display of a presentation of a notification at the client device, the notification including at least the classification;
receiving a selection of the notification from the client device; and
causing display of the information at the client device.
16. The non-transitory machine-readable storage medium of claim 15 , wherein the object comprises dimensions, and the generating the bounding box includes:
generating the bounding box based on the dimensions of the object and the tactile input that selects the position, the bounding box encompassing the portion of the image data.
17. The non-transitory machine-readable storage medium of claim 15 , wherein the navigating the browser to the resource includes:
accessing a database that comprises an address of the resource;
selecting the address of the resource based on the classification of the object; and
navigating the browser to the resource based on the address.
18. The non-transitory machine-readable storage medium of claim 17 , wherein the navigating the browser to the resource includes:
presenting a notification that includes a hyperlink to the resource at the client device, the hyperlink comprising the address of the resource;
receiving an input that selects the notification; and
navigating the browser to the resource in response to the selection.
19. The non-transitory machine-readable storage medium of claim 15 , wherein the receiving the scan request from the client device further comprises:
causing display of a feature carousel at the client device, the feature carou sel comprising a plurality of icons that include an icon associated with the scan request;
receiving an input that selects the icon associated with the scan request;
presenting a scan interface at the client device in response to the input that selects the icon associated with the scan request;
capturing the image data via the scan interface; and
generating the scan request based on the image data.
20. The non-transitory machine-readable storage medium of claim 15 , wherein the determining the classification of the object includes:
determining a match score of the classification, the match score comprising a percentage value;
determining the match score transgresses a threshold value; and
selecting the classification in response to the match score of the classification transgressing the threshold value.