Real-time augmented reality item guide
A real-time augmented reality item guide is described. A service platform may receive a digital image depicting at least one item. A plurality of listings for the at least one item on the service platform is identified via at least one machine learning model of the service platform based on the digital image, each of the plurality of listings associated with a respective point in time. An aspect is fetched from each of the plurality of listings for the at least one item on the service platform. Time-dependent augmented reality digital content is generated for the at least one item based on the aspect. The time-dependent augmented reality digital content is rendered as an overlay on the digital image.
1 . A method for an augmented reality guide, the method comprising:
receiving, by a service platform, a digital image of a plurality of digital images comprising a live stream, the digital image depicting at least one item;
identifying, via at least one machine learning model of the service platform, a plurality of listings for the at least one item on the service platform by:
detecting a boundary of the at least one item based on the digital image;
outputting feature vectors corresponding to at least a portion of the digital image within the boundary; and
matching the feature vectors to the at least one item in the plurality of listings, wherein the plurality of listings is associated with respective points in time;
fetching at least one respective aspect from the plurality of listings for the at least one item on the service platform;
generating time-dependent augmented reality digital content for the at least one item based on the at least one respective aspect;
receiving data from one or more orientation sensors, wherein the data corresponds to a view of the at least one item in the live stream of the plurality of digital images; and
rendering, for display via a user interface and based on the data, the time-dependent augmented reality digital content as an overlay on the live stream, wherein the time-dependent augmented reality digital content remains as is relative to the view of the at least one item in the live stream of the plurality of digital images.
2 . The method of claim 1 , wherein the at least one respective aspect comprises at least one of a color, a size, a brand, a model, or a year of release of the at least one item.
3 . The method of claim 1 , wherein the at least one respective aspect comprises price data, and wherein the method further comprises:
detecting, via a classifier, a price of the at least one item as depicted in the digital image; and
generating the time-dependent augmented reality digital content for the at least one item further based on the detected price.
4 . The method of claim 3 , wherein the time-dependent augmented reality digital content comprises a first visual indicator in response to the detected price being less than an average of the price data or a second visual indicator in response to the detected price being greater than the average of the price data.
5 . The method of claim 3 , wherein the time-dependent augmented reality digital content comprises an indication of the price of the at least one item in a different currency than the detected price.
6 . The method of claim 3 , wherein the time-dependent augmented reality digital content includes a summary of the price data.
7 . The method of claim 6 , wherein the summary comprises an average price, a highest price, and a lowest price of the plurality of listings.
8 . The method of claim 1 , wherein the time-dependent augmented reality digital content indicates a change in the at least one respective aspect over a period of time based on the respective points in time.
9 . The method of claim 1 , wherein the at least one machine learning model of the service platform is trained for a category of items that includes the at least one item, and wherein the category of items is received via the user interface.
10 . The method of claim 1 , further comprising:
receiving a selection of the time-dependent augmented reality digital content; and
generating a chart for the at least one respective aspect with respect to a defined period of time based on aspect data for listings associated with time points within the defined period of time, the defined period of time adjustable based on an input.
11 . The method of claim 1 , wherein the at least one item comprises a plurality of items, and wherein the time-dependent augmented reality digital content is generated for individual items of the plurality of items in parallel.
12 . The method of claim 1 , wherein the digital image is received from a device, wherein the one or more orientation sensors comprise at least one of an accelerometer, an inertial device, or a gyroscope, and wherein the time-dependent augmented reality digital content remains as is relative to the view of the at least one item based on the data indicating a change in orientation of the device.
13 . A computing device comprising:
a processing system; and
a computer-readable storage medium storing instructions that, responsive to execution by the processing system, causes the processing system to perform operations comprising:
receiving, by a service platform, a digital image of a plurality of digital images comprising a live stream, the digital image depicting at least one item;
identifying, via at least one machine learning model of the service platform, a plurality of listings for the at least one item on the service platform by:
detecting a boundary of the at least one item based on the digital image;
outputting feature vectors corresponding to at least a portion of the digital image within the boundary; and
matching the feature vectors to the at least one item in the plurality of listings, wherein the plurality of listings is associated with respective points in time;
fetching at least one respective aspect from the plurality of listings for the at least one item on the service platform;
generating time-dependent augmented reality digital content for the at least one item based on the at least one respective aspect;
receiving data from one or more orientation sensors, wherein the data corresponds to a view of the at least one item in the live stream of the plurality of digital images; and
rendering, for display via a user interface and based on the data, the time-dependent augmented reality digital content as an overlay on the live stream, wherein the time-dependent augmented reality digital content remains as is relative to the view of the at least one item in the live stream of the plurality of digital images.
14 . The computing device of claim 13 , wherein the at least one respective aspect comprises at least one of a color, a size, a brand, a model, or a year of release of the at least one item.
15 . The computing device of claim 13 , wherein the at least one respective aspect comprises price data, and wherein the operations further comprise:
detecting, via a classifier, a price of the at least one item as depicted in the digital image; and
generating the time-dependent augmented reality digital content for the at least one item further based on the detected price.
16 . The computing device of claim 13 , wherein the time-dependent augmented reality digital content indicates a change in the at least one respective aspect over a period of time based on the respective points in time.
17 . A computer-readable storage medium storing instructions that, responsive to execution by one or more processors, causes the one or more processors to perform operations comprising:
receiving, by a service platform, a digital image of a plurality of digital images comprising a live stream, the digital image depicting at least one item;
identifying, via at least one machine learning model of the service platform, a plurality of listings for the at least one item on the service platform by:
detecting a boundary of the at least one item based on the digital image;
outputting feature vectors corresponding to at least a portion of the digital image within the boundary; and
matching the feature vectors to the at least one item in the plurality of listings, wherein the plurality of listings is associated with respective points in time;
fetching at least one respective aspect from the plurality of listings for the at least one item on the service platform;
generating time-dependent augmented reality digital content for the at least one item based on the at least one respective aspect;
receiving data from one or more orientation sensors, wherein the data corresponds to a view of the at least one item in the live stream of the plurality of digital images; and
rendering, for display via a user interface and based on the data, the time-dependent augmented reality digital content as an overlay on the live stream, wherein the time-dependent augmented reality digital content remains as is relative to the view of the at least one item in the live stream of the plurality of digital images.
18 . The computer-readable storage medium of claim 17 , wherein the at least one respective aspect comprises price data, and wherein the operations further comprise:
detecting, via a classifier, a price of the at least one item as depicted in the digital image; and
generating the time-dependent augmented reality digital content for the at least one item further based on the detected price.
19 . The computer-readable storage medium of claim 18 , wherein the time-dependent augmented reality digital content comprises a first visual indicator in response to the detected price being less than an average of the price data or a second visual indicator in response to the detected price being greater than the average of the price data.
20 . The computer-readable storage medium of claim 17 , wherein the operations further comprise:
receiving a selection of the time-dependent augmented reality digital content; and
generating a chart for the at least one respective aspect with respect to a defined period of time based on aspect data for listings associated with time points within the defined period of time, the defined period of time adjustable based on an input.