Augmented reality fashion
View Patent ↗Various approaches discussed herein enable augmenting an image of a person wearing an article of clothing to provide an augmented reality (i.e., virtual) article of clothing to a viewer in order to overlay, replace, and/or augment an actual article of clothing being worn by the user. The augmented reality article of clothing is positioned on the user's real-world piece of clothing according to various markings and/or data that allow the augmented reality article of clothing to appear as if it were being worn by the user, even during movement of the user.
1. A computing device, comprising:
a camera;
a display element;
at least one processor; and
memory including instructions that, when executed by the at least one processor, cause the computing device to:
obtain original image data including a representation of an article of clothing, the article of clothing having a reference marker physically attached to the article of clothing, and represented in the original image data, and a contour marking corresponding substantially to an outline of the article of clothing;
determine a location of the reference marker represented in the original image data;
determine a boundary of the article of clothing represented in the original image data, the boundary corresponding substantially to the contour marking;
determine a replacement area in the original image data, the replacement area based at least in part on the reference marker and the contour marking, the location of the reference marker being represented in the original image data in relation to the boundary of the article of clothing represented in the original image data;
obtain substitute image data, the substitute image data being associated with the reference marker;
generate modified image data, the modified image data comprising a placement of the substitute image data on the original image data, the placement of the substitute image data corresponding substantially to the replacement area; and
display the modified image data on the display element,
wherein the modified image data is displayed at least in substantially real time.
2. The computing device of claim 1 , wherein the instructions, when executed to cause the computing device to determine a replacement area in the original image data, includes causing the computing device to:
determine size information corresponding to dimensions of the article of clothing, the size information being associated with the reference marker;
determine an estimated location of the contour marking in the original image data, the estimated location corresponding to the size information and the location of the reference marker in the original image data; and
analyze the original image data to identify the contour marking in the original image data, starting at the location of the reference marker in the original image data and proceeding outward towards the estimated location of the contour marking in the original image data.
3. The computing device of claim 1 , wherein the original image data comprises a plurality of frames of video data, and wherein the instructions, when executed, further cause the computing device to:
track a movement of the representation of the article of clothing in at least two of the plurality of frames of video data,
wherein the placement of the substitute image data on the original image data remains in substantial correspondence to the replacement area during the movement of the representation of the article of clothing in the at least two of the plurality of frames of video data.
4. The computing device of claim 1 , wherein the instructions when executed further cause the computing device to:
determine a viewer identity based at least upon an identifier associated with the computing device;
obtain a set of potential substitute image data associated with the reference marker; and
cause a selection of the substitute image data from the set of potential substitute image data based at least in part on the viewer identity.
5. A computer implemented method, comprising:
receiving original image data containing a representation of an article of clothing, the article of clothing having a data source reference marker physically proximate to the article of clothing and a contour marking corresponding to an outline of the article of clothing;
determining substitute image data based at least in part on the reference marker;
generating modified image data corresponding to a modification of the representation of the article of clothing in the original image data, the modification of the representation of the article of clothing based at least in part on the substitute image data; and
causing the modified image data to be displayed with the original image data,
wherein the modified image data is overlaid in the original image data, the position of the modified image data based at least on the reference marker and the contour marking.
6. The computer implemented method of claim 5 , wherein determining substitute image data based at least in part on the reference marker further comprises:
receiving query data comprising data associated with the reference marker;
determining, based at least in part on the query data, a set of potential substitute image data;
causing a selection of the substitute image data from the set of potential substitute image data, the selection based at least in part on the reference marker and criteria associated with the substitute image data.
7. The computer implemented method of claim 6 , further comprising:
determining an identity of a viewer of the original image data;
determining that the criteria associated with the substitute image data comprises approved identities of potential viewers; and
determining that the identity of the viewer matches one of the approved identities.
8. The computer implemented method of claim 5 , wherein causing the modified image data to be displayed with the original image data further comprises:
determining, in the original image, a replacement area substantially defined by the contour marking;
analyzing the substitute image data to determine a correspondence between the substitute image data and the replacement area; and
causing the substitute image data to be aligned with the replacement area such that the replacement area is substantially filled with the substitute image data, wherein the contour marking is not visible.
9. The computer implemented method of claim 5 , wherein the original image data comprises a plurality of frames of video, and further comprising:
determining a movement of the representation of the article of clothing, based at least in part on identifying a change in position of the contour marking between at least two frames of the plurality of frames of video;
generating, for each frame of video in which movement of the article of clothing was determined, modified image data for the frame of video,
wherein the modified image data for each frame of video in which movement of the article of clothing was determined is positioned in substantial correspondence to the position of the contour marking.
10. The computer implemented method of claim 5 , wherein the substitute image data comprises a three-dimensional shape, and further comprising:
determining a first perspective associated with a viewing angle of the original image data; and
determining a perspective of the three-dimensional shape corresponding to the first perspective,
wherein the modified image data comprises the three-dimensional shape, and the modified image data is positioned in the original image data such that the perspective of the three-dimensional shape corresponding to the first perspective is displayed.
11. The computer implemented method of claim 5 , further comprising:
determining a customer account associated with the reference marker;
determining, based on data associated with the customer account, that third-party image data is authorized for display;
determining third-party image data available for display; and
causing the third-party image data to be displayed along with the modified image data and the original image data,
wherein the third-party image data is overlaid in the modified image data, the position of the third-party image data based at least on the contour marking.
12. The computer implemented method of claim 5 , wherein the contour marking is printed on the article of clothing such that the contour marking is not visible to the unaided human eye.
13. The computer implemented method of claim 5 , wherein the reference marker comprises data being transmitted wirelessly from a device associated with the article of clothing.
14. The computer implemented method of claim 5 , wherein the original image data comprises image data captured by a camera or image data displayed on a display device.
15. The computer implemented method of claim 5 , wherein the substitute image data comprises at least one of a pattern, an article of clothing, text, an image, a video, a three-dimensional rendering of an object, or an animated image.
16. A system, comprising:
at least one processor;
memory including instructions that, when executed by the processor, cause the computing system to:
receive original image data containing a representation of an article of clothing, the article of clothing having a data source reference marker physically proximate to the article of clothing and a contour marking corresponding to an outline of the article of clothing;
determine substitute image data based at least in part on the reference marker;
generate modified image data corresponding to a modification of the representation of the article of clothing in the original image data, the modification of the representation of the article of clothing based at least in part on the substitute image data; and
cause the modified image data to be displayed with the original image data,
wherein the modified image data is overlaid in the original image data, the position of the modified image data based at least on the reference marker and the contour marking.
17. The system of claim 16 , wherein the instructions, when executed, further cause the system to:
receive query data comprising data associated with the reference marker;
determine, based at least in part on the query data, a set of potential substitute image data;
cause a selection of the substitute image data from the set of potential substitute image data, the selection based at least in part on the reference marker and criteria associated with the substitute image data.
18. The system of claim 17 , wherein the instructions, when executed, further cause the system to:
determine an identity of a viewer of the original image data;
determine that the criteria associated with the substitute image data comprises approved identities of potential viewers; and
determine that the identity of the viewer matches one of the approved identities.
19. The system of claim 16 , wherein the instructions, when executed, further cause the system to:
determine, in the original image, a replacement area substantially defined by the contour marking;
analyze the substitute image data to determine a correspondence between the substitute image data and the replacement area; and
cause a positioning of the substitute image data such that the replacement area is substantially filled with the substitute image data, such that the contour marking is not visible.
20. The system of claim 16 , wherein the instructions, when executed, further cause the system to:
determine a first perspective associated with a viewing angle of the original image data; and
determine a perspective of the three-dimensional shape corresponding to the first perspective,
wherein the modified image data comprises the three-dimensional shape, and the modified image data is positioned in the original image data such that the perspective of the three-dimensional shape corresponding to the first perspective is displayed.