Light and rendering of garments

1. A method comprising:

estimating, by one or more processors of a device, lights and shadows being cast on an object depicted in a portion of an image by:

subtracting an average of pixel values in the portion of the image from the portion of the image to generate white pixel values; and

determining a white color of the object based on the white pixel values; and

applying one or more augmented reality elements relative to the object based on the lights and the shadows being cast on the object determined using the white color of the object.

2. The method of claim 1 , the object comprising a fashion item worn by a person depicted in the image.

3. The method of claim 1 , further comprising:

receiving the image that includes a depiction of a person wearing a fashion item;

generating a segmentation of the fashion item worn by the person depicted in the image; and

extracting the portion of the image corresponding to the segmentation of the fashion item.

4. The method of claim 1 , wherein applying the one or more augmented reality elements comprises changing color values of pixels in the portion of the image.

5. The method of claim 1 , further comprising changing a first color of the object to a second color based on application of the one or more augmented reality elements, the object being presented in the second color while preserving the lights and the shadows being cast on the object in the first color.

6. The method of claim 1 , further comprising:

determining a base color of the object; and

computing the lights and the shadows being cast on pixels of the object relative to the base color of the object.

7. The method of claim 1 , further comprising:

obtaining the pixel values in the portion of the image corresponding to a segmentation of the object; and

computing a base color of the object based on the average of the pixel values in the portion of the image.

8. The method of claim 7 , wherein the base color discounts the lights and the shadows.

9. The method of claim 1 , further comprising:

displaying a list of different augmented reality colors; and

receiving a selection of at least one augmented reality color from the list.

10. The method of claim 1 , further comprising generating a map of pixels representing the object in the white color and based on the lights and the shadows being cast on the object.

11. The method of claim 1 , further comprising:

selecting a new color for the object; and

combining pixel values of the new color with the white pixel values to render a display of the object that takes into account the lights and the shadows being cast on the object.

12. The method of claim 11 , further comprising summing the pixel values of the new color linearly with the white pixel values.

13. The method of claim 1 , further comprising replacing the pixel values in the portion of the image corresponding to a segmentation of the object with pixel values of a new color that have been combined with the white pixel values.

14. The method of claim 1 , wherein a color of the object is changed to at least one augmented reality color that is selected from a list.

15. The method of claim 1 , further comprising:

displaying the one or more augmented reality elements on a first portion of the object in a first frame of a video, wherein a person is positioned at a first location in the first frame;

determining that the person has moved from the first location to a second location in a second frame of the video, the first portion of the object being moved to a new location in the second frame of the video; and

updating a display position of the one or more augmented reality elements in the second frame to maintain the displaying of the one or more augmented reality elements on the first portion of the object.

16. The method of claim 1 , further comprising:

determining that a person depicted in the image has been rotated by a specified amount; and

rotating the one or more augmented reality elements by the specified amount in response to determining that the person has been rotated by the specified amount.

17. A system comprising:

at least one processor of a device; and

a memory component having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

estimating lights and shadows being cast on an object depicted in a portion of an image by:

subtracting an average of pixel values in the portion of the image from the portion of the image to generate white pixel values;

determining a white color of the object based on the white pixel values; and

applying one or more augmented reality elements relative to the object based on the lights and the shadows being cast on the object determined using the white color of the object.

18. The system of claim 17 , the operations further comprising:

displaying a list of different augmented reality colors; and

receiving a selection of at least one augmented reality color from the list.

19. The system of claim 17 , wherein applying the one or more augmented reality elements comprises changing color values of pixels in the portion of the image.

20. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by at least one processor of a device, cause the at least one processor to perform operations comprising:

estimating lights and shadows being cast on an object depicted in a portion of an image by:

subtracting an average of pixel values in the portion of the image from the portion of the image to generate white pixel values;

determining a white color of the object based on the white pixel values; and

applying one or more augmented reality elements relative to the object based on the lights and the shadows being cast on the object determined using the white color of the object.