Dynamic color adjustment in augmented reality
Systems and techniques for dynamic color adjustment in augmented reality are described herein. An image of a user may be obtained from an imaging sensor. A variation between a baseline color calibration and the image of the user may be calculated. A transformation algorithm may be applied to variables of a color of an augmented reality overlay based on the variation to generate a color adjusted augmented reality overlay. The color adjusted augmented reality overlay may be transmitted to an application for overlay on an augmented reality representation of the user.
1. A system for dynamic color adjustment in augmented reality comprising:
at least one processor; and
memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
obtain an image of a user from an imaging sensor;
calculate a variation between a baseline color calibration and the image of the user using an image capture of a calibration device present in an environment of the user, wherein the calibration device is a color calibration card comprising a plurality of colors;
generate an offset based on the variation;
apply a transformation algorithm to variables of a color of an augmented reality overlay using the offset to generate a color adjusted augmented reality overlay; and
transmit the color adjusted augmented reality overlay to an application for overlay on an augmented reality representation of the user, the augmented reality representation being applied to the image of the user, the image of the user being an uncorrected image.
2. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
evaluate ambient light conditions of the image of the user to determine a skin tone of the user; and
calibrate the image of the user based on the skin tone, wherein the variation is calculated between the baseline color calibration and the calibrated image of the user.
3. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
obtain a calibration image from the imaging sensor; and
evaluate attributes for the calibration image using expected calibration image attribute values to determine the baseline color calibration.
4. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
generate a user interface for display on a user computing device that includes lighting configuration instructions;
in response to receipt of an acknowledgment via the user interface, capture a calibration image from the imaging sensor; and
evaluate attributes for the calibration image using expected calibration image attribute values to determine the baseline color calibration.
5. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
generate a user interface for display on a user computing device that includes the image of the user;
identify a product to be applied to the image of the user;
determine an application area for the product on the image of the user; and
output the color adjusted augmented reality overlay on the application area of the image of the user.
6. The system of claim 1 , wherein the variables include one or more of a saturation value, tone value, a brightness value, a contrast value, a lightness value, a hue value, a chroma value, tristimulus values, or red green blue (RGB) values.
7. The system of claim 1 , wherein the image of the user is a video stream and the color adjusted augmented reality overlay is applied to the video stream.
8. The system of claim 1 , wherein the application is a virtual try on application that includes selectable user interface elements for products that, when selected by the user, apply a selected product to the augmented reality representation of the user.
9. The system of claim 1 , wherein the imaging sensor is included with a mobile computing device of the user.
10. The system of claim 1 , wherein the imaging sensor is included in a tablet computing device of the user.
11. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
identify a lighting change in the image of the user;
calculate a second variation between the transformed variables and the image of the user; and
regenerate the color adjusted augmented reality overlay based on the second variation.
12. The system of claim 1 , the memory further comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform operations to:
determine white balance information for the image of the user, wherein the color adjusted augmented reality overlay is generated at least in part based on the white balance information.
13. A method for dynamic color adjustment in augmented reality comprising:
obtaining an image of a user from an imaging sensor;
calculating a variation between a baseline color calibration and the image of the user using an image capture of a calibration device present in an environment of the user, wherein the calibration device is a color calibration card comprising a plurality of colors;
generating an offset based on the variation;
applying a transformation algorithm to variables of a color of an augmented reality overlay using the offset to generate a color adjusted augmented reality overlay; and
transmitting the color adjusted augmented reality overlay to an application for overlay on an augmented reality representation of the user, the augmented reality representation being applied to the image of the user, the image of the user being an uncorrected image.
14. The method of claim 13 , further comprising:
evaluating ambient light conditions of the image of the user to determine a skin tone of the user; and
calibrating the image of the user based on the skin tone, wherein the variation is calculated between the baseline color calibration and the calibrated image of the user.
15. The method of claim 13 , further comprising:
obtaining a calibration image from the imaging sensor; and
evaluating attributes for the calibration image using expected calibration image attribute values to determine the baseline color calibration.
16. The method of claim 13 , further comprising:
generating a user interface for display on a user computing device that includes lighting configuration instructions;
in response to receiving an acknowledgment via the user interface, capturing a calibration image from the imaging sensor; and
evaluating attributes for the calibration image using expected calibration image attribute values to determine the baseline color calibration.
17. The method of claim 13 , further comprising:
generating a user interface for display on a user computing device that includes the image of the user;
identifying a product to be applied to the image of the user;
determining an application area for the product on the image of the user; and
outputting the color adjusted augmented reality overlay on the application area of the image of the user.
18. The method of claim 13 , wherein the variables include one or more of a saturation value, tone value, a brightness value, a contrast value, a lightness value, a hue value, a chroma value, tristimulus values, or red green blue (RGB) values.
19. The method of claim 13 , wherein the image of the user is a video stream and the color adjusted augmented reality overlay is applied to the video stream.
20. The method of claim 13 , wherein the application is a virtual try on application that includes selectable user interface elements for products that, when selected by the user, apply a selected product to the augmented reality representation of the user.
21. The method of claim 13 , wherein the imaging sensor is included with a mobile computing device of the user.
22. The method of claim 13 , wherein the imaging sensor is included in a tablet computing device of the user.
23. The method of claim 13 , further comprising:
identifying a lighting change in the image of the user;
calculating a second variation between the transformed variables and the image of the user; and
regenerating the color adjusted augmented reality overlay based on the second variation.
24. The method of claim 13 , further comprising:
determining white balance information for the image of the user, wherein the color adjusted augmented reality overlay is generated at least in part based on the white balance information.