Robotic cosmetic application device with machine learning and user preference integration
A robotic cosmetic application device, and techniques for controlling the device, are provided. The device may include sensors that capture real-time data associated with a user's face and robotic arms equipped with makeup applicator tools. The device may receive an indication of a makeup look selected by the user; analyze the real-time data associated with the user's face in order to generate a three-dimensional map associated with the face of the user, identify facial features of the user's face on the three-dimensional map; and control the robotic arms to automatically adjust the makeup applicator tools with respect to the user's face, to apply one or more cosmetic products to the user's facial features in order to achieve the makeup look selected by the user.
1 . An intelligent robotic cosmetic application device, comprising:
one or more sensors configured to capture real-time data associated with a face of a user;
one or more robotic arms equipped with one or more respective makeup applicator tools;
a controller, comprising:
one or more processors; and
one or more memories storing non-transitory computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to:
receive, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by the user;
analyze the real-time data associated with the face of the user in order to generate a three-dimensional map associated with the face of the user;
identify one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and
control the one or more robotic arms to automatically:
dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and
adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.
2 . The intelligent robotic cosmetic application device of claim 1 , wherein the one or more sensors include one or more of a camera or a depth sensor.
3 . The intelligent robotic cosmetic application device of claim 1 , wherein the one or more makeup applicator tools include one or more of: a brush applicator tool, a sponge applicator tool, a puff applicator tool, a pencil applicator tool, a felt tip applicator tool, a marker applicator tool, a crayon applicator tool, a lip stick applicator tool, a lip gloss applicator tool, a roller applicator tool, or a mascara wand applicator tool.
4 . The intelligent robotic cosmetic application device of claim 1 , wherein the user interface is integrated into the intelligent robotic cosmetic application device.
5 . The intelligent robotic cosmetic application device of claim 1 , further comprising a communication interface configured to communicate with a mobile device, external to the intelligent robotic cosmetic application device.
6 . The intelligent robotic cosmetic application device of claim 5 , wherein the communication interface is a wired communication interface.
7 . The intelligent robotic cosmetic application device of claim 5 , wherein the communication interface is a wireless communication interface.
8 . The intelligent robotic cosmetic application device of claim 5 , wherein the user interface is integrated into the mobile device.
9 . The intelligent robotic cosmetic application device of claim 5 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to request images of the face of the user as captured by a camera of the mobile device, wherein the images of the face of the user are used to generate the three-dimensional map associated with the face of the user.
10 . The intelligent robotic cosmetic application device of claim 5 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to request that a light source of the mobile device modify one or more lighting parameters in order to provide light to the face of the user.
11 . The intelligent robotic cosmetic application device of claim 1 , further comprising an augmented reality (AR) component configured to generate and display an AR version of the three-dimensional map associated with the face of the user.
12 . The intelligent robotic cosmetic application device of claim 11 , wherein the AR component is integrated into the user interface.
13 . The intelligent robotic cosmetic application device of claim 11 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to generate a three-dimensional preview of the makeup look selected by the user as applied to the three-dimensional map associated with the face of the user, and wherein the AR component is further configured to generate and display an AR version of the three-dimensional preview of the makeup look selected by the user as applied to the three-dimensional map associated with the face of the user.
14 . The intelligent robotic cosmetic application device of claim 13 , wherein the three-dimensional preview of the makeup look selected by the user includes a three-dimensional preview of an application process of the makeup look selected by the user.
15 . The intelligent robotic cosmetic application device of claim 1 , further comprising one or more dispensers for the one or more cosmetic products, wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to control dispensing of the one or more cosmetic products via the one or more dispensers.
16 . The intelligent robotic cosmetic application device of claim 15 , further comprising one or more temperature control components configured to control temperatures associated with the one or more dispensers for the one or more cosmetic products within a particular range of temperatures.
17 . The intelligent robotic cosmetic application device of claim 15 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to:
track the dispensing of the one or more cosmetic products via the one or more dispensers;
determine, based on tracking the dispensing of the one or more cosmetic products via the one or more dispensers, that a refill of at least one of the one or more cosmetic products is required; and
provide a notification indicating that the refill of at least one of the one or more cosmetic products is required, via the user interface.
18 . A computer-implemented method for controlling an intelligent robotic cosmetic application device via one or more processors, comprising:
receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by a user;
analyzing real-time data associated with a face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user;
identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and
controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically:
dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and
adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.
19 . A non-transitory computer-readable medium storing instructions for controlling an intelligent robotic cosmetic application device that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by a user;
analyzing real-time data associated with a face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user;
identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and
controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically:
dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and
adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.