Optimized facial illumination from adaptive screen content

1. A method for adjusting an illumination of a user depicted in one or more images, the method comprising:

receiving one or more images from an image sensor;

extracting a plurality of image features from the received one or more images;

determining that an illumination of a user depicted in the one or more images is unsatisfactory based on the extracted features;

identifying content displayed at a display device;

determining, based on the extracted features and the received one or more images, one or more lighting parameters, wherein the one or more lighting parameters comprise:

enhancement settings parameter of the received one or more images for transmission over a network,

image sensor settings parameter for capturing the user, and

illumination settings parameter for the identified content;

adapting enhancement on the received one or more images based on the enhancement settings parameter;

adapting the settings of the image sensor based on the image sensor settings parameter; and

adapting, based on the illumination setting parameter for the identified content, the identified content displayed at the display device, the adapted content changing an illumination of the user.

2. The method of claim 1 , wherein adapting the content displayed at the display device includes:

generating a graphical element to render at the display device based on the extracted image features and the received one or more images; and

causing the graphical element to be rendered at the display device, the graphical element changing an illumination of the user.

3. The method of claim 2 , wherein at least one extracted image feature of the plurality of image features is a location associated with a face of the user, and wherein the adapted content displayed at the display device is displayed at the display device such that the adapted content illuminates the face of the user.

4. The method of claim 2 , further comprising:

changing at least one of a position of the graphical element, a size of the graphical element, and a color of the graphical element.

5. The method of claim 2 , wherein the graphical element is at least one of a light ring, light square, and light bar.

6. The method of claim 1 , wherein adapting the content displayed at the display device includes:

receiving an image identifying content displayed at the display device;

rearranging the identified content; and

causing the rearranged content to be rendered at the display device, the rearranged content changing an illumination of the user.

7. The method of claim 5 , wherein rearranging the identified content includes:

identifying one or more application windows displayed at the display device; and

moving at least one application of the one or more application windows from a first position to a second position.

8. The method of claim 7 , further comprising:

generating a graphical element to render at the display device based on the extracted image features and the received one or more images; and

causing the graphical element to be rendered at the display device, the graphical element changing an illumination of the user.

9. The method of claim 1 , further comprising changing at least one configuration setting associated with the image sensor based on the determining that the illumination of the user depicted in the one or more images is unsatisfactory.

10. The method of claim 1 , further comprising:

providing the extracted image features, an image of content currently displayed at the display device, and the received one or more images to a neural network model; and

generating, by the neural network model, the updated received image content.

11. The method of claim 1 , further comprising:

providing the extracted image features, and the image of content currently displayed, and the received one or more images to a neural network model; and

generating, by the neural network model, the adapted content and the updated received image content.

12. The method of claim 1 , further comprising:

providing the extracted image features and the received one or more images to a neural network model; and

generating, by the neural network model, the adapted content.

13. A system for adjusting an illumination of a user depicted in one or more images, the system comprising:

a processor;

an image sensor; and

memory including instructions, which when executed by the processor, cause the processor to:

receive, at a video conferencing application, one or more images from an image sensor;

extract a plurality of image features from the received one or more images;

determine that an illumination of a user depicted in the one or more images is unsatisfactory based on the extracted features;

receive an image of content displayed at a display device;

generate, based on the extracted features and the received one or more images, one or more lighting parameters, wherein the one or more display device lighting parameters comprise:

enhancement settings parameter of the received one or more images for transmission over a network,

image sensor settings parameter for capturing the user, and

illumination settings parameter for the identified content;

adapt enhancement on the received one or more images based on the enhancement settings parameter;

adapt the settings of the image sensor based on the image sensor settings parameter; and

cause a change in the illumination of the user depicted in images subsequently received from the image sensor.

14. The system of claim 13 , wherein the instructions, when executed by the processor, cause the processor to:

move at least one user interface element rendered to the display device based on the display device lighting parameters.

15. The system of claim 13 , wherein the instructions, when executed by the processor, cause the processor to:

change at least one configuration parameter of the image sensor.

16. The system of claim 13 , wherein the instructions, when executed by the processor, cause the processor to:

generate a graphical element to render at the display device based on the display device lighting parameters; and

cause the graphical element to be rendered at the display device, the graphical element changing an illumination of the user.

17. A device comprising a processor configured to execute a method comprising:

receiving one or more images from an image sensor;

determining that an illumination of a user depicted in the one or more images is unsatisfactory;

identifying content displayed at a display device;

determining, based on the received one or more images, one or more lighting parameters, wherein the one or more lighting parameters comprise:

enhancement settings parameter of the received one or more images for transmission over a network,

image sensor settings parameter for capturing the user, and

illumination settings parameter for the identified content;

adapting enhancement on the received one or more images based on the enhancement settings parameter;

adapting the settings of the image sensor based on the image sensor settings parameter;

modifying the identified content displayed at the display device based on the determination that the illumination of the user depicted in the one or more images is unsatisfactory; and

causing the modified content to be rendered to the display device.

18. The device of claim 17 , wherein the instructions, which when executed by a processor, the processor to:

generating a graphical element to render at the display device; and

causing the graphical element to be rendered at the display device, the graphical element changing an illumination of the user.

19. The device of claim 17 , wherein the instructions, which when executed by a processor, the processor to:

changing an illumination of the user depicted in the one or more images such that a brightness associated with a portion of the user depicted in the one or more images is reduced.

20. The device of claim 17 , wherein the instructions, which when executed by a processor, the processor to:

receiving user input; and

determining that the illumination of the user depicted in the one or more images is unsatisfactory based on the received user input.