Virtual background color adjustment based on physical environment color

1 . A method comprising:

obtaining, by a scanning device within a physical environment, sensor data including color data of one or more locations within the physical environment;

determining, based on the sensor data, a color of a background area behind a participant device that is used to connect to a video conference;

determining, based on the color of the background area and a current virtual background color of a video stream corresponding to the video conference that is output for display at the participant device, a new virtual background color to use with the video stream, wherein the color of the background area and the new virtual background color are either contrasting colors or complementary colors; and

modifying the video stream to replace the current virtual background color with the new virtual background color.

2 . The method of claim 1 , wherein the new virtual background color is determined based on a user preference.

3 . The method of claim 1 , wherein the color of the background area and the current virtual background color have a same hue.

4 . The method of claim 1 , wherein:

the current virtual background color includes a font color;

the font color and the color of the background area have a same hue; and

the new virtual background color includes a new font color having a hue that is different from the same hue.

5 . The method of claim 1 , wherein:

the current virtual background color includes a clothing color of a human appearing on the video stream; and

the new virtual background color includes a different clothing color that replaces the clothing color.

6 . The method of claim 1 , wherein the sensor data further includes brightness levels of the one or more locations, and the method further comprises:

adjusting, based on the brightness levels, at least one of brightness level or a saturation level of the new virtual background color.

7 . The method of claim 1 , wherein determining the new virtual background color of the video stream happens in real-time during the video conference.

8 . The method of claim 1 , wherein the scanning device is a mobile phone equipped with a LiDAR sensor.

9 . The method of claim 1 , wherein the scanning device is the participant device.

10 . The method of claim 1 , wherein determining the color of the background area behind the participant device includes:

generating, based on the sensor data, an augmented reality map of the physical environment;

determining a location of the participant device and a location of a wall within the augmented reality map; and

determining the color of the background area based on a color of the wall.

11 . A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:

obtaining, by a scanning device within a physical environment, sensor data including color data of one or more locations within the physical environment;

determining, based on the sensor data, a color of a background area behind a participant device that is used to connect to a video conference;

determining, based on the color of the background area and a current virtual background color of a video stream corresponding to the video conference that is output for display at the participant device, a new virtual background color to use with the video stream, wherein the color of the background area and the new virtual background color are either contrasting colors or complementary colors; and

modifying the video stream to replace the current virtual background color with the new virtual background color.

12 . The non-transitory computer readable medium of claim 11 , wherein determining the new virtual background color of the video stream happens in real-time during the video conference.

13 . The non-transitory computer readable medium of claim 11 , wherein the color of the background area and the new virtual background color have a same hue.

14 . The non-transitory computer readable medium of claim 11 , wherein the new virtual background color is determined based on a user preference.

15 . The non-transitory computer readable medium of claim 11 , wherein:

the sensor data further includes brightness levels and light directionalities at the one or more locations;

the brightness levels and the light directionalities are determined based on a height of ceiling of the physical environment and by using a light detection and ranging (LiDAR) sensor of the scanning device; and

the instructions operable to cause one or more processors to perform further operations comprising:

adjusting, based on the brightness levels and the light directionalities, a brightness level or a saturation level of the new virtual background color.

16 . The non-transitory computer readable medium of claim 11 , wherein:

the sensor data further includes brightness levels at the one or more locations; and

determining the color of the background area comprises:

generating, based on the sensor data, an augmented reality map of the physical environment;

determining a location of the participant device and a location of a wall within the augmented reality map;

determining a brightness level at the location of the background area; and

determining, based on the location of the participant device and the brightness level, the color of the background area.

17 . A system comprising:

a scanning device configured to:

obtain sensor data including color data of one or more locations within a physical environment; and

a device configured to:

determine, based on the sensor data, a color of a background area behind a participant device that is used to connect to a video conference;

determine, based on the color of the background area and a current virtual background color of a video stream corresponding to the video conference that is output for display at the participant device, a new virtual background color to use with the video stream, wherein the color of the background area and the new virtual background color are either contrasting colors or complementary colors; and

modify the video stream to replace the current virtual background color with the new virtual background color.

18 . The system of claim 17 , wherein the scanning device is one of a mobile phone or external camera.

19 . The system of claim 17 , wherein the device is a participant device.

20 . The system of claim 17 , wherein the scanning device and the device are a participant device.