Environment matching for mixed reality

1 . A head-mounted display comprising:

a world-side camera configured to capture pass-through images;

a photodetector configured to capture an ambient light measurement of an environment of a world-side scene;

a display configured to emit display light to an eyebox region; and

one or more processing logic configured to:

receive the pass-through images from the world-side camera;

receive the ambient light measurement from the photodetector;

adjust the pass-through images subsequent to receiving the pass-through image from the world-side camera, wherein adjusting the pass-through images includes adjusting at least one of a color or brightness of the pass-through images based on the ambient light measurement;

adjust virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images; and

drive the adjusted pass-through images and adjusted virtual images on to the display.

2 . The head-mounted display of claim 1 wherein the one or more processing logic is configured to adjust or further adjust the pass-through images or color based on manual inputs from a user of the head-mounted display.

3 . The head-mounted display of claim 1 wherein the color or brightness of the pass-through images and the virtual images are adjusted to smoothly transition to or from a view of an outside world as a user puts on or takes off the head-mounted display.

4 . The head-mounted display of claim 1 wherein the one or more processing logic is configured to implement an auto-brightness feature based at least in part on previous user preferences to adjust the brightness and the color of the pass-through images and the virtual images, including on a pass-through homescreen.

5 . The head-mounted display of claim 1 wherein the photodetector detects blue light emissions in the world-side scene and the one or more processing logic is configured to adjust a color temperature of the pass-through images or virtual images to a warmer temperature than the world-side scene.

6 . The head-mounted display of claim 1 further wherein the one or more processing logic is configured to cause ambient lighting to surround a virtual image or a pass-through image to reduce a contrast between the environment of the world-side scene and the pass-through images or the virtual images.

7 . The head-mounted display of claim 1 wherein the photodetector is included in the world-side camera or an ambient light sensor (ALS) outside of the world-side camera.

8 . The head-mounted display of claim 1 wherein the one or more processing logic is configured to adjust a lux or a correlated color temperature (CCT) value of the pass-through images or the virtual images using an RGB scalar value for brightness and an RGB scalar value for color.

9 . The head-mounted display of claim 1 wherein the one or more processing logic is configured to adjust the pass-through images or virtual images by causing a brightness of a display backlight to change.

10 . The head-mounted display of claim 1 wherein the color or brightness of the pass-through images and virtual images are gradually adjusted to smoothly transition to or from a view of a pass-through environment to a Virtual Reality (VR) scene.

11 . The head-mounted display of claim 1 , wherein the pass-through images are digitally adjusted.

12 . The head-mounted display of claim 1 , wherein an image signal processor (ISP) in the processing logic adjusts the pass-through images.

13 . A method comprising:

capturing, pass-through images of a world-side of a head-mounted display (HMD);

initiating an ambient light measurement of an environment of the world-side with a photodetector of the HMD;

generating adjusted pass-through images by adjusting at least one of a color or brightness of the pass-through images based on the ambient light measurement, wherein generating the adjusted pass-through images is performed subsequent to capturing the pass-through images;

generating adjusted virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images; and

driving the adjusted pass-through images and the adjusted virtual images onto a display of the HMD.

14 . The method of claim 13 wherein generating the adjusted pass-through images includes applying an automatic exposure (AE) or auto white balance (AWB) function to world-side images captured by a world-side camera.

15 . The method of claim 13 wherein generating the adjusted virtual images includes applying a k-scalar value in an environment matching algorithm to adjust a color temperature or brightness.

16 . The method of claim 13 wherein generating the adjusted pass-through images or virtual images includes causing adjustment of a lighting level of a backlight display of the head-mounted display to reduce power consumption.

17 . The method of claim 13 further comprising receiving instructions from a manual user setting and adjusting the color or brightness of the pass-through images or the virtual images automatically on the user setting.

18 . The method of claim 13 wherein the color or brightness of the pass-through images and virtual images are adjusted to smoothly transition to or from a view of an environment of the world-side to a Virtual Reality (VR) scene, including a VR home screen.

19 . The method of claim 13 further comprising:

digitally assembling a final image including the adjusted pass-through images and the adjusted virtual image, wherein driving the adjusted pass-through images and the adjusted virtual images onto a display of the HMD includes rendering the final image to the display of the HMD.

20 . A non-transitory computer readable medium including instructions stored thereon which when executed by one or more processors, cause a head-mounted display to:

capture pass-through images of a world-side of a head-mounted display (HMD);

initiate an ambient light measurement of an environment of the world-side with a photodetector of the HMD;

generate adjusted pass-through images by adjusting at least one of a color warmth or brightness of the pass-through images based on the ambient light measurement, wherein generating the adjusted pass-through images is performed subsequent to capturing the pass-through images;

generate adjusted virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images; and

drive the adjusted pass-through images and the adjusted virtual images onto a display of the HMD.