Virtual light in augmented reality
A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.
1. A method for a head mounted display (HMD), comprising:
observing ambient lighting conditions of a physical environment;
assessing a perspective of the HMD;
visually augmenting an appearance of the physical environment with a virtual object; and
creating an illusion of a virtual shadow of the virtual object by virtually illuminating a non-virtual-object, non-shadow region bordering the virtual shadow, an appearance of the non-virtual-object, non-shadow region being based on the observed ambient lighting conditions.
2. The method of claim 1 , wherein the virtual shadow is rendered with one or more omitted pixels.
3. The method of claim 1 , wherein the non-shadow region is displayed with relatively more see-through lighting than the virtual shadow.
4. The method of claim 1 , wherein the virtual shadow is positioned in accordance with an ambient lighting model describing ambient lighting conditions of the physical environment.
5. A method for a head mounted display (HMD), comprising:
observing ambient lighting conditions of a physical environment; and
visually augmenting an appearance of the physical environment with a virtual object and a graphical representation of a non-virtual-object, non-shadow region bordering a virtual shadow of the virtual object, an appearance of the graphical representation of the non-virtual-object, non-shadow region being based on the observed ambient lighting conditions.
6. The method of claim 5 , wherein the virtual shadow is positioned in accordance with an ambient lighting model describing ambient lighting conditions of the physical environment.
7. The method of claim 6 , wherein the ambient lighting model is created based on ambient lighting conditions observed by a plurality of optical sensor systems, and at least one of the plurality of optical sensors systems is separate from the HMD.
8. The method of claim 5 , wherein the non-shadow region is visually illuminated.
9. The method of claim 5 , wherein the non-shadow region is displayed with relatively more see-through lighting than the virtual shadow.
10. The method of claim 5 , further comprising calculating a light vector from the observed ambient lighting conditions, and wherein the virtual shadow is positioned such that the light vector points from a perceived position of the virtual object to a perceived position of the virtual shadow.
11. The method of claim 5 , further comprising calculating a light intensity from the observed ambient lighting conditions, and wherein a brightness of the graphical representation of the non-shadow region is a function of the light intensity.
12. The method of claim 5 , further comprising assessing a perspective of the HMD within the physical environment.
13. The method of claim 12 , wherein the graphical representation of the non-shadow region is changed as the perspective of the HMD within the physical environment changes over time.
14. A method for a head mounted display (HMD), comprising:
observing ambient lighting conditions of a physical environment; and
visually augmenting an appearance of the physical environment with a virtual object and a graphical representation of a non-virtual-object, non-shadow region bordering a virtual shadow of the virtual object, an appearance of the graphical representation of the non-virtual-object, non-shadow region being based on the observed ambient lighting conditions, and the graphical representation of the non-virtual-object, non-shadow region appearing to brighten an area exterior the virtual shadow while leaving the virtual shadow relatively darker.
15. The method of claim 14 , further comprising creating an ambient lighting model describing ambient lighting conditions of the physical environment.
16. The method of claim 15 , wherein the ambient lighting model is created based on ambient lighting conditions observed by a plurality of optical sensor systems, and at least one of the plurality of optical sensors systems is separate from the HMD.
17. The method of claim 14 , further comprising calculating a light vector from the observed ambient lighting conditions, and wherein the virtual shadow is positioned such that the light vector points from a perceived position of the virtual object to a perceived position of the virtual shadow.
18. The method of claim 14 , further comprising calculating a light intensity from the observed ambient lighting conditions, and wherein a brightness of the graphical representation of the non-shadow region is a function of the light intensity.
19. The method of claim 14 , further comprising assessing a perspective of the HMD within the physical environment.
20. The method of claim 19 , wherein the graphical representation of the non-shadow region is changed as the perspective of the HMD within the physical environment changes over time.