Glare and occluded view compensation for automotive and other applications
Often when there is a glare on a display screen the user may be able to mitigate the glare by tilting or otherwise moving the screen or changing their viewing position. However, when driving a car there are limited options for overcoming glares on the dashboard, especially when you are driving for a long distance in the same direction. Embodiments are directed to eliminating such glare. Other embodiments are related to mixed reality (MR) and filling in occluded areas.
1. A system to provide a mixed reality experience, comprising:
a head mounted display (HMD);
an outward facing camera on the HMD to provide real world live video onto which virtual objects are superimposed; and
a semiconductor apparatus coupled communicatively to the HMD, the semiconductor apparatus including logic to:
recognize a part of a first real world (RW) object in the camera field of view, the first RW object having a visible portion and an occluded portion;
fill in the occluded portion based on a previous view of the occluded portion of the first RW object, when the previous view of the occluded portion of the first RW object is available;
fill in the occluded portion based on a previous view of a second real world (RW) object, when the previous view of the occluded portion of the first RW object is not available; and
refine the filled-in occluded portion based on a subsequent view obtained of the first RW object.
2. The system of claim 1 , wherein the second RW object is an object similar to the first RW object.
3. The system of claim 1 , wherein the second RW object is an object within a field of view of the HMD and similar to the first RW object.
4. The system of claim 2 , wherein the previous view of the second RW object is obtained from a database search.
5. The system of claim 1 , wherein the logic is to place a superimposed virtual object based on the filled-in occluded portion of the first RW object.
6. A graphics apparatus comprising logic implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
receive, via an outward facing camera on a head mounted display (HMD), real world live video onto which virtual objects are superimposed;
recognize a part of a first real world (RW) object in the camera field of view, the first RW object having a visible portion and an occluded portion;
fill in the occluded portion based on a previous view of the occluded portion of the first RW object, when the previous view of the occluded portion of the first RW object is available;
fill in the occluded portion based on a previous view of a second real world (RW) object, when the previous view of the occluded portion of the first RW object is not available; and
refine the filled-in occluded portion based on a subsequent view obtained of the first RW object.
7. The graphics apparatus of claim 6 , wherein the second RW object is an object similar to the first RW object.
8. The graphics apparatus of claim 6 , wherein the second RW object is an object within a field of view of the HMD and similar to the first RW object.
9. The graphics apparatus of claim 7 , wherein the previous view of the second RW object is obtained from a database search.
10. The graphics apparatus of claim 6 , wherein the logic is to place a superimposed virtual object based on the filled-in occluded portion of the first RW object.
11. At least one non-transitory computer readable storage medium comprising a set of instructions which, when executed by a processor, cause the processor to:
receive, via an outward facing camera on a head mounted display (HMD), real world live video onto which virtual objects are superimposed;
recognize a part of a first real world (RW) object in the camera field of view, the first RW object having a visible portion and an occluded portion;
fill in the occluded portion based on a previous view of the occluded portion of the first RW object, when the previous view of the occluded portion of the first RW object is available;
fill in the occluded portion based on a previous view of a second real world (RW) object, when the previous view of the occluded portion of the first RW object is not available; and
refine the filled-in occluded portion based on a subsequent view obtained of the first RW object.
12. The at least one non-transitory computer readable storage medium of claim 11 , wherein the second RW object is an object similar to the first RW object.
13. The at least one non-transitory computer readable storage medium of claim 11 , wherein the second RW object is an object within a field of view of the HMD and similar to the first RW object.
14. The at least one non-transitory computer readable storage medium of claim 12 , wherein the previous view of the second RW object is obtained from a database search.
15. The at least one non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed by the processor, further cause the processor to place a superimposed virtual object based on the filled-in occluded portion of the first RW object.
16. A method of providing a mixed reality experience, comprising:
receiving, via an outward facing camera on a head mounted display (HMD), real world live video onto which virtual objects are superimposed;
recognizing a part of a first real world (RW) object in the camera field of view, the first RW object having a visible portion and an occluded portion;
filling in the occluded portion based on a previous view of the occluded portion of the first RW object, when the previous view of the occluded portion of the first RW object is available;
filling in the occluded portion based on a previous view of a second real world (RW) object, when the previous view of the occluded portion of the first RW object is not available; and
refining the filled-in occluded portion based on a subsequent view obtained of the first RW object.
17. The method of claim 16 , wherein the second RW object is an object similar to the first RW object.
18. The method of claim 16 , wherein the second RW object is an object within a field of view of the HMD and similar to the first RW object.
19. The method of claim 17 , wherein the previous view of the second RW object is obtained from a database search.
20. The method of claim 16 , further comprising placing a superimposed virtual object based on the filled-in occluded portion of the first RW object.
21. The system of claim 1 , wherein the subsequent view of the first RW object is obtained based on a shift in the camera field of view.
22. The graphics apparatus of claim 6 , wherein the subsequent view of the first RW object is obtained based on a shift in the camera field of view.
23. The at least one non-transitory computer readable storage medium of claim 11 , wherein the subsequent view of the first RW object is obtained based on a shift in the camera field of view.
24. The method of claim 17 , wherein the subsequent view of the first RW object is obtained based on a shift in the camera field of view.