Lens-based image augmenting optical window with intermediate real image

1. An image augmenting window, comprising:

at least one internally focused intermediate image lens, each of the at least one internally focused intermediate image lens having a respective first side and a respective rear side, the respective first side being opposite the respective rear side, each of the at least one internally focused intermediate image lens respectively comprising:

a first lens portion receiving incoming light through the first side and focusing the incoming light into a focused image on an internal focal plane within the respective internally focused intermediate image lens, the first lens portion comprising Gradient Index (GRIN) refractive material extending continuously from the first side to the internal focal plane; and

a projecting output optical structure refracting the focused image as a projected image exiting the rear side at an exit angle;

at least one controllable light source, wherein each controllable light source within the at least one controllable light source comprises a respective light source lens emitting a respective afocal projection of a respective projected light, the respective light source lens being separate from each internally focused intermediate image lens within the at least one internally focused intermediate image lens, and the respective light source lens being positioned adjacent to a lateral side of a respective internally focused intermediate image lens within the at least one internally focused intermediate image lens, each respective controllable light source within the at least one controllable light source further emitting a respective projected light that is parallel to a respective exit angle of the at least one internally focused intermediate image lens; and

a controller configured to independently control each of the at least one controllable light source.

2. The image augmenting window of claim 1 , each of the at least one controllable light source comprising:

a respective light emitter; and

a respective controllable shutter, and

wherein the respective light source lens refracts light from the respective controllable shutter to emit a projection of the respective controllable shutter as the respective projected light.

3. The image augmenting window of claim 1 , each of the at least one controllable light source comprising:

a controllable light emitter, and

wherein the respective light source lens refracts light from the respective controllable emitter to emit a projection of the respective controllable light emitter as the respective projected light.

4. The image augmenting window of claim 1 , wherein the at least one internally focused intermediate image lens comprises a plurality of internally focused intermediate image lenses, and

wherein the plurality of internally focused intermediate image lenses and the at least one controllable light source are arranged as a two-dimensional array.

5. The image augmenting window of claim 4 , wherein the plurality of internally focused intermediate image lenses are arranged with each respective internal focal plane lying in a common focal plane, and

wherein each of the at least one controllable light source comprises a respective light source creating a light image at a source focal plane, the source focal plane lying in the common focal plane.

6. The image augmenting window of claim 4 , wherein the incoming light arrives at each respective first side with a respective incoming direction relative to a plane formed by the respective first side, and

wherein the respective projecting output optical structure refracts the respective focused image through the respective rear side as light exiting the respective rear side with a respective exit direction that is parallel at the respective incoming direction.

7. The image augmenting window of claim 6 , wherein the respective projecting output optical structure comprises a Gradient Index (GRIN) lens.

8. The image augmenting window of claim 4 , wherein the at least one controllable light source comprises a plurality of controllable light sources, wherein each respective light source lens of each respective controllable light source is interleaved among the plurality of internally focused intermediate image lenses.

9. The image augmenting window of claim 8 , wherein each controllable light source within the plurality of controllable light sources comprises a respective restricting aperture, the respective restricting aperture restricting an aperture of the respective projected light, each respective restricting aperture having an aperture size corresponding to a size of a human iris.

10. The image augmenting window of claim 1 , wherein the at least one internally focused intermediate image lens comprises at least one selectably transmissive internally focused intermediate image lens, wherein each at least one internally focused intermediate image lens comprises one of the at least one selectably transmissive internally focused intermediate image lens,

wherein each selectably transmissive internally focused intermediate image lens comprises at least one respective selectably transmissive shutter located in the internal focal plane, the respective selectably transmissive shutter controllable to block at least a portion of light passing therethrough, and

the controller further configured to:

independently control each respective selectably transmissive shutter of each of the at least one selectably transmissive internally focused intermediate image lens;

determine a subset of the at least one selectably transmissive internally focused intermediate image lens that are to at least partially block transmission of light; and

control the respective selectably transmissive shutters of the subset of the internally focused intermediate image lenses to at least partially block transmission of light therethrough.

11. The image augmenting window of claim 10 , wherein each of the at least one respective selectably transmissive shutter comprises a Liquid Crystal cell.

12. The image augmenting window of claim 10 , wherein the controller is further configured to:

determine a subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image; and

control the respective controllable light sources of the subset of controllable light sources to emit light.

13. The image augmenting window of claim 10 , wherein the controller is further configured to:

determine, subsequent to determining a subset of the at least one selectably transmissive internally focused intermediate image lens, a revised set of selectably transmissive internally focused intermediate image lens within the at least one selectably transmissive internally focused intermediate image lens that are to at least partially block transmission of light;

defining the revised set to be the subset of the at least one selectably transmissive internally focused intermediate image lens to at least partially block transmission of light; and

control, in response to determining the revised set, the respective selectably transmissive shutters of the subset of the at least one selectably transmissive internally focused intermediate image lens to at least partially block transmission of light therethrough.

14. The image augmenting window of claim 13 , wherein the controller is further configured to:

determine a subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image; and

control the respective controllable light sources of the subset of controllable light sources to emit light.

determine, subsequent to determining a subset of the controllable light sources, a revised subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image;

control, in response to determining the revised subset of controllable light sources and in response to controlling the respective selectably transmissive shutters, the respective controllable light sources of the revised subset of controllable light sources to emit light.

15. The image augmenting window of claim 10 , wherein each respective internally focused intermediate image lens comprises a respective array of selectably transmissive blocking shutters, each selectably transmissive blocking shutter within the respective array being located at different positions relative a center axis of the respective internally focused intermediate image lens, and

wherein the controller determines one selectably transmissive blocking shutter within the respective array based upon an apparent distance at which the one selectably transmissive blocking shutter is to appear to an observer of the projected image.

16. A method of controlling an image augmenting window, the method comprising:

providing at least one selectably transmissive internally focused intermediate image lens, each of the at least one selectably transmissive internally focused intermediate image lens comprising:

a first lens portion receiving incoming light through a first side and focusing the incoming light into a focused image on an internal focal plane, the first lens portion comprising Gradient Index (GRIN) refractive material extending continuously from the first side to the internal focal plane;

a projecting output optical structure refracting the focused image as a projected image projected through a rear side that is opposite the first side; and

a selectably transmissive shutter located in the internal focal plane, the selectably transmissive shutter controllable to block at least a portion of light passing therethrough;

providing at least one controllable light source, wherein each controllable light source within the at least one controllable light source comprises a respective light source lens emitting a respective afocal projection of a respective projected light, the respective light source lens being separate from each internally focused intermediate image lens within the at least one internally focused intermediate image lens, and the respective light source lens being positioned adjacent to a lateral side of a respective selectably transmissive internally focused intermediate image lens within the at least one selectably transmissive internally focused intermediate image lens, each respective controllable light source within the at least one controllable light source further emitting a respective projected light that is parallel to the projected image of the respective selectably transmissive internally focused intermediate image lens; and

controlling, independently of each other, each selectably transmissive shutter of each of the at least one selectably transmissive intermediate image lens, the controller further configured to independently control each of the at least one controllable light source.

17. The method of claim 16 ,

wherein the at least one selectably transmissive internally focused intermediate image lens comprises a plurality of selectably transmissive internally focused intermediate image lenses, and

wherein the plurality of selectably transmissive internally focused intermediate image lenses and the at least one controllable light source are arranged as a two-dimensional array, the method further comprising:

determining a subset of the plurality of selectably transmissive internally focused intermediate image lens that are to at least partially block transmission of light; and

controlling the respective selectably transmissive shutters of the subset of the internally focused intermediate image lenses to at least partially block transmission of light therethrough.

18. The method of claim 17 , further comprising:

determining a subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image; and

controlling the respective controllable light sources of the subset of controllable light sources to emit light.

19. The method of claim 17 , further comprising:

determining, subsequent to determining a subset of the plurality of selectably transmissive internally focused intermediate image lens, a revised set of internally focused intermediate image lens within the plurality of internally focused intermediate image lens that are to at least partially block transmission of light;

defining the revised set to be the subset of the internally focused intermediate image lenses to at least partially block transmission of light; and

controlling, in response to determining the revised set, the respective selectably transmissive shutters of the subset of the internally focused intermediate image lenses to at least partially block transmission of light therethrough.

20. The method of claim 19 , further comprising:

determining a subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image; and

controlling the respective controllable light sources of the subset of controllable light sources to emit light.

determining, subsequent to determining a subset of the controllable light sources, a revised subset of controllable light sources within the at least one controllable light source that are to emit light to augment the focused image;

controlling, in response to determining the revised subset of controllable light sources and in response to controlling the respective selectably transmissive shutters, the respective controllable light sources of the revised subset of controllable light sources to emit light.