Peripheral field-of-view illumination system for a head mounted display
A display system for a head mounted device that illuminates the peripheral regions of the user's field of view to enhance an immersive experience. The system may use peripheral light emitters to the left and right of one or more central displays. Peripheral light emitters may provide lower resolution images, or only with vertical resolution, corresponding to the user's lower resolution vision in these peripheral regions. Reflective surfaces and lenses may be used to direct peripheral light into desired shapes and patterns. Rendering of peripheral light colors and intensities at each peripheral pixel may use approximations for improved performance since users may not be sensitive to precise color values in the peripheral regions.
1. A peripheral field-of-view illumination system for a head-mounted display comprising:
a mount configured to be worn on a head of a user;
one or more displays coupled to said mount and located in front of a left eye and a right eye of said user;
a left peripheral light emitter located on a left side of said one or more displays;
a right peripheral light emitter located on a right side of said one or more displays;
a 3D model of a scene;
a display renderer coupled to said 3D model of said scene and to said one or more displays; and,
a peripheral renderer coupled to said 3D model of said scene, to said left peripheral light emitter, and to said right peripheral light emitter;
wherein
said one or more displays form one or more display images in a central portion of said user's field-of-view;
light from said left peripheral light emitter is projected left of said one or more display images;
light from said right peripheral light emitter is projected right of said one or more display images;
said left peripheral light emitter and said right peripheral light emitter each comprise a plurality of peripheral light pixels located at different vertical positions;
said display renderer assigns a display pixel color to each pixel of said one or more displays based on said 3D model of said scene; and,
said peripheral renderer assigns a peripheral light pixel color to each of said peripheral light pixels based on said 3D model of said scene, wherein said peripheral renderer determines a peripheral light pixel area for each of said peripheral light pixels; calculates a sample color for one or more sample locations within each of said peripheral light pixel areas to the left of said one or more displays, from a color of a closest object in said 3D model of said scene on a ray between said left eye of said user and said sample location; calculates said sample color for one or more sample locations within each of said peripheral light pixel areas to the right of said one or more displays, from a color of a closest object in said 3D model of said scene on a ray between said right eye of said user and said sample location; averages the sample colors for all of said sample locations within each of said peripheral light pixel areas to form an average color value for said peripheral light pixel area; and, assigns said average color value as the peripheral light pixel color for the peripheral light pixel corresponding to each peripheral light pixel area.
2. The system of claim 1 , wherein a total horizontal field-of-view spanned by said one or more display images, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 120 degrees.
3. The system of claim 1 , wherein a total horizontal field-of-view spanned by said one or more display images, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 150 degrees.
4. The system of claim 1 , wherein a total horizontal field-of-view spanned by said one or more display images, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 180 degrees.
5. The system of claim 1 , wherein a total horizontal field-of-view spanned by said one or more display images, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is more than 180 degrees.
6. The system of claim 1 , wherein a vertical resolution of said peripheral light pixels is less than a vertical resolution of each of said one or more displays.
7. The system of claim 1 , further comprising
one or more left reflective surfaces located to the left of said one or more displays; and,
one or more right reflective surfaces located to the right of said one or more displays;
wherein
at least a portion of said light from said left peripheral light emitter is reflected from said one or more left reflective surfaces towards said left eye of said user; and
at least a portion of said light from said right peripheral light emitter is reflected from said one or more right reflective surfaces towards said right eye of said user.
8. The system of claim 1 , wherein said peripheral renderer
averages said display pixel colors for pixels of said one more displays that are adjacent to or near to each of said peripheral light pixels, to form an average color value for each of said peripheral light pixels; and,
assigns said average color value as the peripheral light pixel color for each of said peripheral light pixels.
9. The system of claim 1 , further comprising
one or more lenses coupled to said mount, each located between one or more of the left and right eyes of said user and one or more of said one or more displays, said left peripheral light emitter, and said right peripheral light emitter;
wherein
said one or more lenses bend light from said left peripheral light emitter left; and,
said one or more lenses bend light from said right peripheral light emitter right.
10. The system of claim 9 wherein at least one of said one or more lenses comprise a gradient index lens.
11. The system of claim 9 wherein at least one of said one or more lenses comprise a Fresnel lens.
12. The system of claim 9 wherein at least one of said one or more lenses comprise a holographic optical element.
13. A peripheral field-of-view illumination system for a head-mounted display comprising
a mount configured to be worn on a head of a user;
one or more displays coupled to said mount and located in front of a left eye and a right eye of said user;
a left peripheral light emitter located on a left side of said one or more displays;
a right peripheral light emitter located on a right side of said one or more displays;
one or more left reflective surfaces located to the left of said one or more displays;
one or more right reflective surfaces located to the right of said one or more displays;
one or more lenses coupled to said mount, each located between one or more of the left and right eyes of said user and one or more of said one or more displays, said left peripheral light emitter, and said right peripheral light emitter;
a 3D model of a scene;
a display renderer coupled to said 3D model of said scene and to said one or more displays; and,
a peripheral renderer coupled to said 3D model of said scene, to said left peripheral light emitter, and to said right peripheral light emitter;
wherein
said one or more displays form one or more display images in a central portion of said user's field-of-view;
light from said left peripheral light emitter is projected left of said one or more display images;
light from said right peripheral light emitter is projected right of said one or more display images;
said left peripheral light emitter and said right peripheral light emitter each comprise a plurality of peripheral light pixels located at different vertical positions;
a vertical resolution of said peripheral light pixels is less than the vertical resolution of each of said one or more displays;
said one or more lenses bend light from said left peripheral light emitter left;
said one or more lenses bend light from said right peripheral light emitter right;
at least one of said one or more lenses comprise a gradient index lens or a Fresnel lens or a holographic optical element;
a total horizontal field-of-view spanned by said one or more display images, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 180 degrees;
at least a portion of said light from said left peripheral light emitter is reflected from said one or more left reflective surfaces towards said left eye of said user;
at least a portion of said light from said right peripheral light emitter is reflected from said one or more right reflective surfaces towards said right eye of said user;
said display renderer assigns a display pixel color to each pixel of said one or more displays based on said 3D model of said scene; and,
said peripheral renderer assigns a peripheral light pixel color to each of said peripheral light pixels based on said 3D model of said scene.