Eye mounted displays and systems, with scaler
A display device is mounted on and/or inside the eye. The eye mounted display contains multiple sub-displays, each of which projects light to different retinal positions within a portion of the retina corresponding to the sub-display. The projected light propagates through the pupil but does not fill the entire pupil. In this way, multiple sub-displays can project their light onto the relevant portion of the retina. Moving from the pupil to the cornea, the projection of the pupil onto the cornea will be referred to as the corneal aperture. The projected light propagates through less than the full corneal aperture. The sub-displays use spatial multiplexing at the corneal surface. Various electronic devices interface to the eye mounted display.
1. A device for generating images in a format suitable for use with an eye mounted display, the device comprising:
an input for receiving image input;
a component for generating images from the image input, the images generated in an output format suitable for use in an eye mounted display for humans, wherein the images in the output format include pixels of different resolutions within each image, the eye mounted display mountable on an eye of a human user for forming a visual sensation of an image that spans a field of view of the user's eye, the eye mounted display comprising:
a contact lens; and
a plurality of sub-displays in the contact lens, the eye mounted display moving with the user's eye as the user's eye rotates in its socket, each of the sub-displays comprising:
a plurality of display pixels displaying a different portion of the image for each sub-display, and
display optics projecting light from the display pixels to a portion of the retina corresponding to the portion of the image displayed by that sub-display, wherein the portion of the retina is fixed as the user's eye rotates in its socket and thereby forming a visual sensation of the portion of the image displayed by that sub-display, each such projection of light propagating through a partial corneal aperture for that sub-display, different sub-displays projecting light to different portions of the retina, and the sub-displays in aggregate projecting light to portions of the retina that in aggregate span the field of view; and
an output for transmitting the images in the output format.
2. The device of claim 1 wherein higher resolution pixels are projected to smaller size areas on a retina of an eye.
3. The device of claim 1 wherein the resolution of each pixel is based on a size of retinal receptor fields at a location in the eye to which the pixel is projected.
4. The device of claim 1 wherein the transmitted images in the output format comprise a video stream with frames of video, and each frame includes approximately 400,000 to 500,000 pixels.
5. The device of claim 1 wherein the transmitted images in the output format comprise a video stream with frames of video, and the video stream has a frame rate of at least 50 frames per second.
6. The device of claim 1 wherein the component generates the pixels from the image input according to descriptors that describe individual pixels.
7. The device of claim 1 wherein the images in the output format are transmitted to the eye mounted display.
8. The device of claim 7 wherein the images in the output format are wirelessly transmitted to the eye mounted display.
9. The device of claim 1 wherein the images in the output format are transmitted to a headpiece for further transmission to the eye mounted display.
10. The device of claim 1 wherein the transmitted images in the output format comprise still pictures.
11. The device of claim 1 wherein the component correctly generates the images in the output format only if the image input comprises only a single video stream.
12. The device of claim 1 wherein the component correctly generates the images in the output format only if a virtual image projected by the eye mounted display is flat in space and a subtended field of view for the virtual image is known.
13. The device of claim 1 further comprising:
a second input for receiving previously generated second images in the output format;
wherein the component combines the received second images with the images generated by the component, and the output transmits the combined images.
14. The device of claim 13 wherein the second images were generated and transmitted to the second input by a second component.
15. The device of claim 14 wherein the second component generates the second images from input formats that are different than those used by the component.
16. The device of claim 14 wherein the component further transmits data to the second component.
17. The device of claim 1 wherein the device is implemented as a micro-codable VLIW SIMD fixed point vector processor.
18. The device of claim 1 wherein the image input comprises images in an input format, and the input format includes at least one of: DVI, HDMI, UDI, RGB, YUV, VGA, S-video, NTSC, and RS-170.
19. A method for generating images in a format suitable for use with an eye mounted display, the method comprising:
receiving an image input;
generating images from the image input, the images generated in an output format suitable for use in an eye mounted display for humans, wherein the images in the output format include pixels of different resolutions within each image, the eye mounted display mountable on an eye of a human user for forming a visual sensation of an image that spans a field of view of the user's eye, the eye mounted display comprising:
a contact lens; and
a plurality of sub-displays in the contact lens, the eye mounted display moving with the user's eye as the user's eye rotates in its socket, each of the sub-displays comprising:
a plurality of display pixels displaying a different portion of the image for each sub-display, and
display optics projecting light from the display pixels to a portion of the retina corresponding to the portion of the image displayed by that sub-display, wherein the portion of the retina is fixed as the user's eye rotates in its socket and thereby forming a visual sensation of the portion of the image displayed by that sub-display, each such projection of light propagating through a partial corneal aperture for that sub-display, different sub-displays projecting light to different portions of the retina, and the sub-displays in aggregate projecting light to portions of the retina that in aggregate span the field of view; and
transmitting the images in the output format.
20. A tangible non-transitory computer readable medium containing software instructions than, when executed on a computer system, cause the computer system to perform the steps of:
receiving an image input;
generating images from the image input, the images generated in an output format suitable for use in an eye mounted display for humans, wherein the images in the output format include pixels of different resolutions within each image, the eye mounted display mountable on an eye of a human user for forming a visual sensation of an image that spans a field of view of the user's eye, the eye mounted display comprising:
a contact lens; and
a plurality of sub-displays in the contact lens, the eye mounted display moving with the user's eye as the user's eye rotates in its socket, each of the sub-displays comprising:
a plurality of display pixels displaying a different portion of the image for each sub-display, and
display optics projecting light from the display pixels to a portion of the retina corresponding to the portion of the image displayed by that sub-display, wherein the portion of the retina is fixed as the user's eye rotates in its socket and thereby forming a visual sensation of the portion of the image displayed by that sub-display, each such projection of light propagating through a partial corneal aperture for that sub-display, different sub-displays projecting light to different portions of the retina, and the sub-displays in aggregate projecting light to portions of the retina that in aggregate span the field of view; and
transmitting the images in the output format.