Rendering system and method for images having differing foveal area and peripheral view area resolutions
View Patent ↗A client-server arrangement for camera viewing using digital cameras across a computer network. A camera server controls a motorized gimbal which determines the viewing angles of a set of cameras according to signals from a client computer which is equipped with an eye movement tracking system. Movements of the viewer's eyes result in changes in viewing angle of the remote cameras. A high resolution foveal field of view image centered on the user's point of interest is captured and overlaid on a lower resolution full filed of view image, rendering a combined image having a low resolution peripheral area and a high resolution foveal area, and being significantly reduced in size compared to a full resolution, full field of view image. This combined image is transmitted to the client for display to the user.
1. A method for generating an image for user viewing wherein images have a field of view angles formed between two lines intersecting at a point of view and traversing two edges of view area in a direction of view of the image, the method comprising the steps of:
determining a point of interest of a user within a full field of view in a first electronic image;
capturing a full resolution circular foveal image within said full field of view, said foveal image having a field of view being centered upon said point of interest and having a field of view angle between 1° and 4°;
capturing a peripheral image within said full field of view having a reduced resolution, being centered upon same said point of interest, and having a field of view angle greater than said foveal field of view angle and less than or equal to said full field of view angle;
transmitting said foveal image and said peripheral image to a remote display device;
overlaying by said remote display device said foveal image onto said peripheral image both of which being centered upon same said point of interest such that a combined image having a full resolution foveal area and a surrounding reduced resolution peripheral area is rendered;
displaying said combined image to a user;
capturing a full resolution peripheral image having said peripheral field of view angle and being centered upon same said user point of interest;
subsequent to transmission of said reduced resolution peripheral image transmitting said full resolution peripheral image to said remote display; and
replacing said reduced resolution image in said combined image with said received full resolution peripheral image area surrounding said full resolution foveal image area.
2. The method as set forth in claim 1 wherein said step of capturing a full resolution foveal field of view image comprises using a first camera having a telephoto lens, and wherein said step of capturing a full field of view image with a reduced resolution comprises using a second camera having a wide angle lens.
3. The method as set forth in claim 1 wherein said step of capturing a full resolution foveal field of view image comprises setting a camera lens to a telephoto setting, and wherein said step of capturing a full field of view image with a reduced resolution comprises setting a camera lens to a wide angle setting.
4. The method as set forth in claim 1 wherein said step of providing said combined image for display to a user comprises transmitting a digital image over a computer network.
5. A computer readable medium encoded with software for generating an image for user viewing, wherein images have field of view angles formed between two lines intersecting at a point of view and traversing two edges of view area in a direction of view of the image, the software performing the steps of:
determining a point of interest of a user within a full field of view in a first electronic image;
capturing a full resolution circular foveal image within said full field of view, said foveal image having a field of view being centered upon said point of interest and having a field of view angle between 1° and 4°;
capturing a peripheral image within said full field of view having a reduced resolution, being centered upon same said point of interest, and having a field of view angle greater than said foveal field of view angle and less than or equal to said full field of view angle;
transmitting said foveal image and said peripheral image to a remote display device;
overlaying by said remote display device said foveal image onto said peripheral image both of which being centered upon same said point of interest such that a combined image having a full resolution foveal area and a surrounding reduced resolution peripheral area is rendered;
displaying said combined image to a user;
capturing a full resolution peripheral image having said peripheral field of view angle and being centered upon same said user point of interest;
subsequent to transmission of said reduced resolution peripheral image, transmitting said full resolution peripheral image to said remote display; and
replacing said reduced resolution image in said combined image with said received full resolution peripheral image area surrounding said full resolution foveal image area.
6. The computer readable medium as set forth in claim 5 wherein said software for capturing a full resolution foveal field of view image comprises software for receiving an image from a first camera having a telephoto lens, and wherein said software for capturing a full field of view image with a reduced resolution comprises software for receiving an image from a second camera having a wide angle lens.
7. The computer readable medium as set forth in claim 5 wherein said software for capturing a full resolution foveal field of view image comprises software for setting a camera lens to a telephoto setting, and wherein said software for capturing a full field of view image with a reduced resolution comprises software for setting a camera lens to a wide angle setting.
8. The computer readable medium as set forth in claim 5 wherein said software for providing said combined image for display to a user comprises software for transmitting a digital image over a computer network.
9. A system for rendering an image wherein images have a field of view angles formed between two lines intersecting at a point of view and traversing two edges of view area in a direction of view of the image, the system comprising:
a user point of interest tracking system which determines a user point of interest within an electronic image having a full field of view;
a full resolution image capturing means for capturing a circular foveal image centered upon said user point of interest, said foveal image having a field of view being centered upon said point of interest and having a field of view angle between 1° and 4°, and further configured to capture a full resolution peripheral image having said peripheral field of view angle and being centered upon same said user point of interest;
a reduced resolution image capturing means for capturing a peripheral image centered upon same said user point of interest, said peripheral field of view measurement being greater than said foveal field of view angle and less than or equal to said full field of view angle;
a transmitter configured to transmit said foveal image and said peripheral image to a remote display device, and further configured to transmit said full resolution peripheral image to said remote display subsequent to transmission of said reduced resolution peripheral image;
a combined image renderer configured to receive said foveal image and said peripheral image, and to overlay said full resolution foveal image onto said peripheral image both of which being centered upon same said point of interest thereby creating a combined image having full resolution in a foveal area and reduced resolution in a peripheral area, and further configured to replace said reduced resolution image in said combined image with said received full resolution peripheral image area surrounding said full resolution foveal image area; and
a remote display device configured to display said combined image to a user.
10. The system as set forth in claim 9 wherein said comprises an eye movement tracking system.
11. The system as set forth in claim 9 wherein said full resolution image capturing means comprises a first camera equipped with a telephoto lens, and wherein said reduced resolution image capturing means comprises a second camera equipped with a wide angle lens.
12. The system as set forth in claim 9 wherein said full resolution image capturing means and said reduced resolution image capturing means comprise a camera equipped with an adjustable lens having a telephoto and a wide angle setting.
13. The system as set forth in claim 9 wherein said means for displaying said combined image to a user comprises a web browser system.