Method and apparatus for displaying and varying binocular image content
View Patent ↗A controller that may implement variation of the content of binocular images which may depend upon which region of a binocular image a viewer is fixating. An aspect of the present disclosure may include locally controlling the viewer's perceived depth impression which may depend on where in perceived depth in an image the viewer is fixating. This may enable the perceived depth to be optimized across the image for quality and performance reasons.
1. A method for varying binocular image content, comprising:
displaying a current binocular image comprising left and right eye views, wherein the left and right eye views each comprise a first portion of respective left and right eye source images;
using inputs from the current binocular image and a gaze tracker to calculate a subsequent region of binocular fixation;
determining any change in binocular fixation between a current region of binocular fixation and the subsequent region of binocular fixation;
calculating a disparity range of the subsequent region of binocular fixation when there is a change in binocular fixation between the current region of binocular fixation and the subsequent region of binocular fixation;
determining whether the disparity range is substantially zero;
choosing new left and right eye views to create a subsequently displayed binocular image when the disparity range is not substantially zero, wherein a nearest object in the subsequent region of binocular fixation has a disparity of substantially zero in the subsequently displayed binocular image, and wherein the new left and right eye views each comprise a second portion of the respective left and right eye source images, wherein the first and second portions of the left eye source image are different portions, and the first and second portions of the right eye source image are different portions; and
making the currently displayed image, the subsequently displayed binocular image.
2. The method for varying binocular image content of claim 1 , further comprising receiving a second input from the gaze tracker and using the second input from the current binocular image and the gaze tracker to re-calculate the subsequent region of binocular fixation when the subsequent region of binocular fixation has not substantially changed, and if it is determined that the subsequent region of binocular fixation, after re-calculation, has changed, then calculating the disparity range of the subsequent region of binocular fixation.
3. The method for varying binocular image content of claim 1 , further comprising receiving a third input from the gaze tracker and using the third input from the current binocular image and the gaze tracker to further re-calculate the subsequent region of binocular fixation when the disparity range is approximately zero, and if it is determined that the subsequent region of binocular fixation, after further re-calculation, has changed, then re-calculating the disparity range of the subsequent region of binocular fixation.
4. The method for varying binocular image content of claim 1 , further comprising determining, with the gaze tracker, the disparity within the fixated region, wherein the gaze tracker determines the plane of fixation from the difference between left eye and right eye screen fixation points.
5. The method for varying binocular image content of claim 1 , wherein determining whether the disparity range is substantially zero further comprises comparing the image disparity of the subsequent object with zero, wherein the subsequent object is being imaged where it is the closest object to a viewer in the region of binocular fixation.
6. The method for varying binocular image content of claim 1 , further comprising altering a subsequently displayed image in response to the change in the region of binocular fixation between the currently displayed binocular image and the subsequently displayed binocular image.
7. The method for varying binocular image content of claim 1 , further comprising forming a currently displayed binocular image.
8. The method for varying binocular image content of claim 1 , wherein forming a currently displayed binocular image further comprises estimating a 3D region of fixation and projecting the 3D region of fixation into an image plane to form a binocular region of fixation.
9. The method for varying binocular image content of claim 8 , wherein the currently displayed binocular image is formed as a left image and a right image.
10. The method for varying binocular image content of claim 9 , wherein the currently displayed binocular image is selected from a larger source image.
11. The method for varying binocular image content of claim 1 , further comprising receiving a second input from the gaze tracker and using the second input from the current binocular image and the gaze tracker to re-calculate the subsequent region of binocular fixation when the disparity range is approximately zero, and if it is determined that the subsequent region of binocular fixation, after re-calculation, has changed, then re-calculating the disparity range of the subsequent region of binocular fixation.
12. A binocular imaging system, comprising:
a display configured to display a current binocular image having left and right eye views, wherein the left and right eye views each comprise a first portion of respective left and right eye source images;
a gaze tracker that identifies at least one or both gaze directions of the left eye and the right eye; and
an image controller configured to use input from the current binocular image and input from a gaze tracker to calculate a subsequent region of binocular fixation, and to determine any change in binocular fixation between a current region of binocular fixation and the subsequent region of binocular fixation, and to calculate a disparity range of the subsequent region of binocular fixation when there is a change in binocular fixation, and to determine whether the disparity range of the subsequent region of binocular fixation is substantially zero, and to choose new left and right eye views to create a subsequently displayed binocular image when the disparity range is not substantially zero, wherein a nearest object in the subsequent region of binocular fixation has a disparity of substantially zero in the subsequently displayed binocular image, and wherein the new left and right eye views each comprise a second portion of the respective left and right eye source images, wherein the first and second portions of the left eye source image are different portions, and the first and second portions of the right eye source image are different portions, and to make the currently displayed image, the subsequently displayed binocular image.
13. The binocular imaging system of claim 12 , wherein the image controller is configured to receive a second input from the gaze tracker and using the second input from the current binocular image and the gaze tracker to re-calculate the subsequent region of binocular fixation when the subsequent region of binocular fixation has not substantially changed, and the image controller is configured to calculate the disparity range of the subsequent region of binocular fixation, if it is determined that the subsequent region of binocular fixation, after re-calculation, has changed.
14. The binocular imaging system of claim 13 , wherein the image controller is configured to receive a third input from the gaze tracker and using the third input from the current binocular image and the gaze tracker to further re-calculate the subsequent region of binocular fixation when the disparity range is approximately zero, and the image controller is configured to re-calculate the disparity range of the subsequent region of binocular fixation, if it is determined that the subsequent region of binocular fixation, after further re-calculation, has changed.
15. The binocular imaging system of claim 12 , wherein the image controller is configured to receive a second input from the gaze tracker and using the second input from the current binocular image and the gaze tracker to re-calculate the subsequent region of binocular fixation when the disparity range is approximately zero, and the image controller is configured to re-calculate the disparity range of the subsequent region of binocular fixation, if it is determined that the subsequent region of binocular fixation, after re-calculation, has changed.
16. The binocular imaging system of claim 12 , wherein the gaze tracker is configured to determine the disparity within the fixated region and the plane of fixation from the difference between left eye and right eye fixation points.
17. The binocular imaging system of claim 12 , wherein the image controller is configured to determine whether the disparity range is substantially zero by comparing the image disparity of the subsequent object with zero, wherein the subsequent object is being imaged where it is the closest object to a viewer in the region of binocular fixation.
18. The binocular imaging system of claim 12 , wherein the image controller is configured to form a currently displayed binocular image by estimating a 3D region of fixation and projecting the 3D region of fixation into an image plane to form a binocular region of fixation.