Image display device, image display method, and image correction method
A viewpoint detection unit detects a user viewing a stereoscopic image, including a parallax image of a subject as viewed from a predetermined position defined as a reference view position, and tracks a viewpoint of the detected user. A motion parallax correction unit determines, if a speed of movement of the viewpoint becomes equal to or higher than a predetermined level, an amount of motion parallax correction for the parallax image, on the basis of an amount of movement of the viewpoint, so as to generate a stereoscopic image corrected for motion parallax, generates, if the speed of movement of the viewpoint subsequently becomes lower than a predetermined level, a stereoscopic image by changing the amount of motion parallax correction in steps until the parallax image return to parallax images as seen from the reference view position.
1. An image display device comprising:
a viewpoint detector operating to: (1) detect a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present, (2) acquire a position and size of a face of the user, (3) track eyes of the user, (4) determine a viewpoint of the user using the acquired position and size of the face of the user, and the tracking of the eyes of the user, and (5) track the viewpoint of the user; and
a motion parallax calculator operating to determine an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
wherein the amount of motion parallax correction is computed for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
wherein the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
wherein the amount of motion parallax correction computed for the parallax image for the left eye and the parallax image for the right eye is gradually reduced to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period,
a display operating to display the stereoscopic image corrected for motion parallax by the amount of motion parallax correction computed as a function of the speed of movement of the viewpoint of the user and applied to the parallax image for the left eye and the parallax image for the right eye.
2. The image display device according to claim 1 , further comprising:
an image change detection unit configured to detect a switch in an image by analyzing the stereoscopic image,
wherein, if the image change detection unit detects a switch in the image, the motion parallax correction unit invalidates the amount of motion parallax correction computed and outputs to the display unit the stereoscopic image as seen from the reference view position, following the switch in the image.
3. The image display device according to claim 1 , wherein the motion parallax correction unit performs motion parallax correction if the viewpoint detection unit detects that a single user is viewing the stereoscopic image.
4. An image correction method comprising:
detecting a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present;
acquiring a position and size of a face of the user;
tracking eyes of the user;
determining a viewpoint of the user using the acquired position and size of the face of the user, and the tracking of the eyes of the user;
tracking the viewpoint of the user;
determining an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
computing the amount of motion parallax for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
computing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
gradually reducing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period,
displaying the stereoscopic image corrected for motion parallax by the amount of motion parallax correction computed as a function of the speed of movement of the viewpoint of the user and applied to the parallax image for the left eye and the parallax image for the right eye.
5. A non-transitory computer readable storage medium with an executable program stored thereon, wherein a processor performs actions when the program is executed, comprising:
detecting a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present;
acquiring a position and size of a face of the user;
tracking eyes of the user;
determining a viewpoint of the user using the acquired position and size of the face of the user, and the tracking of the eyes of the user;
tracking the viewpoint of the user;
determining an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
computing the amount of motion parallax for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
computing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
gradually reducing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period,
displaying the stereoscopic image corrected for motion parallax by the amount of motion parallax correction computed as a function of the speed of movement of the viewpoint of the user and applied to the parallax image for the left eye and the parallax image for the right eye.
6. An image display device comprising:
a display unit configured to display an image in a parallax barrier method;
a viewpoint operating to: (1) detect a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present, (2) acquire a position and size of a face of the user, (3) track eyes of the user, (4) determine a viewpoint of the user using the acquired position and size of the face of the user, and (5) track the viewpoint of the user;
a motion parallax calculator operating to determine an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
wherein the amount of motion parallax correction is computed for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
wherein the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
wherein the amount of motion parallax correction computed for the parallax image for the left eye and the parallax image for the right eye is gradually reduced to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period; and
a barrier control unit configured to shift a barrier to a position where a stereoscopic view of the stereoscopic image is available when the display unit is viewed in synchronization with a movement of the viewpoint obtained by the tracking of the viewpoint of the user.
7. The image display device according to claim 6 , further comprising:
an image identification unit configured to identify whether an image viewed by a user is a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject, or a two-dimensional image,
wherein the barrier control unit disables the barrier if the image viewed by the user is a two-dimensional image.
8. An image display method comprising:
displaying an image in a parallax barrier method;
detecting a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present;
acquiring a position and size of a face of the user;
tracking eyes of the user;
determining a viewpoint of the user using the acquired position and size of the face of the user, and the tracking of the eyes of the user;
tracking the viewpoint of the user;
determining an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
computing the amount of motion parallax for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
computing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
gradually reducing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period; and
shifting, using a processor, a barrier to a position where a stereoscopic view of the stereoscopic image is available when the subject is viewed in synchronization with a movement of the viewpoint obtained by the tracking of the viewpoint of the user.
9. A non-transitory computer readable storage medium with an executable program stored thereon, wherein a processor performs actions when the program is executed, comprising:
displaying a stereoscopic image in a parallax barrier method;
detecting a user viewing a stereoscopic image, including a parallax image for the left eye and a parallax image for the right eye of a subject as viewed from a predetermined position defined as a reference view position, which is a fixed viewpoint at which no motion parallax is present;
acquiring a position and size of a face of the user;
tracking eyes of the user;
determining a viewpoint of the user using the acquired position and size of the face of the user, and the tracking of the eyes of the user;
tracking the viewpoint of the user;
determining an amount of motion parallax correction to apply to the parallax image for the left eye and for the parallax image for the right eye, respectively, as a function of an amount of movement of the viewpoint determined by tracking the viewpoint of the user,
computing the amount of motion parallax for the parallax image for the left eye and the parallax image for the right eye when the speed of movement of the viewpoint of the user is equal to or higher than a predetermined level,
computing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye is determined to be a reference amount, in accordance with the reference view position at which no motion parallax is present, when the speed of movement of the viewpoint of the user remains below the predetermined level for a sufficient period of time,
gradually reducing the amount of motion parallax correction for the parallax image for the left eye and the parallax image for the right eye to the reference amount during a period of time when the speed of movement of the viewpoint of the user falls below the predetermined level but has not reached the sufficient time period; and
shifting a barrier to a position where a stereoscopic view of the stereoscopic image is available when the subject is viewed in synchronization with a movement of the viewpoint obtained by the tracking of the viewpoint of the user.