Image generation apparatus, image generation method, and program
Provided is an image generation technology capable of suppressing unpleasant feelings caused by fluctuation in image quality caused by the viewer's viewpoint movement. The image generation technology includes an image generation unit configured to generate a pseudo viewpoint image I φk and a pseudo viewpoint image I −φk , by using disparity inducing edge D φk having a phase difference φk from a viewpoint image I, where φk(1≤k≤K) is set as a real number satisfying 0<φ 1 < . . . <φK≤π/2, an output image generation unit configured to generate an output image Out m (1≤m≤2K−1), from the pseudo viewpoint image I (m) (1≤m≤2K+1), the viewpoint image I is set as a pseudo viewpoint image I φ0 , where the pseudo viewpoint images I φk , I −φk (0≤k≤K) are arranged in a sequence of I φk , I φ(K−1) , . . . , I φ1 , I φ0 (=I), I −φ1 , . . . , and I −φK is set as I (1) , I (2) , . . . , I (K) , I (K+1) , I (K+2) , . . . , I (2K+1) , and the output image Out m and the output image Out m+1 (1≤m≤2K−2) include a phase modulation component that is canceled out when synthesized and visually recognized.
1. A computer-implemented method for generating an image at a viewpoint, the method comprising:
receiving a first viewpoint image and a plurality of disparity maps, wherein the disparity map corresponds to the first viewpoint image;
generating, based on the first viewpoint image and the disparity map, a plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has a distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence;
generating, based on the plurality of disparity inducing edges and the first viewpoint image, a first set of pseudo viewpoint images;
generating, based on polarity-inverted images associated with the plurality of disparity inducing edges and the first viewpoint image, a second set of pseudo viewpoint images;
generating, based at least on the first set of pseudo viewpoint images and the second set of pseudo viewpoint images, a set of output images, wherein the set of output images are in the predetermined sequence, and wherein the set of output images include a plurality of phase modulations for canceling out upon a synthesis and visual confirmation; and
providing the set of output images.
2. The computer-implemented method of claim 1 , the method comprising:
receiving a second viewpoint image, wherein a first viewpoint of the first viewpoint image is adjacent to a second viewpoint of the second viewpoint image; and
generating, based on the first viewpoint image, the second viewpoint image, and the disparity map, the plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has the distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence.
3. The computer-implemented method of claim 1 , the method further comprising:
receiving a set of viewpoint images and a set of disparity maps, wherein the set of viewpoint images are in a sequence of a set of viewpoint positions, and wherein each of the set of disparity maps corresponds to one of the set of viewpoint images; and
generating, based at least on the set of viewpoint images and the set of disparity maps, the set of output images.
4. The computer-implemented method of claim 1 , the method further comprising:
generating, based on a set of viewpoint images, the set of output images, wherein the set of viewpoint images relates to in a predetermined sequence of viewpoint positions.
5. The computer-implemented method of claim 3 , wherein a first number of output images in the set of output images is based on a second number of the viewpoint images in the set of viewpoint images, wherein the first number is less than a half of the second number, and wherein the second number corresponds to a third number of viewpoint positions.
6. The computer-implemented method of claim 1 , the method comprising:
aggregating luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
providing the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.
7. The computer-implemented method of claim 3 , the method comprising:
aggregating luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
providing the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.
8. A system for generating an image at a viewpoint, the system comprises:
a processor; and
a memory storing computer-executable instructions that when executed by the processor cause the system to:
receive a first viewpoint image and a plurality of disparity maps, wherein the disparity map corresponds to the first viewpoint image;
generate, based on the first viewpoint image and the disparity map, a plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has a distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence;
generate, based on the plurality of disparity inducing edges and the first viewpoint image, a first set of pseudo viewpoint images;
generate, based on polarity-inverted images associated with the plurality of disparity inducing edges and the first viewpoint image, a second set of pseudo viewpoint images;
generate, based at least on the first set of pseudo viewpoint images and the second set of pseudo viewpoint images, a set of output images, wherein the set of output images are in the predetermined sequence, and wherein the set of output images include a plurality of phase modulations for canceling out upon a synthesis and visual confirmation; and
provide the set of output images.
9. The system of claim 8 , the computer-executable instructions when executed further causing the system to:
receive a second viewpoint image, wherein a first viewpoint of the first viewpoint image is adjacent to a second viewpoint of the second viewpoint image; and
generate, based on the first viewpoint image, the second viewpoint image, and the disparity map, the plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has the distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence.
10. The system of claim 8 , the computer-executable instructions when executed further causing the system to:
receive a set of viewpoint images and a set of disparity maps, wherein the set of viewpoint images are in a sequence of a set of viewpoint positions, and wherein each of the set of disparity maps corresponds to one of the set of viewpoint images; and
generate, based at least on the set of viewpoint images and the set of disparity maps, the set of output images.
11. The system of claim 8 , the computer-executable instructions when executed further causing the system to:
generate, based on a set of viewpoint images, the set of output images, wherein the set of viewpoint images relates to in a predetermined sequence of viewpoint positions.
12. The system of claim 10 , wherein a first number of output images in the set of output images is based on a second number of the viewpoint images in the set of viewpoint images, wherein the first number is less than a half of the second number, and wherein the second number corresponds to a third number of viewpoint positions.
13. The system of claim 8 , the computer-executable instructions when executed further causing the system to:
aggregate luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
provide the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.
14. The system of claim 10 , the computer-executable instructions when executed further causing the system to:
aggregate luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
provide the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.
15. A computer-readable non-transitory recording medium storing computer-executable instructions that when executed by a processor cause a computer system to:
receive a first viewpoint image and a plurality of disparity maps, wherein the disparity map corresponds to the first viewpoint image;
generate, based on the first viewpoint image and the disparity map, a plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has a distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence;
generate, based on the plurality of disparity inducing edges and the first viewpoint image, a first set of pseudo viewpoint images;
generate, based on polarity-inverted images associated with the plurality of disparity inducing edges and the first viewpoint image, a second set of pseudo viewpoint images;
generate, based at least on the first set of pseudo viewpoint images and the second set of pseudo viewpoint images, a set of output images, wherein the set of output images are in the predetermined sequence, and wherein the set of output images include a plurality of phase modulations for canceling out upon a synthesis and visual confirmation; and
provide the set of output images.
16. The computer-readable non-transitory recording medium of claim 15 , the computer-executable instructions when executed further causing the system to:
receive a second viewpoint image, wherein a first viewpoint of the first viewpoint image is adjacent to a second viewpoint of the second viewpoint image; and
generate, based on the first viewpoint image, the second viewpoint image, and the disparity map, the plurality of disparity inducing edges, wherein each of the plurality of disparity inducing edges has the distinct predetermined phase difference based on the first viewpoint image and a predetermined sequence.
17. The computer-readable non-transitory recording medium of claim 15 , the computer-executable instructions when executed further causing the system to:
receive a set of viewpoint images and a set of disparity maps, wherein the set of viewpoint images are in a sequence of a set of viewpoint positions, and wherein each of the set of disparity maps corresponds to one of the set of viewpoint images; and
generate, based at least on the set of viewpoint images and the set of disparity maps, the set of output images.
18. The computer-readable non-transitory recording medium of claim 15 , the computer-executable instructions when executed further causing the system to:
generate, based on a set of viewpoint images, the set of output images, wherein the set of viewpoint images relates to in a predetermined sequence of viewpoint positions.
19. The computer-readable non-transitory recording medium of claim 17 ,
wherein a first number of output images in the set of output images is based on a second number of the viewpoint images in the set of viewpoint images, wherein the first number is less than a half of the second number, and wherein the second number corresponds to a third number of viewpoint positions, the computer-executable instructions when executed further causing the system to:
aggregating luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
providing the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.
20. The computer-readable non-transitory recording medium of claim 15 , the computer-executable instructions when executed further causing the system to:
aggregate luminance of at least two adjacent images of a combination of the first set of pseudo viewpoint image and the received viewpoint image, and wherein the at least two adjacent images corresponds to at least two adjacent viewpoints; and
provide the aggregated luminance of the at least two adjacent images as an image at a view located at an intermediate position of the at least two adjacent viewpoints.