Image processing device, image processing method, and program
[Object] To generate, for a panoramic image, a thumbnail image showing satisfactory visibility when displayed. [Solution] Both first thumbnail image data generated by applying resolution conversion to panoramic image data generated by combining a plurality of captured images and second thumbnail image data generated by performing aspect ratio adjustment processing on the panoramic image data are generated as thumbnail images for the panoramic image data.
1. An image processing device for processing a panoramic image comprising:
a processor; and
a memory storing program code executable by the processor to perform operations comprising
accessing panoramic image data corresponding to a plurality of panoramic images,
generating first thumbnail image data for a plurality of first thumbnail images by applying resolution conversion to the panoramic image data,
determining a kind of aspect ratio adjustment processing among a plurality of kinds of aspect ratio adjustment processing, the determination being based upon a processing selection condition,
generating second thumbnail image data for a plurality of second thumbnail images by performing the determined aspect ratio adjustment processing on the panoramic image data,
storing the panoramic image data, the first thumbnail image data, and the second thumbnail image data on a recording medium,
determining whether a display of the image processing device is in a first display mode or a second display mode, wherein the first display mode is when the image processing device is in a vertical posture, and the second display mode is when the image processing device is in a horizontal posture, and
causing a display of the plurality of first thumbnail images when the display device is in the first display mode and a display of the plurality of second thumbnail images when the display device is in the second display mode,
wherein generating the second thumbnail image data includes setting a viewpoint position by determining an object in the panoramic image data, and generating the second thumbnail image data by performing the determined aspect ratio adjustment processing according to the viewpoint position, and
wherein the determined aspect ratio adjustment processing further includes at least one of a process of rendering an image acquired by texture-mapping a panoramic image to a three-dimensional model of a projection surface of the panoramic image, a process of applying polar coordinate transformation to the panoramic image, and a process of reducing the panoramic image by using a determination result of importance of a pixel in the panoramic image.
2. The image processing device according to claim 1 ,
wherein the processing selection condition is at least one of a plurality of conditions, the plurality of conditions including a projection type condition, a panoramic angle-of-view condition, an object condition, and a user setting condition.
3. The image processing device according to claim 1 ,
wherein generating the second thumbnail image data includes using different kinds of aspect ratio adjustment processing to generate pieces of the second thumbnail image data.
4. The image processing device according to claim 1 ,
wherein generating the second thumbnail image data includes using a same kind of aspect ratio adjustment processing to generate pieces of the second thumbnail image data having a viewpoint position different from a viewpoint position of the panoramic image data.
5. An image processing method for processing a panoramic image on a display device, the method comprising:
accessing panoramic image data corresponding to a plurality of panoramic images;
generating first thumbnail image data for a plurality of first thumbnail images by applying resolution conversion to the panoramic image data;
determining a kind of aspect ratio adjustment processing among a plurality of kinds of aspect ratio adjustment processing, the determination being based upon a processing selection condition;
generating second thumbnail image data for a plurality of second thumbnail images by performing the determined aspect ratio adjustment processing on the panoramic image data;
storing the panoramic image data, the first thumbnail image data, and the second thumbnail image data on a recording medium;
determining whether the display device is in a first display mode or a second display mode,
wherein the first display mode is when the image processing device is in a vertical posture, and the second display mode is when the image processing device is in a horizontal posture; and
accessing the stored first and second thumbnail image data and causing a display of the plurality of first thumbnail images when the display device is in the first display mode and a display of the plurality of second thumbnail images when the display device is in the second display mode,
wherein generating the second thumbnail image data includes setting a viewpoint position by determining an object in the panoramic image data, and generating the second thumbnail image data by performing the determined aspect ratio adjustment processing according to the viewpoint position, and
wherein the determined aspect ratio adjustment processing further includes at least one of a process of rendering an image acquired by texture-mapping a panoramic image to a three-dimensional model of a projection surface of the panoramic image, a process of applying polar coordinate transformation to the panoramic image, and a process of reducing the panoramic image by using a determination result of importance of a pixel in the panoramic image.
6. A non-transitory computer readable medium storing program code for processing a panoramic image on a display device, the program code being executable by a processor to perform operations comprising:
accessing panoramic image data corresponding to a plurality of panoramic images;
generating first thumbnail image data for a plurality of first thumbnail images by applying resolution conversion to the panoramic image data;
determining a kind of aspect ratio adjustment processing among a plurality of kinds of aspect ratio adjustment processing, the determination being based upon a processing selection condition;
generating second thumbnail image data for a plurality of second thumbnail images by performing the determined aspect ratio adjustment processing on the panoramic image data;
storing the panoramic image data, the first thumbnail image data, and the second thumbnail image data on a recording medium;
determining whether the display device is in a first display mode or a second display mode,
wherein the first display mode is when the image processing device is in a vertical posture, and the second display mode is when the image processing device is in a horizontal posture; and
accessing the stored first and second thumbnail image data and causing a display of the plurality of first thumbnail images when the display device is in the first display mode and a display of the plurality of second thumbnail images when the display device is in the second display mode
wherein generating the second thumbnail image data includes setting a viewpoint position by determining an object in the panoramic image data, and generating the second thumbnail image data by performing the determined aspect ratio adjustment processing according to the viewpoint position, and
wherein the determined aspect ratio adjustment processing further includes at least one of a process of rendering an image acquired by texture-mapping a panoramic image to a three-dimensional model of a projection surface of the panoramic image, a process of applying polar coordinate transformation to the panoramic image, and a process of reducing the panoramic image by using a determination result of importance of a pixel in the panoramic image.
7. The image processing method according to claim 5 ,
wherein the processing selection condition is at least one of a plurality of conditions, the plurality of conditions including a projection type condition, a panoramic angle-of-view condition, an objection condition, and a user setting condition.
8. The image processing method according to claim 5 ,
wherein generating second thumbnail image data includes using different kinds of aspect ratio adjustment processing to generate pieces of the second thumbnail image data.
9. The image processing method according to claim 5 ,
wherein generating second thumbnail image data includes using a same kind of aspect ratio adjustment processing to generate pieces of the second thumbnail image data having a viewpoint position different from a viewpoint position of the panoramic image data.
10. The image processing method according to claim 5 ,
wherein, when image data for which a thumbnail is generated is image data acquired by capturing a normal image, only the first thumbnail image data is generated, and
wherein, when image data for which a thumbnail is generated is the panoramic image data, the first thumbnail image data and the second thumbnail image data are generated.
11. The image processing device according to claim 1 ,
wherein the operations further comprise:
selecting at least one of the first thumbnail image data and the second thumbnail image data;
buffering the selected thumbnail image data from the recording medium in a second recording medium;
generating thumbnail display data based on the buffered thumbnail image data in the second recording medium; and
outputting the thumbnail display data.
12. The image processing device according to claim 1 , wherein the determined aspect ratio adjustment processing includes a process of columnar projection and a process of spherical projection.
13. The image processing method according to claim 5 , wherein the determined aspect ratio adjustment processing includes a process of columnar projection and a process of spherical projection.
14. The non-transitory computer readable medium according to claim 6 , wherein the determined aspect ratio adjustment processing includes a process of columnar projection and a process of spherical projection.