Image processing device and image processing method
The present technology is related to an image processing device and image processing method that enables the generating of 3D images that can be viewed safely and comfortably. The communication unit acquires encoded data of 3D images, and the 3D image bitstream that includes at least the disparity information representing the disparity of these 3D images. The CPU specifies the playback timing of the 3D images. Based on the disparity information, the CPU determines the re-encoding section, which is the section of a front stream and back stream where adjustment of the disparity is needed, so that the difference between the disparity of 3D images of which the timings of playback are consecutive is at or below a predetermined threshold. The editing unit adjusts the disparity of the image data in the re-encoding section. The present technology is applicable, for example, to an editing device that edits 3D images.
1. An image processing device configured to edit, at an edit point, a first encoded stream of 3D images, and a second encoded stream of 3D images, comprising:
an obtaining unit configured to obtain first disparity information, which includes a binocular disparity amount for a first main viewing region within the 3D images that are part of the first encoded stream, and configured to obtain second disparity information, which includes a binocular disparity amount for a second main viewing region within the 3D images that are part of the second encoded stream;
an adjustment unit configured to adjust at least one of the binocular disparity amount for the first disparity information of the first main viewing region and the binocular disparity amount for the second disparity information of the second main viewing region, so that the difference between the binocular disparity amount included in the first disparity information obtained by the obtaining unit and the binocular disparity amount included in the second disparity information obtained by the obtaining unit, is at or below a threshold;
an updating unit configured to update the binocular disparity amount included in the first disparity information obtained by the obtaining unit and the binocular disparity amount included in the second disparity information obtained by the obtaining unit, into the binocular disparity amount adjusted by the adjustment unit; and
an editing unit configured to add the first disparity information with the binocular disparity amount updated by the updating unit to the first encoded stream, or add the second disparity information with the binocular disparity amount updated by the updating unit to the second encoded stream, and configured to edit the first encoded stream and the second encoded stream at the edit point, and configured to re-encode a re-encoding section that includes at least a portion of the first encoded stream or the second encoded stream,
wherein the first main viewing region within the 3D images of the first encoded stream and the second main viewing region within the 3D images of the second encoded stream are between a foreground and a background of a frame of the 3D images.
2. The image processing device according to claim 1 , further comprising:
a setting unit configured to set a predetermined range that includes the edit point in the first encoded stream and a predetermined range that includes the edit point in the second encoded stream, as the re-encoding section which is a section regarding which adjusting of disparity is necessary, based on the binocular disparity amount included in the first disparity information obtained by the obtaining unit and on the binocular disparity amount included in the second disparity information obtained by the obtaining unit;
wherein the editing unit is configured to re-encode the re-encoding section set by the setting unit for the first encoded stream and the second encoded stream.
3. The image processing device according to claim 2 , the editing unit further comprising:
a decoding unit configured to decode the re-encoding section of the first encoded stream and the re-encoding section of the second encoded stream; and
an encoding unit configured to encode edited 3D images obtained as a result of editing at the edit point the first encoded stream and the second encoded stream, both of which have been obtained as the decoding result from the decoding unit.
4. The image processing device according to claim 2 , wherein the obtaining unit obtains a first estimated viewing environment information that includes a first maximum screen width based on an estimated viewing environment for the first encoded stream, and obtains a second estimated viewing environment information that includes a second maximum screen width based on an estimated viewing environment for the second encoded stream; and
wherein the setting unit sets the re-encoding section, based on the first estimated viewing environment information obtained from the obtaining unit and on the second estimated viewing environment information obtained from the obtaining unit.
5. The image processing device according to claim 2 , wherein the first disparity information includes a first upper limit value for a binocular disparity of the first encoded stream, and the second disparity information includes a second upper limit value for a binocular disparity of the second encoded stream;
and wherein the setting unit is configured to set the re-encoding section based on the first disparity information and the second disparity information.
6. An image processing method for an image processing device that edits, at an edit point, a first encoded stream which has a first encoded 3D image, and a second encoded stream which has a second encoded 3D image, comprising;
an obtaining step that obtains first disparity information, which includes a binocular disparity amount for a first main viewing region within the first encoded 3D image in the first encoded stream, and obtains second disparity information, which includes a binocular disparity amount for a second main viewing region within the second encoded 3D image in the second encoded stream;
an adjusting step that adjusts the binocular disparity amount of the first disparity information for the first main viewing region, or adjusts the binocular disparity amount of the second disparity information for the second main viewing region, so that the difference between the binocular disparity amount included in the first disparity information obtained from processing of the obtaining step and the binocular disparity amount included in the second disparity information obtained from processing of the obtaining step is at or below a threshold;
an updating step that updates the binocular disparity amount included in the first disparity information obtained by processing of the obtaining step, or updates the binocular disparity amount included in the second disparity information obtained by processing of the obtaining step, into the binocular disparity amount adjusted by processing of the adjusting step; and
an editing step that adds the first disparity information with the updated binocular disparity amount updated by processing of the updating step to the first encoded stream, or adds the second disparity information with the updated binocular disparity amount updated by processing of the updating step to the second encoded stream, and edits at the edit point the first encoded stream and the second encoded stream, and re-encodes a re-encoding section that includes at least a portion of the first encoded stream or the second encoded stream,
wherein the first main viewing region within the encoded 3D images of the first encoded stream and the first main viewing region within the encoded 3D images of the second encoded stream are between a foreground and a background of a frame of the encoded 3D images.