Image processing device, non-transitory computer-readable medium, and image processing method
An image processing device includes: an image sensor generating raw image data; a pipeline processing unit executing, on the raw image data, an image processing group such that image data which is a result of image processing in a preceding stage becomes a target of image processing in a subsequent stage; an extended image processing unit executing extended image processing different from each image processing included in the image processing group; a storage unit storing a definition for identifying target image processing to be bypassed and a definition indicating that image processing to be executed before and/or after bypassing is the extended image processing; and a switching unit switching, on the basis of the definitions stored upon satisfaction of a switching condition, a processing flow in the image processing group such that intermediate image data becomes the target of the extended image processing.
1 . An image processing device comprising:
an image sensor, generating at least one piece of raw image data;
a pipeline processor, executing an image processing group consisting of a series of image processings with respect to each of the at least one piece of raw image data generated by the image sensor, so that image data which is a result of image processing in a preceding stage becomes a target of image processing in a subsequent stage;
an extended image processor, executing extended image processing different from each of the image processings comprised in the image processing group;
a storage, storing a definition for identifying target image processing which is image processing to be bypassed among the image processings comprised in the image processing group and a definition indicating that image processing to be executed either or both before and after bypassing is the extended image processing; and
a switch, in response to a predetermined switching condition being satisfied, switching, on the basis of the definition stored in the storage, a processing flow in the image processing group so that intermediate image data which is a result of image processing before the target image processing becomes a target of the extended image processing, wherein
based on the definition, the extended image processor executes the extended image processing on an image obtained by bypassing at least one image processing comprised in the image processing group and executing at least one image processing comprised in the image processing group.
2 . The image processing device according to claim 1 , wherein
the image sensor generates a plurality of pieces of raw image data;
the pipeline processor executes the image processing group for each of the pieces of raw image data generated by the image sensor;
the switch switches the processing flow in the image processing group for each piece of raw image data in response to the switching condition being satisfied; and
the extended image processor generates single image data on the basis of a plurality of pieces of intermediate image data.
3 . The image processing device according to claim 2 , wherein
the extended image processing is noise reduction processing; and
the target image processing is processing for varying a noise intensity of the image data.
4 . The image processing device according to claim 2 , wherein
the extended image processing is super-resolution processing; and
the target image processing is processing for varying a noise intensity of the image data.
5 . The image processing device according to claim 2 , wherein
the extended image processing is super-resolution processing; and
the target image processing is processing for interpolating a pixel lacking in color information in the raw image data generated by the image sensor.
6 . The image processing device according to claim 2 , wherein
the storage further stores a definition of an output destination of the single image data generated by the extended image processor; and
the extended image processor outputs the generated single image data to the output destination on the basis of the definition stored in the storage.
7 . A non-transitory computer-readable medium storing an image processing program causing a computer to function as:
a pipeline processor, executing an image processing group consisting of a series of image processings with respect to each of at least one piece of raw image data generated by an image sensor, so that image data which is a result of image processing in a preceding stage becomes a target of image processing in a subsequent stage;
an extended image processor, executing extended image processing different from each of the image processings comprised in the image processing group; and
a switch, acquiring a definition for identifying target image processing which is image processing to be bypassed among the image processings comprised in the image processing group and a definition indicating that image processing to be executed either or both before and after bypassing is the extended image processing, and, in response to a predetermined switching condition being satisfied, switching, on the basis of the acquired definition, a processing flow in the image processing group so that intermediate image data which is a result of image processing before the target image processing becomes a target of the extended image processing, wherein
based on the definition, the extended image processor executes the extended image processing on an image obtained by bypassing at least one image processing comprised in the image processing group and executing at least one image processing comprised in the image processing group.
8 . An image processing method for executing an image processing group consisting of a series of image processings with respect to each of at least one piece of raw image data generated by an image sensor, so that image data which is a result of image processing in a preceding stage becomes a target of image processing in a subsequent stage, the image processing method comprising:
determining whether a predetermined switching condition is satisfied;
in response to determining that the switching condition is satisfied, switching a processing flow in the image processing group so that intermediate image data which is a result of image processing before target image processing among the image processings comprised in the image processing group becomes a target of extended image processing different from each of the image processings comprised in the image processing group; and
executing the extended image processing, wherein
based on the definition, executing the extended image processing on an image obtained by bypassing at least one image processing comprised in the image processing group and executing at least one image processing comprised in the image processing group.