Smooth zoom transition in high resolution sensors

1 . A method comprising:

obtaining first sensor data and second sensor data;

obtaining first image data by processing the first sensor data using a first processing mode, wherein the first processing mode is based on a first pixel pattern;

obtaining second image data by processing the second sensor data using a second processing mode, wherein the second processing mode is based on a second pixel pattern different from the first pixel pattern, and wherein based on a zoom factor, the first processing mode includes performing a first pixel binning and the second processing mode includes a second pixel binning different from the first pixel binning;

generating an image by combining the first image data and the second image data;

comparing a target parameter with a plurality of threshold values including a first threshold value, a second threshold value, a third threshold value, and a fourth threshold value; and

generating a subsequent image using one or more of the first processing mode, the second processing mode and a third processing mode based on a result of the comparing,

wherein the comparing determines that the target parameter is above the first threshold value and the second threshold value and between the third threshold value and the fourth threshold value, and

the generating generates the subsequent image using the second processing mode and the third processing mode based on the determination.

2 . The method of claim 1 , wherein:

the first image data is spatially aligned with the second image data.

3 . The method of claim 1 , further comprising:

identifying the target parameter for the image;

computing a first weight for the first image data based on the target parameter; and

computing a second weight for the second image data based on the target parameter, wherein the first image data and the second image data are combined based on the first weight and the second weight, respectively.

4 . The method of claim 3 , wherein:

the target parameter is the zoom factor.

5 . The method of claim 3 , wherein:

the first weight and the second weight are computed using a temporal stabilization function based on the target parameter over time.

6 . The method of claim 1 , further comprising:

generating another subsequent image using the first processing mode based on a determination that the target parameter is below the first threshold value.

7 . The method of claim 6 , further comprising:

refraining from using the second processing mode for the subsequent image based on the determination that the target parameter is below the first threshold value.

8 . The method of claim 1 , further comprising:

combining the first image data and the second image data based on a determination that the target parameter is between the first threshold value and the second threshold value.

9 . The method of claim 1 , further comprising:

generating another subsequent image using the second processing mode based on a determination that the target parameter is above the first threshold value and above the second threshold value.

10 . The method of claim 9 , further comprising:

refraining from using the first processing mode for the subsequent image based on the determination that the target parameter is above the first threshold value and above the second threshold value.

11 . The method of claim 1 , further comprising:

refraining from using the first processing mode for the subsequent image based on the determination.

12 . The method of claim 1 , further comprising:

generating another subsequent image using the third processing mode based on a determination that the target parameter is above the first threshold value, the second threshold value, the third threshold value, and the fourth threshold value.

13 . The method of claim 12 , further comprising:

refraining from using the first processing mode and the second processing mode for the subsequent image based on the determination that the target parameter is above the first threshold value, the second threshold value, the third threshold value, and the fourth threshold value.

14 . The method of claim 1 , further comprising:

obtaining third image sensor data; and

obtaining third image data by processing the third image sensor data using the third processing mode to obtain third image data, wherein the third processing mode is based on a third pixel pattern different from the first pixel pattern and the second pixel pattern, wherein the image is generated by combining the first image data, the second image data, and the third image data.

15 . A method comprising:

obtaining first sensor data and second sensor data that is spatially aligned with the first sensor data;

obtaining first image data and second image data by processing the first sensor data and the second sensor data based on a first color filter pattern and a second color filter pattern, respectively, to obtain first image data and second image data;

obtaining first scaled image data by scaling the first image data based on a first scaling factor;

obtaining second scaled image data by scaling the second image data based on a second scaling factor different from the first scaling factor; and

generating an image by combining the first image data and the second image data,

wherein the image is generated by combining the first scaled image data and the second scaled image data.

16 . The method of claim 15 , further comprising:

obtaining first binned sensor data by binning the first sensor data based on a first binning size to obtain first binned sensor data, wherein the first image data is based on the first binned sensor data; and

obtaining second binned sensor data by binning the second sensor data based on a second binning size to obtain second binned sensor data, wherein the second image data is based on the second binned sensor data.

17 . An apparatus comprising:

an image sensor configured to obtain first sensor data, second sensor data, and third sensor data;

one or more processors configured to determine whether a target parameter associated with a resolution of a combined image is greater than at least one threshold value;

a memory including instructions executable by the one or more processors;

a first processing pipeline configured to obtain first image data by processing process the first sensor data using a first processing mode, wherein the first processing mode is based on a first pixel pattern;

a second processing pipeline configured to obtain second image data by processing process the second sensor data using a second processing mode, wherein the second processing mode is based on a second pixel pattern different from the first pixel pattern, and wherein based on a zoom factor, the first processing mode includes performing a first pixel binning and the second processing mode includes a second pixel binning different from the first pixel binning;

a third processing pipeline configured to obtain third image data by processing process the third sensor data using a third processing mode, wherein the third processing mode is based on a third pixel pattern different from the first pixel pattern and the second pixel pattern; and

a merge component configured to generate combined image data using at least one of combine the first image data and the second image data to obtain combined image data based on a result of the comparison between the target parameter and the at least one threshold value,

wherein the one or more processors are configured to generate a subsequent image using the second processing mode and the third processing mode based on the target parameter is above a first threshold value and a second threshold value and between a third threshold value and a fourth threshold value.

18 . The apparatus of claim 17 , wherein:

the first processing pipeline comprises first circuitry configured to process the first sensor data using the first processing mode; and

the second processing pipeline comprises second circuitry configured to process the second sensor data using the second processing mode.