Granted Patent B2

US 12,250,462 · App. 18/138,403 · Granted Mar 11, 2025

Inventors: Ravi Prasad Mohan Kini (Karnataka, IN); Gururaj Bhat (Karnataka, IN); Pavan Sudheendra (Karnataka, IN); Girish Kulkarni (Karnataka, IN); Vineeth Thanikonda Munirathnam (Karnataka, IN); Sanjay Narasimha Murthy (Karnataka, IN); Balvinder Singh (Karnataka, IN)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

H04N23/69G02B15/14H04N23/58H04N23/667G02B13/0015G02B13/009

Abstract

Claims (82)

1. A method of an electronic device, comprising:

displaying, by the electronic device, a first frame captured by a first camera with a first field of view (FOV), wherein the electronic device includes the first camera with the first FOV, a second camera with a second FOV greater than the first FOV, and a third camera with a third FOV greater than the first FOV and less than the second FOV;

detecting, by the electronic device, a first event that causes the electronic device to transition from displaying the first frame to displaying a second frame captured by the second camera with the second FOV; and;

based on the detecting the first event;

generating, by the electronic device, a first number of intermediate frames; and

displaying, by the electronic device, the second frame,

wherein the first number of intermediate frames are displayed after the displaying of the first frame and before the displaying of the second frame,

wherein a second number of intermediate frames are generated upon detecting a second event, the second event causing the electronic device to transition from displaying a third frame captured by the second camera to displaying a fourth frame captured by the first camera, and

wherein the first number is different from the second number.

2. The method of claim 1 , wherein the generating the first number of intermediate frames comprises:

identifying at least one transition parameter of the first camera and the second camera to generate the first number of intermediate frames;

obtaining at least one from among a spatial alignment data, a photometric alignment data and a color alignment data of the first camera and the second camera; and

generating the first number of intermediate frames further based on the at least one transition parameter, and at least one from among the spatial alignment data, the photometric alignment data and the color alignment data.

3. The method of claim 1 , wherein the first number of intermediate frames are at least one from among spatially aligned with respect to the first frame and the second frame, photometrically aligned with respect to the first frame and the second frame and color aligned with respect to the first frame and the second frame.

4. The method of claim 2 , further comprising determining the first number of intermediate frames to be generated,

wherein determining the first number of intermediate frames to be generated comprises:

determining the spatial alignment data using the at least one transition parameter; and

determining the first number of intermediate frames to be generated based on the determined spatial alignment data and the at least one transition parameter.

5. The method of claim 2 , wherein the spatial alignment data is obtained by:

capturing a first single frame associated with the first camera and a second single frame of a same scene associated with the second camera when the electronic device is in an idle mode;

resizing the first single frame and the second single frame into a preview resolution size;

computing feature points in the first single frame and the second single frame;

computing a transformation matrix using the identified at least one transition parameter and a Homography relationship between the first single frame and the second single frame, wherein the transformation matrix includes a first scaling of the first single frame, a second scaling of the second single frame, a first rotation of the first single frame, a second rotation of the second single frame, a first translation of the first single frame, and a second translation of the second single frame; and

obtaining the spatial alignment data using the transformation matrix.

6. The method of claim 2 , wherein the photometric alignment data is obtained by:

computing a transformation matrix for the generated first number of intermediate frames;

computing a correction factor based on the transformation matrix; and

obtaining the photometric alignment data based on the correction factor.

7. The method of claim 2 , wherein the color alignment data is obtained by:

computing a transformation matrix for the generated first number of intermediate frames;

computing a correction factor for the color alignment data based on the transformation matrix; and

obtaining the color alignment data based on the correction factor.

8. The method of claim 2 , wherein the at least one transition parameter includes an F-value of the first camera, the first FOV of the first camera, a color profile of the first camera, a saturation profile of the first camera, an F-value of the second camera, the second FOV of the second camera, a color profile of the second camera, a saturation profile of the second camera, a scale factor of the first camera, a scale factor of the second camera, a scale factor between the first camera and the second camera, a single scale factor of a combination of the first camera and the second camera, a pivot between the first camera and the second camera, and a single pivot value of the combination of the first camera and the second camera.

9. The method of claim 1 , wherein the first number of intermediate frames are for smoothly transitioning from the first frame to the second frame.

10. The method of claim 1 , wherein the generating the first number of intermediate frames comprises obtaining the first number of intermediate frames based on a switching time, and

wherein the switching time is related to a difference between a first time the first frame is displayed and a second time the second frame is displayed.

11. An electronic device, comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the electronic device to:

display a first frame captured by a first camera with a first field of view (FOV), wherein the electronic device includes the first camera with the first FOV, a second camera with a second FOV greater than the first FOV, and a third camera with a third FOV greater than the first FOV and less than the second FOV;

detect a first event that causes the electronic device to transition from displaying the first frame to displaying a second frame captured by the second camera with the second FOV; and

based on the detecting the first event;

generate a first number of intermediate frames, and

display the second frame,

wherein the first number of intermediate frames is are displayed after the displaying of the first frame and before the displaying of the second frame,

wherein a second number of intermediate frames are generated upon detecting a second event, the second event causing the electronic device to transition from displaying a third frame captured by the second camera to displaying a fourth frame captured by the first camera, and

wherein the first number is different from the second number.

12. The electronic device of claim 11 , wherein the instructions further cause the electronic device to:

identify at least one transition parameter of the first camera and the second camera to generate the first number of intermediate frames;

obtain at least one from among a spatial alignment data, a photometric alignment data and a color alignment data of the first camera and the second camera; and

generate the first number of intermediate frames further based on the at least one transition parameter, and at least one from among the spatial alignment data, the photometric alignment data and the color alignment data.

13. The electronic device of claim 11 , wherein the first number of intermediate frames are at least one from among spatially aligned with respect to the first frame and the second frame, photometrically aligned with respect to the first frame and the second frame and color aligned with respect to the first frame and the second frame.

14. The electronic device of claim 12 , wherein the instructions further cause the electronic device to:

determine the spatial alignment data using the at least one transition parameter; and

determine the first number of intermediate frames to be generated based on the determined spatial alignment data and the at least one transition parameter.

15. The electronic device of claim 12 , wherein the instructions further cause the electronic device to:

capture a first single frame associated with the first camera and a second single frame of a same scene associated with the second camera when the electronic device is in an idle mode;

resize the first single frame and the second single frame into a preview resolution size;

compute feature points in the first single frame and the second single frame;

compute a transformation matrix using the identified at least one transition parameter and a Homography relationship between the first single frame and the second single frame, wherein the transformation matrix includes a first scaling of the first single frame, a second scaling of the second single frame, a first rotation of the first single frame, a second rotation of the second single frame, a first translation of the of the first single frame, and a second translation of the second single frame; and

obtain the spatial alignment data using the transformation matrix.

16. The electronic device of claim 12 , wherein the photometric alignment data is obtained by:

computing a transformation matrix for the generated first number of intermediate frames;

computing a correction factor based on the transformation matrix; and

obtaining the photometric alignment data based on the correction factor.

17. The electronic device of claim 12 , wherein the color alignment data is obtained by:

computing a transformation matrix for the generated first number of intermediate frames;

computing a correction factor for the color alignment data based on the transformation matrix; and

obtaining the color alignment data based on the correction factor.

18. The electronic device of claim 12 , wherein the at least one transition parameter includes an F-value of the first camera, the first FOV of the first camera, a color profile of the first camera, a saturation profile of the first camera, an F-value of the second camera, the second FOV of the second camera, a color profile of the second camera, a saturation profile of the second camera, a scale factor of the first camera, a scale factor of the second camera, a scale factor between the first camera and the second camera, a scale factor of a combination of the first camera and the second camera, a pivot between the first camera and the second camera, and a single pivot value of the combination of the first camera and the second camera.

19. The electronic device of claim 11 , wherein the first number of intermediate frames are for smoothly transitioning from the first frame to the second frame.

20. The electronic device of claim 11 , wherein the instructions further cause the electronic device to generate the first number of intermediate frames based on a switching time, and

wherein the switching time is related to a difference between a first time the first frame is displayed and a second time the second frame is displayed.

21. A non-transitory computer-readable storage medium storing instructions which, when executed by at least one processor of an electronic device, cause the electronic device to perform:

displaying a first frame captured by a first camera with a first field of view (FOV), wherein the electronic device includes the first camera with the first FOV, a second camera with a second FOV greater than the first FOV, and a third camera with a third FOV greater than the first FOV and less than the second FOV;

detecting a first event that causes the electronic device to transition from displaying the first frame to displaying a second frame captured by the second camera with the second FOV; and

based on the detecting the first event;

generating a first number of intermediate frames, and

displaying the second frame,

wherein the first number of intermediate frames are displayed after the displaying of the first frame and before the displaying of the second frame,

wherein a second number of intermediate frames are generated upon detecting a second event, the second event causing the electronic device to transition from displaying a third frame captured by the second camera to displaying a fourth frame captured by the first camera, and

wherein the first number is different from the second number.

Priority Claims (2)

Continuity (2)

References Cited (56)