IP Library › Granted Patent US 11,637,957
Granted Patent B2
US 11,637,957 · App. 16/599,761 · Granted Apr 25, 2023

Method and electronic device for switching between first lens and second lens

Inventors: Ravi Prasad Mohan Kini (Karnataka, IN); Gururaj Bhat (Karnataka, IN); Pavan Sudheendra (Karnataka, IN); Girish Kulkarni (Karnataka, IN); Vineeth Thanikonda Munirathnam (Karnataka, IN); Sanjay Narasimha Murthy (Karnataka, IN); Balvinder Singh (Karnataka, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N5/23296G02B15/14H04N5/2259H04N5/23245G02B13/009G02B13/0015
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,637,957
App. No.
16/599,761
Granted
Apr 25, 2023
Kind
B2
Abstract

A method for switching between a first lens and a second lens in an electronic device includes displaying, by the electronic device, a first frame showing a field of view (FOV) of the first lens; detecting, by the electronic device, an event that causes the electronic device to transition from displaying the first frame to displaying a second frame showing a FOV of the second lens; generating, by the electronic device and based on the detecting the event, at least one intermediate frame for transitioning from the first frame to the second frame; and switching, by the electronic device and based on the detecting the event, from the first lens to the second lens and displaying the second frame, wherein the at least one intermediate frame is displayed after the displaying the first frame and before the displaying the second frame while the switching is performed.

Claims (59)

1. A method for switching between a first lens and a second lens in an electronic device, comprising:

displaying, by the electronic device, a first frame captured by the first lens showing a field of view (FOV) of the first lens, wherein the electronic device includes the first lens with the first FOV, the second lens with a second FOV greater than the first FOV, and a third lens with a third FOV greater than the first FOV and less than the second FOV;

detecting, by the electronic device, an event that causes the electronic device to transition from displaying the first frame to displaying a second frame showing a FOV of the second lens;

generating, by the electronic device and based on a switching delay which is determined based on a time difference between a first time at which the first frame is displayed and a second time at which the second frame is displayed, at least one intermediate frame for transitioning from the first frame to the second frame; and

switching, by the electronic device and based on the detecting the event, from the first lens to the second lens and displaying the second frame, wherein the at least one intermediate frame is displayed after the displaying the first frame and before the displaying of the second frame.

2. The method of claim 1 , wherein the generating the at least one intermediate frame comprises:

identifying at least one transition parameter of the first lens and the second lens to generate the at least one intermediate frame;

obtaining at least one from among a spatial alignment data, a photometric alignment data and a color alignment data of the first lens and the second lens; and

generating the at least one intermediate frame further based on the at least one transition parameter, and at least one from among the spatial alignment data, the photometric alignment data and the color alignment data.

3. The method of claim 1 , wherein the at least one intermediate frame is at least one from among spatially aligned with respect to the first frame and the second frame, photometrically aligned with respect to the first frame and the second frame and color aligned with respect to the first frame and the second frame.

4. The method of claim 2 , further comprising determining the at least one intermediate frame to be generated,

wherein determining the at least one intermediate frame to be generated comprises:

determining the spatial alignment data using the at least one transition parameter; and

determining the at least one intermediate frame to be generated based on the determined spatial alignment data and the at least one transition parameter.

5. The method of claim 2 , wherein the spatial alignment data is obtained by:

capturing a first single frame associated with the first lens and a second single frame of a same scene associated with the second lens when the electronic device is in an idle mode;

resizing the first single frame and the second single frame into a preview resolution size;

computing feature points in the first single frame and the second single frame;

computing a transformation matrix using the identified at least one transition parameter and a Homography relationship between the first single frame and the second single frame, wherein the transformation matrix includes a first scaling of the first single frame, a second scaling of the second single frame, a first rotation of the first single frame, a second rotation of the second single frame, a first translation of the first single frame, and a second translation of the second single frame; and

obtaining the spatial alignment data using the transformation matrix.

6. The method of claim 2 , wherein the photometric alignment data is obtained by:

computing a transformation matrix for the generated at least one intermediate frame;

computing a correction factor based on the transformation matrix; and

obtaining the photometric alignment data based on the correction factor.

7. The method of claim 2 , wherein the color alignment data is obtained by:

computing a transformation matrix for the generated at least one intermediate frame;

computing a correction factor for the color alignment data based on the transformation matrix; and

obtaining the color alignment data based on the correction factor.

8. The method of claim 2 , wherein the at least one transition parameter includes an F-value of the first lens, the FOV of the first lens, a color profile of the first lens, a saturation profile of the first lens, an F-value of the second lens, the FOV of the second lens, a color profile of the second lens, a saturation profile of the second lens, a scale factor of the first lens, a scale factor of the second lens, a scale factor between the first lens and the second lens, a single scale factor of a combination of the first lens and the second lens, a pivot between the first lens and the second lens, and a single pivot value of a combination of the first lens and the second lens.

9. An electronic device for switching between a first lens and a second lens, comprising:

a memory;

a processor coupled with the memory, the processor being configured to:

display a first frame captured by the first lens showing a field of view (FOV) of the first lens, wherein the electronic device includes the first lens with the first FOV, the second lens with a second FOV greater than the first FOV, and a third lens with a third FOV greater than the first FOV and less than the second FOV;

detect an event that causes the electronic device to transition from displaying the first frame to displaying a second frame showing a FOV of the second lens;

generate, based on a switching delay which is determined based on a time difference between a first time at which the first frame is displayed and a second time at which the second frame is displayed, at least one intermediate frame for transitioning from the first frame to the second frame; and

switch, based on detecting the event, from the first lens to the second lens and display the second frame, wherein the at least one intermediate frame is displayed after the first frame is displayed and before the second frame is displayed.

10. The electronic device of claim 9 , wherein the processor is further configured to:

identify at least one transition parameter of the first lens and the second lens to generate the at least one intermediate frame;

obtain at least one from among a spatial alignment data, a photometric alignment data and a color alignment data of the first lens and the second lens; and

generate the at least one intermediate frame further based on the at least one transition parameter, and at least one from among the spatial alignment data, the photometric alignment data and the color alignment data.

11. The electronic device of claim 9 , wherein the at least one intermediate frame is at least one from among spatially aligned with respect to the first frame and the second frame, photometrically aligned with respect to the first frame and the second frame and color aligned with respect to the first frame and the second frame.

12. The electronic device of claim 10 , wherein the processor is further configured to:

determine the spatial alignment data using the at least one transition parameter; and

determine the at least one intermediate frame to be generated based on the determined spatial alignment data and the at least one transition parameter.

13. The electronic device of claim 10 , wherein the processor is further configured to:

capture a first single frame associated with the first lens and a second single frame of a same scene associated with the second lens when the electronic device is in an idle mode;

resize the first single frame and the second single frame into a preview resolution size;

compute feature points in the first single frame and the second single frame;

compute a transformation matrix using the identified at least one transition parameter and a Homography relationship between the first single frame and the second single frame, wherein the transformation matrix includes a first scaling of the first single frame, a second scaling of the second single frame, a first rotation of the first single frame, a second rotation of the second single frame, a first translation of the of the first single frame, and a second translation of the second single frame; and

obtain the spatial alignment data using the transformation matrix.

14. The electronic device of claim 10 , wherein the photometric alignment data is obtained by:

computing a transformation matrix for the generated at least one intermediate frame;

computing a correction factor based on the transformation matrix; and

obtaining the photometric alignment data based on the correction factor.

15. The electronic device of claim 10 , wherein the color alignment data is obtained by:

computing a transformation matrix for the generated at least one intermediate frame;

computing a correction factor for the color alignment data based on the transformation matrix; and

obtaining the color alignment data based on the correction factor.

16. The electronic device of claim 10 , wherein the at least one transition parameter includes an F-value of the first lens, the FOV of the first lens, a color profile of the first lens, a saturation profile of the first lens, an F-value of the second lens, the FOV of the second lens, a color profile of the second lens, a saturation profile of the second lens, a scale factor of the first lens, a scale factor of the second lens, a scale factor between the first lens and the second lens, a scale factor of a combination of the first lens and the second lens, a pivot between the first lens and the second lens, and a single pivot value of a combination of the first lens and the second lens.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2019
From: KINI, RAVI PRASAD MOHAN; BHAT, GURURAJ; SUDHEENDRA, PAVAN; KULKARNI, GIRISH; MUNIRATHNAM, VINEETH THANIKONDA; MURTHY, SANJAY NARASIMHA; SINGH, BALVINDER
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 050691/0334 →
Priority Claims (2)
IN 201841038833 · Oct 12, 2018 · national
IN 201841038833 · Oct 7, 2019 · national
Continuity (2)
Related Publication 20200120284A1 · Apr 16, 2020
Related Publication 20220086352A9 · Mar 17, 2022