IP Library › Granted Patent US 11,050,915
Granted Patent B2
US 11,050,915 · App. 16/711,458 · Granted Jun 29, 2021

Method for zooming by switching between dual cameras, mobile terminal, and storage apparatus

Inventor: Jianming Feng (Huizhou, CN)
Assignee: HUIZHOU TCL MOBILE COMMUNICATION CO., LTD.
H04N5/2258H04N5/23212H04N5/23232H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,050,915
App. No.
16/711,458
Granted
Jun 29, 2021
Kind
B2
Abstract

A method for zooming by switching between dual cameras includes: detecting, by a mobile terminal, whether the magnification of a first camera during a zooming process exceeds a predefined threshold value, and activating a second camera when the magnification exceeds the predefined threshold value; reading, by the mobile terminal, an average photographing distance difference between the first camera and the second camera pre-stored in a memory, and acquiring a first image of the first camera and a second image of the second camera; and obtaining a common focusing position range of the first camera and the second camera according to the average distance difference, fusing the first image and the second image, and outputting and displaying a fused image. A mobile terminal and a non-transitory storage apparatus performing the above-mentioned method are also provided.

Claims (79)

1. A method of zooming by switching between dual cameras, comprising:

detecting, by a mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera;

reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera, wherein the average distance difference is stored in a non-transitory memory in advance; and

determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed.

2. The method according to claim 1 , further comprising:

acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal.

3. The method according to claim 2 , wherein the acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal comprises:

placing a reference card at a position having a predefined distance away from the dual cameras of the mobile terminal for the dual cameras to capture an image;

activating the first camera to capture an image A, activating the second camera to capture an image B;

selecting five points on the image A and same five points on the image B, wherein the five points on the image A are (x1, y1), (x2, y2), (x3, y3), (x4, y4), and (x5, y5), the same five points on the image B are (x1′, y1′), (x2′, y2′), (x3′, y3′), (x4′, y4′), and (x5′, y5′), and the same five points on the image B are in one-to-one correspondence with the five points on the image A, calculating a distance difference between each of the five points on the image A and each of the five points of the image B correspondingly;

calculating a mean of the distance difference of x-axis values of the five points as Δx=[(x1−x1′)+(x2−x2′)+(x3−x3′)+(x4−x4′)+(x5−x5′)]/5, and calculating a mean of the distance difference y-axis values of the five points as Δ y=[(y1−y1′)+(y2−y2′)+(y3−y3′)+(y4−y4′)+(y5−y5′)]/5, obtaining the average distance difference (Δx, Δy); and

storing the average distance difference (Δx, Δy) in the non-transitory memory to be invoked by the dual cameras of the mobile terminal for photographing.

4. The method according to claim 3 , wherein the predefined distance is 1 meter.

5. The method according to claim 1 , wherein the detecting, by a mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera comprises:

after activating the first camera to capture the first image, the first camera continually zooming in; and

in response to the magnification being detected by the mobile terminal as exceeding the predefined threshold, activating the second camera to capture the second image.

6. The method according to claim 5 , wherein the reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera comprises:

reading, by the mobile terminal, the average distance difference stored in the non-transitory memory;

obtaining the first image of the first camera and the second image of the second camera;

acquiring an edge of the first image and an edge of the second image; and

acquiring a first pixel of the first image and a second pixel of the second image, and determining a pixel difference between the first pixel and the second pixel.

7. The method according to claim 6 , wherein the determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed comprises:

obtaining the range of the common focus of the first camera and the second camera based on the pixel difference;

determining a final common focal position of the first camera and the second camera based on the range of the common focus;

replacing the first image with the second image based on coordinates of the average distance difference; and

outputting the fused image to be displayed.

8. The method according to claim 6 , wherein the first image and the second image are processed by performing image detection to obtain the edge of the first image and the edge of the second image.

9. A mobile terminal, comprising: a processor and a non-transitory memory communicatively connected with the processor, wherein

the non-transitory memory is arranged to store a computer program, the computer program is arranged to be executed to perform a method of zooming by switching between dual cameras; and

the processor is arranged to invoke the computer program stored in the non-transitory memory to perform the method of zooming by switching between dual cameras by performing operations of:

detecting, by the mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera;

reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera, wherein the average distance difference is stored in a non-transitory memory in advance; and

determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed.

10. The mobile terminal according to claim 9 , wherein the processor is further arranged to invoke the computer program stored in the non-transitory memory to perform operations of:

acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal.

11. The mobile terminal according to claim 10 , wherein, when acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal, the processor is further arranged to invoke the computer program stored in the non-transitory memory to perform operations of:

placing a reference card at a position having a predefined distance away from the dual cameras of the mobile terminal for the dual cameras to capture an image;

activating the first camera to capture an image A, activating the second camera to obtain an image B;

selecting five points on the image A and same five points on the image B, wherein the five points on the image A are (x1, y1), (x2, y2), (x3, y3), (x4, y4), and (x5, y5), the same five points on the image B are (x1′, y1′), (x2′, y2′), (x3′, y3′), (x4′, y4′), and (x5′, y5′), and the same five points on the image B are in one-to-one correspondence with the five points on the image A, calculating a distance difference between each of the five points on the image A and each of the five points of the image B correspondingly;

calculating a mean of the distance difference of x-axis values of the five points as Δx=[(x1−x1′)+(x2−x2′)+(x3−x3′)+(x4−x4′)+(x5−x5′)]/5, and calculating a mean of the distance difference y-axis values of the five points as Δ y=[(y1−y1′)+(y2−y2′)+(y3−y3′)+(y4−y4′)+(y5−y5′)]/5, obtaining the average distance difference (Δx, Δy); and

storing the average distance difference (Δx, Δy) in the non-transitory memory to be invoked by the dual cameras of the mobile terminal for photographing.

12. The mobile terminal according to claim 9 , wherein, when detecting, by the mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera, the processor is further arranged to invoke the computer program stored in the non-transitory memory to perform operations of:

after activating the first camera to capture the first image, the first camera continually zooming in; and

in response to the magnification being detected by the mobile terminal as exceeding the predefined threshold, activating the second camera to capture the second image.

13. The mobile terminal according to claim 12 , wherein, when reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera, the processor is further arranged to invoke the computer program stored in the non-transitory memory to perform operations of:

reading, by the mobile terminal, the average distance difference stored in the non-transitory memory;

obtaining the first image of the first camera and the second image of the second camera;

acquiring an edge of the first image and an edge of the second image; and

acquiring a first pixel of the first image and a second pixel of the second image, and determining a pixel difference between the first pixel and the second pixel.

14. The mobile terminal according to claim 13 , wherein, when determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed, the processor is further arranged to invoke the computer program stored in the non-transitory memory to perform operations of:

obtaining the range of the common focus of the first camera and the second camera based on the pixel difference;

determining a final common focal position of the first camera and the second camera based on the range of the common focus;

replacing the first image with the second image based on coordinates of the average distance difference; and

outputting the fused image to be displayed.

15. A non-transitory storage apparatus, having a computer program stored in, wherein the computer program is arranged to be executed to perform a method of zooming by switching between dual cameras, comprising operations of:

detecting, by the mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera;

reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera, wherein the average distance difference is stored in a non-transitory memory in advance; and

determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed.

16. The non-transitory storage apparatus according to claim 15 , wherein the computer program is further arranged to be executed to perform operations of:

acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal.

17. The non-transitory storage apparatus according to claim 16 , wherein, when acquiring the average distance difference between photographing by the first camera and photographing by the second camera in advance, and storing the average distance difference in the non-transitory memory of the mobile terminal, the computer program is further arranged to be executed to perform operations of:

placing a reference card at a position having a predefined distance away from the dual cameras of the mobile terminal for the dual cameras to capture an image;

activating the first camera to capture an image A, activating the second camera to obtain an image B;

selecting five points on the image A and same five points on the image B, wherein the five points on the image A are (x1, y1), (x2, y2), (x3, y3), (x4, y4), and (x5, y5), the same five points on the image B are (x1′, y1′), (x2′, y2′), (x3′, y3′), (x4′, y4′), and (x5′, y5′), and the same five points on the image B are in one-to-one correspondence with the five points on the image A, calculating a distance difference between each of the five points on the image A and each of the five points of the image B correspondingly;

calculating a mean of the distance difference of x-axis values of the five points as Δx=[(x1−x1′)+(x2−x2′)+(x3−x3′)+(x4−x4′)+(x5−x5′)]/5, and calculating a mean of the distance difference y-axis values of the five points as Δ y=[(y1−y1′)+(y2−y2′)+(y3−y3′)+(y4−y4′)+(y5−y5′)]/5, obtaining the average distance difference (Δx, Δy); and

storing the average distance difference (Δx, Δy) in the non-transitory memory to be invoked by the dual cameras of the mobile terminal for photographing.

18. The non-transitory storage apparatus according to claim 15 , wherein, when detecting, by the mobile terminal, whether magnification of a first camera during a zooming process exceeds a predefined threshold, and, in response to the magnification being detected as exceeding the predefined threshold, activating a second camera, the computer program is further arranged to be executed to perform operations of:

after activating the first camera to capture the first image, the first camera continually zooming in; and

in response to the magnification being detected by the mobile terminal as exceeding the predefined threshold, activating the second camera to capture the second image.

19. The non-transitory storage apparatus according to claim 18 , wherein, when reading, by the mobile terminal, an average distance difference between photographing by the first camera and photographing by the second camera, and obtaining a first image of the first camera and a second image of the second camera, the computer program is further arranged to be executed to perform operations of:

reading, by the mobile terminal, the average distance difference stored in the non-transitory memory;

obtaining the first image of the first camera and the second image of the second camera;

acquiring an edge of the first image and an edge of the second image; and

acquiring a first pixel of the first image and a second pixel of the second image, and determining a pixel difference between the first pixel and the second pixel.

20. The non-transitory storage apparatus according to claim 19 , wherein, when determining a range of a common focus of the first camera and the second camera based on the average distance difference, fusing the first image and the second image, and outputting a fused image to be displayed, the computer program is further arranged to be executed to perform operations of:

obtaining the range of the common focus of the first camera and the second camera based on the pixel difference;

determining a final common focal position of the first camera and the second camera based on the range of the common focus;

replacing the first image with the second image based on coordinates of the average distance difference; and

outputting the fused image to be displayed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2019
From: FENG, JIANMING
To: HUIZHOU TCL MOBILE COMMUNICATION CO., LTD.
Reel/Frame 051255/0645 →
Priority Claims (1)
CN 201710580057.7 · Jul 17, 2017 · national
Continuity (2)
Continuation PCTCN2018095928 · Jul 17, 2018
Related Publication 20200120289A1 · Apr 16, 2020