IP Library › Granted Patent US 10,764,486
Granted Patent B2
US 10,764,486 · App. 15/868,788 · Granted Sep 1, 2020

Multi-camera autofocus synchronization

Inventors: Jisoo Lee (San Diego, CA); Lee-Kang Liu (San Diego, CA); Micha Galor Gluskin (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N5/23212H04N5/23238H04N5/23296H04N5/232061H04N5/247H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,764,486
App. No.
15/868,788
Granted
Sep 1, 2020
Kind
B2
Abstract

A method synchronizes autofocus in a system having a master camera and a slave camera. The method comprises: focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images. The map relates a plurality of master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera. An autofocus operation is periodically performed in the slave camera to determine an additional slave camera lens position for an additional image. The map is adaptively updated, based at least partially on the additional slave camera lens position.

Claims (63)

1. A method for synchronizing autofocus in a system having a master camera and a slave camera, comprising:

focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images, the map comprising entries relating master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera;

determining an initial slave camera lens position based on one or more of the entries in the map;

determining a plurality of samples, each of the samples comprising a master camera lens position of the master camera and a slave camera lens position of the slave camera when capturing a corresponding one of the images;

periodically performing an autofocus operation in the slave camera to determine an additional slave camera lens position for an additional image; and

adaptively updating the map, the updating comprising:

adding a first entry to the map or updating the first entry in the map based on a first weight assigned to the initial slave camera lens position and a second weight assigned to the plurality of samples, and

adding a second entry to the map or updating the second entry in the map based at least partially on the additional slave camera lens position.

2. The method for synchronizing autofocus according to claim 1 , wherein the updating includes adding a master camera lens position and a corresponding slave camera lens position to the map or replacing a single one of the slave camera lens positions in the map.

3. The method for synchronizing autofocus according to claim 1 , wherein the map is independent of a location of the master camera.

4. The method for synchronizing autofocus in a system according to claim 1 , wherein the map is adaptively updated based on a temperature differential between a master camera lens of the master camera and a slave camera lens of the slave camera.

5. The method for synchronizing autofocus in a system according to claim 1 , wherein the map is adaptively updated using machine learning.

6. The method for synchronizing autofocus in a system according to claim 1 , wherein the updating is performed while the system captures a plurality of images.

7. The method for synchronizing autofocus in a system according to claim 1 , wherein the updating is performed based on an autofocus operation during capture of the additional image.

8. The method for synchronizing autofocus in a system according to claim 1 , wherein the master camera and the slave camera are configured so that the master camera and the slave camera have a same or substantially same azimuth angle as each other and a same or substantially same elevation angle as each other, where the azimuth and elevation angles are measured relative to a reference direction.

9. The method for synchronizing autofocus in a system according to claim 1 , wherein the slave camera performs the autofocus operation independently of the master camera after a predetermined number of images are captured.

10. The method for synchronizing autofocus in a system according to claim 1 , wherein the additional slave camera lens position and a corresponding additional master camera lens position are determined after performing a plurality of independent autofocus operations in the slave camera.

11. The method for synchronizing autofocus in a system according to claim 1 , wherein an additional entry or updated entry, comprising a master camera lens position and a corresponding slave camera lens position, is provided in the map in response to a determination that a statistic based on the plurality of samples has at least a threshold value.

12. The method for synchronizing autofocus in a system according to claim 1 , wherein an additional entry or updated entry, comprising a master camera lens position and a corresponding slave camera lens position, is provided in the map in response to a determination that the plurality of samples includes at least a predetermined number of samples.

13. The method for synchronizing autofocus in a system according to claim 12 , wherein the slave camera lens position of the additional entry is partially based on a set of initial master camera lens positions and corresponding initial slave camera lens positions in the map.

14. The method for synchronizing autofocus in a system according to claim 12 , wherein

adding the first entry to the map or updating the first entry in the map is based on the initial slave camera lens position and the slave camera lens positions of the plurality of samples.

15. The method for synchronizing autofocus in a system according to claim 1 , wherein the first weight assigned to the initial slave camera lens position is greater than the second weight assigned to the plurality of samples.

16. A system for synchronizing autofocus in a master camera and a slave camera, comprising:

a non-transitory, machine readable storage medium storing a map that includes entries relating master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera; and

a processor coupled to the storage medium, the processor configured with executable instructions to:

focus the slave camera based on the map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images;

determine an initial slave camera lens position based on one or more of the plurality of entries in the map;

determine a plurality of samples, each of the samples comprising a master camera lens position of the master camera and a slave camera lens position of the slave camera when capturing a corresponding one of the images;

periodically perform an autofocus operation in the slave camera to determine an additional slave camera lens position for an additional image; and

adaptively update the map, the updating comprising:

adding a first entry to the map or updating the first entry in the map based on a first weight assigned to the initial slave camera lens position and a second weight assigned to the plurality of samples, and

adding a second entry to the map or updating the second entry in the map based at least partially on the additional slave camera lens position.

17. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the updating includes adding a master camera lens position and a corresponding slave camera lens position to the map or replacing a single one of the slave camera lens position in the map.

18. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the processor is configured with instructions to adaptively update the map based on at least one of:

a temperature of a lens of the master camera,

a temperature of a lens of the slave camera,

a characteristic of a lens actuator in the master camera and a lens actuator in the slave camera, or

an orientation of a mobile device containing the master camera and the slave camera.

19. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the processor is configured to adaptively update the map using machine learning.

20. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the master camera and slave camera are positioned within a housing, and the master camera and the slave camera are configured so that the master camera and the slave camera have a same azimuth angle as each other and a same elevation angle as each other.

21. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the processor is configured with instructions to initiate an independent autofocus operation in the slave camera, each time a predetermined number of images are captured.

22. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the processor is configured with instructions to determine the additional slave camera lens position and a corresponding additional master camera lens position after performing a plurality of independent autofocus operations in the slave camera.

23. The system for synchronizing autofocus in a master camera and a slave camera according to claim 16 , wherein the processor is configured with instructions to:

determine an initial slave camera lens position based on one or more entries in the map, and

add an entry to the map or update an entry in the map based on the initial slave camera lens position and a plurality of slave camera lens positions from a plurality of independent autofocus operations by the slave camera.

24. A system for synchronizing autofocus in a master camera and a slave camera, comprising:

means for determining an initial slave camera lens position for focusing a slave camera in response to an autofocus operation performed by the master camera;

means for determining a plurality of samples, each of the plurality of samples comprising a master camera lens position of the master camera and a slave camera lens position of the slave camera when capturing a corresponding image;

means for periodically initiating an autofocus operation in the slave camera to determine an additional slave camera lens position for capturing an additional image;

means for adaptively updating a map, the means for adaptively updating comprising:

means for adding a first entry to the map or updating the first entry in the map based on a first weight assigned to the initial slave camera lens position and a second weight assigned to the plurality of samples; and

means for adding a second entry to the map or updating the second entry in the map based at least partially on the additional slave camera lens position; and

means for determining a slave camera lens position based at least partially on the map.

25. A non-transitory, machine readable storage medium storing data and instructions, wherein the instructions are executable by a processor for synchronizing autofocus in a master camera and a slave camera, the medium comprising:

a map comprising a plurality of entries, each of the plurality of entries relating a master camera lens positions of the master camera to a corresponding slave camera lens positions of the slave camera; and

instructions to focus the slave camera based on the map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images;

instructions to determine an initial slave camera lens position based on one or more of the plurality of entries in the map;

instructions to determine a plurality of samples, each of the plurality of samples comprising a master camera lens position of the master camera and a slave camera lens position of the slave camera when capturing a corresponding one of the images,

instructions to periodically perform an autofocus operation in the slave camera to determine an additional slave camera lens position for an additional image; and

instructions to adaptively update the map comprising:

instructions to add a first entry to the map or updating the first entry in the map based on a first weight assigned to the initial slave camera lens position and a second weight assigned to the plurality of samples; and

instructions to add a second entry to the map or updating the second entry in the map based at least partially on the additional slave camera lens position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2018
From: LEE, JISOO; LIU, LEE-KANG; GALOR GLUSKIN, MICHA
To: QUALCOMM INCORPORATED
Reel/Frame 045576/0901 →
Continuity (1)
Related Publication 20190215438A1 · Jul 11, 2019