IP Library › Granted Patent US 11,490,000
Granted Patent B2
US 11,490,000 · App. 17/203,235 · Granted Nov 1, 2022

Depth-assisted auto focus

Inventors: Wen-Chun Feng (New Taipei, TW); Hui Shan Kao (New Taipei, TW); Hsuan-Ming Liu (New Taipei, TW)
Assignee: QUALCOMM Incorporated
H04N5/232125G03B13/32H04N5/23229H04N5/232122H04N5/36961H04N5/36965
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,490,000
App. No.
17/203,235
Granted
Nov 1, 2022
Kind
B2
Abstract

An apparatus configured for image processing comprises one or more processors configured to determine data associated with a distance between an object and the apparatus and determine a plurality of lens positions of a camera lens based on the data associated with the distance between the object and the apparatus. The one or more processors are further configured to determine, for each one of the plurality of lens positions, a respective focus value to generate a plurality of focus values. To determine, for each one of the plurality of lens positions, the respective focus value, the one or more processors are configured to determine, for each one of the plurality of lens positions, phase difference information. The one or more processors are further configured to determine a final lens position based on the plurality of focus values.

Claims (55)

1. An apparatus configured for image processing, the apparatus comprising one or more processors implemented in circuitry and configured to:

determine data associated with a distance between an object and the apparatus;

determine a plurality of lens positions of a camera lens based on the data associated with the distance between the object and the apparatus;

determine, for each one of the plurality of lens positions, a respective focus value to generate a plurality of focus values, wherein, to determine, for each one of the plurality of lens positions, the respective focus value, the one or more processors are configured to determine, for each one of the plurality of lens positions, phase difference information; and

determine a final lens position based on the plurality of focus values, wherein, to determine the final lens position, the one or more processors are configured to determine whether the respective focus value for a particular lens position of the plurality of lens positions is within a threshold range from a peak focus value for the data associated with the distance between the object and the apparatus.

2. The apparatus of claim 1 , wherein the one or more processors are further configured to output instructions to move the camera lens to the final lens position.

3. The apparatus of claim 1 , wherein, to determine, for each one of the plurality of lens positions, the respective focus value, the one or more processors are further configured to determine, for each one of the plurality of lens positions, one or more of:

contrast information for a horizontal direction; or

contrast information for a vertical direction.

4. The apparatus of claim 1 , wherein, to determine the final lens position, the one or more processors are further configured to:

determine whether the respective focus value for the particular lens position corresponds to an estimated local maximum of focus values.

5. The apparatus of claim 4 , wherein, to determine the final lens position, the one or more processors are configured to skip a fine search in response to a determination that the respective focus value for the particular lens position is within the threshold range from the peak focus value for the distance of the object and a determination that the respective focus value for the particular lens position corresponds to the estimated local maximum of focus values.

6. The apparatus of claim 4 , wherein, to determine the final lens position, the one or more processors are configured to perform a fine search based on the plurality of focus values based on a determination that the respective focus value for the particular lens position is not within the threshold range from the peak focus value for the distance of the object and a determination that the respective focus value for the particular lens position does not correspond to the estimated local maximum of focus values.

7. The apparatus of claim 6 , wherein, to determine the final lens position, the one or more processors are configured to:

determine a start point for the fine search based on the plurality of lens position and the plurality of focus values;

determine a direction for the fine search based on the plurality of lens position and the plurality of focus values; or

determine a search range for the fine search based on the plurality of lens position and the plurality of focus values.

8. The apparatus of claim 1 , wherein, to determine the distance of the object, the one or more processors are configured to perform an active-depth assisted focus operation.

9. The apparatus of claim 1 , wherein, to determine the distance of the object, the one or more processors are configured to perform a course search.

10. The apparatus of claim 1 , wherein, to determine the distance of the object, the one or more processors are configured to perform phase detection auto focus (PDAF).

11. The apparatus of claim 1 , further comprising a camera configured to:

position the camera lens to the final lens position; and

capture an image with the camera lens positioned at the final lens position.

12. The apparatus of claim 11 , further comprising a display configured to output the image.

13. The apparatus of claim 1 , wherein the one or more processors are configured to cause the camera lens to move to each of the plurality of lens positions in response to determining the plurality of lens positions.

14. A method for image processing, the method comprising:

determining, with one or more processors implemented in circuitry, data associated with a distance between an object and a camera lens;

determining, with the one or more processors, a plurality of lens positions of the camera lens based on the data associated with the distance between the object and the camera lens;

determining, with the one or more processors and for each one of the plurality of lens positions, a respective focus value to generate a plurality of focus values, wherein determining, for each one of the plurality of lens positions, the respective focus value comprises determining, for each one of the plurality of lens positions, phase difference information; and

determining, with the one or more processors, a final lens position based on the plurality of focus values, wherein determining the final lens position comprises determining whether the respective focus value for a particular lens position of the plurality of lens positions is within a threshold range from a peak focus value for the data associated with the distance between the object and the camera lens.

15. The method of claim 14 , further comprising outputting, with the one or more processors, instructions to move the camera lens to the final lens position.

16. The method of claim 14 , wherein determining, for each one of the plurality of lens positions, the respective focus value, comprises determining, for each one of the plurality of lens positions, one or more of:

contrast information for a horizontal direction; or

contrast information for a vertical direction.

17. The method of claim 14 , wherein determining the final lens position further comprises:

determining whether the respective focus value for the particular lens position corresponds to an estimated local maximum of focus values.

18. The method of claim 17 , wherein determining the final lens position comprises skipping a fine search in response to a determination that the respective focus value for the particular lens position is within the threshold range from the peak focus value for the distance of the object and a determination that the respective focus value for the particular lens position corresponds to the estimated local maximum of focus values.

19. The method of claim 17 , wherein determining the final lens position comprises performing a fine search based on the plurality of focus values based on a determination that the respective focus value for the particular lens position is not within the threshold range from the peak focus value for the distance of the object and a determination that the respective focus value for the particular lens position does not correspond to the estimated local maximum of focus values.

20. The method of claim 19 , wherein determining the final lens position comprises:

determining a start point for the fine search based on the plurality of lens position and the plurality of focus values;

determining a direction for the fine search based on the plurality of lens position and the plurality of focus values; or

determining a search range for the fine search based on the plurality of lens position and the plurality of focus values.

21. The method of claim 14 , wherein determining the distance of the object comprises performing an active-depth assisted focus operation.

22. The method of claim 14 , wherein determining the distance of the object comprises performing a course search.

23. The method of claim 14 , wherein determining the distance of the object comprises performing phase detection auto focus (PDAF).

24. The method of claim 14 , further comprising:

positioning, with the one or more processors and with a camera, the camera lens to the final lens position; and

capturing, with the one or more processors and with the camera, an image with the camera lens positioned at the final lens position.

25. The method of claim 24 , further comprising outputting, with the one or more processors, the image at a display.

26. The method of claim 14 , further comprising causing, with the one or more processors, the camera lens to move to each of the plurality of lens positions in response to determining the plurality of lens positions.

27. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, configure one or more processors to:

determine data associated with a distance between an object and a camera lens;

determine a plurality of lens positions of the camera lens based on the data associated with the distance between the object and the camera lens;

determine, for each one of the plurality of lens positions, a respective focus value to generate a plurality of focus values, wherein the instructions that cause the one or more processors to determine, for each one of the plurality of lens positions, the respective focus value further cause the processor to determine, for each one of the plurality of lens positions, phase difference information; and

determine a final lens position based on the plurality of focus values, wherein, to determine the final lens position, the instructions further configure the one or more processors to determine whether the respective focus value for a particular lens position of the plurality of lens positions is within a threshold range from a peak focus value for the data associated with the distance between the object and the camera lens.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE SIGNING DATES FOR ALL INVENTORS PREVIOUSLY RECORDED ON REEL 055829 FRAME 0115. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 21, 2021
From: FENG, WEN-CHUN; KAO, HUI SHAN; LIU, HSUAN-MING
To: QUALCOMM INCORPORATED
Reel/Frame 056638/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2021
From: FENG, WEN-CHUN; KAO, HUI SHAN; LIU, HSUAN-MING
To: QUALCOMM INCORPORATED
Reel/Frame 055829/0115 →
Continuity (2)
Provisional Application 63090977 · Oct 13, 2020
Related Publication 20220116545A1 · Apr 14, 2022
Cited By (3)
US 12,335,613 US 12,389,116 US 12,568,705