IP Library Granted Patent US 10,362,303
Granted Patent B2
US 10,362,303 · App. 14/557,476 · Granted Jul 23, 2019

Sensor-assisted autofocus calibration

Inventors: Daniel Kravitz (Petah Tikva, IL); Niv Gilboa (Ra'anana, IL); Yohai Zmora (Ganei Tikva, IL); Zafrir Mor (Ein Habsor, IL); Jonathan Pokrass (Bat Yam, IL)
Assignee: APPLE INC.
H04N17/002G03B13/36H04N5/2257H04N5/23212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,362,303
App. No.
14/557,476
Granted
Jul 23, 2019
Kind
B2
Abstract

A mobile device includes a camera module, including a lens and an image sensor. An inertial sensor in the mobile device outputs a signal indicative of an orientation of the device. A controller corrects one or more focal properties of the camera module responsively to the orientation indicated by the inertial sensor.

Claims (30)

1. A mobile device, comprising:

a camera module, comprising a lens and an image sensor that lie along a focal axis;

an inertial sensor, which is configured to output a signal indicative of an orientation of the device; and

a controller, which is configured to correct for a displacement, between the lens and the image sensor, in a direction that is transverse to the focal axis, caused by a change in a direction of gravitational pull on components of the camera module that results from the mobile device being turned on its side, responsively to:

the signal from the inertial sensor indicating that the mobile device is being held on its side, and

stored values indicative of a dependence of the displacement on the orientation.

2. The device according to claim 1 , and comprising a temperature sensor, wherein the controller is configured to correct for the displacement responsively to a temperature indicated by the temperature sensor.

3. The device according to claim 1 , wherein the controller is configured to correct for the displacement by processing electronic images output by the camera module.

4. The device according to claim 1 , wherein the controller is further configured to correct, responsively to the orientation indicated by the signal from the inertial sensor, for a deviation in a distance, along the focal axis, between the lens and the image sensor.

5. The device according to claim 4 , wherein the controller is configured to correct for the deviation by adjusting the distance between the lens and the image sensor.

6. The device according to claim 5 , wherein the camera module comprises an autofocus mechanism, and wherein the controller is configured to adjust the autofocus mechanism responsively to the orientation in order to correct for the deviation in the distance between the lens and the image sensor.

7. The device according to claim 1 , wherein the stored values include tables of values of the displacement for different orientation angles of the device.

8. The device according to claim 1 , wherein the stored values include constants derived by fitting a function to calibration measurements of the displacement.

9. The device according to claim 1 , wherein the stored values indicate, for the orientation indicated by the signal from the inertial sensor, a corresponding deviation in a position of a center of the image sensor, and wherein the controller is configured to correct for the displacement by using the stored values to determine the deviation.

10. The device according to claim 1 , wherein the stored values include calibration parameters that were derived by finding a transverse shift of an image of a target relative to a known reference image of the target.

11. A method for imaging, comprising:

capturing electronic images using a camera module in a mobile device, the camera module comprising a lens and an image sensor that lie along a focal axis;

receiving, from an inertial sensor in the mobile device, a signal indicative of an orientation of the device; and

correcting for a displacement, between the lens and the image sensor, in a direction that is transverse to the focal axis, caused by a change in a direction of gravitational pull on components of the camera module that results from the mobile device being turned on its side, responsively to:

the signal from the inertial sensor indicating that the mobile device is being held on its side, and

stored values indicative of a dependence of the displacement on the orientation.

12. The method according to claim 11 , wherein the mobile device comprises a temperature sensor, and wherein correcting for the displacement comprises correcting for the displacement responsively to a temperature indicated by the temperature sensor.

13. The method according to claim 11 , wherein correcting for the displacement comprises processing electronic images output by the camera module.

14. The method according to claim 11 , further comprising, responsively to the orientation indicated by the signal from the inertial sensor, correcting for a deviation in a distance, along the focal axis, between the lens and the image sensor.

15. The method according to claim 14 , wherein correcting for the deviation comprises correcting the distance between the lens and the image sensor.

16. The method according to claim 15 , wherein the camera module comprises an autofocus mechanism, and wherein correcting the distance comprises adjusting the autofocus mechanism responsively to the orientation.

17. The method according to claim 11 , wherein the stored values include tables of values of the displacement for different orientation angles of the device.

18. The method according to claim 11 , wherein the stored values include constants derived by fitting a function to calibration measurements of the displacement.

19. The method according to claim 11 , wherein the stored values indicate, for the orientation indicated by the signal from the inertial sensor, a corresponding deviation in a position of a center of the image sensor, and wherein correcting for the displacement comprises correcting for the displacement by using the stored values to determine the deviation.

20. The method according to claim 11 , wherein the stored values include calibration parameters that were derived by finding a transverse shift of an image of a target relative to a known reference image of the target.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2014
From: KRAVITZ, DANIEL; GILBOA, NIV; ZMORA, YOHAI; MOR, ZAFRIR; POKRASS, JONATHAN
To: APPLE INC.
Reel/Frame 034294/0724 →
Continuity (2)
Provisional Application 61910998 · Dec 3, 2013
Related Publication 20150156485A1 · Jun 4, 2015
Cited By (1)
US 12,493,197