IP Library Granted Patent US 9,628,713
Granted Patent B2
US 9,628,713 · App. 14/524,807 · Granted Apr 18, 2017

Systems and methods for optical image stabilization using a digital interface

Inventors: Stephen Lloyd (Los Altos, CA); Mehran Ayat (Los Altos, CA)
Assignee: InvenSense, Inc.
H04N5/2328H04N5/23258H04N5/23287H04N5/23212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,628,713
App. No.
14/524,807
Granted
Apr 18, 2017
Kind
B2
Abstract

Systems and methods are disclosed for implementing optical image stabilization (OIS) in a mobile device. One or more functions associated with OIS may be performed by hardware and/or processing resources that are provided independently of a camera unit.

Claims (47)

1. An optical image stabilization (OIS) system comprising:

a first camera unit including a lens, an image sensor and an actuator for moving the lens relative to the image sensor along at least two orthogonal axes;

a motion sensor separate from the first camera unit including a gyroscope configured to sense angular velocity of the first camera unit on at least the two orthogonal axes;

a motion processor configured to determine movement of the first camera unit based at least in part on output from the motion sensor;

an OIS controller configured to output a signal corresponding to a compensating relative movement between the lens and image sensor in response to the determined movement of the first camera unit;

an actuator circuit for translating the output signal to actuator movement along the at least two orthogonal axes;

a digital interface coupling the actuator circuit and the OIS controller; and

a host processor configured to run a process utilizing output from the motion sensor, wherein the motion processor is configured to simultaneously provide output to the host processor and the OIS controller.

2. The OIS system of claim 1 , further comprising a position sensor configured to determine a position of the lens relative to the image sensor along the at least two orthogonal axes.

3. The OIS system of claim 2 , wherein the position sensor provides feedback to the actuator circuit.

4. The OIS system of claim 3 , further comprising a position circuit configured to receive output from the position sensor to determine the position of the lens relative to the image sensor.

5. The OIS system of claim 4 , wherein the position circuit, the actuator circuit and the OIS controller are implemented in a single package.

6. The OIS system of claim 4 , further comprising a position controller receiving feedback from the position circuit.

7. The OIS system of claim 1 , wherein the process utilizing output from the motion sensor comprises a user interface function.

8. The OIS system of claim 1 , wherein the motion sensor further comprises an accelerometer.

9. The OIS system of claim 8 , wherein the motion sensor further comprises a magnetometer and a pressure sensor.

10. The OIS system of claim 8 , wherein the output provided to the host processor by the motion processor comprises a result of a sensor fusion operation, wherein the host processor is configured to run a process utilizing output from the motion sensor.

11. The OIS system of claim 1 , further comprising a sensor hub receiving input from at least one additional sensor.

12. The OIS system of claim 1 , wherein the actuator moves the lens along three orthogonal axes and wherein the motion sensor senses motion along three orthogonal axes, further comprising an autofocus (AF) controller configured to output a signal corresponding to movement along at least one of the three orthogonal axes in response to the determined movement of the first camera unit.

13. The OIS system of claim 12 , further comprising an image processor receiving output from the image sensor, wherein the image processor provides focus information to the AF controller.

14. The OIS system of claim 1 , further comprising an image processor receiving output from the image sensor, wherein information from the image processor is used to assess the compensating relative movement between the lens and image sensor.

15. The OIS system of claim 1 , further comprising a second camera unit, wherein the OIS controller is further configured to output a signal corresponding to a compensating relative movement between a lens and an image sensor of the second camera unit in response to the determined movement.

16. A method for optically stabilizing an image, comprising:

providing a first camera unit including a lens, an image sensor and an actuator for moving the lens relative to the image sensor along at least two orthogonal axes;

sensing motion of the first camera unit using a motion sensor comprising a gyroscope separate from the first camera unit configured to sense angular velocity of the first camera unit on at least the two orthogonal axes;

processing the sensed motion using a motion processor to determine movement of the first camera unit;

determining a compensating relative movement between the lens and the image sensor in response to the determined movement of the first camera unit;

controlling the actuator to produce the compensating relative movement by sending an output signal from an OIS controller that determines the compensating relative movement to an actuator circuit for translating the output signal to actuator movement along the at least two orthogonal axes over a digital interface; and

simultaneously providing output from the motion processor to the host processor configured to run a process utilizing output from the motion sensor and the OIS controller.

17. The method of claim 16 , further comprising determining a position of the lens relative to the image sensor along the at least two orthogonal axes using a position sensor.

18. The method of claim 17 , further comprising providing feedback from the position sensor to the actuator circuit.

19. The method of claim 18 , further comprising performing a calibration routine using the feedback.

20. The method of claim 16 , further comprising simultaneously determining movement of the first camera unit and providing output to a host processor configured to run a process utilizing output from the motion sensor.

21. The method of claim 20 , wherein the process utilizing output from the motion sensor is a user interface function.

22. The method of claim 20 , wherein the motion sensor further comprises an accelerometer and providing the output to the host processor by the motion processor comprises performing a sensor fusion operation.

23. The method of claim 16 , wherein the actuator moves the lens along three orthogonal axes and wherein the motion sensor senses motion along three orthogonal axes, further comprising performing an autofocus (AF) process to output a signal corresponding to movement along at least one of the three orthogonal axes in response to the determined movement of the first camera unit.

24. The method of claim 23 , further comprising receiving output from the image sensor with an image processor, wherein the AF process includes focus information determined by the image processor.

25. The method of claim 16 , further comprising processing output from the image sensor to assess the compensating relative movement between the lens and image sensor.

26. The method of claim 25 , further comprising performing a calibration routine using the assessment of the compensating relative movement.

27. The method of claim 16 , further comprising calibrating the motion sensor and the actuator independently.

28. The method of claim 16 , further comprising:

providing a second camera unit including a lens, an image sensor and an actuator for moving the lens relative to the image sensor along at least two orthogonal axes;

determining a compensating relative movement between the lens and the image sensor of the second camera unit; and

controlling the actuator of the second camera unit to produce the compensating relative movement using the digital interface.

29. The OIS system of claim 1 , wherein the OIS controller and the actuator circuit are implemented in separate packages coupled by the digital interface.

30. The OIS system of claim 29 , wherein the OIS controller and the motion sensor are implemented in the same package.

31. The OIS system of claim 1 , wherein the OIS controller and the actuator circuit are implemented in a single package.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2014
From: LLOYD, STEPHEN; AYAT, MEHRAN
To: INVENSENSE INC.
Reel/Frame 034043/0936 →
Continuity (2)
Provisional Application 61954450 · Mar 17, 2014
Related Publication 20150319365A1 · Nov 5, 2015