IP Library › Granted Patent US 10,412,306
Granted Patent B1
US 10,412,306 · App. 16/107,622 · Granted Sep 10, 2019

Optical image stabilization method and apparatus

Inventors: Mehul Soman (Sunnyvale, CA); Victor Kulik (San Jose, CA); Russel Allyn Martin (Menlo Park, CA)
Assignee: QUALCOMM Incorporated
H04N5/23287H04N5/23258H04N5/23299H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,412,306
App. No.
16/107,622
Granted
Sep 10, 2019
Kind
B1
Abstract

Disclosed are systems, devices, and methods for compensating for roll blur in an optical image stabilization (OIS) module. An OIS controller receives a selection for one or more areas of interest (AOI), each AOI associated with an image optimization point (IOP), and each IOP is associated with an X position (X pos ) and a Y position (Y pos ). The OIS controller receives gyroscope data comprising X axis rotation data (X gyro ), Y axis rotation data (Y gyro ) and Z axis rotation data (Z gyro ). The OIS controller generates adjusted X axis rotation data (X gyro_adj ) and Y axis rotation data (Y gyro_adj ), wherein X gyro_adj and Y gyro_adj based on the Z axis rotation data and the one or more IOPs and adjusts lens shift gain on the basis of X gyro_adj and Y gyro_adj and adjusts lens movement based at least in part on the lens shift gain.

Claims (50)

1. A method for image stabilization comprising:

receiving a selection for one or more areas of interest (AOI), the AOI having one or more image optimization points (IOPs), wherein each IOP is associated with an X position (X pos ) and a Y position (Y pos );

receiving gyroscope data comprising X axis rotation data (X gyro ), Y axis rotation data (Y gyro ) and Z axis rotation data (Z gyro );

generating adjusted X axis rotation data (X gyro_adj ) and adjusted Y axis rotation data (Y gyro_adj ), based at least in part on the Z axis rotation data and the one or more IOPs;

generating an adjusted lens shift gain based at least in part on X gyro_adj and Y gyro_adj ; and

adjusting lens movement based at least in part on the adjusted lens shift gain.

2. The method of claim 1 , wherein:

X gyr_adj =X gyro ±Y pos *Z gyro

Y gyr_adj =Y gyro ±X pos *Z gyro .

3. The method of claim 1 , wherein the selection of one or more AOIs is based at least in part upon a user selection on a touchscreen.

4. The method of claim 1 , wherein the selection of one or more AOIs is based at least in part upon tracking an object within a field of view of a lens.

5. The method of claim 1 , wherein the selection of one or more AOIs is based upon an auto focus algorithm.

6. The method of claim 1 , wherein the selection of one or more AOIs is based upon a maximum blur measurement.

7. The method of claim 1 , wherein the one or more AOIs is defined in terms of pixels.

8. The method of claim 1 , wherein the one or more AOIs is defined in terms of deviation angle from image center.

9. The method of claim 1 , wherein the one or more IOPs is based upon a weighted average of the one or more AOIs.

10. An apparatus for adjusting lens movement, comprising:

a lens;

a gyroscope; and

an OIS controller, wherein the OIS controller is operably configured to:

receive a selection for one or more areas of interest (AOI), the AOI having one or more image optimization points (IOPs), wherein each IOP is associated with an X position (X pos ) and a Y position (Y pos );

receive gyroscope data comprising X axis rotation data (X gyro ), Y axis rotation data (Y gyro ) and Z axis rotation data (Z gyro );

adjust lens shift gain, wherein adjusting lens shift gain comprises generating adjusted X axis rotation data (X gyro_adj ) and Y axis rotation data (Y gyro_adj ), wherein X gyro_adj and Y gyro_adj are generated based at least in part on the Z axis rotation data and the one or more IOPs; and

adjust lens movement based at least in part on the lens shift gain.

11. The apparatus of claim 10 , wherein:

X gyr_adj =X gyro ±Y pos *Z gyro

Y gyr_adj =Y gyro ±X pos *Z gyro .

12. The apparatus of claim 10 , wherein the selection of one or more AOIs is based at least in part upon a user selection on a touchscreen.

13. The apparatus of claim 10 , wherein the selection of one or more AOIs is based at least in part upon tracking an object within a field of view of the lens.

14. The apparatus of claim 10 , wherein the selection of one or more AOIs is based upon an auto focus algorithm.

15. The apparatus of claim 10 , wherein the selection of one or more AOIs is based upon a maximum blur measurement.

16. The apparatus of claim 10 , wherein the one or more AOIs is defined in terms of pixels.

17. The apparatus of claim 10 , wherein the one or more AOIs is defined in terms of deviation angle from image center.

18. The apparatus of claim 10 , wherein the one or more IOPs is based upon a weighted average of the one or more AOIs.

19. An image stabilizer comprising:

means for adjusting lens movement to image movement in an optical wherein the means for adjusting lens movement comprises a lens and an image sensor optically coupled with the lens and a means for controlling the lens movement, wherein the means for controlling is operably configured for:

receiving a selection for one or more areas of interest (AOI), the AOI having one or more image optimization points (IOPs), wherein each IOP is associated with an X position (X pos ) and a Y position (Y pos );

receiving gyroscope data comprising X axis rotation data (X gyro ), Y axis rotation data (Y gyro ) and Z axis rotation data (Z gyro );

adjusting lens shift gain, wherein adjusting lens shift gain comprises generating adjusted X axis rotation data (X gyro_adj ) and Y axis rotation data (Y gyro_adj ), wherein X gyro_adj and Y gyro_adj are generated based at least in part on the Z axis rotation data and the one or more IOPs; and

adjusting lens movement based at least in part on the lens shift gain.

20. The image stabilizer of claim 19 , wherein:

X gyr_adj =X gyro ±Y pos *Z gyro

Y gyr_adj =Y gyro ±X pos *Z gyro .

21. The image stabilizer of claim 19 , wherein the selection of one or more AOIs is based at least in part upon a user selection on a touchscreen.

22. The image stabilizer of claim 19 , wherein the selection of one or more AOIs is based at least in part upon tracking an object within a field of view of the lens.

23. The image stabilizer of claim 19 , wherein the selection of one or more AOIs is based upon an auto focus algorithm.

24. The image stabilizer of claim 19 , wherein the selection of one or more AOIs is based upon a maximum blur measurement.

25. The image stabilizer of claim 19 , wherein the one or more AOIs is defined in terms of pixels.

26. The image stabilizer of claim 19 , wherein the one or more AOIs is defined in terms of deviation angle from image center.

27. The image stabilizer of claim 19 , wherein the one or more IOPs is based upon a weighted average of the one or more AOIs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2019
From: SOMAN, MEHUL; KULIK, VICTOR; MARTIN, RUSSEL ALLYN
To: QUALCOMM INCORPORATED
Reel/Frame 048458/0394 →
Cited By (1)
US 12,335,618