IP Library Granted Patent US 11,044,418
Granted Patent B2
US 11,044,418 · App. 16/044,228 · Granted Jun 22, 2021

Three camera alignment in mobile devices

Inventor: Kuochin Chang (Cupertino, CA)
Assignee: Black Sesame International Holding Limited
H04N5/247G03B13/36G06T7/85H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,418
App. No.
16/044,228
Granted
Jun 22, 2021
Kind
B2
Abstract

A three camera alignment system, having a first camera module having a first fixed zoom, a second camera module having a second fixed zoom coupled to the first camera module, wherein the second camera module is calibrated to the first camera module and a third camera module having a third fixed zoom coupled to at least one of the first camera module and the second camera module and wherein the third camera module is aligned to the calibrated first camera module and second camera module based on block matching along epipolar lines.

Claims (16)

1. A three camera alignment system, comprising:

a first camera module of a mobile device having a first fixed zoom and outputting a first zoomed image;

a second camera module of the mobile device having a second fixed zoom coupled to the first camera module and outputting a second zoomed image, wherein the second camera module is calibrated to the first camera module and the first zoomed image is fused to the second zoomed image, wherein the second fixed zoom is greater than the first fixed zoom and wherein a second field of view of the second camera module is nested completely within a first field of view of the first camera module and the first camera module of the mobile device is mated to the second camera module of the mobile device; and

a third camera module of the mobile device having a third fixed zoom and outputting a second zoomed image is coupled to at least one of the first camera module and the second camera module, wherein the third camera module is aligned to the first camera module and the first zoomed image is fused to the third zoomed image or the second camera module and the second zoomed image is fused to the third zoomed image based on block matching along epipolar lines and wherein the third fixed zoom is greater than the second fixed zoom and wherein a third field of view of the third camera module is nested completely within the second field of view of the second camera module which is nested completely within a first field of view of the first camera module and the third camera module of the mobile device is mated to the first camera module of the mobile device.

2. The three camera alignment system of claim 1 , wherein the third camera module is algorithmically rotated to align the third camera module with the first or second camera module to calibrate out misalignments between the third camera module and the respective camera module.

3. The three camera alignment system of claim 1 , wherein the third camera module is algorithmically shifted to align the third camera module with the first or second camera module to calibrate out misalignments between the third camera module and the respective camera module.

4. The three camera alignment system of claim 1 , wherein the second camera module to first camera module calibration pre-defines a relationship between a disparity and a z-distance.

5. The three camera alignment system of claim 1 , wherein at least one of the first camera module, the second camera module and the third camera module is auto focus.

6. A three camera alignment method, comprising:

calibrating a first camera module of a mobile device having a first fixed zoom and outputting a first zoomed image and a second camera module of the mobile device having a second fixed zoom and outputting a second zoomed image, wherein the second fixed zoom is greater than the first fixed zoom and wherein a second field of view of the second camera module is nested completely within a first field of view of the first camera module and the first zoomed image is fused to the second zoomed image and the first camera module of the mobile device is mated to the second camera module of the mobile device;

block matching a third camera module of the mobile device having a third fixed zoom and outputting a third zoomed image to the calibrated first camera module and the first zoomed image is fused to the third zoomed image or the second camera module and the second zoomed image is fused to the third zoomed image, wherein the block matching is based on epipolar lines and wherein the third fixed zoom is greater than the second fixed zoom and wherein a third field of view of the third camera module is nested completely within the second field of view of the second camera module which is nested completely within a first field of view of the first camera module and the third camera module of the mobile device is mated to the first camera module of the mobile device; and

aligning the third camera module to the calibrated first camera module and second camera module of the mobile device.

7. The three camera alignment method of claim 6 , further comprising algorithmically rotating the third camera module to align the third camera module with the first or second camera module to calibrate out misalignments between the third camera module and the respective camera module.

8. The three camera alignment method of claim 6 , further comprising algorithmically shifting the third camera module to align the third camera module with the first or second camera module to calibrate out misalignments between the third camera module and the respective camera module.

9. The three camera alignment method of claim 6 , wherein the second camera module to first camera module calibration pre-defines a relationship between a disparity and a z-distance.

10. The three camera alignment method of claim 6 , wherein at least one of the first camera module, the second camera module and the third camera module is auto focus.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: BLACK SESAME INTERNATIONAL HOLDING LIMITED
To: BLACK SESAME TECHNOLOGIES INC.
Reel/Frame 058301/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2019
From: CHANG, KUOCHIN
To: BLACK SESAME INTERNATIONAL HOLDING LIMITED
Reel/Frame 050158/0681 →
Continuity (1)
Related Publication 20200036905A1 · Jan 30, 2020
Cited By (1)
US 12,250,462