IP Library Granted Patent US 9,533,618
Granted Patent B2
US 9,533,618 · App. 14/642,510 · Granted Jan 3, 2017

Method, apparatus and system for processing a display from a surround view camera solution

Inventors: Buyue Zhang (Santa Clara, CA); Ibrahim Pekkucuksen (Dallas, TX); Vikram Appia (Dallas, TX); Aziz Umit Batur (Dallas, TX)
Assignee: TEXAS INSTRUMENTS INCORPORATED
B60R1/00G06T3/4038B60R2300/303B60R2300/607
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,533,618
App. No.
14/642,510
Granted
Jan 3, 2017
Kind
B2
Abstract

A method, apparatus and a system multi-camera image processing method. The method includes performing geometric alignment to produce a geometric output, performing photometric alignment to produce a photometric output and blending output, using data from the geometric alignment and the photometric alignment for performing synthesis function for at least one of blending and stitching images from the multi-cameras, and displaying an image from the synthesis function.

Claims (40)

1. A multi-camera image processing method, comprising:

performing geometric alignment to produce a geometric output, wherein performing the geometric alignment includes:

performing perspective correction on each of a plurality of frames;

performing corner detection in overlapping areas to find regions of interest;

filtering corner data to locate corners;

calculating a descriptor for each of the corners;

matching corners from two cameras using scores;

finding perspective matrices for each of the frames for minimizing distances between matched features; and

creating a geometric lookup table that encodes fisheye lens distortion correction and perspective transformation information, the method further comprising:

performing photometric alignment to produce a photometric output and a blending output;

using the geometric output and the photometric output for performing a synthesis function for at least one of blending and stitching images obtained from the two cameras; and

displaying an image obtained from the synthesis function.

2. The multi-camera image processing method of claim 1 , wherein the two cameras are two adjacent cameras, and wherein the synthesis function comprises using an alpha blend to blend images from the two adjacent cameras at a seam boundary to eliminate irregularities at the seam boundary caused by image data from the two adjacent cameras.

3. The multi-camera image processing method of claim 1 , wherein the geometric function comprises a camera calibration.

4. The multi-camera image processing method of claim 3 , wherein the camera calibration is at least one of a dynamic calibration and a one-time calibration.

5. The multi-camera image processing method of claim 1 , wherein the input to the synthesis function includes fisheye frames from the two cameras, the geometric output, the photometric output.

6. The multi-camera image processing method of claim 1 , wherein the geometric output, the photometric output and blending output are saved in a lookup table in a memory, a geometric lookup table and a photometric lookup table, respectively.

7. The multi-camera image processing method of claim 6 , wherein an output of the photometric lookup table has 255 entries for 8-bit data input.

8. The multi-camera image processing method of claim 1 , wherein the geometric alignment comprises camera calibration using calibration charts independent of any camera parameters.

9. An image processing system, comprising:

a memory; and

a processor coupled to the memory, the processor configured to:

perform geometric alignment to produce a geometric output;

perform perspective correction on each of a plurality of frames;

perform corner detection in overlapping areas to find regions of interest;

filter corner data to locate corners;

calculate a descriptor for each of the corners;

match the corners from two cameras using scores;

find perspective matrices for each of the frames for minimizing distances between matched features;

create a geometric lookup table that encodes fisheye lens distortion correction and perspective transformation information;

perform photometric alignment to produce a photometric output and blending output;

use the geometric output and the photometric output for performing a synthesis function for at least one of blending and stitching images obtained from the two cameras; and

display an image obtained from the synthesis function.

10. The image processing system of claim 9 , wherein the two cameras are two adjacent cameras, and wherein the synthesis function comprises using an alpha blend to blend images from the two adjacent cameras at a seam boundary to eliminate irregularities at the seam boundary caused by image data from the two adjacent cameras.

11. The image processing system of claim 9 , wherein the geometric function comprises a camera calibration.

12. The image processing system of claim 11 , wherein the camera calibration is at least one of a dynamic calibration and a one-time calibration.

13. The image processing system of claim 9 , wherein the input to the synthesis function includes fisheye frames from the multi-cameras, the geometric output, the photometric output.

14. The image processing system of claim 9 , wherein the geometric output, the photometric output and blending output are saved in a lookup table in the memory, a geometric lookup table and a photometric lookup table, respectively.

15. The image processing system of claim, wherein an output of the photometric lookup table has 255 entries for 8-bit data input.

16. The image processing system of claim 9 , wherein the geometric alignment comprises camera calibration using calibration charts independent of any camera parameters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2015
From: ZHANG, BUYUE; PEKKUCUKSEN, IBRAHIM; APPIA, VIKRAM; BATUR, AZIZ UMIT
To: TEXAS INSTRUMENTS INCORPORATED
Reel/Frame 035402/0406 →
Continuity (2)
Provisional Application 61949450 · Mar 7, 2014
Related Publication 20150254825A1 · Sep 10, 2015