IP Library Patent Application 16991818
Patent Application
App. No. 16/991,818

METHOD AND SYSTEMS FOR AUTO WHITE BALANCE PROCESSING FOR AN IMAGE CAPTURE DEVICE WITH MULTIPLE IMAGE CAPTURE DEVICES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/991,818
Abstract

Methods for auto white balance (AWB) processing are described herein. An image capture device includes a first image capture device to capture a first image, a second image capture device to capture a second image, and an image signal processor. The image signal processor is configured to generate a global AWB scale based on the first image and the second image, apply a first image capture device calibration factor to the global AWB scale to generate a first image capture device AWB scale, apply a second image capture device calibration factor to the global AWB scale to generate a second image capture device AWB scale, compensate the first image using the first image capture device AWB scale, compensate the second image using the second image capture device AWB scale, and output an image based on the compensated first image and compensated second image.

Claims (78)

1 . An image capture device, comprising:

a first image capture device configured to capture a first image;

a second image capture device configured to capture a second image;

an image signal processor connected to the first image capture device and to the second image capture device, the image signal processor configured to:

generate a global auto white balance (AWB) scale based on the first image and the second image;

apply a first image capture device calibration factor to the global AWB scale to generate a first image capture device AWB scale;

apply a second image capture device calibration factor to the global AWB scale to generate a second image capture device AWB scale;

compensate the first image using the first image capture device AWB scale;

compensate the second image using the second image capture device AWB scale; and

output an image based on a compensated first image and a compensated second image.

2 . The image capture device of claim 1 , wherein the image signal processor is further configured to:

obtain first image statistics for the first image;

generate first image capture device AWB parameters based on the first image statistics; and

generate a first image capture device scale based on the first image capture device AWB parameters.

3 . The image capture device of claim 2 , wherein the image signal processor is further configured to:

obtain second image statistics for the second image;

generate second image capture device AWB parameters based on the second image statistics; and

generate a second image capture device scale based on the second image capture device AWB parameters.

4 . The image capture device of claim 3 , wherein the image signal processor is further configured to:

generate the global AWB scale from the first image capture device scale and the second image capture device scale.

5 . The image capture device of claim 4 , wherein the image signal processor is further configured to:

take a weighted average of the first image capture device scale and the second image capture device scale to generate the global AWB scale.

6 . The image capture device of claim 3 , wherein the image signal processor is further configured to:

apply color lens shading correction to the first image statistics; and

apply color lens shading correction to the second image statistics.

7 . The image capture device of claim 3 , wherein the image signal processor is further configured to:

discard first image statistics based on at least geometry of the first image capture device; and

discard second image statistics based on at least geometry of the second image capture device.

8 . The image capture device of claim 1 , wherein the first image capture device calibration factor and the second image capture device calibration factor are determined by comparing images from the first image capture device and images from the second image capture device against images from a reference device, respectively.

9 . The image capture device of claim 1 , wherein the image signal processor is further configured to:

obtain first image statistics for the first image;

apply the first image capture device calibration factor to the first image statistics; and

generate first image capture device AWB parameters based on the calibrated first image statistics.

10 . The image capture device of claim 9 , wherein the image signal processor is further configured to:

obtain second image statistics for the second image;

apply the second image capture device calibration factor to the second image statistics; and

generate second image capture device AWB parameters based on the calibrated second image statistics.

11 . The image capture device of claim 10 , wherein the image signal processor is further configured to:

generate the global AWB scale based on the first image capture device AWB parameters and the second image capture device AWB parameters.

12 . The image capture device of claim 11 , wherein the image signal processor is further configured to:

determine an illuminant based on the first image capture device AWB parameters and the second image capture device AWB parameters.

13 . The image capture device of claim 1 , wherein the first image capture device and the second image capture device are configured to provide 360° of coverage.

14 . An image capture device, comprising:

a first image capture device configured to capture a first image;

a second image capture device configured to capture a second image;

an auto white balance (AWB) processing unit configured to generate a global AWB scale based on the first image and the second image;

an allocation processing unit configured to apply a first image capture device calibration factor to the global AWB scale to generate a first image capture device AWB scale and apply a second image capture device calibration factor to the global AWB scale to generate a second image capture device AWB scale;

a compensation processing unit configured to compensate the first image using the first image capture device AWB scale and compensate the second image using the second image capture device AWB scale; and

a processing unit configured to output an image based on the compensated first image and compensated second image.

15 . A method for auto white balance (AWB) processing, the method comprising:

capturing an image by a first image capture device;

capturing an image by a second image capture device;

generating a global scale from the image captured by the first image capture device and from the image captured by the second image capture device;

applying a first image capture device calibration factor to the global scale to generate a first image capture device AWB scale;

applying a second image capture device calibration factor to the global scale to generate a second image capture device AWB scale;

compensating the image captured by the first image capture device using the first image capture device AWB scale;

compensating the image captured by the second image capture device using the second image capture device AWB scale; and

outputting an image based on a compensated image of the first image capture device and a compensated image of the first image capture device.

16 . The method of claim 15 , the method further comprising:

obtaining statistics for the image captured by the first image capture device;

generating AWB parameters based on the statistics for the image captured by the first image capture device;

generating a scale based on the AWB parameters for the image captured by the first image capture device;

obtaining statistics for the image captured by the second image capture device;

generating AWB parameters based on the statistics for the image captured by the second image capture device; and

generating a scale based on the AWB parameters for the image captured by the second image capture device.

17 . The method of claim 16 , the method further comprising:

generating the global scale from the scale for the image captured by the first image capture device and the scale for the image captured by the second image capture device.

18 . The method of claim 15 , the method further comprising:

obtaining statistics for the image captured by the first image capture device;

applying the first image capture device calibration factor to the statistics for the image captured by the first image capture device;

generating AWB parameters based on the calibrated statistics for the image captured by the first image capture device;

obtaining statistics for the image captured by the second image capture device;

applying the second image capture device calibration factor to the statistics for the image captured by the second image capture device; and

generating AWB parameters based on the calibrated statistics for the image captured by the second image capture device.

19 . The method of claim 18 , the method further comprising:

generating the global scale based on the AWB parameters for the image captured by the first image capture device and the AWB parameters for the image captured by the second image capture device.

20 . The method of claim 19 , the method further comprising:

determining an illuminant based on the AWB parameters for the image captured by the first image capture device and the AWB parameters for the image captured by the second image capture device.

Assignments (2)
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →