IP Library Granted Patent US 10,713,820
Granted Patent B2
US 10,713,820 · App. 15/214,619 · Granted Jul 14, 2020

System and method for adjusting brightness in multiple images

Inventors: Kongqiao Wang (Beijing, CN); Junzhou Mou (Beijing, CN)
Assignee: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
G06T11/001G06T3/4038G06T5/50G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,820
App. No.
15/214,619
Granted
Jul 14, 2020
Kind
B2
Abstract

A device is provided for adjusting brightness of a plurality of images each including a plurality of pixels. The device may include a memory configured to store instructions. The device may also include a processor configured to execute the instructions to determine overall luminance values of the images. The processor may also be configured to determine, from the images, a reference image and a reference overall luminance value based on the overall luminance values. The processor may further be configured to determine adjustment factors for the images based on the reference overall luminance value of the reference image, determine weighting factors for the pixels in an image to be adjusted, and adjust luminance values of the pixels in the image to be adjusted based on an adjustment factor for the image and the weighting factors for the pixels.

Claims (70)

1. A device for adjusting brightness of a plurality of images each including a plurality of pixels, comprising:

a memory configured to store instructions; and

a processor configured to execute the instructions to:

determine an overall luminance value of each of the plurality of images;

determine a reference overall luminance value, among the overall luminance values of the plurality of images;

determine a reference image, among the plurality of images, corresponding to the reference overall luminance value;

determine adjustment factors for the images based on the reference overall luminance value of the reference image;

determine weighting factors for the pixels in an image to be adjusted, the weighting factors varying based on luminance values of the pixels obtained before adjustment; and

adjust the luminance values of the pixels in the image to be adjusted based on an adjustment factor for the image and the weighting factors for the pixels;

wherein the weighting factors for the pixels in the image to be adjusted monotonically change as a function of the luminance values of the pixels obtained before adjustment;

wherein the weighting factors monotonically change as the luminance values of the pixels obtained before adjustment vary within a range between zero and a predetermined maximum luminance value;

wherein when the adjustment factor for the image to be adjusted is greater than a predetermined factor, the weighting factors for the pixels monotonically decrease within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value; and

wherein when the adjustment factor for the image to be adjusted is less than a predetermined factor, the weighting factors for the pixels monotonically increase within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value.

2. The device of claim 1 , wherein the processor is further configured to execute the instructions to, for the image to be adjusted:

determine luminance adjustment amount values for pixels of the image based on:

the adjustment factor determined for the image; and

the weighting factors determined for the pixels; and

adjust the luminance values of the pixels based on the luminance adjustment amount values.

3. The device of claim 1 , wherein the processor is further configured to execute the instructions to:

after adjusting the luminance values of the pixels in the images, stitch the images to obtain a combined image.

4. The device of claim 3 , wherein the combined image is a 360-degree panoramic view.

5. The device of claim 1 , wherein the processor is further configured to execute the instructions to:

obtain a statistical value based on the overall luminance values of the plurality of images; and

compare each of the overall luminance values with the statistical value to determine an overall luminance value closest to the statistical value as the reference overall luminance value.

6. The device of claim 5 , wherein the statistical value is an average of the overall luminance values of the plurality of images; or

the statistical value is a median value of the overall luminance values of the plurality of images.

7. The device of claim 1 , wherein the overall luminance value of each of the plurality of images is determined based on luminance values of all of the plurality of pixels in the each image.

8. A method for adjusting brightness of a plurality of images each including a plurality of pixels, comprising:

determining an overall luminance value of each of the plurality of images;

determining a reference overall luminance value, among the overall luminance values of the plurality of images;

determining a reference image, among the plurality of images, corresponding to the reference overall luminance value;

determining adjustment factors for the images based on the reference overall luminance value of the reference image;

determining weighting factors for the pixels in an image to be adjusted, the weighting factors varying based on luminance values of the pixels obtained before adjustment; and

adjusting the luminance values of the pixels in the image to be adjusted based on an adjustment factor for the image and the weighting factors for the pixels;

wherein the weighting factors for the pixels in the image to be adjusted monotonically change as a function of the luminance values of the pixels obtained before adjustment;

wherein the weighting factors monotonically change as the luminance values of the pixels obtained before adjustment vary within a range between zero and a predetermined maximum luminance value;

wherein when the adjustment factor for the image to be adjusted is greater than a predetermined factor, the weighting factors for the pixels monotonically decrease within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value; and

wherein when the adjustment factor for the image to be adjusted is less than a predetermined factor, the weighting factors for the pixels monotonically increase within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value.

9. The method of claim 8 , further comprising:

for the image to be adjusted,

determining luminance adjustment amount values for pixels of the image based on:

the adjustment factor determined for the image; and

the weighting factors determined for the pixels; and

adjusting the luminance values of the pixels based on the luminance adjustment amount values.

10. The method of claim 8 , further comprising:

after adjusting the luminance values of the pixels in the images, stitching the images to obtain a combined image.

11. The method of claim 10 , wherein the combined images is a 360-degree panoramic view.

12. The method of claim 8 , wherein determining a reference overall luminance value among the overall luminance values of the plurality of images comprises:

obtaining a statistical value based on the overall luminance values of the plurality of images; and

comparing each of the overall luminance values with the statistical value to determine an overall luminance value closest to the statistical value as the reference overall luminance value.

13. The method of claim 12 , wherein the statistical value is an average of the overall luminance values of the plurality of images; or

the statistical value is a median value of the overall luminance values of the plurality of images.

14. The method of claim 8 , wherein the overall luminance value of each of the plurality of images is determined based on luminance values of all of the plurality of pixels in the each image.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform a method for adjusting brightness of a plurality of images each including a plurality of pixels, the method comprising:

determining an overall luminance value of each of the plurality of images;

determining a reference overall luminance value, among the overall luminance values of the plurality of images;

determining a reference image, among the plurality of images, corresponding to the reference overall luminance value;

determining adjustment factors for the images based on the reference overall luminance value of the reference image;

determining weighting factors for the pixels in an image to be adjusted, the weighting factors varying based on luminance values of the pixels obtained before adjustment; and

adjusting luminance values of the pixels in the image to be adjusted based on an adjustment factor for the image and the weighting factors for the pixels;

wherein the weighting factors for the pixels in the image to be adjusted monotonically change as a function of the luminance values of the pixels obtained before adjustment;

wherein the weighting factors monotonically change as the luminance values of the pixels obtained before adjustment vary within a range between zero and a predetermined maximum luminance value;

wherein when the adjustment factor for the image to be adjusted is greater than a predetermined factor, the weighting factors for the pixels monotonically decrease within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value; and

wherein when the adjustment factor for the image to be adjusted is less than a predetermined factor, the weighting factors for the pixels monotonically increase within a predetermine range as the luminance values of the pixels obtained before adjustment increase from zero to the predetermined maximum luminance value.

16. The non-transitory computer-readable storage medium of claim 15 , wherein determining a reference overall luminance value among the overall luminance values of the plurality of images comprises:

obtaining a statistical value based on the overall luminance values of the plurality of images; and

comparing each of the overall luminance values with the statistical value to determine an overall luminance value closest to the statistical value as the reference overall luminance value.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the statistical value is an average of the overall luminance values of the plurality of images; or

the statistical value is a median value of the overall luminance values of the plurality of images.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the overall luminance value of each of the plurality of images is determined based on luminance values of all of the plurality of pixels in the each image.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2024
From: EAST WEST BANK
To: KAMI VISION INCORPORATED
Reel/Frame 070792/0551 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 28, 2022
From: KAMI VISION INCORPORATED
To: EAST WEST BANK
Reel/Frame 059512/0101 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
To: KAMI VISION INC.
Reel/Frame 059275/0652 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY'S NAME TO "SHANGHAI XIAOYI TECHNOLOGY CO., LTD." PREVIOUSLY RECORDED ON REEL 039740 FRAME 0849. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNOR HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 31, 2018
From: WANG, KONGQIAO; MOU, JUNZHOU
To: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 047110/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2016
From: WANG, KONGQIAO; MOU, JUNZHOU
To: XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 039740/0849 →
Priority Claims (1)
CN 2016 1 0496593 · Jun 29, 2016 · national
Continuity (1)
Related Publication 20180005410A1 · Jan 4, 2018