IP Library › Granted Patent US 10,469,760
Granted Patent B2
US 10,469,760 · App. 15/726,666 · Granted Nov 5, 2019

High dynamic range imaging

Inventor: Vanjushin Igor' Valer'evich (Moscow, RU)
Assignee: Pinnacle Imaging Corporation
H04N5/2352G06T3/4015G06T5/009G06T5/50H04N5/2355H04N5/23245H04N9/045G06T2207/10024G06T2207/10144G06T2207/20208G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,469,760
App. No.
15/726,666
Granted
Nov 5, 2019
Kind
B2
Abstract

A high dynamic range video processing method performs merging and tone mapping techniques after a Bayer filter mosaic technique is performed and then converts it to red green blue (RGB) at the end as opposed to converting into RGB at the beginning and then performing merging and tone mapping after. The HDR processing is performed on Bayer-mosaic images and no de-mosaicing and color space conversions are required. The merging procedure has two modes: full-reset merging and LDR-updated merging. The first mode, full-reset merging, creates an HDR frame once the system has all image frames captured. The second mode, LDR-updating merging, means that any new HDR frame is obtained by an updating of a previous HDR frame with a new LDR frame data.

Claims (53)

1. A high dynamic resolution video processing method comprising:

passing light through a Bayer filter;

capturing the light by an image capture device to create a Bayer-mosaic image;

performing merging techniques on the Bayer-mosaic image; the merging techniques comprising a low dynamic range-updated merging mode comprising updating a previous high dynamic range frame with a new low dynamic range frame data to obtain a new high dynamic range frame;

wherein, during merging techniques, multiple frames of different exposures are used per high dynamic range capture;

performing tone mapping techniques on the Bayer-mosaic image;

converting results of the merging techniques and the tone mapping techniques to red green blue (RGB) data; and

outputting a high dynamic range image from the red green blue data.

2. The high dynamic resolution video processing method of claim 1 , the merging techniques comprising a full-reset merging mode.

3. The high dynamic resolution video processing method of claim 2 , the full-reset merging mode comprising:

merging of N consecutive frames 1, 2, 3, . . . N into a first high dynamic range image;

merging of a next series of N consecutive frames 1, 2, 3, . . . N into a second high dynamic range image; and

merging subsequent series of N consecutive frames 1, 2, 3, . . . N into subsequent high dynamic range images.

4. The high dynamic resolution video processing method of claim 2 , the full-reset merging mode comprising creating a high dynamic range frame once all multiple frames have been captured.

5. The high dynamic resolution video processing method of claim 1 , wherein no de-mosaicing or color space conversions are utilized to perform merging and tone mapping techniques.

6. The high dynamic resolution video processing method of claim 1 , wherein all high dynamic range processing techniques are performed in a logarithmic scale.

7. The high dynamic resolution video processing method of claim 1 , the tone mapping techniques comprising performing locally-adaptive tone mapping to a brightness range compression.

8. A high dynamic resolution video processing method comprising:

passing light through a Bayer filter;

capturing the light by an image capture device to create a Bayer-mosaic image;

performing merging techniques comprising a full-reset merging mode and a low dynamic range-updated merging mode on the Bayer-mosaic image; the low dynamic range-updated merging mode comprising updating a previous high dynamic range frame with a new low dynamic range frame data to obtain a new high dynamic range frame;

wherein, during merging techniques, multiple frames of different exposures are used per high dynamic range capture;

the full-reset merging mode comprising:

merging of N consecutive frames 1, 2, 3, . . . N into a first high dynamic range image;

merging of a next series of N consecutive frames 1, 2, 3, . . . N into a second high dynamic range image; and

merging subsequent series of N consecutive frames 1, 2, 3, . . . N into subsequent high dynamic range images;

performing tone mapping techniques on the Bayer-mosaic image;

converting results of the merging techniques and the tone mapping techniques to red green blue (RGB) data; and

outputting a high dynamic range image from the red green blue data.

9. The high dynamic resolution video processing method of claim 8 , the full-reset merging mode comprising creating a high dynamic range frame once all multiple frames have been captured.

10. The high dynamic resolution video processing method of claim 8 , wherein no de-mosaicing or color space conversions are utilized to perform merging and tone mapping techniques.

11. The high dynamic resolution video processing method of claim 8 , wherein all high dynamic range processing techniques are performed in a logarithmic scale.

12. The high dynamic resolution video processing method of claim 8 , the tone mapping techniques comprising performing locally-adaptive tone mapping to a brightness range compression.

13. A high dynamic resolution video processing method comprising:

passing light through a Bayer filter;

capturing the light by an image capture device to create a Bayer-mosaic image;

performing merging techniques comprising a full-reset merging mode and a low dynamic range-updated merging mode on the Bayer-mosaic image; the low dynamic range-updated merging mode comprising updating a high dynamic range frame with low dynamic range frames at a frame rate of the low dynamic range frames;

wherein, during merging techniques, multiple frames of different exposures are used per high dynamic range capture;

the full-reset merging mode comprising:

merging of N consecutive frames 1, 2, 3, . . . N into a first high dynamic range image;

merging of a next series of N consecutive frames 1, 2, 3, . . . N into a second high dynamic range image; and

merging subsequent series of N consecutive frames 1, 2, 3, . . . N into subsequent high dynamic range images;

performing tone mapping techniques on the Bayer-mosaic image;

converting results of the merging techniques and the tone mapping techniques to red green blue (RGB) data; and

outputting a high dynamic range image from the red green blue data.

14. A high dynamic resolution video processing method comprising:

passing light through a Bayer filter;

capturing the light by an image capture device to create a Bayer-mosaic image;

performing merging techniques on the Bayer-mosaic image; the merging techniques comprising a low dynamic range-updated merging mode comprising updating a high dynamic range frame with low dynamic range frames at a frame rate of the low dynamic range frames;

wherein, during merging techniques, multiple frames of different exposures are used per high dynamic range capture;

performing tone mapping techniques on the Bayer-mosaic image;

converting results of the merging techniques and the tone mapping techniques to red green blue (RGB) data; and

outputting a high dynamic range image from the red green blue data.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 043820 FRAME: 0957. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 11, 2017
From: VALER'EVICH, VANJUSHIN IGOR'
To: PINNACLE IMAGING CORPORATION
Reel/Frame 044173/0767 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2017
From: VALER'EVICH, VANJUSHIN IGOR'
To: PINACLE IMAGING CORPORATION
Reel/Frame 043820/0957 →
Continuity (2)
Continuation 15272904 · Sep 22, 2016
Related Publication 20180084176A1 · Mar 22, 2018