IP Library Granted Patent US 10,614,550
Granted Patent B2
US 10,614,550 · App. 15/899,036 · Granted Apr 7, 2020

Decoding a bayer-mask or like coded image

Inventor: Michael James Knee (Petersfield, GB)
Assignee: SNELL ADVANCED MEDIA LIMITED
G06T3/4015G06T7/90G06T9/00H04N9/04515G06T2207/20024H04N2209/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,614,550
App. No.
15/899,036
Granted
Apr 7, 2020
Kind
B2
Abstract

A Bayer-mask image is decoded by forming a decoded green array; calculating a slope at each pixel of the array, expressed as an angle; calculating an activity at each pixel; converting the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle; expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal and filtering the Cartesian slope signal with a linear spatial filter to derive a slope measure. Blue-green and red-green values are calculated and interpolated using a slope-adaptive interpolation filter steered by said slope measure.

Claims (41)

1. An apparatus for decoding a Bayer-mask or like coded image comprising a value for one of a set of colors at each pixel of the image to provide a decoded value for each of the set of colors at each pixel of the image, the apparatus comprising:

a first interpolation filter configured to derive from the image an array having for a selected color a value at each pixel of the image, said array forming a first decoded color value output;

a slope detector configured to calculate a slope at each pixel of the array, expressed as a slope angle;

an activity measure configured to calculate an activity at each pixel;

a converter configured to convert the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle and expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal;

a slope filter configured to filter the Cartesian slope signal with a linear spatial filter to derive a slope measure;

a color difference unit configured to calculate from the array at each of the pixels a color difference signal associated with each other color;

a slope-adaptive interpolation filter steered by said slope measure configured to interpolate said color difference signals; and

a combiner configured to combine said interpolated color difference signals and said first decoded color value output to derive at least second and third decoded color value outputs.

2. The apparatus of claim 1 , wherein the selected color is green and the other colors are red and blue.

3. The apparatus of claim 1 , wherein the activity measure measures a gradient.

4. The apparatus of claim 3 , wherein the activity measure forms the absolute value of a gradient at each pixel and applies a spatial filter.

5. The apparatus of claim 1 , wherein the slope-adaptive interpolation filter comprises a set of differently angled interpolation filters, from which at least one filter is selected according to the slope measure.

6. The apparatus of claim 5 , wherein a cross-fade is formed from two filters selected according to the slope measure.

7. The apparatus of claim 1 , further comprising a mixer configured to form a mix between said color difference signals and said interpolated color difference signals and a mix control unit configured to predict the appropriateness of slope-adaptive interpolation.

8. The apparatus of claim 7 , wherein the slope-adaptive interpolation filter comprises a set of differently angled interpolation filters, from which at least one filter is selected according to the slope measure, each filter comprising a pair of one sided filters and wherein said mix control unit comprises a slope consistency unit configured to filter the Cartesian slope signal using pairs of said one-sided filters.

9. An imaging system comprising a light sensor array, a Bayer mask and an apparatus for decoding a Bayer-mask or like coded image comprising a value for one of a set of colors at each pixel of the image to provide a decoded value for each of the set of colors at each pixel of the image including:

a first interpolation filter configured to derive from the image an array having for a selected color a value at each pixel of the image, said array forming a first decoded color value output;

a slope detector configured to calculate a slope at each pixel of the array, expressed as a slope angle;

an activity measure configured to calculate an activity at each pixel;

a converter configured to convert the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle and expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal;

a slope filter configured to filter the Cartesian slope signal with a linear spatial filter to derive a slope measure;

a color difference unit configured to calculate from the array at each of the pixels a color difference signal associated with each other color;

a slope-adaptive interpolation filter steered by said slope measure configured to interpolate said color difference signals; and

a combiner configured to combine said interpolated color difference signals and said first decoded color value output to derive at least second and third decoded color value outputs.

10. A method in a processor of decoding a Bayer-mask or like coded image comprising a value for one of a set of colors at each pixel of the image to provide a decoded value for each of the set of colors at each pixel of the image, comprising the steps of:

deriving from the image an array having for a selected color a value at each pixel of the image, said array forming a first decoded color value output;

calculating a slope at each pixel of the array, expressed as a slope angle;

calculating an activity at each pixel;

converting the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle;

expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal and filtering the Cartesian slope signal with a linear spatial filter to derive a slope measure;

calculating from the array a color difference signal at each of the pixels associated with each other color; interpolating said color difference signals using

a slope-adaptive interpolation filter steered by said slope measure; and

combining said interpolated color difference signals and said first decoded color value output to derive at least second and third decoded color value outputs.

11. The method of claim 10 , wherein the selected color is green and the other colors are red and blue.

12. The method of claim 10 , wherein the step of calculating an activity at each pixel comprises measuring a gradient.

13. The method of claim 10 , wherein the step of calculating an activity at each pixel comprises forming the absolute value of a gradient at each pixel and applying a spatial filter.

14. The method of claim 10 , wherein the slope-adaptive interpolation filter comprises a set of differently angled interpolation filters, from which at least one filter is selected according to the slope measure.

15. The method of claim 14 , wherein the at least one filter is selected in accordance with a quantized slope angle.

16. The method of claim 14 , wherein said interpolated color difference signals are formed from a cross-fade between two filters.

17. The method of claim 10 , wherein a mix is formed between said color difference signals and said interpolated color difference signals, controlled by a measure predicting the appropriateness of slope-adaptive interpolation.

Assignments (6)
ASSIGNMENT OF INTELLECTUAL PROPERTY SECURITY AGREEMENTS Recorded Dec 12, 2025
From: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
To: MGG INVESTMENT GROUP LP
Reel/Frame 073959/0584 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT Recorded Mar 21, 2024
From: MGG INVESTMENT GROUP LP
To: GRASS VALLEY USA, LLC; GRASS VALLEY CANADA; GRASS VALLEY LIMITED
Reel/Frame 066867/0336 →
SECURITY INTEREST Recorded Mar 20, 2024
From: GRASS VALLEY CANADA; GRASS VALLEY LIMITED
To: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
Reel/Frame 066850/0869 →
GRANT OF SECURITY INTEREST - PATENTS Recorded Jul 2, 2020
From: GRASS VALLEY USA, LLC; GRASS VALLEY CANADA; GRASS VALLEY LIMITED
To: MGG INVESTMENT GROUP LP, AS COLLATERAL AGENT
Reel/Frame 053122/0666 →
CHANGE OF NAME Recorded Mar 9, 2020
From: SNELL ADVANCED MEDIA LIMITED
To: GRASS VALLEY LIMITED
Reel/Frame 052127/0795 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2018
From: KNEE, MICHAEL JAMES
To: SNELL ADVANCED MEDIA LIMITED
Reel/Frame 045438/0049 →