IP Library Granted Patent US 10,115,003
Granted Patent B2
US 10,115,003 · App. 15/247,748 · Granted Oct 30, 2018

Image processing apparatus

Inventors: Vlad Georgescu (Brasov, RO); Mihai Constantin Munteanu (Brasov, RO); Petronel Bigioi (Galway, IE); Corneliu Zaharia (Brasov, RO); Szabolcs Fulop (Brasov, RO); Gyorgy Simon (Brasov, RO)
Assignee: FotoNation Limited
G06K9/00228G06T3/60G06T7/11G06T7/73G06T2207/10004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,115,003
App. No.
15/247,748
Granted
Oct 30, 2018
Kind
B2
Abstract

An image processing apparatus comprises a normalisation module operatively connected across a bus to a memory storing an image in which a region of interest (ROI) has been identified within the image. The ROI is bound by a rectangle having a non-orthogonal orientation within the image. In one embodiment, the normalisation module is arranged to divide the ROI into one or more slices, each slice comprising a plurality of adjacent rectangular tiles. For each slice, the apparatus successively reads ROI information for each tile from the memory including: reading a portion of the image extending across at least a width of the slice line-by-line along an extent of a slice. For each tile, the apparatus downsamples the ROI information to a buffer to within a scale S D <2 of a required scale for a normalised version of the ROI. The apparatus then fractionally downsamples and rotates downsampled information for a tile within the buffer to produce a respective normalised portion of the ROI at the required scale for the normalised ROI. Downsampled and rotated information is accumulated for each tile within a normalised ROI buffer for subsequent processing by the image processing apparatus.

Claims (41)

1. An image processing apparatus comprising a normalisation module operatively connected across a bus to a memory storing an image in which a region of interest (ROI) has been identified within the image, the ROI being bound by a rectangle having a non-orthogonal orientation within the image, the normalisation module being arranged to:

divide said ROI into one or more slices, each slice comprising a plurality of adjacent rectangular tiles;

for each slice, successively read ROI information for each tile from said memory including: reading a portion of said image extending across at least a width of said slice line-by-line along an extent of a slice;

for each tile, downsample said ROI information to a buffer to within a scale S D <2 of a required scale for a normalised version of said ROI; and fractionally downsample and rotate downsampled information for a tile within said buffer to produce a respective normalised portion of the ROI at the required scale for the normalised ROI; and

accumulate downsampled and rotated information for each tile within a normalised ROI buffer for subsequent processing by said image processing apparatus.

2. An image processing apparatus according to claim 1 wherein said ROI is divided into S slices and each slice is divided into T=S tiles.

3. An image processing apparatus according to claim 1 wherein said ROI is oriented at one of a fixed number of possible non-orthogonal orientations and the direction of reading successive slices and the order of reading successive tiles is a function of said orientation.

4. An image processing apparatus according to claim 3 wherein said fixed number is 8 and said orientations are evenly spaced from one another to detect objects at orientations within respective half-quadrant ranges of orientation.

5. An image processing apparatus according to claim 4 wherein successive tiles from ROI in adjacent half-quadrants are read in opposite directions.

6. An image processing apparatus according to claim 4 wherein successive slices from ROI in opposite hemispheres are read in opposite directions.

7. An image processing apparatus according to claim 3 wherein information for a slice is read from said memory beginning at a memory address corresponding to a leftmost pixel of a slice.

8. An image processing apparatus according to claim 1 wherein said portion of said image read from memory is constant for each line of a slice.

9. An image processing apparatus according to claim 8 wherein a start memory address for reading each line of a slice is advanced according to the non-orthogonal orientation of said ROI.

10. An image processing apparatus according to claim 8 wherein said advance is non-linear for a first tile of a slice.

11. An image processing apparatus according to claim 8 wherein said advance is linear for second and subsequent tiles of a slice.

12. An image processing apparatus comprising a normalisation module operatively connected across a bus to a memory storing an image in which a region of interest (ROI) has been identified within the image, the ROI being bound by a rectangle having a non-orthogonal orientation within the image, the normalisation module being arranged to:

read ROI information from said memory including: reading a portion of said image extending across at least a width of said ROI line-by-line along an extent of the ROI;

for successive sets of lines of said ROI, downsample said ROI information to a buffer to within a scale S D <2 of a required scale for a normalised version of said ROI;

for each set of lines, fractionally downsample and rotate downsampled information for the set of lines within said buffer to produce a respective normalised line of the ROI at the required scale for the normalised ROI; and

accumulate downsampled and rotated lines within a normalised ROI buffer for subsequent processing by said image processing apparatus.

13. An image processing apparatus according to claim 12 wherein information for a line is read from said memory beginning at a start memory address corresponding to a leftmost pixel of a line and extending to an end memory address corresponding to a rightmost pixel of a line.

14. An image processing apparatus according to claim 12 wherein said apparatus is arranged to calculate a shift in said start memory address and said end memory address according to the non-orthogonal orientation of said ROI.

15. An image processing apparatus according to claim 14 wherein said apparatus is arranged to recalculate said shifts at any line incorporating a corner of said ROI.

16. An image processing apparatus according to claim 12 wherein a number of lines in said buffer into which said downsampled information is written is a function of the orientation of said ROI.

17. An image processing apparatus according to claim 1 wherein said apparatus is arranged to selectively flip information for said ROI according to said non-orthogonal orientation so that objects within said normalised ROI buffer have a common orientation.

18. An image processing apparatus according to claim 1 wherein said ROI of interest comprises a face detected within said image.

19. An image processing apparatus according to claim 1 wherein said apparatus is further arranged to perform one or both of histogram equalisation or contrast enhancement of the information within said normalised ROI buffer.

20. An image processing apparatus according to claim 1 wherein said apparatus is further arranged to determine a mean intensity value of the information within said normalised ROI buffer.

21. An image processing apparatus according to claim 1 wherein said apparatus is further arranged to generate one or more of the following maps based on the information within said normalised ROI buffer:

an Integral Image (II)

an II 2 map

a Census map

a LBP (linear binary pattern)

a HOG (Histogram of Gradients) and

a Convolution of maps generated from a plurality of normalised ROI generated from respective images comprising similar content.

22. An image processing apparatus according to claim 1 wherein the normalisation module is responsive to the ROI being bound by a rectangle having an orthogonal orientation within the image to:

divide said ROI into one or more rectangular tiles; and

for each tile, successively read ROI information for each tile from said memory including:

reading a portion of said image extending across at least a width of said tile; and

downsampling information for a tile to produce a respective normalised portion of the ROI at the required scale for the normalised ROI; and

accumulating downsampled information for each tile within a normalised ROI buffer for subsequent processing by said image processing apparatus.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2016
From: GEORGESCU, VLAD; MUNTEANU, MIHAI CONSTANTIN; BIGIOI, PETRONEL; ZAHARIA, CORNELIU; FULOP, SZABOLCS; SIMON, GYORGY
To: FOTONATION LIMITED
Reel/Frame 040255/0016 →
Priority Claims (1)
WO PCT/EP2016/060827 · May 13, 2016 · international
Continuity (2)
Provisional Application 62210243 · Aug 26, 2015
Related Publication 20170061639A1 · Mar 2, 2017