IP Library Granted Patent US 10,356,346
Granted Patent B1
US 10,356,346 · App. 15/904,858 · Granted Jul 16, 2019

Method for compensating for off-axis tilting of a lens

Inventors: Piotr Stec (Galway, IE); Brian O'Sullivan (Galway, IE)
Assignee: FotoNation Limited
H04N5/3572G06T7/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,346
App. No.
15/904,858
Granted
Jul 16, 2019
Kind
B1
Abstract

A method for compensating for off-axis tilting of a lens relative to an image sensor in an image acquisition device comprises acquiring a set of calibrated parameters n → ≡ ( n x n y n z ) corresponding to the tilting of said lens. P x ′ and P y ′ indicate a coordinate of a pixel in an acquired image. Image information is mapped from the acquired image to a lens tilt compensated image according to the formulae: P x ′ = s n z ⁡ ( n z - 1 ) ⁢ ( ( n x 2 + n z ⁡ ( n z - 1 ) ) ⁢ u x + n x ⁢ n y ⁢ u y ) P y ′ = s n z ⁡ ( n z - 1 ) ⁢ ( ( n y 2 + n z ⁡ ( n z - 1 ) ) ⁢ u y + n x ⁢ n y ⁢ u x ) where s comprises a scale factor given by s = n z u x ⁢ n x + u y ⁢ n y + n z and where u x and u y indicate the location of a pixel in the lens tilt compensated image.

Claims (290)

1. An image acquisition system comprising a lens assembled to project an image onto an image sensor, where the lens is tilted relative to the image sensor, the image acquisition system including a calibration module configured to:

acquire a set of calibrated parameters

n

(

n

x

n

y

n

z

)

 corresponding to said tilting of said lens, where z is the optical axis relative to which said lens is tilted;

acquire an image from said image sensor through said lens, where P x ′ and P y ′ indicate a coordinate of a pixel in said acquired image;

map image information from said acquired image to a lens tilt compensated image according to the formulae:

P

x

=

s

n

z

(

n

z

-

1

)

(

(

n

x

2

+

n

z

(

n

z

-

1

)

)

u

x

+

n

x

n

y

u

y

)

P

x

=

s

n

z

(

n

z

-

1

)

(

(

n

x

2

+

n

z

(

n

z

-

1

)

)

u

x

+

n

x

n

y

u

y

)

where s comprises a scale factor given by

s

=

n

z

u

x

n

x

+

u

y

n

y

+

n

z

and where u x and u y indicate the location of a pixel in said lens tilt compensated image;

and store said lens tilt compensated image in a memory.

2. An image acquisition system according to claim 1 wherein said calibration module is configured to map image information by: selecting a pixel location u x , u y in said lens tilt compensated image, determining a corresponding coordinate P x ′, P y ′ in said acquired image, determining a plurality of pixel locations in said acquired image surrounding said coordinate, and interpolating pixel values for said surrounding pixel locations to determine a value for the pixel location in said lens tilt compensated image.

3. An image acquisition system according to claim 1 wherein said calibration module is configured to acquire said set of calibrated parameters

n

(

n

x

n

y

n

z

)

by:

acquiring a pair of calibrated scalar parameters NX, NY;

determining a length d=sqrt(NX 2 +NY 2 +1); and

calculating the components of {right arrow over (n)} as follows:

n x =NX/d

n y =NY/d

n z =1/ d.

4. An image acquisition system comprising a lens assembled to proiect an image onto an image sensor, while the lens is tilted relative to the image sensor, the image acquisition system including a calibration module configured to:

acquire a set of calibrated parameters

n

(

n

x

n

y

n

z

)

 corresponding to said tilting of said lens, where z is the optical axis relative to which said lens is tilted;

acquire an image from said image sensor through said lens, where p x and p y indicate a location of a pixel in a lens tilt compensated image;

map image information from said lens tilt compensated image to said acquired image according to the formulae:

p

x

λ

n

z

(

1

+

n

z

)

(

(

n

x

2

+

n

z

(

1

+

n

z

)

)

p

x

+

n

x

n

y

p

y

)

p

y

λ

n

z

(

1

+

n

z

)

(

(

n

y

2

+

n

z

(

1

+

n

z

)

)

p

y

+

n

x

n

y

p

x

)

where λ comprises a scale factor given by:

λ

=

n

z

n

z

-

n

x

p

x

-

n

y

p

y

;

and

store said lens tilt compensated image in a memory.

5. An image acquisition system according to claim 4 wherein said calibration module is configured to map image information by: selecting a pixel location p x , p y in said lens tilt compensated image, determining a corresponding coordinate in said acquired image, determining a plurality of pixel locations in said acquired image surrounding said coordinate, and interpolating pixel values for said surrounding pixel locations to determine a value for the pixel location in said lens tilt compensated image.

6. An image acquisition system according to claim 4 wherein said calibration module is configured to acquire said set of calibrated parameters

n

(

n

x

n

y

n

z

)

by:

acquiring a pair of calibrated scalar parameters NX, NY;

determining a length d=sqrt(NX 2 +NY 2 +1); and

calculating the components of {right arrow over (n)} as follows:

n x =NX/d

n y =NY/d

n z =1/ d.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2018
From: STEC, PIOTR; O'SULLIVAN, BRIAN
To: FOTONATION LIMITED
Reel/Frame 045068/0122 →