IP Library Granted Patent US 10,628,568
Granted Patent B2
US 10,628,568 · App. 15/472,624 · Granted Apr 21, 2020

Biometric recognition system

Inventors: Adrian Zamfir (Bucharest, RO); Andreea Oana Miu (Bucharest, RO); Corneliu Florea (Bucharest, RO)
Assignee: FotoNation Limited
G06F21/32G01C19/5776G01P15/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,568
App. No.
15/472,624
Granted
Apr 21, 2020
Kind
B2
Abstract

A biometric recognition system for a hand held computing device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope is disclosed. A tremor analysis component is arranged to: obtain from the IMU, accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as a gyroscope signal indicating rotational velocity about the Y axis during a measurement window. Each of the IMU signals is filtered to provide filtered frequency components for the signals during the measurement window. The accelerometer signals are combined to provide a combined filtered accelerometer magnitude signal for the measurement window. A spectral density estimation is provided for each of the combined filtered accelerometer magnitude signal and the filtered gyroscope signal. An irregularity is determined for each spectral density estimation; and based on the determined irregularities, the tremor analysis component attempts to authenticate a user of the device.

Claims (588)

1. A biometric recognition system for a hand held computing device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope, said system comprising a tremor analysis component arranged to:

obtain from said IMU accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as a gyroscope signal indicating rotational velocity about the Y axis during a measurement window;

filter each of said IMU signals to provide filtered frequency components for said signals during said measurement window;

provide a spectral density estimation for each of said filtered accelerometer magnitude signal and said filtered gyroscope signal;

determine an irregularity for each spectral density estimation, each spectral density estimation comprising a periodogram, wherein said irregularity comprises;

and irregularity (IJ P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows;

IJ

p

=

i

=

1

N

-

1

(

p

m

(

i

)

-

p

m

(

i

+

1

)

)

2

i

=

1

N

-

1

(

p

m

(

i

)

)

2

,

 and

an irregularity (IK P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows;

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of each periodogram, and N is the number of elements in p m ; and

based on said determined irregularities, authenticating a user of said handheld computing device further comprising a first authentication component requiring a higher level of authentication than provided by said tremor analysis component, said system being responsive to said first authentication component authenticating a given user to place said handheld computing device in first authentication state and said tremor analysis component, being responsive to said handheld computing device entering said first authentication state to periodically verify said user to maintain said handheld computing device in a second authentication state, said second authentication state providing greater access to said handheld computing device than said first authentication state.

2. The system as claimed in claim 1 further comprising a first authentication component requiring a higher level of authentication than provided by said tremor analysis component, said system being responsive to said first authentication component and said tremor analysis component authenticating a given user to place said device in an authenticated state providing user access to said device.

3. The system as claimed in claim 1 wherein each spectral density estimation extends across a range from 4Hz to 15Hz.

4. The system as claimed in claim 1 wherein said tremor analysis component is arranged to provide an accelerometer X axis periodogram and to calculate an irregularity (IK P ) for said accelerometer X axis periodogram as follows:

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of said accelerometer X axis periodogram, and N is the number of elements in p m .

5. The system according to claim 1 wherein said filter comprises a Fourier linear (FLC) combiner for adaptively estimating the Fourier coefficients of said IMU signals.

6. The system according to claim 5 wherein said filter comprises one of: a weighted Fourier Linear Combiner (WFLC) or a Bandlimited FLC for adaptively estimating a quasi-periodic signal.

7. The system according to claim 1 wherein said matching module comprises a random forest classifier.

8. The system according to claim 7 wherein said classifier comprises no more than 130 trees.

9. The system according to claim 1 wherein said matching module comprises a bagged ensemble of trees classifier.

10. The system according to claim 1 wherein said measurement window is 1 second.

11. The system according to claim 1 wherein a sampling frequency of said IMU signals is at least 100Hz.

12. The system according to claim 1 wherein said tremor analysis component is operable in a normal mode for authenticating a user; and a training mode for obtaining signals indicative of said user's tremor.

13. A device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope and a biometric recognition system comprising a tremor analysis component arranged to;

obtain from said IMU accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as gyroscope signal indicating rotational velocity about the Y axis during a measurement window;

filter each of said IMU signals to provide filtered frequency components for said signals during said measurement window;

provide a special density estimation for each of said filtered accelerometer magnitude signal and said filtered gyroscope signal;

determine an irregularity for each spectral density estimation, each spectral density estimation comprising a periodogram, wherein said irregularity comprises;

an irregularity (IJ P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IJ

p

=

-

i

=

1

N

-

1

(

p

m

(

i

)

-

p

m

(

i

+

1

)

)

2

-

i

=

1

N

-

1

(

p

m

(

i

)

)

2

,

 and

and irregularity (IK P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of each periodogram, and N is the number of elements in p m ; and

based on said determined irregularities, authenticating a user of said device further comprising a first authentication component requiring a higher level of authentication than provided by said tremor analysis component, said device being responsive to said first authentication component authenticating a given user to place said device in first authentication state and said tremor analysis component, being responsive to said device entering said first authentication state to periodically verify said user to maintain said device in a second authentication state, said second authentication state providing greater access to said device than said first authentication state.

14. A computer program product stored on a non-transitory computer readable medium which when executed on a handheld computing device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope is arranged to perform the steps of:

obtaining from the IMU, accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as a gyroscope signal indicating rotational velocity about the Y axis during a measurement window;

filtering each of said IMU signals to provide filtered frequency components for said signals during said measurement window; providing a spectral density estimation for each of said filtered accelerometer magnitude signal and said filtered gyroscope signal;

determining an irregularity for each spectral density estimation, each spectral density estimation comprising a periodogram, wherein said irregularity comprises:

an irregularity (IJ P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IJ

p

=

-

i

=

1

N

-

1

(

p

m

(

i

)

-

p

m

(

i

+

1

)

)

2

-

i

=

1

N

-

1

(

p

m

(

i

)

)

2

,

 and

an irregularity (IK P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of each periodogram, and N is the number of elements in p m ; and

based on said determined irregularities, authenticating a user of said handheld computing device further comprising a first authentication component requiring a higher level of authentication than provided by said tremor analysis component, said handheld computing device being responsive to said first authentication component authenticating a given user to place said handheld computing device in first authentication state and said tremor analysis component, being responsive to said handheld computing device entering said first authentication state to periodically verify said user to maintain said handheld computing device in a second authentication state, said second authentication state providing greater access to said handheld computing device than said first authentication state.

15. A biometric recognition system for a hand held computing device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope, said system comprising a first authentication component requiring a higher level of authentication than provided by a tremor analysis component, said system being responsive to said first authentication component authenticating a given user to place said device in first authentication state; and

said tremor analysis component, being responsive to said device entering said first authentication state to periodically verify said user to maintain said device in a second authentication state, said second authentication state providing greater access to said device than said first authentication state, the tremor analysis component being arranged to:

obtain from said IMU accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as a gyroscope signal indicating rotational velocity about the Y axis during a measurement window;

filter each of said IMU signals to provide filtered frequency components for said signals during said measurement window;

provide a spectral density estimation for each of said filtered accelerometer magnitude signal and said filtered gyroscope signal; and

based on features extracted from said spectral density estimates, attempt to verify said user of said device,

wherein each spectral density estimation comprising a periodogram, and wherein said features comprise irregularities comprising:

an irregularity (IJ P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IJ

p

=

-

i

=

1

N

-

1

(

p

m

(

i

)

-

p

m

(

i

+

1

)

)

2

-

i

=

1

N

-

1

(

p

m

(

i

)

)

2

,

 and

an irregularity (IK P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of each periodogram, and N is the number of elements in p m .

16. A device incorporating an inertial measurement unit (IMU) comprising a plurality of accelerometers and at least one gyroscope, and a biometric recognition system comprising a first authentication component requiring a higher level of authentication than provided by a tremor analysis component, said biometric recognition system being responsive to said first authentication component authenticating a given user to place said device in first authentication state; and

said tremor analysis component, being responsive to said device entering said first authentication state to periodically verify said user to maintain said device in a second authentication state, said second authentication state providing greater access to said device than said first authentication state, the tremor analysis component being arranged to;

obtain from said IMU accelerometer signals indicating device translational acceleration along each of X, Y and Z axes as well as gyroscope signal indicating rotational velocity about the Y axis during a measurement window;

filter each of said IMU signals to provide filtered frequency components for said signals during said measurement window;

provide a spectral density estimation for each of said filtered accelerometer magnitude signal and said filtered gyroscope signal; and

based on features extracted from said spectral density estimates, attempt to verify said user of said device,

wherein each spectral density estimation comprising a periodogram, and wherein said features comprise irregularities comprising;

and irregularity (IJ P ) for said accelerometer magnitude and said gyroscope periodograms calculated as follows;

IJ

p

=

-

i

=

1

N

-

1

(

p

m

(

i

)

-

p

m

(

i

+

1

)

)

2

-

i

=

1

N

-

1

(

p

m

(

i

)

)

2

,

 and

an irregularity (IK P )for said accelerometer magnitude and said gyroscope periodograms calculated as follows:

IK

p

=

i

=

1

N

-

1

p

m

(

i

)

-

p

m

(

i

-

1

)

+

p

m

(

i

)

+

p

m

(

i

+

1

)

3

where p m holds the magnitude coefficient of each periodogram, and N is the number of elements in p m .

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2017
From: ZAMFIR, ADRIAN; MIU, ANDREEA OANA; FLOREA, CORNELIU
To: FOTONATION LIMITED
Reel/Frame 042109/0832 →
Continuity (2)
Provisional Application 62316225 · Mar 31, 2016
Related Publication 20170286658A1 · Oct 5, 2017