IP Library Granted Patent US 8,391,554
Granted Patent B2
US 8,391,554 · App. 12/243,088 · Granted Mar 5, 2013

Eye detection system using a single camera

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,391,554
App. No.
12/243,088
Granted
Mar 5, 2013
Kind
B2
Abstract

A system and a method for detecting the eyes of a driver of a vehicle using a single camera. The method includes determining a set of positional parameters corresponding to a driving seat of the vehicle. The camera is positioned at a pre-determined location inside the vehicle, and a set of parameters corresponding to the camera is determined. The location of the driver's eyes is detected using the set of positional parameters, an image of the driver's face and the set of parameters corresponding to the camera.

Claims (146)

1. A method for detecting the location of at least one eye of a driver positioned in a driving seat of a vehicle using a single camera positioned inside the vehicle, said method comprising:

determining a set of positional parameters corresponding to the driving seat, where said set of positional parameters includes an angle between a back-rest of the driving seat and a vertical plane, a distance between an edge of the driving seat and a center of the camera and a length of the back-rest of the driving seat;

determining a set of parameters corresponding to the camera, wherein the set of parameters corresponding to the camera includes a focal length of the camera, an angle between the camera and a vertical plane and one or more positional parameters of the camera based on a known profile of an interior of the vehicle;

capturing an image of a face of the driver using the camera; and

detecting the eye location based on the set of positional parameters, the image of the face and the set of parameters corresponding to the camera.

2. The method according to claim 1 wherein the set of positional parameters is determined using sensors in the driving seat.

3. The method according to claim 1 wherein the set of parameters corresponding to the camera is determined using sensors.

4. The method according to claim 1 wherein detecting the eye location includes processing the image to detect the eye location in the image and correlating the eye location in the image with the set of positional parameters and the set of parameters corresponding to the camera.

5. The method according to claim 1 further comprising calculating the eye location using the equation:

ρ

=

tan

-

1

(

u

v

2

+

f

2

)

-

γ

where ρ is an angle subtended by the eye location at a center of the camera, u and v are positional parameters of the eye location in the image of the face, γ is a tilt angle of the camera and f is a focal length of the camera.

6. A method for detecting the location of at least one eye of a driver of a vehicle using a single camera positioned inside the vehicle, said method comprising:

determining a set of positional parameters corresponding to a first rear-view mirror of one or more rear-view mirrors, where the set of positional parameters includes an angle between a center of a head of the driver and the first rear-view mirror in a horizontal plane, an angle between the center of the head of the driver and the first rear-view mirror in a vertical plane, a distance between the center of the head of the driver and the first rear-view mirror in the horizontal plane, measured along a direction perpendicular to a direction of motion of the vehicle and a center of the camera and a distance between the center of the camera and the first rear-view mirror in the horizontal plane, measured along a direction of motion of the vehicle;

determining a set of parameters corresponding to the camera;

capturing an image of a face of the driver using the camera; and

detecting the eye location based on the set of positional parameters, the image of the face and the set of parameters corresponding to the camera.

7. The method according to claim 6 wherein the set of positional parameters is determined using sensors.

8. The method according to claim 6 wherein the set of parameters corresponding to the camera includes a focal length of the camera, an angle between the camera and a vertical plane and one or more positional parameters of the camera based on a known profile of an interior of the vehicle.

9. The method according to claim 6 wherein the set of parameters corresponding to the camera is determined using sensors.

10. The method according to claim 6 wherein detecting the eye location comprises processing the image to detect the eye location in the image and correlating the eye location in the image with the set of positional parameters and the set of parameters corresponding to the camera.

11. The method according to claim 6 further comprising calculating the eye location using the equation:

ρ

=

tan

(

(

l

+

d

)

tan

(

δ

)

-

h

l

)

-

γ

where ρ is an angle subtended by the eye location at a center of the camera, l is a distance of the eye location from the center of the camera, d is a pre-determined distance of the center of the camera from a center of the first rear-view mirror wherein l and d are measured along a direction of motion of the vehicle, δ is a head position angle subtended by the first rear-view mirror at the eye location in a plane parallel to the direction of motion of the vehicle and perpendicular to the floor of the vehicle, h is a pre-determined distance between the center of the camera and a center of the first rear-view mirror measured along a direction perpendicular to the direction of motion of the vehicle and in a plane parallel to the plane containing δ, and γ is an angle of tilt of the camera in the plane containing δ.

12. A system for detecting the location of at least one eye of a driver positioned in a driving seat of a vehicle, said system comprising:

a driving seat position module for determining a first set of positional parameters corresponding to the driving seat, where said driving seat position module includes a driving seat inclination sensor to measure an angle between a back-rest of the driving seat and a vertical plane and a driving seat position sensor to measure a distance between an edge of the driving seat and a center of the camera;

a camera module for determining a set of parameters corresponding to a camera, where said camera module includes a camera position sensor to measure an angle between the camera and a vertical plane;

a rear-view mirror module for determining a second set of positional parameters corresponding to at least one rear-view mirror; and

an eye location detection module for detecting the eye location based on an image from the camera, the set of parameters corresponding to the camera and at least one of the first set of positional parameters and the second set of positional parameters.

13. The system according to claim 12 wherein the camera position sensor measures an angle between the camera and a horizontal plane of the vehicle.

14. The system according to claim 12 wherein the rear-view mirror module includes a position controller to re-position the at least one rear-view mirror based on the eye location.

15. The system according to claim 12 wherein the eye location detection module includes an image processing module, the image processing module processing the image to detect the eye location in the image.

16. The system according to claim 12 wherein the image processing module includes a gaze detection sub-module for performing gaze detection of the driver by identifying a pupil of the at least one eye based on the eye location and a drowsiness detection sub-module for detecting drowsiness condition of the driver based on the eye location.

17. A method for detecting the location of at least one eye of a driver positioned in a driving seat of a vehicle using a single camera positioned inside the vehicle, said method comprising:

determining a set of positional parameters corresponding to the driving seat;

determining a set of parameters corresponding to the camera;

capturing an image of a face of the driver using the camera;

detecting the eye location based on the set of positional parameters, the image of the face and the set of parameters corresponding to the camera; and

calculating the eye location using the equation:

ρ

=

tan

-

1

(

u

v

2

+

f

2

)

-

γ

(

4

)

where ρ is an angle subtended by the eye location at a center of the camera, u and v are positional parameters of the eye location in the image of the face, γ is a tilt angle of the camera and f is a focal length of the camera.

18. A method for detecting the location of at least one eye of a driver of a vehicle using a single camera positioned inside the vehicle, said method comprising:

determining a set of positional parameters corresponding to a first rear-view mirror of one or more rear-view mirrors;

determining a set of parameters corresponding to the camera;

capturing an image of a face of the driver using the camera;

detecting the eye location based on the set of positional parameters, the image of the face and the set of parameters corresponding to the camera; and

calculating the eye location using the equation:

ρ

=

tan

(

(

l

+

d

)

tan

(

δ

)

-

h

l

)

-

γ

(

12

)

where ρ is an angle subtended by the eye location at a center of the camera, l is a distance of the eye location from the center of the camera, d is a pre-determined distance of the center of the camera from a center of the first rear-view mirror wherein l and d are measured along a direction of motion of the vehicle, δ is a head position angle subtended by the first rear-view mirror at the eye location in a plane parallel to the direction of motion of the vehicle and perpendicular to the floor of the vehicle, h is a pre-determined distance between the center of the camera and a center of the first rear-view mirror measured along a direction perpendicular to the direction of motion of the vehicle and in a plane parallel to the plane containing δ, and γ is an angle of tilt of the camera in the plane containing δ.

19. A method for detecting the location of at least one eye of a driver positioned in a driving seat of a vehicle using a single, camera positioned inside the vehicle, said method comprising:

determining a set of positional parameters corresponding to the driving seat, where said set of positional parameters includes an angle between a back-rest of the driving seat and a vertical plane, a distance between an edge of the driving seat and a center of the camera and a length of the back-rest of the driving seat;

determining a set of parameters corresponding to the camera;

capturing an image of a face of the driver using the camera; and

detecting the eye location based on the set of positional parameters, the image of the face and the set of parameters corresponding to the camera; and

calculating the eye location using the equation:

ρ

=

tan

-

1

(

u

v

2

+

f

2

)

-

γ

where ρ is an angle subtended by the eye location at a center of the camera, u and v are positional parameters of the eye location in the image of the face, γ is a tilt angle of the camera and f is a focal length of the camera.

Assignments (12)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034384/0758 →
CHANGE OF NAME Recorded Feb 10, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025781/0211 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: WILMINGTON TRUST COMPANY
Reel/Frame 025324/0515 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025315/0046 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025245/0909 →
SECURITY AGREEMENT Recorded Aug 28, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023162/0237 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023156/0313 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023126/0914 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023155/0769 →
SECURITY AGREEMENT Recorded Apr 16, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
Reel/Frame 022554/0538 →
SECURITY AGREEMENT Recorded Feb 4, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 022201/0448 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2008
From: LEE, JIN-WOO; SHIN, KWANG-KEUN; RYU, JIHAN; LITKOUHI, BAKHTIAR BRIAN
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 021725/0139 →