IP Library Granted Patent US 9,990,552
Granted Patent B2
US 9,990,552 · App. 14/820,281 · Granted Jun 5, 2018

Operator fatigue monitoring system

Inventors: Dennis John Melas (Chicago, IL); John David Semple (Woodridge, IL)
Assignee: Progress Rail Locomotive Inc.
G06K9/00845A61B5/18A61B5/1114
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,990,552
App. No.
14/820,281
Granted
Jun 5, 2018
Kind
B2
Abstract

A fatigue monitoring system is disclosed for use with a machine. The fatigue monitoring system may have an input device configured to generate a first signal indicative of an activity performed by a machine operator, a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator, and a warning device. The fatigue monitoring system may also have a controller in communication with the input device, the scanning device, and the warning device. The controller may be configured to determine a time between generations of the first signal, to make a comparison of the recognized characteristic with a threshold characteristic, and to selectively activate the warning device based on the time or the comparison.

Claims (50)

1. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to:

determine a time between generations of the first signal;

make a comparison of the recognized characteristic with a threshold characteristic;

selectively activate the warning device based on the time or the comparison;

selectively log a first fault condition and communicate the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively log a second fault condition when the warning device is activated.

2. The fatigue monitoring system of claim 1 , wherein the activity includes a control activity associated with an operation of the machine.

3. The fatigue monitoring system of claim 1 , wherein the activity is associated with only resetting of the fatigue monitoring system.

4. The fatigue monitoring system of claim 1 , wherein the recognized characteristic is a facial characteristic.

5. The fatigue monitoring system of claim 4 , wherein the facial characteristic is one of an eyelid position, an eye blink frequency, and a head pose.

6. The fatigue monitoring system of claim 1 , wherein:

the scanning device is an IR camera disposed within a cabin of the machine; and

the fatigue monitoring system further includes at least one IR source also disposed within the cabin of the machine.

7. The fatigue monitoring system of claim 1 , wherein the warning device is one of a visual warning device and an audible warning device.

8. The fatigue monitoring system of claim 7 , wherein:

the warning device is an audible warning device; and

the fatigue monitoring system further includes a visual warning device.

9. The fatigue monitoring system of claim 1 , wherein the penalty device includes a brake of the machine.

10. The fatigue monitoring system of claim 9 , wherein the controller is further configured to selectively reduce throttling of the machine when the brake of the machine is activated as a penalty.

11. The fatigue monitoring system of claim 8 , wherein the controller is configured to:

rate a fatigue level of the machine operator based on the comparison; and

selectively activate the visual warning device when the fatigue level is a first level or the time between generations of the first signal exceeds a first threshold level.

12. The fatigue monitoring system of claim 11 , wherein the controller is further configured to selectively activate the audible warning device when the fatigue level is a second level or the time between generations of the first signal exceeds a second threshold level greater than the first threshold level.

13. The fatigue monitoring system of claim 11 , wherein the controller is further configured to selectively activate the penalty device when the fatigue level is a third level or the time between generations of the first signal exceeds a third threshold level greater than the second threshold level.

14. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to:

determine a time between generations of the first signal;

selectively implement a first level response when the time between generations of the first signal exceeds a first threshold time;

selectively implement a second level response when the time between generations of the first signal exceeds a second threshold time greater than the first threshold time;

make a comparison of the recognized characteristic with a threshold characteristic;

selectively implement the second level response based on the comparison;

selectively log a first fault condition and communicate the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively log a second fault condition when the warning device is activated.

15. A method of monitoring fatigue of a machine operator, comprising:

receiving inputs indicative of an activity performed by the machine operator;

scanning a facial characteristic of the machine operator;

determining a time between receipt of the inputs;

making a comparison of the characteristic with a threshold characteristic;

selectively activating a warning device based on the time or the comparison;

selectively logging a first fault condition and communicating the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively logging a second fault condition when the warning device is activated.

16. The method of claim 15 , wherein the activity includes one of a control activity associated with machine operation and a resetting activity.

17. The method of claim 15 , further including selectively affecting machine braking or fueling based on the time and the comparison.

Assignments (2)
CHANGE OF NAME Recorded Feb 23, 2018
From: ELECTRO-MOTIVE DIESEL, INC.
To: PROGRESS RAIL LOCOMOTIVE INC.
Reel/Frame 045430/0426 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2015
From: MELAS, DENNIS JOHN; SEMPLE, JOHN DAVID
To: ELECTRO-MOTIVE DIESEL, INC.
Reel/Frame 036272/0232 →
Continuity (2)
Provisional Application 62053164 · Sep 21, 2014
Related Publication 20160082838A1 · Mar 24, 2016