IP Library Granted Patent US 10,339,659
Granted Patent B2
US 10,339,659 · App. 15/180,272 · Granted Jul 2, 2019

System, method, and recording medium for workforce performance management

Inventors: Kuntal Dey (New Delhi, IN); Seema Nagar (Bangalore, IN); Sudhanshu Singh (New Delhi, IN); Roman Vaculin (Bronxville, NY)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06T7/20G06K9/0061G06K9/00335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,339,659
App. No.
15/180,272
Granted
Jul 2, 2019
Kind
B2
Abstract

A break recommendation method, system, and non-transitory computer readable medium, include a cognitive state tracking circuit configured to track a cognitive state of a user viewing a document, a document identification and difficulty measuring circuit configured to identify a document type, a deviation detecting circuit configured to detect a deviation between a current cognitive state of the user and a past cognitive state of the user during a predetermined amount of time for the document type; and a recommending circuit configured to recommend that the user stop viewing the document for a predetermined amount of time based on the deviation being greater than a predetermined threshold value.

Claims (38)

1. A break recommendation system, comprising:

a document identification and difficulty measuring circuit configured to identify a document type of a document;

a cognitive state tracking circuit configured to track on a continuous basis a cognitive state of a user viewing and working on the document via an imagine device, the imagine device being controlled by:

a gaze tracking circuit configured to track an eye gaze movement of the user over time relative to the document to determine the cognitive state of the user; and

an emotional and facial expression tracking circuit configured to monitor a facial and emotional expression of the user over time relative to the document to determine the cognitive state of the user;

a deviation detecting circuit configured to detect a deviation between a current cognitive state of the user and a past cognitive state of the user during a predetermined amount of time for the identified document type based on a change in the eye gaze movement and the facial and emotion expression; and

a recommending circuit configured to recommend that the user takes a break from viewing the document for a predetermined amount of time based on the deviation being greater than a predetermined threshold value, wherein the cognitive state of the user is determined based on the viewing of the document by the user, and wherein the deviation is in a relation to the user viewing the document and the identified document type of the document.

2. The system of claim 1 , wherein the document identification and difficulty measuring circuit further measures a document difficulty of the document, and

wherein the document identification and difficulty measuring circuit measures the document difficulty for each portion of the document.

3. The system of claim 1 , wherein the cognitive state tracking circuit creates a user profile for the user, the user profile comprising a cognitive state measurement of the user relative to a predetermined amount of time.

4. The system of claim 1 , wherein the cognitive state tracking circuit creates a user profile for the user with respect to the identified document type for the cognitive state of the user over a predetermined amount of time.

5. The system of claim 1 , wherein the deviation detecting circuit detects the deviation relative to the past cognitive state of the user within a predetermined time frame.

6. The system of claim 1 , wherein the past cognitive state comprises a total past cognitive state as measured over a predetermined window of time.

7. The system of claim 1 , wherein the cognitive state of the user is based on an eye gaze relative to the document.

8. The system of claim 1 , wherein the deviation detecting circuit is further configured to detect the deviation between the current cognitive state of the user and the past cognitive state of the user on a document having a same document difficulty as the current document being viewed by the user.

9. The system of claim 1 , wherein the predetermined amount of time for the user to stop viewing the document increases based on a type of deviation from the past cognitive state.

10. A break recommendation method, comprising:

identifying a document type of a document;

tracking on a continuous basis a cognitive state of a user viewing and working on the document via an imagine device, the imagine device being controlled by:

a gaze tracking circuit configured to track an eye gaze movement of the user over time relative to the document to determine the cognitive state of the user; and

an emotional and facial expression tracking circuit configured to monitor a facial and emotional expression of the user over time relative to the document to determine the cognitive state of the user;

detecting a deviation between a current cognitive state of the user and a past cognitive state of the user during a predetermined amount of time for the identified document type based on a change in the eye gaze movement and the facial and emotion expression; and

recommending that the user takes a break from working on the document for a predetermined amount of time based on the deviation being greater than a predetermined threshold value, wherein the cognitive state of the user is determined based on the viewing of the document by the user, and wherein the deviation is in a relation to the user viewing the document and the identified document type of the document.

11. The method of claim 10 , further comprising measuring a document difficulty of the document,

wherein the measuring measures the document difficulty for each portion of the document.

12. The method of claim 10 , wherein the tracking further creates a user profile for the user, the user profile comprising cognitive state measurements of the user relative to a predetermined amount of time.

13. The method of claim 10 , wherein the tracking creates a user profile for the user with respect to the identified document type for the cognitive state of the user over a predetermined amount of time.

14. A non-transitory computer-readable recording medium recording a break recommendation program, the program causing a computer to perform:

identifying a document type of a document;

tracking on a continuous basis a cognitive state of a user viewing and working on the document via an imagine device, the imagine device being controlled by:

a gaze tracking circuit configured to track an eye gaze movement of the user over time relative to the document to determine the cognitive state of the user; and

an emotional and facial expression tracking circuit configured to monitor a facial and emotional expression of the user over time relative to the document to determine the cognitive state of the user;

detecting a deviation between a current cognitive state of the user and a past cognitive state of the user during a predetermined amount of time for the identified document type based on a change in the eye gaze movement and the facial and emotion expression; and

recommending that the user takes a break from working on the document for a predetermined amount of time based on the deviation being greater than a predetermined threshold value, wherein the cognitive state of the user is determined based on the viewing of the document by the user, and wherein the deviation is in a relation to the user viewing the document and the identified document type of the document.

15. The iron-transitory computer readable medium of claim 14 , further comprising measuring a document difficulty of the document,

wherein the measuring measures the document difficulty for each page of the document.

16. The non-transitory computer readable medium of claim 14 , wherein the tracking further creates a user profile for the user, the user profile comprising cognitive state measurements of the user relative to a predetermined amount of time.

17. The non-transitory computer readable medium of claim 14 , wherein the tracking creates a user profile for the user with respect to the identified document type for the cognitive state of the user over a predetermined amount of time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2016
From: DEY, KUNTAL; NAGAR, SEEMA; SINGH, SUDHANSHU; VACULIN, ROMAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 038894/0382 →
Continuity (1)
Related Publication 20170357846A1 · Dec 14, 2017