IP Library Granted Patent US 9,715,622
Granted Patent B2
US 9,715,622 · App. 14/797,365 · Granted Jul 25, 2017

System and method for predicting neurological disorders

Inventors: Geelapaturu Subrahmanya Venkata Radha Krishna Rao (Chennai, IN); Kuhelee Roy (Kolkata, IN); Savarimuthu Margret Anouncia (Tamil Nadu, IN)
Assignee: COGNIZANT TECHNOLOGY SOLUTIONS INDIA PVT. LTD.
G06K9/00348A61B5/112A61B5/1128A61B5/165A61B5/4076A61B5/7275G06K9/00362G06K9/3233G06T7/0012G06T7/246H04N19/17H04N19/503A61B5/4082A61B5/7257A61B5/7267A61B2576/00G06T2207/10016G06T2207/20081G06T2207/30016G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,715,622
App. No.
14/797,365
Granted
Jul 25, 2017
Kind
B2
Abstract

A method and system for predicting neurological disorders is provided. The method comprises receiving videos of individuals and detecting Regions of Interest (ROI) in video frames. The method further comprises determining a Motion Vector (MV) for each ROI in a set of successive frames and comparing value of the determined MV with pre-stored values. Furthermore, the method comprises identifying a MV matching a pre-stored value thereby identifying a ROI and a frame corresponding to the identified MV, wherein the pre-stored value indicates onset of an expression. Also, the method comprises determining MVs for the identified ROI in subsequent sets of successive frames and comparing value of the determined MVs with a pre-stored value of MV corresponding to peak and offset of the indicated expression. The method further comprises identifying the frame corresponding to the peak and offset of the indicated expression and generating pictorial representation for predicting neurological disorders.

Claims (51)

1. A method for predicting one or more neurological disorders via a processor configured to execute program instructions stored in a memory, the method comprising:

receiving, via the processor, one or more videos of one or more individuals;

splitting, via the processor, the one or more videos into one or more frames;

detecting, via the processor, one or more regions of interest in each of the one or more frames;

analyzing, via the processor, each of the one or more regions of interest in each of the one or more frames by:

determining a motion vector for each of the one or more regions of interest in a set of successive frames; and

comparing value of the determined motion vector for each of the one or more regions of interest with corresponding pre-stored values, wherein the pre-stored values for the motion vector for each of the one or more regions are pre-stored in a database;

identifying, via the processor, at least one motion vector, from the determined motion vectors, that matches with a pre-stored value of a motion vector thereby identifying a region of interest and a frame corresponding to the identified at least one motion vector, wherein the pre-stored value indicates onset of an expression;

determining, via the processor, one or more motion vectors for the identified region of interest in subsequent sets of successive frames;

comparing, via the processor, value of the one or more determined motion vectors for the identified region of interest with at least one of a pre-stored value of motion vector corresponding to peak of an indicated expression and a pre-stored value of motion vector corresponding to offset of the indicated expression, wherein the peak of the indicated expression and the offset of the indicated expression are values in at least one of a graph, a histogram and a table depicting the indicated expression;

identifying, via the processor, the frame corresponding to the at least one of: the peak of the indicated expression and the offset of the indicated expression; and

generating, via the processor, a pictorial representation of the one or more videos depicting at least one of: the onset, peak and offset of the indicated expression of the one or more individuals captured in the one or more videos for predicting the one or more neurological disorders.

2. The method of claim 1 , wherein the one or more expressions include at least one of: happy, content, sad, disgust, surprise, clueless and angry.

3. The method of claim 1 , wherein the detected one or more regions of interest include at least one of: eyes, cheeks, nose, lips, ears, eyebrows, hands, arms, torso, legs and feet.

4. The method of claim 1 , wherein the regions of interest are detected using Viola-Jones algorithm.

5. The method of claim 1 , wherein the motion vector for each of the one or more regions of interest in a set of successive frames is determined using optical flow algorithm.

6. The method of claim 5 , wherein the optical flow algorithm uses Horn-Schunck method for determining the motion vector.

7. The method of claim 1 , wherein the one or more individuals are speaking while the one or more videos are being captured.

8. A system for predicting one or more neurological disorders, the system comprising:

a video acquisition module configured to:

receive one or more videos of one or more individuals; and

split the one or more videos into one or more frames;

a region of interest detection module configured to detect one or more regions of interest in each of the one or more frames;

a video processing module configured to analyze each of the one or more detected regions of interest in each of the one or more frames, wherein the video processing module comprises:

a feature extraction module configured to determine a motion vector for each of the one or more regions of interest in a set of successive frames; and

a comparator configured to compare value of the determined motion vector for each of the one or more regions of interest with corresponding pre-stored values, wherein the pre-stored values for the motion vector for each of the one or more regions are stored in a training module;

the feature extraction module further configured to:

identify at least one motion vector, from the determined motion vectors, that matches with a pre-stored value of a motion vector thereby identifying a region of interest and a frame corresponding to the identified at least one motion vector, wherein the pre-stored value indicates onset of an expression; and determine one or more motion vectors for the identified region of interest in subsequent sets of successive frames;

the comparator further configured to:

compare value of the one or more determined motion vectors for the identified region of interest with at least one of a pre-stored value of motion vector corresponding to peak of an indicated expression and a pre-stored value of motion vector corresponding to offset of the indicated expression, wherein the peak of the indicated expression and the offset of the indicated expression are values in at least one of a graph, a histogram and a table depicting the indicated expression; and

identify the frame corresponding to the at least one of: the peak of the indicated expression and the offset of the indicated expression; and

a testing module configured to generate a pictorial representation of the one or more videos depicting at least one of: the onset, peak and offset of the indicated expression of the one or more individuals captured in the one or more videos for predicting the one or more neurological disorders.

9. The system of claim 8 , wherein the one or more expressions include at least one of: happy, content, sad, disgust, surprise, clueless and angry.

10. The system of claim 8 , wherein the detected one or more regions of interest include at least one of: eyes, cheeks, nose, lips, ears, eyebrows, hands, arms, torso, legs and feet.

11. The system of claim 8 , wherein the regions of interest are detected using Viola-Jones algorithm.

12. The system of claim 8 , wherein the motion vector for each of the one or more regions of interest in a set of successive frames is determined using optical flow algorithm.

13. The system of claim 12 , wherein the optical flow algorithm uses Horn-Schunck method for determining the motion vector.

14. The system of claim 8 , wherein the one or more individuals are speaking while the one or more videos are being captured.

15. A computer program product for predicting one or more neurological disorders, the computer program product comprising:

a non-transitory computer-readable medium having computer-readable program code stored thereon, the computer-readable program code comprising instructions that when executed by a processor, cause the processor to:

receive one or more videos of one or more individuals;

split the one or more videos into one or more frames:

detect one or more regions of interest in each of the one or more frames;

analyze each of the one or more regions of interest in each of the one or more frames by:

determining a motion vector for each of the one or more regions of interest in a set of successive frames; and

comparing value of the determined motion vector for each of the one or more regions of interest with corresponding pre-stored values, wherein the pre-stored values for the motion vector for each of the one or more regions are pre-stored in a database;

identify at least one motion vector, from the determined motion vectors, that matches with a pre-stored value of a motion vector thereby identifying a region of interest and a frame corresponding to the identified at least one motion vector, wherein the pre-stored value indicates onset of an expression;

determine one or more motion vectors for the identified region of interest in subsequent sets of successive frames;

compare value of the one or more determined motion vectors for the identified region of interest with at least one of a pre-stored value of motion vector corresponding to peak of an indicated expression and a pre-stored value of motion vector corresponding to offset of the indicated expression, wherein the peak of the indicated expression and the offset of the indicated expression are values in at least one of a graph, a histogram and a table depicting the indicated expression;

identify the frame corresponding to the at least one of: the peak of the indicated expression and the offset of the indicated expression; and

generate a pictorial representation of the one or more videos depicting at least one of: the onset, peak and offset of the indicated expression of the one or more individuals captured in the one or more videos for predicting the one or more neurological disorders.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2015
From: KRISHNA RAO, GEELAPATURU SUBRAHMANYA VENKATA RADHA; ROY, KUHELEE; MARGRET ANOUNCIA, SAVARIMUTHU
To: COGNIZANT TECHNOLOGY SOLUTIONS INDIA PVT. LTD.
Reel/Frame 036067/0309 →
Priority Claims (1)
IN 6745/CHE/2014 · Dec 30, 2014 · national
Continuity (1)
Related Publication 20160189371A1 · Jun 30, 2016