IP Library Granted Patent US 10,952,661
Granted Patent B2
US 10,952,661 · App. 15/622,091 · Granted Mar 23, 2021

Analysis of cognitive status through object interaction

Inventors: Rick A. Hamilton, II (Charlottesville, VA); Clifford A. Pickover (Yorktown Heights, NY); Ninad D. Sathaye (Pune, IN); Edgar A. Zamora Duran (Heredia, CR)
Assignee: International Business Machines Corporation
A61B5/4088A61B5/1125A61B5/165A61B5/168A61B5/4082A61B5/6843G06K9/00248G06K9/00295G06K9/00302G06K9/00335A61B5/0053A61B2560/0209A61B2562/0204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,952,661
App. No.
15/622,091
Granted
Mar 23, 2021
Kind
B2
Abstract

Embodiments of the present invention provide systems and methods for analyzing cognitive status. The method includes capturing a set of observables for a subject based on their interaction with smart objects, such as smart blocks or smart items. The method further includes accessing data sets, such as medical data about cognitive function, scientific data about cognitive function, and historical data for the subject, analyzing the set of observables, and generating a report about the cognitive abilities of the subject based on the analysis.

Claims (44)

1. A method comprising:

capturing, by one or more sensors of a smart block, a set of observables about a subject, wherein the set of observables contains interaction information of the subject with one or more smart objects that are used to build a structure such as length of time, wherein the one or more smart objects are modular building blocks;

determining whether an assembly configuration of the structure comprising the one or more smart objects matches a pre-defined assembly configuration via interfacing connection points of each of the one or more smart objects;

determining cognitive functions of the subject from the captured set of observables that led to the assembled configuration of the one or more smart objects, a length of time associated with completing the assembled configuration, amount of force exerted by the subject on each of the one or more smart objects, visual cues from the subject, and emotional signs depicted by the subject;

generating, by one or more processors, an interactive report that includes one or more suggestions that a subject can do to improve performance of an associated task and a query option to determine whether a degree of difficulty and frequency in tests administered to the subject should be modified;

predicting, by one or more processors, cognitive impairments based on measured cognitive functions and emotional signs depicted by the subject during assembly of the one or more smart objects the generated interactive report and response to the query option; and

broadcasting, by one or more processors, one or more of a set of commands and a set of suggestions, to the subject through one or more of an audio device, a visual device, and an audiovisual device based on the generated interactive report and the predicted cognitive impairments.

2. The method of claim 1 , further comprising:

utilizing, by one or more processors, a cognitive computing platform to analyze, at least in part, the set of observables.

3. The method of claim 1 , further comprising:

utilizing, by one or more processors, one or more external data recording devices to record one or more of the set of observables; and

accessing, by one or more processors, the recorded one or more of the set of observables from the one or more external data recording devices.

4. The method of claim 1 , wherein the set of observables contains one or more of:

pressure applied by the subject, facial expressions of the subject, emotion of the subject, distraction level of the subject, ability of the subject to follow instructions, fine motor skills of the subject, tightness of fit between the one or more smart blocks in the larger structure, accuracy of the larger structure with respect to a set of instructions, and time it takes the subject to complete a task.

5. The method of claim 1 , further comprising:

accessing, by one or more processors, one or more sets of data about cognitive functions of one or more cohorts;

determining, by one or more processors, a set of tasks for the subject based, at least in part, on one or more of the medical data about cognitive function, the scientific data about cognitive function, the historical data for the subject, and the accessed one or more sets of data about cognitive functions of one or more cohorts; and

generating, by one or more processors, the determined set of tasks.

6. The method of claim 1 , further comprising: predicting, by one or more processors, cognitive impairments based on measured cognitive functions and emotional signs depicted by the subject during assembly of the one or more smart objects—the generated interactive report and response to the query option comprises: predicting a decline or recovery of the subject's cognitive state based on a comparison of measured cognitive functions to previously measured cognitive functions of the subject.

7. The method of claim 1 , further comprising: identifying exceptions to measured cognitive functions that can affect the subject's performance.

8. A computer program product comprising: one or more non-transitory computer readable storage medium configured to execute program instructions stored on the non-transitory computer readable storage medium, the program instructions comprising: program instructions to capture, by one or more sensors of a smart object, a set of observables about a subject, wherein the set of observables contains interaction information of the subject with one or more smart objects that are used to build a structure such as length of time, wherein the one or more smart objects are modular building blocks; program instructions to determine whether an assembly configuration of the structure comprising the one or more smart objects matches a pre-defined assembly configuration via interfacing connection points of each of the one or more smart objects; program instructions to determine cognitive functions of the subject from the captured set of observables that led to the assembled configuration of the one or more smart objects based on a completeness of the assembled configuration of the one or more smart objects, a length of time associated with completing the assembled configuration, amount of force exerted by the subject on each of the one or more smart objects, visual cues from the subject, and emotional signs depicted by the subject; program instructions to generate an interactive report that includes one or more suggestions that a subject can do to improve performance of an associated task and a query option to determine whether a degree of difficulty and frequency in tests administered to the subject should be modified; program instructions to predict, cognitive impairments based on measured cognitive functions and emotional signs depicted by the subject during assembly of the one or more smart objects the generated interactive report and response to the query option the generated interactive report and response to the query option; and program instructions to broadcast one or more of a set of commands and a set of suggestions, to the subject through one or more of an audio device, a visual device, and an audiovisual device based on the generated interactive report and the predicted cognitive impairments.

9. The computer program product of claim 8 , further comprising:

program instructions to utilize a cognitive computing platform to analyze, at least in part, the set of observables.

10. The computer program product of claim 8 , further comprising:

program instructions to utilize one or more external data recording devices to record one or more of the set of observables; and

program instructions to access the recorded one or more of the set of observables from the one or more external data recording devices.

11. The computer program product of claim 8 , wherein the set of observables contains one or more of:

pressure applied by the subject, facial expressions of the subject, emotion of the subject, distraction level of the subject, ability of the subject to follow instructions, fine motor skills of the subject, time it takes the subject to complete a task, hesitation by the subject during completion of the task.

12. The computer program product of claim 8 , further comprising:

program instructions to access one or more sets of data about cognitive functions of one or more cohorts;

program instructions to determine a set of tasks for the subject based, at least in part, on one or more of the medical data about cognitive function, the scientific data about cognitive function, the historical data for the subject, and the accessed one or more sets of data about cognitive functions of one or more cohorts; and

program instructions to generate the determined set of tasks.

13. A computer system comprising: one or more computer processors; one or more non-transitory computer readable storage media; program instructions stored on the one or more non-transitory computer readable storage media for execution by at least one or the one or more processors, the program instructions comprising: program instructions to capture, by one or more sensors of a smart object, a set of observables about a subject, wherein the set of observables contains interaction information of the subject with one or more smart objects that are used to build a structure such as length of time, wherein the one or more smart objects are modular building blocks; program instructions to determine whether an assembly configuration of the structure comprising the one or more smart objects matches a pre-defined assembly configuration via interfacing connection points of each of the one or more smart objects; program instructions to determine cognitive functions of the subject from the captured set of observables that led to the assembled configuration of the one or more smart objects based on a completeness of the assembled configuration of the one or more smart objects, a length of time associated with completing the assembled configuration, amount of force exerted by the subject on each of the one or more smart objects, visual cues from the subject, and emotional signs depicted by the subject; program instructions to generate an interactive report that includes one or more suggestions that a subject can do to improve performance of an associated task and a query option to determine whether a degree of difficulty and frequency in tests administered to the subject should be modified; program instructions to predict, cognitive impairments based on measured cognitive functions and emotional signs depicted by the subject during assembly of the one or more smart objects the generated interactive report and response to the query option; and program instructions to broadcast one or more of a set of commands and a set of suggestions, to the subject through one or more of an audio device, a visual device, and an audiovisual device based on the generated interactive report and the predicted cognitive impairments.

14. The computer system of claim 13 , further comprising:

program instructions to utilize a cognitive computing platform to analyze, at least in part, the set of observables.

15. The computer system of claim 13 , further comprising:

program instructions to utilize one or more external data recording devices to record one or more of the set of observables; and

program instructions to access the recorded one or more of the set of observables from the one or more external data recording devices.

16. The computer system of claim 13 , wherein the set of observables contains one or more of:

pressure applied by the subject, facial expressions of the subject, emotion of the subject, distraction level of the subject, ability of the subject to follow instructions, fine motor skills of the subject, and time it takes the subject to complete a task.

17. The computer system of claim 13 , further comprising:

program instructions to access one or more sets of data about cognitive functions of one or more cohorts;

program instructions to determine a set of tasks for the subject based, at least in part, on one or more of the medical data about cognitive function, the scientific data about cognitive function, the historical data for the subject, and the accessed one or more sets of data about cognitive functions of one or more cohorts; and

program instructions to generate the determined set of tasks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2017
From: HAMILTON, RICK A., II; PICKOVER, CLIFFORD A.; SATHAYE, NINAD D.; ZAMORA DURAN, EDGAR A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 042701/0176 →
Continuity (1)
Related Publication 20180360369A1 · Dec 20, 2018
Cited By (4)
US 12,665,441 US 12,708,840 US 12,712,389 US 12,734,435