Method and apparatus for determining health status

1. A system comprising one or more computers in one or more locations and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising: providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence; capturing, by an audio sensor of the user device, one or more verbal answers to the sequence of questions; capturing, by a camera of the user device, motion and appearance of the user in a video sequence while the user provides the one or more verbal answers to the sequence of questions, the motion and appearance of the user being depicted in the video sequence; and analyzing the motion of the user in the video sequence and the one or more verbal answers to determine one or more indications of a disease or of a change in a disease progression.

2. The system of claim 1 , wherein capturing the motion of the user comprises capturing one or more of the following: body motion, eye motion, emotions, heart rate, breathing patterns, skin tone, or speech tone of the user.

3. The system of claim 1 , wherein the operations comprising:

based on responses of the user to the sequence of questions, selectively requesting the user to perform one or more actions to complete a medical test.

4. The system of claim 3 , wherein capturing the motion and appearance of the user in the video sequence further comprises:

capturing further motion and appearance of the user while the user is performing the one or more actions to complete the medical test; and

wherein analyzing the motion of the user in the video sequence comprises analyzing the motion and appearance of the user while the user provides the one or more verbal answers to the sequence of questions and analyzing the further motion and appearance of the user while the user is performing the one or more actions to complete the medical test.

5. The system of claim 3 , wherein requesting the user to perform one or more actions comprises asking the user to hold the user device such that the camera of the user device focuses on a static object.

6. The system of claim 5 , comprising capturing camera motion of the user device with respect to the static object.

7. The system of claim 6 , wherein analyzing the motion of the user in the video sequence to determine the one or more indications of the disease or of the change in the disease progression comprises:

measuring the user's hand stability or tremor based on the captured camera motion; and

determining the one or more indications of the disease or of the change in the disease progression based on the measured hand stability or tremor.

8. The system of claim 3 , wherein requesting the user to perform one or more actions comprises asking the user to look at a moving object displayed on the user interface.

9. The system of claim 8 , wherein capturing the motion and appearance of the user comprise capturing eye movement of the user while the user is looking at the moving object.

10. The system of claim 9 , wherein analyzing the motion of the user comprises:

measuring the user's ability to focus on the moving object; and

determining the one or more indications of the disease or of the change in the disease progression based on the user's ability to focus on the moving object.

11. A computer-implemented method comprising:

providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence;

capturing, by an audio sensor of the user device, one or more verbal answers to the sequence of questions;

capturing, by a camera of the user device, motion and appearance of the user in a video sequence while the user provides the one or more verbal answers to the sequence of questions, the motion and appearance of the user being depicted in the video sequence; and

analyzing the motion of the user in the video sequence and the one or more verbal answers to determine one or more indications of a disease or of a change in a disease progression.

12. The method of claim 11 , wherein capturing the motion of the user comprises capturing one or more of the following: body motion, eye motion, emotions, heart rate, breathing patterns, skin tone, or speech tone of the user.

13. The method of claim 11 , further comprising:

based on responses of the user to the sequence of questions, selectively requesting the user to perform one or more actions to complete a medical test.

14. The method of claim 13 , wherein capturing the motion and appearance of the user in the video sequence further comprises:

capturing further motion and appearance of the user while the user is performing the one or more actions to complete the medical test; and

wherein analyzing the motion of the user in the video sequence comprises analyzing the motion and appearance of the user while the user provides the one or more verbal answers to the sequence of questions and analyzing the further motion and appearance of the user while the user is performing the one or more actions to complete the medical test.

15. The method of claim 14 , wherein selectively requesting the user to perform one or more actions comprises asking the user to hold the user device such that the camera of the user device focuses on a static object.

16. The method of claim 15 , comprising capturing camera motion of the user device with respect to the static object.

17. The method of claim 16 , wherein analyzing the motion of the user in the video sequence to determine the one or more indications of the disease or of the change in the disease progression comprises:

measuring the user's hand stability or tremor based on the captured camera motion; and

determining the one or more indications of the disease or of the change in the disease progression based on the measured hand stability or tremor.

18. The method of claim 13 , wherein selectively requesting the user to perform one or more actions comprises asking the user to look at a moving object displayed on the user interface.

19. The method of claim 18 , wherein capturing the motion and appearance of the user comprise capturing eye movement of the user while the user is looking at the moving object.

20. The method of claim 19 , wherein analyzing the motion of the user comprises:

measuring the user's ability to focus on the moving object; and

determining the one or more indications of the disease or of the change in the disease progression based on the user's ability to focus on the moving object.

21. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

providing, to a user interface displayed on a display of a user device, a sequence of questions for a user to respond to in an interactive manner, wherein each of the questions following a first question of the sequence of questions is adaptive based on the user's response to one or more previous questions in the sequence;

capturing, by an audio sensor of the user device, one or more verbal answers to the sequence of questions;

capturing, by a camera of the user device, motion and appearance of the user in a video sequence while the user provides the one or more verbal answers to the sequence of questions, the motion and appearance of the user being depicted in the video sequence; and

analyzing the motion of the user in the video sequence and the one or more verbal answers to determine one or more indications of a disease or of a change in a disease progression.