Home automation system including user interface operation according to user cognitive level and related methods

1. A home automation (HA) system comprising:

a cloud server;

a plurality of HA operation devices;

a plurality of HA user interface devices for respective users and each comprising a user audio input device, a touch display defining a user interface (UI), and a controller coupled to the user audio input device and the touch display, the controller of each HA user interface device being switchable between a voice input mode for receiving user input based upon the user audio input device and a touch input mode for receiving user input based upon the touch display; and

a plurality of HA hub devices to provide communications for the cloud server, the plurality of HA user interface devices and the plurality of HA operation devices;

the controller of each HA user interface device configured to send user interaction data to the cloud server and operate the UI according to a user cognitive level, the user interaction data comprising a current touch display user contact location and historical touch display user contact locations; and

the cloud server configured to

determine the user cognitive level based upon the user interaction data received from a given HA user interface device,

decrease the user cognitive level based upon the current touch display user contact location being outside a touch location threshold relative to the historical touch display user contact locations, and

send the user cognitive level to the given HA user interface device; and

the controller of each HA user interface device being configured to switch from the touch input mode to the voice input mode based upon the decreased user cognitive level.

2. The HA system of claim 1 wherein the cloud server is configured to decrease the user cognitive level based upon the user interaction data received from the given HA user interface device representing cognitive decline of the user.

3. The HA system of claim 1 wherein the user interaction data comprises time periods between successive user contacts on the touch display.

4. The HA system of claim 1 wherein each HA user interface device comprises a camera; and wherein the user interaction data comprises device-to-user distance data.

5. The HA system of claim 1 wherein each HA user interface device comprises an accelerometer; and wherein the user interaction data comprises device acceleration data.

6. The HA system of claim 1 wherein the user interaction data comprises user game interaction data.

7. The HA system of claim 1 wherein the user cognitive level determines at least one of a color adjustment within the UI, an adjustment in contrast within the UI, an adjustment in brightness within the UI, an adjustment in size within the UI, and a disablement of elements within the UI.

8. A home automation (HA) user interface device from among a plurality thereof for respective users and to be used with an HA system comprising a cloud server, a plurality of HA operation devices and a plurality of HA hub devices to provide communications for the cloud server, the plurality of HA user interface devices, and the plurality of HA operation devices, each HA user interface device comprising:

a user audio input device;

a touch display defining a user interface (UI); and

a controller coupled to the user audio input device and the touch display, the controller being switchable between a voice input mode for receiving user input based upon the user audio input device and a touch input mode for receiving user input based upon the touch display, and configured to

send user interaction data to the cloud server, the cloud server determining a cognitive level based upon the user interaction data, the user interaction data comprising a current touch display user contact location and historical touch display user contact locations, the cloud server decreasing the user cognitive level based upon the current touch display user contact location being outside a touch location threshold relative to the historical touch display user contact locations,

receive the user cognitive level from the cloud server,

operate the UI according to the user cognitive level, and

switch from the touch input mode to the voice input mode based upon the decreased user cognitive level.

9. The HA user interface device of claim 8 wherein the user interaction data comprises time periods between successive user contacts on the touch display.

10. The HA user interface device of claim 8 further comprising a camera; and wherein the user interaction data comprises device-to-user distance data.

11. The HA user interface device of claim 8 further comprising an accelerometer; and wherein the user interaction data comprises device acceleration data.

12. The HA user interface device of claim 8 wherein the user interaction data comprises user game interaction data.

13. The HA user interface device of claim 8 wherein the user cognitive level determines at least one of a color adjustment within the UI, an adjustment in contrast within the UI, an adjustment in brightness within the UI, an adjustment in size within the UI, and a disablement of elements within the UI.

14. A method of operating a user interface (UI) according to a user cognitive level, the UI defined by a user audio input device and a touch display of a home automation (HA) user interface device for a respective user from among a plurality of HA user interface devices in an HA system, the HA user interface device being switchable between a voice input mode for receiving user input based upon the user audio input device and a touch input mode for receiving user input based upon the touch display, the HA system comprising a cloud server, a plurality of HA operation devices, and a plurality of HA hub devices to provide communications for the cloud server, the plurality of HA user interface devices and the plurality of HA operation devices, the method comprising:

using the HA user interface device to

send user interaction data to the cloud server, the user interaction data comprising a current touch display user contact location and historical touch display user contact locations, the cloud server determining the user cognitive level based upon the user interaction data and decreasing the user cognitive level based upon the current touch display user contact location being outside a touch location threshold relative to the historical touch display user contact locations,

receive the user cognitive level from the cloud server,

operate the UI according to the user cognitive level, and

switch from the touch input mode to the voice input mode based upon the decreased user cognitive level.

15. The method of claim 14 wherein the cloud server decreases the user cognitive level based upon the user interaction data received from the given HA user interface device representing cognitive decline of the user.

16. The method of claim 14 wherein the user interaction data comprises time periods between successive user contacts on the touch display.

17. The method of claim 14 wherein the HA user interface device comprises a camera; and wherein the user interaction data comprises device-to-user distance data.

18. The method of claim 14 wherein the HA user interface device comprises an accelerometer; and wherein the user interaction data comprises device acceleration data.

19. The method of claim 14 wherein the user interaction data comprises user game interaction data.

20. The method of claim 14 wherein the user cognitive level determines at least one of a color adjustment within the UI, an adjustment in contrast within the UI, an adjustment in brightness within the UI, an adjustment in size within the UI, and a disablement of elements within the UI.