Interactive personal assistive devices and systems with artificial intelligence, and related methods
A smart and scalable dementia assistant device is provided that converses with a patient in voices familiar with the patient. It utilizes content learned from the patient and content provided by family, friends, caregivers, and doctors, and autonomously adjusts conversations based on the changing state of the patient's dementia state. The device autonomously controls IoT devices (e.g. doors, elevators, tvs, medical dispensers) to help and assist the dementia patient using oral and IoT sensors.
1. A user device comprising:
a microphone for obtaining voice data from a first person;
a processor for processing the voice data to obtain text data;
a communication device for transmitting the text data to a server system and, in response, receive from the server system:
first response data stored at or in relation to the server system; and
a response identifier that identifies second response data provided by a third party data source;
the communication device obtaining the second response data from the third party data source using the response identifier;
the processor combining the first response data and the second response data to generate combined response;
one or more output devices that output the combined response; and
memory that stores one or more synthesized bots of one or more people that are familiar to the first user, and one or more libraries specific to each of the one or more synthesized bots.
2. The user device of claim 1 wherein the first response data is outputted first followed by the second response data.
3. The user device of claim 1 wherein the first response data is overlaid the second response data.
4. The user device of claim 1 wherein the first response data is outputted after outputting the second response data.
5. The user device of claim 1 wherein the first response data comprises audio data of a second person that is familiar to the first person.
6. The user device of claim 1 wherein the first response data comprises audio data and visual data that are of a second person that is familiar to the first person.
7. The user device of claim 1 wherein the second response data includes at least one of a video, an image, and audio data.
8. The user device of claim 1 wherein a given synthesized bot comprises a synthesized voice corresponding to a given person that is familiar to the first user.
9. The user device of claim 1 wherein a given synthesized bot comprises an image and voice data corresponding to a given person that is familiar to the first user.
10. The user device of claim 1 wherein a given synthesized bot has related given libraries corresponding to a given person that is familiar to the first user, and the given libraries include personal data of the given person that are mapped to different contexts.
11. The user device of claim 10 wherein the different contexts comprise different time frames of the given person's life.
12. The user device of claim 10 wherein the different contexts comprise different locations associated with the given person.
13. The user device of claim 10 wherein the different contexts comprise different topics associated with the given person.
14. A data enablement platform comprising: one or more servers that are configured to at least receive user data of a first user, the user data transmittable by a user device; the one or more servers comprising memory that has stored thereon a synthesized bot corresponding to a second person that is familiar to the first user; the one or more servers further configured to at least match the user data to pre-stored data to search for a response identifier of a 3rd party data source and internal response data, wherein the one or more servers of the data enablement platform are in data communication with the 3 rd party data source; and the one or more servers are further configured to at least transmit a response comprising the response identifier, the internal response data, and executable instructions that combine the internal response data with 3rd party response data obtained via the response identifier, wherein the response is transmittable to the user device.
15. The data enablement platform of claim 14 wherein the user data matches the pre-stored data according to a certain percentage threshold.
16. The data enablement platform of claim 14 wherein the user data is text data outputted by a speech-to-text computing process.
17. The data enablement platform of claim 14 wherein the executable instructions are configured to initiate the user device to output the internal response data first and then the 3rd party response data.
18. The data enablement platform of claim 14 receiving multiple communications of user data over time to build a behavior model of a given user.
19. The data enablement platform of claim 14 wherein the user data comprises body posture data.
20. The data enablement platform of claim 14 wherein the user data comprises facial expression data.
21. The data enablement platform of claim 14 wherein the user data comprises at least one of text data and voice data.
22. The data enablement platform of claim 14 wherein the synthesized bot is a voice bot of the second person.
23. The data enablement platform of claim 14 wherein the synthesized bot includes an image and voice data corresponding to the second person.
24. The data enablement platform of claim 14 wherein the user data comprises language data in a first language, and the one or more servers translate the language data to a second language, and the response further comprises the translated language data.
25. The data enablement platform of claim 14 wherein the one or more servers further transmit a command to an IoT device based upon the user data.
26. The data enablement platform of claim 14 , wherein the user data is a certain set of words associated with the first user, and if the certain set of words has been detected a certain number of times within a certain time frame, then the one or more servers transmit a notification message, the notification message transmittable to a second user device.