Intelligent reasoning framework for user intent extraction

1. A method implemented in a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, the method comprising:

receiving, at the computer system, data relating to a plurality of aspects of at least one person, including data from at least one of physical or physiological sensors and communicatively connected devices;

extracting, at the computer system, from the received data, features relevant to events relating to at least one person;

extracting, at the computer system, at least one intent of at least one event relating to at least one person, wherein the extracted intent comprises a strategic intent comprising that which the at least one person seeks to achieve over a long-term in a domain and a tactical intent comprising that which the at least one person seeks to achieve over a short-term, wherein extracting the at least one intent comprises performing intention awareness processing to form multidimensional intention awareness vectors and determining a component of at least one multidimensional intention awareness vector as a barycenter of the weighted points of the vector, including consistent tracking and extrapolation of objects in an environment and circumstantial semantics, performing Sentic processing to form multidimensional intention Sentic vectors and determining a component of at least one multidimensional intention Sentic vector as a barycenter of the weighted points of the vector, including using conceptual and affective information associated with objects and actors of the environment, and generating an ensemble datastream representing the extracted at least one intent by fusing the intention awareness vectors and the Sentic vectors; and

performing, at the computer system, an action based on the extracted at least one intent.

2. The method of claim 1 , wherein the data relating to a plurality of aspects of at least one person comprises live data retrieved from a plurality of capture points that at least one person is exposed to and interacts with;

the communicatively connected device comprises at least one of a microphone, room camera, fridge camera, smart mobile, smart refrigerator, smart watch, smart fire alarm, smart door lock, smart bicycle, medical sensor, fitness tracker, smart security system, voice controller, dash button, doorbell cam, mobile robot, smart light switch, and air quality monitor;

the physical and physiological sensor comprises at least one of an audio sensor, video sensor, electro-encephalogram sensor, electro-cardiogram sensor, heart rate sensor, breathing rate sensor, blood pressure sensor, body temperature sensor, head movement sensor, body posture sensor, and blood oxygenation level sensor, humidity sensor, biometric sensor; and

the data further comprises at least one of browsing history, bookmarks, browsing behavior, time spent on particular web pages, location history, calendar with past and upcoming events, social media activity, posts, social network graph, text, audio, video, social media content, chat, Short Message Service (SMS), email, medical visits, current diseases, medical treatments, real-time movements, breathing, cardiac frequency, and sleep patterns.

3. The method of claim 2 , wherein the features relevant to events relating to at least one person are extracted using artificial intelligence and machine learning models trained using data relating to a plurality of aspects of at least one person, wherein data relating to actions that are highly-specific predictors for particular intents are tagged.

4. The method of claim 3 , wherein at least one intent of at least one event relating to at least one person is extracted using ontologies data relating to subject areas that shows the properties and the relations between the subject area; and

ontologies methodology is used to create a supporting framework for intention query by defining concepts, sub-concepts, relationships, and aggregations of multiple concepts.

5. The method of claim 4 , wherein the physical action comprises at least one of generating an alarm, providing information or suggestions, and providing narrativization of events.

6. A system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor to perform:

receiving data relating to a plurality of aspects of at least one person, including data from at least one of physical or physiological sensors and communicatively connected devices;

extracting from the received data, features relevant to events relating to at least one person;

extracting, at the computer system, at least one intent of at least one event relating to at least one person, wherein the extracted intent comprises a strategic intent comprising that which the at least one person seeks to achieve over a long-term in a domain and a tactical intent comprising that which the at least one person seeks to achieve over a short-term, wherein extracting the at least one intent comprises performing intention awareness processing to form multidimensional intention awareness vectors and determining a component of at least one multidimensional intention awareness vector as a barycenter of the weighted points of the vector, including consistent tracking and extrapolation of objects in an environment and circumstantial semantics, performing Sentic processing to form multidimensional intention Sentic vectors and determining a component of at least one multidimensional intention Sentic vector as a barycenter of the weighted points of the vector, including using conceptual and affective information associated with objects and actors of the environment, and generating an ensemble datastream representing the extracted at least one intent by fusing the intention awareness vectors and the Sentic vectors; and

performing an action based on the extracted at least one intent.

7. The system of claim 6 , wherein the data relating to a plurality of aspects of at least one person comprises live data retrieved from a plurality of capture points that at least one person is exposed to and interacts with;

the communicatively connected device comprises at least one of a microphone, room camera, fridge camera, smart mobile, smart refrigerator, smart watch, smart fire alarm, smart door lock, smart bicycle, medical sensor, fitness tracker, smart security system, voice controller, dash button, doorbell cam, mobile robot, smart light switch, and air quality monitor;

the physical and physiological sensor comprises at least one of an audio sensor, video sensor, electro-encephalogram sensor, electro-cardiogram sensor, heart rate sensor, breathing rate sensor, blood pressure sensor, body temperature sensor, head movement sensor, body posture sensor, and blood oxygenation level sensor, humidity sensor, biometric sensor; and

the data further comprises at least one of browsing history, bookmarks, browsing behavior, time spent on particular web pages, location history, calendar with past and upcoming events, social media activity, posts, social network graph, text, audio, video, social media content, chat, Short Message Service (SMS), email, medical visits, current diseases, medical treatments, real-time movements, breathing, cardiac frequency, and sleep patterns.

8. The system of claim 7 , wherein the features relevant to events relating to at least one person are extracted using artificial intelligence and machine learning models trained using data relating to a plurality of aspects of at least one person, wherein data relating to actions that are highly-specific predictors for particular intents are tagged.

9. The system of claim 8 , wherein at least one intent of at least one event relating to at least one person is extracted using ontologies data relating to subject areas that shows the properties and the relations between the subject area; and

ontologies methodology is used to create a supporting framework for intention query by defining concepts, sub-concepts, relationships, and aggregations of multiple concepts.

10. The method of claim 9 , wherein the physical action comprises at least one of generating an alarm, providing information or suggestions, and providing narrativization of events.

11. A computer program product comprising a non-transitory computer readable storage having program instructions embodied therewith, the program instructions executable by a computer, to cause the computer to perform a method comprising:

receiving, at the computer system, data relating to a plurality of aspects of at least one person, including data from at least one of physical or physiological sensors and communicatively connected devices;

extracting, at the computer system, from the received data, features relevant to events relating to at least one person;

extracting, at the computer system, at least one intent of at least one event relating to at least one person, wherein the extracted intent comprises a strategic intent comprising that which the at least one person seeks to achieve over a long-term in a domain and a tactical intent comprising that which the at least one person seeks to achieve over a short-term, wherein extracting the at least one intent comprises performing intention awareness processing to form multidimensional intention awareness vectors and determining a component of at least one multidimensional intention awareness vector as a barycenter of the weighted points of the vector, including consistent tracking and extrapolation of objects in an environment and circumstantial semantics, performing Sentic processing to form multidimensional intention Sentic vectors and determining a component of at least one multidimensional intention Sentic vector as a barycenter of the weighted points of the vector, including using conceptual and affective information associated with objects and actors of the environment, and generating an ensemble datastream representing the extracted at least one intent by fusing the intention awareness vectors and the Sentic vectors; and

performing, at the computer system, an action based on the extracted at least one intent.

12. The computer program product of claim 11 , wherein the data relating to a plurality of aspects of at least one person comprises live data retrieved from a plurality of capture points that at least one person is exposed to and interacts with;

the communicatively connected device comprises at least one of a microphone, room camera, fridge camera, smart mobile, smart refrigerator, smart watch, smart fire alarm, smart door lock, smart bicycle, medical sensor, fitness tracker, smart security system, voice controller, dash button, doorbell cam, mobile robot, smart light switch, and air quality monitor;

the physical and physiological sensor comprises at least one of an audio sensor, video sensor, electro-encephalogram sensor, electro-cardiogram sensor, heart rate sensor, breathing rate sensor, blood pressure sensor, body temperature sensor, head movement sensor, body posture sensor, and blood oxygenation level sensor, humidity sensor, biometric sensor; and

the data further comprises at least one of browsing history, bookmarks, browsing behavior, time spent on particular web pages, location history, calendar with past and upcoming events, social media activity, posts, social network graph, text, audio, video, social media content, chat, Short Message Service (SMS), email, medical visits, current diseases, medical treatments, real-time movements, breathing, cardiac frequency, and sleep patterns.

13. The computer program product of claim 12 , wherein the features relevant to events relating to at least one person are extracted using artificial intelligence and machine learning models trained using data relating to a plurality of aspects of at least one person, wherein data relating to actions that are highly-specific predictors for particular intents are tagged.

14. The computer program product of claim 13 , wherein at least one intent of at least one event relating to at least one person is extracted using ontologies data relating to subject areas that shows the properties and the relations between the subject area; and

ontologies methodology is used to create a supporting framework for intention query by defining concepts, sub-concepts, relationships, and aggregations of multiple concepts.

15. The computer program product of claim 14 , wherein the physical action comprises at least one of generating an alarm, providing information or suggestions, and providing narrativization of events.