System for automatically augmenting a message based on context extracted from the message
An augmentation service receives message information about a message being authored by a message sender. The augmentation service calls a topic extraction service to extract a topic from the message information and then accesses inferences, based upon the topics, to identify a suggested augmentation to the message. The suggested augmentation is surfaced for the sender of the message. Similarly, a messaging system can process the message prior to sending it to a recipient and insert suggested augmentations into the message so that the recipient sees a message which has additional content over that which was sent by the sender.
1. A computer system, comprising:
at least one processor; and
a data store that stores instructions which, when executed by the at least one processor, cause the at least one processor to perform steps comprising:
receiving message information, including message content to be included in a message generated by a message service;
identifying an entity in the message information in response to a means for inferring inferences parsing the message information and generating tokens indicative of the entity extracted from the message information;
identifying a recipient associated with the message;
accessing a user-specific inference store based on the recipient, wherein the user-specific inference store stores an inference identified by the means for inferring inferences that indicates a correlation between the entity and an augmentation to include in the message;
identifying the augmentation based on the inference identified by the means for inferring inferences;
providing a user interface, wherein the user interface includes a drop-down menu including a link to the augmentation;
causing the augmentation that is linked in the drop-down menu to be attached to the message; and
sending, to the message service, the augmentation attached to the message.
2. The computer system of claim 1 wherein receiving message information comprises:
receiving user data identifying a first user who is authoring the message; and
receiving context information indicative of a context in which the message is generated.
3. The computer system of claim 2 wherein identifying an entity in the message information in response to a means for inferring inferences parsing the message information comprises:
identifying at least one of the recipient, a topic of the message, a location where the first user generates the message, or a document related to the message.
4. The computer system of claim 1 wherein the data store stores instructions which, when executed by the at least one processor, cause the at least one processor to perform acts further comprising:
detecting activity data indicative of activity of a plurality of different users;
for each given user of the plurality of different users, generating a set of inferences that each indicate a correlation between the given user and an entity in the activity data; and
storing the set of inferences for each given user in the user-specific inference store.
5. The computer system of claim 4 wherein identifying the augmentation to include in the message comprises:
identifying an attachment to the message as the augmentation to include in the message.
6. The computer system of claim 5 wherein sending of the augmentation to include in the message to the message service for surfacing to a first user comprises:
displaying, as a suggestion, an interactive user identifier identifying the attachment to be attached to the message;
detecting user interaction of the first user with the interactive user identifier to accept or dismiss the suggestion; and
if the user interaction indicates that the first user accepts the suggestion, then causing the augmentation to be attached to the message includes adding the attachment to a body of the message.
7. The computer system of claim 4 wherein identifying the augmentation to include in the message comprises:
identifying a user to be mentioned in a body of the message as the augmentation to include in the message.
8. The computer system of claim 7 wherein the user to be mentioned in the body of the message comprises the recipient.
9. The computer system of claim 7 wherein sending the augmentation to include in the message to the message services for surfacing to a first user comprises:
displaying, as a suggestion, an interactive user identifier identifying the user to be mentioned in the body of the message;
detecting user interaction of the first user with the interactive user identifier to accept or dismiss the suggestion; and
if the user interaction indicates that the first user accepts the suggestion, then adding the user identifier to the body of the message; and
the data store stores instructions which, when executed by the at least one processor, cause the at least one processor to perform steps further comprising:
feeding back the detected user interaction to modify generation of the set of inferences based on the detected user interaction.
10. The computer system of claim 1 wherein the data store stores instructions which, when executed by the at least one processor, cause the at least one processor to perform steps further comprising:
detecting a send indication indicative of the message being sent to a recipient;
identifying the augmentation to include in the message based on the inference; and
sending an indication of the augmentation to include in the message to the message service for surfacing to the recipient.
11. The computer system of claim 1 , wherein the user interface further includes an actuator configured to be actuated by a first user who is authoring the message to accept or reject to include the augmentation in the message.
12. The computer system of claim 11 , wherein upon receiving an actuation via the actuator, attaching the augmentation to the message.
13. A computer implemented method, comprising:
receiving message information including message content of a message generated by a message service;
identifying an entity in the message information in response to a means for inferring inferences parsing the message information and generating tokens indicative of the entity extracted from the message information;
identifying a recipient associated with the message;
accessing a user-specific inference store based on the recipient, wherein the user-specific inference store stores an inference identified by the means for inferring inferences that indicates a correlation between the entity and an augmentation to include in the message;
identifying the augmentation based on the inference identified by the means for inferring inferences;
providing a user interface, wherein the user interface includes a drop-down menu including a link to the augmentation;
causing the augmentation that is linked in the drop-down menu to be attached to the message; and
sending, to the message service, the augmentation attached to the message.
14. The computer implemented method of claim 11 and further comprising:
detecting activity data indicative of activity of a plurality of different users;
for each given user of the plurality of different users generating a set of inferences that each indicate a correlation between the given user and an entity in the activity data; and
storing the set of inferences for each given user in the user-specific inference store.
15. The computer implemented method of claim 14 wherein identifying the augmentation to include in the message comprises:
identifying an attachment to include in the message as the augmentation to include in the message.
16. The computer implemented method of claim 15 wherein sending an indication of the augmentation to include in the message comprises:
displaying, as a suggestion, an interactive user identifier identifying the attachment to be attached to the message;
detecting user interaction of the first user with the interactive user identifier to accept or dismiss the suggestion; and
if the user interaction indicates that the first user accepts the suggestion, then adding the attachment to the body of the message.
17. The computer implemented method of claim 16 and further comprising:
feeding back the detected user interaction to modify generation of the set of inferences based on the detected user interaction.
18. The computer implemented method of claim 16 wherein identifying the augmentation to include in the message comprises:
identifying a user to be mentioned in a body of the message as the augmentation to include in the message.
19. The computer implemented method of claim 18 wherein the user to be mentioned in the body of the message comprises the recipient.
20. The computer implemented method of claim 18 , wherein sending an indication of the augmentation to include in the message to the message service for surfacing to the first user comprises:
displaying, as a suggestion, an interactive user identifier identifying the user to be mentioned in the body of the message;
detecting user interaction of the first user with the interactive user identifier to accept or dismiss the suggestion; and
if the user interaction indicates that the first user accepts the suggestion, then adding the user identifier to the body of the message, and further comprising:
feeding back the detected user interaction to modify generation of the set of inferences based on the detected user interaction.
21. The computer implemented method of claim 13 and further comprising:
detecting a send indication indicative of the message being sent to a recipient;
identifying an entity in the message information in response to a means for inferring inferences parsing the message information;
accessing the user-specific inference store based on the recipient identified by the means for inferring inferences;
identifying the augmentation to include in the message based on the inference identified by the means for inferring inferences; and
sending an indication of the augmentation to include in the message to the message service for surfacing to the recipient.
22. The computer implemented method of claim 13 , wherein the user interface further includes an actuator configured to be actuated by a first user who is authoring the message to accept or reject to include the augmentation in the message.
23. The computer implemented method of claim 22 , wherein upon receiving an actuation via the actuator, attaching the augmentation to the message.
24. A computer implemented method, comprising:
receiving message content of a message generated by a message service;
detecting a send indication indicative of the message being sent to a recipient;
identifying an entity in the message content in response to a means for inferring inferences parsing message information and generating tokens indicative of the entity extracted from the message information;
accessing a user-specific inference store, specific to the recipient, that stores an inference identified by the means for inferring inferences that indicates a correlation between the entity and an augmentation to include in the message;
identifying the augmentation based on the inference identified by the means for inferring inferences;
providing a user interface, wherein the user interface includes a drop-down menu including a link to the augmentation, and wherein the user interface further includes an actuator configured to be actuated by a first user who is authoring the message to accept the augmentation to include in the message;
sending the augmentation to include in the message to the message service upon receiving an actuation via the actuator;
causing the augmentation that is linked in the drop-down menu to be attached to the message; and
including the augmentation to include in the message when the message is rendered by the message service.