IP Library Granted Patent US 11,888,798
Granted Patent B2
US 11,888,798 · App. 17/458,633 · Granted Jan 30, 2024

Attachment and embedded object positioning validation

Inventors: Rohit Pradeep Shetty (Bangalore, IN); Ramanandan Nambannor Kunnath (Bangalore, IN)
Assignee: VMware, Inc.
H04L51/08H04L51/212H04L51/224H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,888,798
App. No.
17/458,633
Granted
Jan 30, 2024
Kind
B2
Abstract

Disclosed are various approaches for validating a relevance or an accuracy associated with an item being attached to a message or inserted inline with the text of the message or other type of document. An addition of the item (e.g., attachment, hyperlink, embedded image, etc.) to the message being generated by a sender can be detected. Message keywords associated with the message content and item keywords associated with the item content can be identified following an analysis of the message content and item content. The message keywords and item keywords can be compared to determine a likelihood of a mismatch between the item and the message. Upon determining a potential mismatch and prior to the message being sent to a recipient, a notification identifying the likelihood of the mismatch is presented to the sender.

Claims (51)

1. A system for determining a relevance of an item added to a message, the system comprising:

a client device;

at least one application executable in the client device, wherein, when executed, the at least one application causes the client device to at least:

detect an addition of the item to the message being generated by a sender in a user interface of a client application of the client device, the item comprising at least one of: an attachment to the message or an embedded object within the message;

determine a confidence score based at least in part on a comparison of: a plurality of message keywords extracted from user-entered message content of the message during creation of the message within the user interface of the client application, and a plurality of item keywords extracted from image data or video data of the embedded object that is inserted in a particular position in the user-entered message content during the creation of the message, the confidence score indicating a likelihood of a mismatch between the item and the message; and

render a notification on a display of the client device in an instance in which the confidence score fails to meet or exceed a predefined threshold, the notification identifying the mismatch between the item and the message and positioning information based at least in part on the particular position of the embedded object.

2. The system of claim 1 , wherein the item comprises the attachment to the message, and wherein, when executed, the at least one application causes the client device to at least determine a type of attachment associated with the attachment, the item keywords being extracted according to an analysis that is based at least in part on the type of attachment.

3. The system of claim 1 , wherein the item comprises the embedded object, and the embedded object comprises an embedded image or a link.

4. The system of claim 3 , wherein, when executed, the at least one application causes the client device to at least identify an alternative location within the message content for inclusion of the embedded object based at least in part on the comparison of the message keywords and the item keywords, the notification indicating the alternative location.

5. The system of claim 4 , wherein the message keywords are associated with a respective content section of the message content that includes a respective keyword in the message keywords, and identifying the alternative location is further based at least in part on the respective content section of the message content.

6. The system of claim 1 , wherein the client device is enrolled in a management service operated by an enterprise, and when executed, the at least one application causes the client device to at least:

extract the message keywords from the message content according to an analysis of the message content that is based at least in part on a role of the sender in the enterprise.

7. The system of claim 1 , wherein, when executed, the at least one application further causes the client device to at least:

send the message content and item content comprising the item to at least one computing device, the at least one computing device being configured to:

extract the message keywords from the message content;

extract the item keywords from the item content; and

calculate the confidence score based at least in part on the comparison of the message keywords and the item keywords; and

receive the confidence score from the at least one computing device.

8. A method for determining a relevance of an item added to a message, the method comprising:

detecting, by a client device, an addition of the item to the message being generated by a sender in a user interface of a client application of the client device, the item comprising at least one of: an attachment to the message or an embedded object within the message;

determining, by the client device, a confidence score based at least in part on a comparison of: a plurality of message keywords extracted from user-entered message content of the message during creation of the message within the user interface of the client application, and a plurality of item keywords extracted from image data or video data of the embedded object that is inserted in a particular position in the user-entered message content during the creation of the message, the confidence score indicating a likelihood of a mismatch between the item and the message; and

rendering, by the client device, a notification on a display of the client device in an instance in which the confidence score fails to meet or exceed a predefined threshold, the notification identifying the mismatch among the item and the message and positioning information based at least in part on the particular position of the embedded object.

9. The method of claim 8 , wherein the item comprises the attachment to the message, and further comprising determining a type of attachment associated with the attachment, the item keywords being extracted according to an analysis that is based at least in part on the type of attachment.

10. The method of claim 8 , wherein the item comprises the embedded object, and the embedded object comprises an embedded image or an embedded link.

11. The method of claim 10 , further comprising identifying, by the client device, an alternative location within the message content for inclusion of the embedded object based at least in part on the comparison of the message keywords and the item keywords, the notification indicating the alternative location.

12. The method of claim 11 , wherein the message keywords are associated with a respective content section of the message content that includes a respective keyword in the message keywords, and identifying the alternative location is further based at least in part on the respective content section of the message content.

13. The method of claim 8 , wherein the client device is enrolled in a management service operated by an enterprise, and further comprising:

extracting, by the client device, the message keywords from the message content according to an analysis of the message content that is based at least in part on a role of the sender in the enterprise.

14. The method of claim 8 , further comprising:

sending, by the client device, the message content and item content comprising the item to at least one computing device, the at least one computing device being configured to:

extract the message keywords from the message content;

extract the item keywords from the item content; and

calculate the confidence score based at least in part on the comparison of the message keywords and the item keywords; and

receiving, by the client device, the confidence score from the at least one computing device.

15. A non-transitory computer readable medium for determining a relevance of an item added to a message, the non-transitory computer readable medium comprising machine-readable instructions that, when executed by a processor of a client device, cause the client device to at least:

detect an addition of the item to the message being generated by a sender in a user interface of a client application of the client device, the item comprising at least one of: an embedded object within the message;

determine a confidence score based at least in part on a comparison of: a plurality of message keywords extracted from user-entered message content of the message during creation of the message within the user interface of the client application, and a plurality of item keywords extracted from image data or video data of the embedded object that is inserted in a particular position in the user-entered message content during the creation of the message, the confidence score indicating a likelihood of a mismatch between the item and the message; and

render a notification on a display of the client device in an instance in which the confidence score fails to meet or exceed a predefined threshold, the notification identifying the mismatch among the item and the message and positioning information based at least in part on the particular position of the embedded object.

16. The non-transitory computer readable medium of claim 15 , wherein the item comprises the attachment to the message, and wherein, when executed, the machine-readable instructions cause the client device to at least determine a type of attachment associated with the attachment, the item keywords being extracted according to an analysis that is based at least in part on the type of attachment.

17. The non-transitory computer readable medium of claim 16 , wherein:

the item comprises the embedded object, and the embedded object comprises an embedded image or an embedded link; and

when executed, the machine-readable instructions cause the client device to at least identify an alternative location within the message content for inclusion of the embedded object based at least in part on the comparison of the message keywords and the item keywords, the notification indicating the alternative location.

18. The non-transitory computer readable medium of claim 17 , wherein the message keywords are associated with a respective content section of the message content that includes a respective keyword in the message keywords, and identifying the alternative location is further based at least in part on the respective content section of the message content.

19. The non-transitory computer readable medium of claim 15 , wherein the client device is enrolled in a management service operated by an enterprise, and when executed, the machine-readable instructions further cause the client device to at least:

extract the message keywords from the message content according to an analysis of the message content that is based at least in part on a role of the sender in the enterprise.

20. The non-transitory computer readable medium of claim 15 , when executed, the machine-readable instructions further cause the client device to at least:

send the message content and item content comprising the item to at least one computing device, the at least one computing device being configured to:

extract the message keywords from the message content;

extract the item keywords from the item content; and

calculate the confidence score based at least in part on the comparison of the message keywords and the item keywords; and

receive the confidence score from the at least one computing device.

Assignments (5)
PATENT ASSIGNMENT Recorded Aug 5, 2024
From: VMWARE LLC
To: OMNISSA, LLC
Reel/Frame 068327/0365 →
SECURITY INTEREST Recorded Jul 3, 2024
From: OMNISSA, LLC
To: UBS AG, STAMFORD BRANCH
Reel/Frame 068118/0004 →
CHANGE OF NAME Recorded Apr 15, 2024
From: VMWARE, INC.
To: VMWARE LLC
Reel/Frame 067102/0242 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2021
From: SHETTY, ROHIT PRADEEP; KUNNATH, RAMANANDAN NAMBANNOR
To: VMWARE, INC.
Reel/Frame 058061/0015 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2021
From: SHETTY, ROHIT PRADEEP; NAMBANNOR KUNNATH, RAMANANDAN
To: VMWARE, INC.
Reel/Frame 057305/0349 →