IP Library Granted Patent US 12,231,379
Granted Patent B2
US 12,231,379 · App. 18/336,259 · Granted Feb 18, 2025

Computerized system and method for multi-factor message classification and delivery

Inventors: Neeti Narayan (Sunnyvale, CA); Hongwei Shang (Sunnyvale, CA); Changsung Kang (San Jose, CA); Jean-Marc Langlois (Menlo Park, CA)
Assignee: YAHOO ASSETS LLC
H04L51/02G06F40/205G06F40/30G06N3/04G06N3/08H04L51/21H04L51/224H04L51/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,379
App. No.
18/336,259
Granted
Feb 18, 2025
Kind
B2
Abstract

Disclosed are systems and methods for improving interactions with and between computers in content providing, searching and/or hosting systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel messaging framework that automatically applies a multi-factor analysis technique to incoming and received messages in order to properly identify a message's type and category, which dictates the manner in which the message is displayed within a recipient's inbox. The disclosed framework operates on two levels: i) it determines whether a message is from a human or machine sender (H/M classification), and ii) it determines the messages category (MAGMA categorization).

Claims (69)

1. A method comprising:

receiving, by a device over a network, a message sent by a sender that is addressed to an inbox of a recipient, the message comprising message content;

parsing, by the device, the message and identifying message information related to the sender, the message content and a subject of the message;

applying, by the device, a Human/Machine (H/M) classifier to the message, the H/M classifier comprising at least one sub-model that analyzes a message based on specific features of the message;

determining, by the device, based on the H/M classifier application and analysis, information indicating whether the message sender is a machine or human;

applying, by the device, a Machine Generated Mail Analysis (MAGMA) classifier to the message, the application of the MAGMA classifier comprising analyzing the subject information and the content information;

determining, by the device, based on the MAGMA classifier application, information indicating at least one specific category the message is associated with;

applying, by the device, a set of indicators to the message, the set of indicators providing information related to the machine or human determination and the MAGMA categorization; and

communicating, by the device, over the network, the message to the inbox along with the set of indicators.

2. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises a content model.

3. The method of claim 2 , wherein the application of the H/M classifier comprises analyzing the sender information and the content information via at least the content model.

4. The method of claim 2 , wherein application of the H/M classifier further comprises:

creating a vector representation of each word in the sender information;

creating a vector representation of each word in the content information;

analyzing each vector and based on the analysis, concatenate each vector to a content model vector; and

analyzing the content model vector using the content model, and based on the analysis, determining whether the message sender was a machine or a human.

5. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises a sender model.

6. The method of claim 5 , wherein application of the H/M classifier further comprises:

identifying, from the sender information, an email address and a name of the sender;

creating a vector representation of the email address;

creating a vector representation of the name;

concatenating each vector based on convolutional analysis of each vector to generate a sender model vector; and

analyzing the sender model vector using the sender model, and based on the analysis, determining whether the message sender was a machine or a human.

7. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises an action model.

8. The method of claim 7 , wherein application of the H/M classifier further comprises:

identifying data indicating actions related to message deletions within said inbox;

identifying data related to actions of opened messages within said inbox;

training the action model based on the identified deletion and opened data; and

analyzing the sender information and content information using the trained action model, and based on the analysis determining whether the message sender was a machine or a human.

9. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises a salutation model.

10. The method of claim 9 , wherein application of the H/M classifier further comprises:

identifying data indicating a positive label, the positive label corresponding to messages that contain an explicit salutation, the explicit salutation being a message with a match between the beginning part of a message body and a recipient name;

identifying data indicating a negative label, the negative label corresponding to messages that do not contain the explicit salutation;

training the salutation model based on the identified positive label and negative label data; and

analyzing at least a portion of the message content using the trained salutation model, and based on the analysis determining whether the message sender was a machine or a human.

11. The method of claim 1 , wherein the MAGMA classifier comprises a word encoder for specific portions of a message, the application of the MAGMA classifier to the message comprises analyzing the subject information and the content information via the portion specific word encoder.

12. The method of claim 11 , wherein analyzing the subject information and the content information via the portion specific word encoder further comprises:

analyzing the subject information, and based on the analysis, identifying a set of words less than a predetermined threshold within the subject;

analyzing the content information, and based on the analysis, identifying a set of words less than a predetermined threshold within the content;

creating a subject vector and a content vector based on the subject and content analysis, respectively;

concatenating the subject vector and the content vector based on application of a text classifier to the subject vector and the content vector;

analyzing the concatenated vector via a text classifier, the text classifier comprising a convolutional neural network layer; and

determining the at least one specific category for the message based on the analysis, wherein the MAGMA categorization indicator is based on the determination.

13. The method of claim 12 , wherein the at least one specific category is selected from a group of MAGMA classes comprising: Human (personal), Social, Travel, Career, Shopping, Finance and Other.

14. The method of claim 1 , wherein the communication causes the message to be displayed in a portion of a user interface of the inbox based on at least one of the set of indicators.

15. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises a neural network.

16. The method of claim 15 , wherein the neural network comprises a convolutional neural network (CNN).

17. The method of claim 1 , wherein the at least one sub-model of the H/M classifier comprises a combination of a plurality of sub-models that analyze a message based on specific features of the message.

18. The method of claim 17 , wherein the application of the H/M classifier comprising analyzing the sender information and the content information via said combination of sub-models based on said specific features.

19. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions that when executed by a processor associated with a computing device perform a method comprising:

receiving, over a network, a message sent by a sender that is addressed to an inbox of a recipient, the message comprising message content;

parsing the message and identifying message information related to the sender, the message content and a subject of the message;

applying a Human/Machine (H/M) classifier to the message, the H/M classifier comprising at least one sub-model that analyzes a message based on specific features of the message;

determining, based on the H/M classifier application and analysis, information indicating whether the message sender is a machine or human;

applying a Machine Generated Mail Analysis (MAGMA) classifier to the message, the application of the MAGMA classifier comprising analyzing the subject information and the content information;

determining, based on the MAGMA classifier application, information indicating at least one specific category the message is associated with;

applying a set of indicators to the message, the set of indicators providing information related to the machine or human determination and the MAGMA categorization; and

communicating, over the network, the message to the inbox along with the set of indicators.

20. A computing device comprising:

a processor; and

a non-transitory storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:

receiving logic executed by the processor for receiving, over a network, a message sent by a sender that is addressed to an inbox of a recipient, the message comprising message content;

parsing logic executed by the processor for parsing the message and identifying message information related to the sender, the message content and a subject of the message;

applying logic executed by the processor for applying a Human/Machine (H/M) classifier to the message, the H/M classifier comprising at least one sub-model that analyzes a message based on specific features of the message;

determining logic executed by the processor for identifying, based on the H/M classifier application and analysis, information indicating whether the message sender is a machine or human;

applying logic executed by the processor for applying a Machine Generated Mail Analysis (MAGMA) classifier to the message, the application of the MAGMA classifier comprising analyzing the subject information and the content information;

determining logic executed by the processor for determining, based on the MAGMA classifier application, information indicating at least one specific category the message is associated with;

applying logic executed by the processor for applying a set of indicators to the message, the set of indicators providing information related to the machine or human determination and the MAGMA categorization; and

communicating logic executed by the processor for communicating, over the network, the message to the inbox along with the set of indicators.

Assignments (4)
SUPPLEMENTAL PATENT SECURITY AGREEMENT Recorded Sep 17, 2025
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 072915/0540 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2023
From: NARAYAN, NEETI; SHANG, HONGWEI; KANG, CHANGSUNG; LANGLOIS, JEAN-MARC
To: OATH INC.
Reel/Frame 064795/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2023
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 064806/0413 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2023
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 064808/0168 →