IP Library Patent Application 15384950
Patent Application
App. No. 15/384,950

SYSTEMS AND METHODS FOR SUGGESTING EMOJI

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/384,950
Abstract

Implementations of the present disclosure are directed to a method, a system, and an article for suggesting emoji for insertion into a communication having text or other content. A plurality of features corresponding to the communication are obtained and provided to a plurality of emoji detection modules. A set of emoji and first confidence scores are received from each emoji detection module and provided to at least one classifier. A proposed set of candidate emoji and second confidence scores are received from the at least one classifier. A candidate emoji is inserted into the communication.

Claims (45)

1 . A computer-implemented method of suggesting emoji, the method comprising:

obtaining a plurality of features corresponding to a communication from a user;

providing the features to a plurality of emoji detection modules;

receiving from each emoji detection module a respective output comprising a set of emoji and first confidence scores, each first confidence score being associated with a different emoji in the set and representing a likelihood that the user may wish to insert the associated emoji into the communication;

providing the output from the emoji detection modules to at least one classifier;

receiving from the at least one classifier a proposed set of candidate emoji and second confidence scores, each second confidence score being associated with a different candidate emoji in the proposed set and representing a likelihood that the user may wish to insert the associated candidate emoji into the communication; and

inserting at least one of the candidate emoji into the communication.

2 . The method of claim 1 , wherein the plurality of features comprise at least one of a current cursor position in the communication, one or more words from the communication, one or more words from a previous communication, a user preference, and demographic information.

3 . The method of claim 1 , wherein the emoji detection modules comprise at least one of a grammar error correction module, a statistical machine translation module, a dictionary-based module, a part-of-speech tagging module, an information extraction module, a natural language processing module, a keyword matching module, and a finite state transducer module.

4 . The method of claim 3 , wherein the dictionary-based module is configured to map at least a portion of a word in the communication to at least one corresponding emoji.

5 . The method of claim 3 , wherein the natural language processing module comprises at least one of a parser, a morphological analyzer, and a semantic analyzer to extend a mapping between words and emoji provided by the dictionary-based module.

6 . The method of claim 3 , wherein the keyword matching module is configured to search for at least one keyword in the communication and match the at least one keyword with at least one tag associated with emoji.

7 . The method of claim 1 , wherein at least one of the first confidence scores and the second confidence scores are based on at least one of (i) a user preference, (ii) a linguistic domain, (iii) demographic information, (iv) prior usage of emoji by at least one of the user and a community of users, and (v) prior usage of emoji in prior communications having at least one of a word, a phrase, a context, and a sentiment in common with the communication.

8 . The method of claim 1 , wherein the at least one classifier comprises at least one of a supervised learning model, a partially supervised learning model, an unsupervised learning model, and an interpolation model.

9 . The method of claim 1 , wherein the at least one of the candidate emoji is inserted at the current cursor position and replaces at least one word in the communication.

10 . The method of claim 1 , wherein inserting the at least one of the candidate emoji comprises:

identifying a best emoji having a highest second confidence score in the proposed set of candidate emoji.

11 . The method of claim 1 , further comprising:

receiving a user selection of at least one of the candidate emoji from the proposed set of candidate emoji; and

building a usage history based on the user selection.

12 . The method of claim 1 , further comprising:

selecting the at least one classifier based on at least one of the user preferences and the demographic information.

13 . A system, comprising:

one or more processors programmed to perform operations comprising:

obtaining a plurality of features corresponding to a communication from a user;

providing the features to a plurality of emoji detection modules;

receiving from each emoji detection module a respective output comprising a set of emoji and first confidence scores, each first confidence score being associated with a different emoji in the set and representing a likelihood that the user may wish to insert the associated emoji into the communication;

providing the output from the emoji detection modules to at least one classifier;

receiving from the at least one classifier a proposed set of candidate emoji and second confidence scores, each second confidence score being associated with a different candidate emoji in the proposed set and representing a likelihood that the user may wish to insert the associated candidate emoji into the communication; and

inserting at least one of the candidate emoji into the communication.

14 . The system of claim 13 , wherein the plurality of features comprise at least one of a current cursor position in the communication, one or more words from the communication, one or more words from a previous communication, a user preference, and demographic information.

15 . The system of claim 13 , wherein the emoji detection modules comprise at least one of a grammar error correction module, a statistical machine translation module, a dictionary-based module, an information extraction module, a natural language processing module, a keyword matching module, and a finite state transducer module.

16 . The system of claim 13 , wherein at least one of the first confidence scores and the second confidence scores are based on at least one of (i) a user preference, (ii) a linguistic domain, (iii) demographic information, (iv) prior usage of emoji by at least one of the user and a community of users, and (v) prior usage of emoji in prior communications having at least one of a word, a phrase, a context, and a sentiment in common with the communication.

17 . The system of claim 13 , wherein the at least one classifier comprises at least one of a supervised learning model, a partially supervised learning model, an unsupervised learning model, and an interpolation model.

18 . The system of claim 13 , wherein the at least one of the candidate emoji is inserted at the current cursor position and replaces at least one word in the communication.

19 . The system of claim 13 , wherein inserting the at least one of the candidate emoji comprises:

identifying a best emoji having a highest second confidence score in the proposed set of candidate emoji.

20 . An article, comprising:

a non-transitory computer-readable medium comprising executable instructions, the executable instructions being executable by one or more processors to perform operations comprising:

obtaining a plurality of features corresponding to a communication from a user;

providing the features to a plurality of emoji detection modules;

receiving from each emoji detection module a respective output comprising a set of emoji and first confidence scores, each first confidence score being associated with a different emoji in the set and representing a likelihood that the user may wish to insert the associated emoji into the communication;

providing the output from the emoji detection modules to at least one classifier;

receiving from the at least one classifier a proposed set of candidate emoji and second confidence scores, each second confidence score being associated with a different candidate emoji in the proposed set and representing a likelihood that the user may wish to insert the associated candidate emoji into the communication; and

inserting at least one of the candidate emoji into the communication.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded May 19, 2020
From: COMERICA BANK
To: MZ IP HOLDINGS, LLC
Reel/Frame 052706/0899 →
RELEASE OF SECURITY INTEREST Recorded May 19, 2020
From: MGG INVESTMENT GROUP LP, AS COLLATERAL AGENT
To: MACHINE ZONE, INC.; SATORI WORLDWIDE, LLC; COGNANT LLC
Reel/Frame 052706/0917 →
SECURITY INTEREST Recorded May 22, 2018
From: MZ IP HOLDINGS, LLC
To: COMERICA BANK
Reel/Frame 046215/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2018
From: MACHINE ZONE, INC.
To: MZ IP HOLDINGS, LLC
Reel/Frame 045786/0179 →
NOTICE OF SECURITY INTEREST -- PATENTS Recorded Feb 2, 2018
From: MACHINE ZONE, INC.; SATORI WORLDWIDE, LLC; COGNANT LLC
To: MGG INVESTMENT GROUP LP, AS COLLATERAL AGENT
Reel/Frame 045237/0861 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2017
From: BOJJA, NIKHIL; KARUPPUSAMY, SATHEESHKUMAR; WANG, PIDONG; KANNAN, SHIVASANKARI; NEDUNCHEZHIAN, ARUN
To: MACHINE ZONE, INC.
Reel/Frame 040862/0144 →