IP Library Granted Patent US 11,418,849
Granted Patent B2
US 11,418,849 · App. 17/077,539 · Granted Aug 16, 2022

Systems and methods for inserting emoticons within a media asset

Inventors: Ankur Anil Aher (Maharashtra, IN); Charishma Chundi (Andhra Pradesh, IN)
Assignee: Rovi Guides, Inc.
H04N21/4884G06V20/41H04N21/4667H04N21/4755H04N21/8146G06F16/685
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,849
App. No.
17/077,539
Granted
Aug 16, 2022
Kind
B2
Abstract

Systems and methods are described herein for inserting emoticons within a media asset based on an audio portion of the media asset. Each audio portion of a media asset is associated with a respective part of speech, and an emotion corresponding to the audio portion for the media asset is determined. A corresponding emoticon is identified based on the determined emotion in the audio portion and presented in the subtitles.

Claims (55)

1. A method comprising:

receiving a media asset comprising:

an audio portion, and

subtitles corresponding to the audio portion;

determining an emotion corresponding to the audio portion, the emotion comprising at least one of the following emotion characteristics: a facial expression of actors in the media asset, a body expression of actors in the media asset, a dialogue in the audio portion of the media asset, a tone of the dialogue in the audio portion of the media asset, and background music in the audio portion of the media asset;

identifying, in an emoticon database, an emoticon based on the emotion;

calculating, based on the emotion characteristics of the media asset, an emotion score;

comparing the emotion score against a threshold score; and

in response to the emotion score being lower than the threshold score, causing to be presented the subtitles and the emoticon, wherein the emoticon is inserted in the subtitles.

2. The method of claim 1 , further comprising:

in response to the emotion score being greater than the threshold score, accessing a user profile to determine a user preference emoticon threshold;

comparing the emotion score to the user preference emoticon threshold;

in response to the emotion score being lower than the user preference emoticon threshold, inserting the emoticon during the presentation of the media asset.

3. The method of claim 1 , further comprising:

calculating, based on the emotion characteristics of the media asset, an emotion score;

receiving a threshold for emoticons associated with a user profile;

comparing the emotion score to the threshold;

in response to the emotion score being lower than the threshold, causing to be presented the subtitles and the emoticon, wherein the emoticon is inserted in the subtitles.

4. The method of claim 1 , wherein causing to be presented the subtitles and the emoticon, comprises:

determining a source of the emotion, wherein the source is one of an actor, an action, or apparatus within the media asset;

identifying a location of the source within a video frame of the media asset; and

causing to be presented the emoticon next to the location of the source.

5. The method of claim 1 , wherein the causing to be presented the emoticon into the media asset comprises causing to be presented the emoticon into the subtitles corresponding to the audio portion of the media asset.

6. The method of claim 1 , wherein the audio portion of the media asset comprises a start time of the audio portion, an end time of the audio portion and the emotion associated with the emotion characteristics, and wherein causing to be presented the emoticon into the media asset comprises causing to be presented the emoticon into the media asset from the start time to the end time of the audio portion.

7. The method of claim 1 , wherein the emoticon is transparent to minimize covering up content on the media asset.

8. The method of claim 1 , further comprising:

receiving instructions to enable the presentation of the subtitles and the emoticon into the media asset.

9. A system comprising:

processing circuitry configured to:

receive a media asset comprising:

an audio portion, and

subtitles corresponding to the audio portion;

determine an emotion corresponding to the audio portion, the emotion comprising at least one of the following emotion characteristics: a facial expression of actors in the media asset, a body expression of actors in the media asset, a dialogue in the audio portion of the media asset, a tone of the dialogue in the audio portion of the media asset, and background music in the audio portion of the media asset;

identify, in an emoticon database, an emoticon based on the emotion;

calculate, based on the emotion characteristics of the media asset, an emotion score;

compare the emotion score against a threshold score; and

in response to the emotion score being lower than the threshold score, cause to be presented the subtitles and the emoticon, wherein the emoticon is inserted in the subtitles.

10. The system of claim 9 , the processing circuitry is further configured:

in response to the emotion score being greater than the threshold score, access a user profile to determine a user preference emoticon threshold;

compare the emotion score to the user preference emoticon threshold;

in response to the emotion score being lower than the user preference emoticon threshold, cause to be presented the emoticon during the presentation of the media asset.

11. The system of claim 9 , the processing circuitry is further configured:

calculate, based on the emotion characteristics of the media asset, an emotion score;

receive a threshold for emoticons associated with a user profile;

compare the emotion score to the threshold;

in response to the emotion score being lower than the threshold, cause to be presented the subtitles and the emoticon, wherein the emoticon is inserted in the subtitles.

12. The system of claim 9 , wherein the processing circuitry when causing to be presented the subtitles and the emoticon, is configured to:

determine a source of the emotion, wherein the source is one of an actor, an action, or apparatus within the media asset;

identify a location of the source within a video frame of the media asset; and

cause to be presented the emoticon next to the location of the source.

13. The system of claim 9 , wherein the processing circuitry when causing to be presented the emoticon into the media asset further configured to cause to be presented the emoticon into the subtitles corresponding to the audio portion of the media asset.

14. The system of claim 9 , wherein the processing circuitry comprises the audio portion of the media asset that is configured with a start time of the audio portion, an end time of the audio portion and the emotion associated with the emotion characteristics, and wherein causing to be presented the emoticon into the media asset comprises causing to be presented the emoticon into the media asset from the start time to the end time of the audio portion.

15. The system of claim 9 , wherein the emoticon is transparent to minimize covering up content on the media asset.

16. The system of claim 9 , the processing circuitry is further configured to:

receiving instructions to enable the presentation of the subtitles and the emoticon into the media asset.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0392 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2020
From: AHER, ANKUR ANIL; CHUNDI, CHARISHMA
To: ROVI GUIDES, INC.
Reel/Frame 054682/0713 →
Continuity (1)
Related Publication 20220132217A1 · Apr 28, 2022
Cited By (1)
US 12,627,865