IP Library › Granted Patent US 11,212,383
Granted Patent B2
US 11,212,383 · App. 16/878,868 · Granted Dec 28, 2021

Customizing text messages in modifiable videos of multimedia messaging application

Inventors: Jeremy Voss (Los Angeles, CA); Victor Shaburov (Ocean Village, GI); Ivan Babanin (Saratov, RU); Aleksandr Mashrabov (Sochi, RU); Roman Golobokov (Sochi, RU)
Assignee: Snap Inc.
H04M1/72439G06T11/60G06T13/80H04L51/02H04L51/16H04M1/72427H04M1/72436H04M1/72442
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,212,383
App. No.
16/878,868
Granted
Dec 28, 2021
Kind
B2
Abstract

A system for customizing text messages in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to analyze recent messages of a user in the MMA to determine a context of the recent messages; determine, based on the context, a customized text message; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages; replace the preset text messages in the relevant modifiable videos with the customized message; and render the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

Claims (73)

1. A system for customizing text messages in modifiable videos, the system comprising at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to implement the following operations upon executing the processor-executable codes:

analyzing recent messages of a user in a multimedia messaging application to determine a context of the recent messages;

determining, based on the context, a customized text message;

selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages;

replacing the preset text messages in the relevant modifiable videos with the customized message; and

rendering the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

2. The system of claim 1 , further comprising:

providing the user with an option to enter a search string for searching the relevant modifiable videos in the database; and

prefilling the search string with the customized text message.

3. The system of claim 2 , further comprising:

receiving an indication that the user has modified the customized text message in the search string; and

in response to the indication, updating, based on the modified customized text message, the list of relevant modifiable videos.

4. The system of claim 1 , further comprising:

receiving an indication that the user has selected a modifiable video from the list of modifiable videos; and

storing information concerning the context, the customized text message, the list of relevant modifiable videos, and the selected modifiable video to a statistical log.

5. The system of claim 4 , wherein the customized text message is determined by a machine learning model based on historical data from the statistical log.

6. The system of claim 1 , further comprising:

determining, based on the recent messages, an emotional state of the user;

selecting, based on the emotional state, a style of text animation from a list of styles of text animations; and

replacing a preset style of text animation in the relevant modifiable videos with the selected style of text animation, wherein the relevant modifiable videos are associated with the preset style of text animation.

7. The system of claim 6 , further comprising:

receiving an indication that the user has selected a modifiable video from the list of modifiable videos; and

providing the user with an option to modify the selected style of text animation in the selected modifiable video.

8. The system of claim 7 , further comprising:

receiving an indication that the user has modified the selected style of text animation in the selected modifiable video;

storing information concerning the context and the modified selected style of text animation to a statistical log; and

adjusting, based on historical data in the statistical log, an algorithm for selecting the style of text animation from the list of styles of text animations.

9. The system of claim 1 , further comprising:

selecting, based on the customized message, a soundtrack from a library of soundtracks; and

replacing preset soundtracks in the relevant modifiable videos with the selected soundtrack, wherein the relevant modifiable videos are associated with the preset soundtracks.

10. The system of claim 1 , further comprising:

determining, based on the recent messages, an emotional state of the user;

selecting, based on the emotional state, a hairstyle from a list of hairstyles; and

applying the hairstyle to an image of hair in a selfie of the user to modify the selfie of the user, and wherein the rendering including displaying the modified selfie of the user in the relevant modifiable videos.

11. A method for customizing text messages in modifiable videos, the method comprising:

analyzing recent messages of a user in a multimedia messaging application to determine a context of the recent messages;

determining, based on the context, a customized text message;

selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages;

replacing the preset text messages in the relevant modifiable videos with the customized message; and

rendering the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

12. The method of claim 11 , further comprising:

providing the user with an option to enter a search string for searching the relevant modifiable videos in the database; and

prefilling the search string with the customized text message.

13. The method of claim 12 , further comprising:

receiving an indication that the user has modified the customized text message in the search string; and

in response to the indication, updating, based on the modified customized text message, the list of relevant modifiable videos.

14. The method of claim 11 , further comprising:

receiving an indication that the user has selected a modifiable video from the list of modifiable videos; and

storing information concerning the context, the customized text message, the list of relevant modifiable videos, and the selected modifiable video to a statistical log.

15. The method of claim 14 , wherein the customized text message is determined by a machine learning model based on historical data of the statistical log.

16. The method of claim 11 , further comprising:

determining, based on the recent messages, an emotional state of the user;

selecting, based on the emotional state, a style of text animation from a list of styles of text animations; and

replacing a preset style of text animation in the relevant modifiable videos with the selected style of text animation, wherein the relevant modifiable videos are associated with the preset style of text animation.

17. The method of claim 16 , further comprising:

receiving an indication that the user has selected a modifiable video from the list of modifiable videos; and

providing the user with an option to modify the selected style of text animation in the selected modifiable video.

18. The method of claim 17 , further comprising:

receiving an indication that the user has modified the selected style of text animation in the selected modifiable video;

storing information concerning the context and the modified selected style of text animation into a statistical log; and

adjusting, based on historical data in the statistical log, an algorithm for selecting the style of text animation from the list of styles of text animations.

19. The method of claim 11 , further comprising:

selecting, based on the customized message, a soundtrack from a library of soundtracks;

replacing preset soundtracks in the relevant modifiable videos with the selected soundtrack, wherein the relevant modifiable videos are associated with the preset soundtracks;

determining, based on the recent messages, an emotional state of the user;

selecting, based on the emotional state, a hairstyle from a list of hairstyles; and

applying the hairstyle to an image of hair in a selfie of the user to modify the selfie of the user, and wherein the rendering including displaying the modified selfie of the user in the relevant modifiable videos.

20. A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method for customizing text messages in modifiable videos, the method comprising:

analyzing recent messages of a user in a multimedia messaging application to determine a context of the recent messages;

determining, based on the context, a customized text message;

selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages;

replacing the preset text messages in the relevant modifiable videos with the customized message; and

rendering the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2021
From: VOSS, JEREMY; SHABUROV, VICTOR; BABANIN, IVAN; MASHRABOV, ALEKSANDR; GOLOBOKOV, ROMAN
To: SNAP INC.
Reel/Frame 058108/0254 →
Continuity (1)
Related Publication 20210368039A1 · Nov 25, 2021
Cited By (2)
US 12,315,495 US 12,361,934