IP Library › Granted Patent US 11,711,414
Granted Patent B2
US 11,711,414 · App. 17/538,545 · Granted Jul 25, 2023

Triggering changes to real-time special effects included in a live streaming video

Inventors: Artem Gaiduchenko (Marina de Rey, CA); Artem Yerofieiev (Marina del Rey, CA); Bohdan Pozharskyi (Venice, CA); Gabriel Lupin (Marina del Rey, CA); Oleksii Kholovchuk (Marina del Rey, CA); Travis Chen (Los Angeles, CA); Yurii Monastyrshyn (Santa Monica, CA); Denys Makoviichuk (Marina Del Rey, CA)
Assignee: Snap Inc.
H04L65/762H04L65/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,711,414
App. No.
17/538,545
Granted
Jul 25, 2023
Kind
B2
Abstract

Method for triggering changes to real-time special effects included in a live streaming video starts with a processor transmitting in real-time a video stream captured by a camera via a network. The processor causes a live streaming interface that includes the video stream to be displayed on the plurality of client devices. The processor receives a trigger to apply one of a plurality of special effects to the video stream and determines a first special effect of the plurality of special effects is associated with the trigger. The processor applies in real-time the first special effect to the video stream to generate a video stream having the first special effect and transmits in real-time the video stream having the first special effect via the network. The processor causes the live streaming interface that includes the video stream having the first special effect to be displayed on the plurality of client devices. Other embodiments are disclosed.

Claims (53)

1. A system comprising:

a processor; and

a memory component having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising:

causing a live streaming interface to be transmitted to and displayed on a plurality of client devices in real time, the live streaming interface including a video stream and a live stream of a video game being played by a user in real-time, the video stream and the live stream of the video game being displayed independently in the live streaming interface;

receiving a trigger to apply one of a plurality of special effects to the video stream, the plurality of special effects comprising augmented reality special effects that use a combination of one or more visual effects and one or more sound effects; and

applying in real-time a first special effect of the plurality of special effects to the video stream.

2. A system of claim 1 , the operations comprising:

transmitting in real-time the video stream having the first special effect via a network.

3. The system of claim 2 , the operations comprising:

causing the live streaming interface including the video stream having the first special effect to be displayed on the plurality of client devices.

4. The system of claim 2 , wherein receiving the trigger includes:

receiving a selection of a display item included in the live streaming interface from one of the plurality of client devices.

5. The system of claim 4 , the operations comprising determining that the first special effect is associated with the display item.

6. The system of claim 2 , the operations further comprising:

receiving a customized setting that associates a display item with the first special effect.

7. The system of claim 2 , the operations further comprising:

causing a lens selection user interface to be displayed on a display device, the lens selection user interface including a plurality of lens selections;

wherein the plurality of lens selections are associated with the plurality of special effects, respectively, and wherein the plurality of lens selections include a first lens selection associated with the first special effect and a second lens selection associated with a second special effect.

8. The system of claim 2 , wherein receiving the trigger includes:

receiving an input from a user via a lens selection user interface selecting a first lens selection, or

receiving an input from the user of a set of keys on a keyboard, wherein the set of keys is associated with the first lens selection.

9. The system of claim 2 , the operations further comprising:

receiving a subsequent trigger to apply one of the plurality of special effects to the video stream;

determining a second special effect of the plurality of special effects is associated with the subsequent trigger; and

applying in real-time the second special effect to the video stream to generate a video stream having the second special effect.

10. The system of claim 2 , wherein receiving the trigger includes:

receiving the trigger from a third-party application, wherein the trigger is generated by the third-party application based on an occurrence within the third-party application.

11. The system of claim 10 , wherein:

the third-party application is an email application, a messaging application, or a telephone application, and

the occurrence within the third-party application is a new email notification, a new message notification, or a telephone call notification.

12. The system of claim 10 , wherein the third-party application is the video game, wherein the occurrence within the video game includes a predetermined action by or on a user's character.

13. A method comprising:

causing a live streaming interface to be transmitted to and displayed on a plurality of client devices in real time, the live streaming interface including a video stream and a live stream of a video game being played by a user in real-time, the video stream and the live stream of a video game being displayed independently in the live streaming interface,

receiving a trigger to apply one of a plurality of special effects to the video stream, the plurality of special effects comprising augmented reality special effects that use a combination of one or more visual effects and one or more sound effects; and

applying in real-time a first special effect of the plurality of special effects to the video stream.

14. The method of claim 13 , further comprising:

transmitting in real-time the video stream having the first special effect via a network, and

causing the live streaming interface including the video stream having the first special effect to be displayed on the plurality of client devices.

15. The method of claim 13 , wherein receiving the trigger includes:

receiving a selection of a display item included in the live streaming interface from one of the plurality of client devices.

16. The method of claim 15 , further comprising determining that the first special effect is associated with the display item.

17. The method of claim 13 , further comprising:

receiving a customized setting that associates a display item with the first special effect.

18. The method of claim 13 , further comprising:

causing a lens selection user interface to be displayed on a display device, the lens selection user interface including a plurality of lens selections;

wherein the plurality of lens selections are associated with the plurality of special effects, respectively, and wherein the plurality of lens selections include a first lens selection associated with the first special effect and a second lens selection associated with a second special effect.

19. The method of claim 13 , wherein receiving the trigger includes:

receiving an input from a user via a lens selection user interface selecting a first lens selection, or

receiving an input from the user of a set of keys on a keyboard, wherein the set of keys is associated with the first lens selection.

20. A non-transitory computer storage medium, having stored thereon instructions, when executed by a processor, causes the processor to perform a method of triggering changes to real-time special effects included in a live streaming video comprising:

causing a live streaming interface to be transmitted to and displayed on a plurality of client devices in real time, the live streaming interface including a video stream and a live stream of a video game being played by a user in real-time, the video stream and the live stream of a video game being displayed independently in the live streaming interface,

receiving a trigger to apply one of a plurality of special effects to the video stream, the plurality of special effects comprising augmented reality special effects that use a combination of one or more visual effects and one or more sound effects; and

applying in real-time a first special effect of the plurality of special effects to the video stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2023
From: GAIDUCHENKO, ARTEM; YEROFIEIEV, ARTEM; POZHARSKYI, BOHDAN; LUPIN, GABRIEL; KHOLOVCHUK, OLEKSII; CHEN, TRAVIS; MONASTYRSHYN, YURII; MAKOVIICHUK, DENYS
To: SNAP INC.
Reel/Frame 063582/0420 →
Continuity (3)
Continuation 16264515 · Jan 31, 2019
Provisional Application 62751365 · Oct 26, 2018
Related Publication 20220166816A1 · May 26, 2022