IP Library Granted Patent US 10,321,092
Granted Patent B2
US 10,321,092 · App. 15/392,845 · Granted Jun 11, 2019

Context-based media effect application

Inventors: Daniel Danker (San Francisco, CA); David J. Capra (San Francisco, CA); Tory Hargro (Foster City, CA)
Assignee: FACEBOOK, INC.
H04N7/147H04N7/152H04N21/2343H04N21/252H04N21/25891H04N21/4758
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,321,092
App. No.
15/392,845
Granted
Jun 11, 2019
Kind
B2
Abstract

Exemplary embodiments relate to techniques for applying media effects to a video stream. For example, media effects may be applied and/or altered based on input from viewers or participants in the video stream. Changes to the media effects may accumulate based on the inputs. In another example, viewership numbers or engagement with a user applying a media effect may alter the media effect. In a broadcast context, actions of the broadcast audience (e.g., as measured by polling) may affect the broadcast and hence the broadcaster. Object recognition and/or people recognition may be applied to cumulatively alter the media effects in an augmented reality context.

Claims (43)

1. A method, comprising:

accessing, at a media effect server, a video stream on a data channel connecting the media effect server to a sending client;

receiving an instruction to apply a media effect to the video stream, wherein the media effect is associated with a plurality of tiers, each tier associated with a predetermined level of recipient client engagement and a predefined audible or visible augmentation configured to be added to the video stream, and wherein an increasing level of recipient client engagement beyond one or more of the predetermined levels is associated with a higher tier of the media effect;

applying a first tier of the media effect to the video stream by adding the predefined audible or visible augmentation associated with the first tier to the video stream, the applying performed at the media effect server;

receiving input from a plurality of recipient clients;

accumulating the input across the plurality of users;

determining that the accumulated input has exceeded the predetermined level of recipient client engagement associated with a second tier; and

augmenting the predefined audible or visible augmentation associated with the first tier with the predefined audible or visible augmentation associated with the second tier in the video stream, the augmenting performed at the media effect server based on the accumulated input.

2. The method of claim 1 , the input associated with a plurality of vectors, wherein accumulating the input comprises adding the vectors together.

3. The method of claim 1 , the input comprising one or more of a viewership status or an engagement with the video stream.

4. The method of claim 1 , the video stream comprising a video broadcast and the input comprising poll results of an audience of the video broadcast.

5. The method of claim 1 , the video stream comprising a video broadcast associated with a broadcaster that originates the video broadcast, wherein the media effect changes the video broadcast automatically without input from the broadcaster.

6. The method of claim 1 , further comprising determining whether the accumulated input exceeds a modification threshold, wherein the media effect is modified after the accumulated input exceeds the modification threshold.

7. A non-transitory computer-readable storage medium storing instructions configured to cause one or more processors to:

access, at a media effect server, a video stream on a data channel connecting the media effect server to a sending client;

receive an instruction to apply a media effect to the video stream, wherein the media effect is associated with a plurality of tiers, each tier associated with a predetermined level of recipient client engagement and a predefined audible or visible augmentation configured to be added to the video stream, and wherein an increasing level of recipient client engagement beyond one or more of the predetermined levels is associated with a higher tier of the media effect;

apply a first tier of the media effect to the video stream by adding the predefined audible or visible augmentation associated with the first tier to the video stream, the applying performed at the media effect server;

receive input from a plurality of recipient clients;

accumulate the input across the plurality of users;

determine that the accumulated input has exceeded the predetermined level of recipient client engagement associated with a second tier; and

augment the predefined audible or visible augmentation associated with the first tier with the predefined audible or visible augmentation associated with the second tier in the video stream, the augmenting performed at the media effect server based on the accumulated input.

8. The medium of claim 7 , the input associated with a plurality of vectors, wherein accumulating the input comprises adding the vectors together.

9. The medium of claim 7 , the input comprising one or more of a viewership status or an engagement with the video stream.

10. The medium of claim 7 , the video stream comprising a video broadcast and the input comprising poll results of an audience of the video broadcast.

11. The medium of claim 7 , the video stream comprising a video broadcast associated with a broadcaster that originates the video broadcast, wherein the media effect changes the video broadcast automatically without input from the broadcaster.

12. The medium of claim 7 , further storing instructions configured to cause the one or more processors to determine whether the accumulated input exceeds a modification threshold, wherein the media effect is modified after the accumulated input exceeds the modification threshold.

13. An apparatus comprising:

a non-transitory computer readable medium configured to store instructions for facilitating a video communication; and

a processor configured to execute the instructions, the instructions configured to cause the processor to:

access, at a media effect server, a video stream on a data channel connecting the media effect server to a sending client;

receive an instruction to apply a media effect to the video stream, wherein the media effect is associated with a plurality of tiers, each tier associated with a predetermined level of recipient client engagement and a predefined audible or visible augmentation configured to be added to the video stream, and wherein an increasing level of recipient client engagement beyond one or more of the predetermined levels is associated with a higher tier of the media effect;

apply a first tier of the media effect to the video stream by adding the predefined audible or visible augmentation associated with the first tier to the video stream, the applying performed at the media effect server;

receive input from a plurality of recipient clients;

accumulate the input across the plurality of users;

determine that the accumulated input has exceeded the predetermined level of recipient client engagement associated with a second tier; and

augment the predefined audible or visible augmentation associated with the first tier with the predefined audible or visible augmentation associated with the second tier in the video stream, the augmenting performed at the media effect server based on the accumulated input.

14. The apparatus of claim 13 , the input associated with a plurality of vectors, wherein accumulating the input comprises adding the vectors together.

15. The apparatus of claim 13 , the input comprising one or more of a viewership status or an engagement with the video stream.

16. The apparatus of claim 13 , the video stream comprising a video broadcast associated with a broadcaster that originates the video broadcast, wherein the media effect changes the video broadcast automatically without input from the broadcaster.

17. The apparatus of claim 13 , further storing instructions configured to cause processor to determine whether the accumulated input exceeds a modification threshold, wherein the media effect is modified after the accumulated input exceeds the modification threshold.

18. The method of claim 1 wherein the level of recipient client engagement is determined, at least in part, by the number of responding recipient clients.

19. The medium of claim 7 wherein the level of recipient client engagement is determined, at least in part, by the number of responding recipient clients.

20. The apparatus of claim 13 wherein the level of recipient client engagement is determined, at least in part, by the number of responding recipient clients.

Assignments (2)
CHANGE OF NAME Recorded May 5, 2022
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 059858/0387 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2017
From: DANKER, DANIEL; CAPRA, DAVID J; HARGRO, TORY
To: FACEBOOK, INC.
Reel/Frame 041606/0047 →
Continuity (1)
Related Publication 20180184140A1 · Jun 28, 2018