IP Library Granted Patent US 10,148,910
Granted Patent B2
US 10,148,910 · App. 15/395,172 · Granted Dec 4, 2018

Group video session

Inventors: Dwayne B. Mercredi (Kirkland, WA); Pavol Mravec (Redmond, WA); Chi Wang Ho (Redmond, WA); Naizhi Li (Redmond, WA)
Assignee: Facebook, Inc.
H04N7/147G06K9/00302H04L65/403H04L65/60H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,148,910
App. No.
15/395,172
Granted
Dec 4, 2018
Kind
B2
Abstract

In one embodiment, a computer server machine receives, from one or more client devices, one or more video streams associated with a video session associated with one or more users. The one or more users are respectively associated with each client device. The computer server machine analyzes the one or more video streams to identify an interesting event and generates a marker for the one or more video streams based on a time associated with the identified interesting event. The computer server machine sends information regarding the marker to the one or more client devices.

Claims (54)

1. A method comprising:

by a computer server machine, receiving, from one or more client devices with each client device respectively associated with a user, one or more video streams associated with a video session, wherein the one or more video streams are associated with the one or more users, and wherein the one or more users are communicating with one another within the video session;

by the computer server machine, analyzing the one or more video streams to identify an interesting event candidate;

by the computer server machine, generating a marker for the one or more of the video streams based on a time associated with the identified interesting event candidate;

by the computing server machine, determining, for each of the one or more users, whether the identified interesting event candidate is an interesting event for the user based at least on information related to a user profile associated with the user; and

by the computer server machine, sending, for each of the one or more users for whom the identified interesting event candidate is an interesting event, information regarding the marker to the client device associated with the user.

2. The method of claim 1 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises:

by the computer server machine, recognizing an expression in one or more of the video streams; and

by the computer server machine, identifying a change in the expression in one or more of the video streams.

3. The method of claim 2 , further comprising:

by the computer server machine, determining an emotion with the change in the expression; and

by the computer server machine, associating information regarding the emotion with the information regarding the marker.

4. The method of claim 2 , further comprising providing, by the computer server machine, an overlay to one or more of the video streams, wherein the overlay comprises an audio or visual indication corresponding to the change in the expression.

5. The method of claim 1 , wherein the each of the one or more video streams comprises a video component and an audio component.

6. The method of claim 1 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in the audio content captured in one or more of the video streams by the computer server machine.

7. The method of claim 1 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in a scene captured in one or more of the video streams by the computer server machine.

8. The method of claim 1 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in quality in one or more of the video streams by the computer server machine.

9. The method of claim 1 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in an attribute for one or more of the video streams by the computer server machine.

10. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive, from one or more client devices with each client device respectively associated with a user, one or more video streams associated with a video session, wherein the one or more video streams are associated with the one or more users, and wherein the one or more users are communicating with one another within the video session;

analyze the one or more video streams to identify an interesting event candidate;

generate a marker for the one or more of the video streams based on a time associated with the identified interesting event candidate;

determine, for each of the one or more users, whether the identified interesting event candidate is an interesting event for the user based at least on information related to a user profile associated with the user; and

send, for each of the one or more users for whom the identified interesting event candidate is an interesting event, information regarding the marker to the client device associated with the user.

11. The media of claim 10 , wherein the software is further operable when executed to:

recognize an expression in one or more of the video streams; and

identify a change in the expression in one or more of the video streams.

12. The media of claim 11 , wherein the software is further operable when executed to:

determine an emotion with the change in the expression; and

associate information regarding the emotion with the information regarding the marker.

13. The media of claim 11 , wherein the software is further operable when executed to provide an overlay to one or more of the video streams, wherein the overlay comprises an audio or visual indication corresponding to the change in the expression.

14. The media of claim 10 , wherein the each of the one or more video streams comprises a video component and an audio component.

15. The media of claim 10 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in the audio content captured in one or more of the video streams.

16. The media of claim 10 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in a scene captured in one or more of the video streams.

17. The media of claim 10 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in quality in one or more of the video streams.

18. The media of claim 10 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in an attribute for one or more of the video streams.

19. A system comprising: one or more processors; and a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to:

receive, from one or more client devices with each client device respectively associated with a user, one or more video streams associated with a video session, wherein the one or more video streams are associated with the one or more users, and wherein the one or more users are communicating with one another within the video session;

analyze the one or more video streams to identify an interesting event candidate;

generate a marker for the one or more of the video streams based on a time associated with the identified interesting event candidate;

determine, for each of the one or more users, whether the identified interesting event candidate is an interesting event for the user based at least on information related to a user profile associated with the user; and

send, for each of the one or more users for whom the identified interesting event candidate is an interesting event, information regarding the marker to the client device associated with the user.

20. The system of claim 19 , wherein the processors are further operable when executing the instructions to:

recognize an expression in one or more of the video streams; and

identify a change in the expression in one or more of the video streams.

21. The system of claim 20 , wherein the processors are further operable when executing the instructions to:

determine an emotion with the change in the expression; and

associate information regarding the emotion with the information regarding the marker.

22. The system of claim 20 , wherein the software is further operable when executed to provide an overlay to one or more of the video streams, wherein the overlay comprises an audio or visual indication corresponding to the change in the expression.

23. The system of claim 19 , wherein the each of the one or more video streams comprises a video component and an audio component.

24. The system of claim 19 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in the audio content captured in one or more of the video streams.

25. The system of claim 19 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in a scene captured in one or more of the video streams.

26. The system of claim 19 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in quality in one or more of the video streams.

27. The system of claim 19 , wherein analyzing the one or more video streams to identify an interesting event candidate further comprises detecting a change in an attribute for one or more of the video streams.

Assignments (2)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2017
From: MERCREDI, DWAYNE B.; MRAVEC, PAVOL; HO, CHI WANG; LI, NAIZHI
To: FACEBOOK, INC.
Reel/Frame 041278/0723 →
Continuity (1)
Related Publication 20180192000A1 · Jul 5, 2018
Cited By (1)
US 12,355,719