IP Library Granted Patent US 10,499,010
Granted Patent B2
US 10,499,010 · App. 16/183,568 · Granted Dec 3, 2019

Group video session

Inventors: Dwayne B. Mercredi (Kirkland, WA); Pavol Mravec (Redmond, WA); Chi Wang Ho (Redmond, WA); Naizhi Li (Redmond, WA)
Assignee: Facebook, Inc.
H04N7/147G06K9/00302G06K9/00744G06Q50/00H04L65/1089H04L65/403H04L65/60H04N7/15H04N7/155G06K2009/00738
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,499,010
App. No.
16/183,568
Granted
Dec 3, 2019
Kind
B2
Abstract

In one embodiment, a computer server machine receives, from one or more client devices, one or more video streams associated with a video session associated with one or more users. The one or more users are respectively associated with each client device. The computer server machine analyzes the one or more video streams to identify an interesting event and generates a marker for the one or more video streams based on a time associated with the identified interesting event. The computer server machine sends information regarding the marker to the one or more client devices.

Claims (39)

1. A method comprising:

by a computer server machine, maintaining a persistent real-time video messaging session, wherein one or more video streams associated with one or more users are associated with the video messaging session, and wherein the one or more users are communicating with each other within the video messaging session;

by the computer server machine, determining that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than a threshold;

by the computer server machine, analyzing the one or more video streams to identify an interesting event;

by the computer server machine, generating a marker for the one or more of the video streams based on a time associated with the identified interesting event; and

by the computer server machine, sending information regarding the marker to a client device associated with the one of the one or more users.

2. The method of claim 1 , wherein the determining that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than the threshold comprises detecting that a user interface for the video messaging session on a client device associated with the one of one or more users is not active or open for the period of time.

3. The method of claim 1 , wherein the determining that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than the threshold comprises determining that the one of the one or more users has not provided input to the video messaging session for the period of time.

4. The method of claim 1 , wherein the identifying the interesting event is customized based on information related to a user profile associated with the one of the one or more users.

5. The method of claim 1 , wherein each of the one or more video streams comprises a video component and an audio component.

6. The method of claim 1 , further comprising providing an overlay to one or more of the video streams, wherein the overlay comprises an audio or visual indication corresponding to the identified interesting event.

7. The method of claim 1 , wherein analyzing the one or more video streams comprises:

recognizing an expression in one or more of the video streams; and

identifying a change in the expression in one or more of the video streams.

8. The method of claim 7 , further comprising:

determining an emotion with the change in the expression; and

associating information regarding the emotion with the information regarding the marker.

9. The method of claim 1 , wherein the analyzing the one or more video streams comprises detecting a change in the audio content captured in one or more of the video streams.

10. The method of claim 1 , wherein the analyzing the one or more video streams comprises detecting a change in a scene captured in one or more of the video streams.

11. The method of claim 1 , wherein the analyzing the one or more video streams comprises detecting a change in video quality in one or more of the video streams.

12. The method of claim 1 , wherein analyzing the one or more video streams comprises detecting a change in an attribute for one or more of the video streams by the computer server machine.

13. The method of claim 1 , wherein the sending information regarding the marker to the client device associated with the one of the one or more users comprises communicating an e-mail to an e-mail address associated with the one of the one or more users.

14. The method of claim 1 , wherein the sending information regarding the marker to the client device associated with the one of the one or more users comprises providing a notification through the video messaging session.

15. The method of claim 1 , wherein the sending information regarding the marker to the client device associated with the one of the one or more users comprises sending instructions to the client device to generate a pop-up notification on the client device.

16. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

maintain a persistent real-time video messaging session, wherein one or more video streams associated with one or more users are associated with the video messaging session, and wherein the one or more users are communicating with each other within the video messaging session;

determine that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than a threshold;

analyze the one or more video streams to identify an interesting event;

generate a marker for the one or more of the video streams based on a time associated with the identified interesting event; and

send information regarding the marker to a client device associated with the one of the one or more users.

17. The media of claim 16 , wherein the determining that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than the threshold comprises detecting that a user interface for the video messaging session on a client device associated with the one of one or more users is not active or open for the period of time.

18. The media of claim 16 , wherein the determining that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than the threshold comprises determining that the one of the one or more users has not provided input to the video messaging session for the period of time.

19. The media of claim 16 , wherein the identifying the interesting event is customized based on information related to a user profile associated with the one of the one or more users.

20. A system comprising: one or more processors; and a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to:

maintain a persistent real-time video messaging session, wherein one or more video streams associated with one or more users are associated with the video messaging session, and wherein the one or more users are communicating with each other within the video messaging session;

determine that one of the one or more users has been non-active in the persistent real-time video messaging session for a period of time longer than a threshold;

analyze the one or more video streams to identify an interesting event;

generate a marker for the one or more of the video streams based on a time associated with the identified interesting event; and

send information regarding the marker to a client device associated with the one of the one or more users.

Assignments (2)
CHANGE OF NAME Recorded Jan 23, 2022
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058820/0137 →
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →