IP Library Granted Patent US 11,355,158
Granted Patent B2
US 11,355,158 · App. 17/320,800 · Granted Jun 7, 2022

Asynchronous video collaboration

Inventors: Yu-Han Chang (South Pasadena, CA); Tracey Chui Ping Ho (South Pasadena, CA); Kevin William King (Los Angeles, CA); Rajiv Tharmeswaran Maheswaran (South Pasadena, CA)
Assignee: Genius Sports SS, LLC
G11B27/036G06F3/0484G06K9/00744G11B27/005G09B19/0038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,355,158
App. No.
17/320,800
Granted
Jun 7, 2022
Kind
B2
Abstract

Video may be edited to include collaborations by users. Collaborations may be added to the video and associated with a span of the video. The span of the collaborations may be determined according to an action that is received from a user contemporaneously with the playback of the video. In some cases, the span of the collaborations may be determined automatically by analyzing the collaboration and the video frames to which the user initial added the collaborations. Analysis of the collaborations and video frame may be used to determine span criteria for the frames of the video that should be associated with the collaborations.

Claims (33)

1. A method comprising:

presenting, in an electronic user interface, a base video;

responsive to receiving an indication of a collaboration action in the electronic user interface, identifying at least one of a frame of the base video and a region within the frame of the base video that is presented in the user interface contemporaneously with receiving the indication;

generating a collaboration for the base video based on a type of the collaboration action and a duration of the collaboration action; and

producing a collaboration video that includes the base video and the generated collaboration that commences at the identified at least one of the frame of the base video and the region of the frame of the base video and lasting for a duration based on the duration of the collaboration action.

2. The method of claim 1 , wherein the type of collaboration is one of playback manipulation, an in-line visual insertion, a visual overlay, a visual replacement of an object identified in the region, a picture in a picture window, a visual text comment, or an audio comment.

3. The method of claim 1 , wherein the duration of the collaboration action is determined based on a duration of the indication of the collaboration action in the electronic user interface.

4. The method of claim 1 , wherein generating the collaboration for the base video includes combining at least a portion of a second video with the base video based on the type of collaboration action.

5. The method of claim 4 , wherein the portion of the second video is automatically selected based on computer vision-based analysis of the region of the frame.

6. The method of claim 5 , wherein the computer vision-based analysis determines at least one object in the region of the base video and a corresponding object in the second video.

7. The method of claim 6 , further include replacing the at least one object in the region of the base video with the corresponding object in the second video thereby producing a collaboration video.

8. A method comprising:

receiving an indication of a of a frame of a video;

receiving one or more collaborations for the frame;

determining collaboration elements;

determining video frame elements in the frame;

generating, based on the collaboration elements and the video frame elements, a span criteria for evaluating frames of the video; and

searching for a span of the video for which the frames meet the span criteria.

9. The method of claim 8 , wherein determining the video frame elements comprises searching for the collaboration elements in the frame.

10. The method of claim 8 , wherein determining the collaboration elements comprises searching for the video frame elements in the one or more collaborations.

11. The method of claim 8 , wherein the collaboration elements include at least one of words, phrases, lines, sounds, or shapes.

12. The method of claim 8 , wherein the video frame elements include at least one of objects, people, colors, video quality, video motion, or actions.

13. The method of claim 8 , further comprising determining a video frame element score based on a position of the video frame elements in the frame and wherein the span criteria comprises a criteria based on the video frame element score.

14. The method of claim 8 , further comprising determining a video frame element score based on a size of the video frame elements in the frame and wherein the span criteria comprises a criteria based on the video frame element score.

15. The method of claim 8 , wherein the span of the video includes a gap where the frames do not meet the span criteria.

16. The method of claim 8 , further comprising:

identifying keywords in the one or more collaborations;

corroborating the keywords in the span based at least in part on motion of objects in the frames of the span; and

generating a recommendation for a playback configuration of the span.

17. The method of claim 16 , wherein the recommendation includes at least one of a playback at a reduced speed, a playback at an increased speed, or a repetition of a playback of the span.

18. The method of claim 8 , wherein searching includes searching away from the frame.

19. The method of claim 8 , wherein searching includes searching in one direction from the frame.

20. The method of claim 18 , wherein the span criteria is different for a forward search direction and a backward search direction from the frame.

Assignments (5)
SECURITY INTEREST Recorded May 1, 2026
From: GENIUS SPORTS SS, LLC
To: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 074544/0266 →
RELEASE OF SECURITY INTEREST Recorded May 1, 2026
From: CITIBANK, N.A.
To: GENIUS SPORTS SS, LLC
Reel/Frame 074544/0683 →
SECURITY INTEREST Recorded May 1, 2024
From: GENIUS SPORTS SS, LLC
To: CITIBANK, N.A.
Reel/Frame 067281/0470 →
MERGER Recorded Sep 17, 2021
From: SECOND SPECTRUM, INC.
To: GENIUS SPORTS SS, LLC
Reel/Frame 057509/0582 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: CHANG, YU-HAN; HO, TRACEY CHUI PING; KING, KEVIN WILLIAM; MAHESWARAN, RAJIV THARMESWARAN
To: SECOND SPECTRUM, INC.
Reel/Frame 056288/0052 →
Continuity (2)
Provisional Application 63025730 · May 15, 2020
Related Publication 20210358525A1 · Nov 18, 2021