IP Library Granted Patent US 12,046,039
Granted Patent B2
US 12,046,039 · App. 18/175,019 · Granted Jul 23, 2024

Video processing for enabling sports highlights generation

Inventors: Mihailo Stojancic (San Jose, CA); Warren Packard (Palo Alto, CA); Dennis Kanygin (Sunnyvale, CA)
Assignee: Stats LLC
G06V20/42G06F16/908G06T7/12G06V20/41G06V20/46G06V20/48G06V30/153G06V40/20H04N21/435H04N21/44008H04N21/458H04N21/8133H04N21/84G06T2207/20132G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,046,039
App. No.
18/175,019
Granted
Jul 23, 2024
Kind
B2
Abstract

One or more highlights of a video stream may be identified. The highlights may be segments of a video stream, such as a broadcast of a sporting event, that are of particular interest to one or more users. According to one method, at least a portion of the video stream may be stored. The portion of the video stream may be compared with templates of a template database to identify the one or more highlights. Each highlight may be a subset of the video stream that is deemed likely to match the one or more templates. The highlights, an identifier that identifies each of the highlights within the video stream, and/or metadata pertaining particularly to the one or more highlights may be stored to facilitate playback of the highlights for the users.

Claims (54)

1. A method for extracting one or more highlights from video stream, the method comprising:

determining, by a computing system, that a subset of a video stream is a highlight by:

detecting, by the computing system, a leading logo and recording a first transition time corresponding to the leading logo, and

detecting, by the computing system; a trailing logo and recording a second transition time corresponding to the trailing logo;

based on the determining, extracting, by the computing system, the subset of the video stream in between the first transition time and the second transition time from the video stream;

determining, by the computing system, whether a current frame count of the video stream exceeds a video length of the video stream; and

in response to determining that the current frame count exceeds the video length:

storing, by the computing system, a plurality of transition times for a plurality of highlights including the first transition time and the second transition time for the highlight.

2. The method of claim 1 , wherein detecting the leading logo comprises:

comparing, by the computing system, a first portion of the video stream with a plurality of logo templates stored in a template database.

3. The method of claim 2 , wherein the detecting the trailing logo comprises:

comparing, by the computing system, a second portion of the video portion with the plurality of logo templates.

4. The method of claim 3 , wherein the plurality of logo templates comprise at least one of: a network logo associated with a television network, a network logo associated with a cable network, a network logo associated with a broadcast network, or a team logo associated with a sports team.

5. The method of claim 3 , wherein each of comparing the first portion of the video stream and the second portion of the video stream with the plurality of logo templates comprises:

using, by the computing system, at least one of a boundary detection technique or peak signal-to-noise ration (PSNR) computation.

6. The method of claim 1 , wherein the leading logo and the trailing logo are associated with a replay sequence in the video stream.

7. The method of claim 1 , further comprising:

causing, by the computing system, an output device to output the video stream concurrently with the extraction of the one or more highlights.

8. A system comprising:

a non-transitory storage medium storing computer program instructions;

a processor configured to execute the computer program instructions to cause operations comprising:

determining that a subset of a video stream is a highlight by:

detecting a leading logo and recording a first transition time corresponding to the leading logo, and

detecting a trailing logo and recording a second transition time corresponding to the trailing logo;

based on the determining, extracting the subset of the video stream in between the first transition time and the second transition time from the video stream;

determining whether a current frame count of the video stream exceeds a video length of the video stream; and

in response to determining that the current frame count exceeds the video length:

storing a plurality of transition times for a plurality of highlights including the first transition time and the second transition time for the highlight.

9. The system of claim 8 , wherein detecting the leading logo comprises:

comparing a first portion of the video stream with a plurality of logo templates stored in a template database.

10. The system of claim 9 , wherein the detecting the trailing logo comprises:

comparing a second portion of the video portion with the plurality of logo templates.

11. The system of claim 10 , wherein the plurality of logo templates comprise at least one of: a network logo associated with a television network, a network logo associated with a cable network, a network logo associated with a broadcast network, or a team logo associated with a sports team.

12. The system of claim 10 , wherein each of comparing the first portion of the video stream and the second portion of the video stream with the plurality of logo templates comprises:

using at least one of a boundary detection technique or peak signal-to-noise ration (PSNR) computation.

13. The system of claim 8 , wherein the leading logo and the trailing logo are associated with a replay sequence in the video stream.

14. The system of claim 8 , wherein the operations further comprise:

causing an output device to output the video stream concurrently with the determining the highlight.

15. A non-transitory computer readable medium storing computer program instructions, which when executed by a processor cause operations comprising:

determining that a subset of a video stream is a highlight by:

detecting a leading logo and recording a first transition time corresponding to the leading logo, and

detecting a trailing logo and recording a second transition time corresponding to the trailing logo;

based on the determining, extracting the subset of the video stream in between the first transition time and the second transition time from the video stream;

determining whether a current frame count of the video stream exceeds a video length of the video stream; and

in response to determining that the current frame count exceeds the video length:

storing a plurality of transition times for a plurality of highlights including the first transition time and the second transition time for the highlight.

16. The non-transitory computer readable medium of claim 15 , wherein detecting the leading logo comprises:

comparing a first portion of the video stream with a plurality of logo templates stored in a template database.

17. The non-transitory computer readable medium of claim 16 , wherein the detecting the trailing logo comprises:

comparing a second portion of the video portion with the plurality of logo templates.

18. The non-transitory computer readable medium of claim 17 , wherein the plurality of logo templates comprise at least one of: a network logo associated with a television network, a network logo associated with a cable network, a network logo associated with a broadcast network, or a team logo associated with a sports team.

19. The non-transitory computer readable medium of claim 17 , wherein each of comparing the first portion of the video stream and the second portion of the video stream with the plurality of logo templates comprises:

using at least one of a boundary detection technique or peak signal-to-noise ration (PSNR) computation.

20. The non-transitory computer readable medium of claim 15 , wherein the leading logo and the trailing logo are associated with a replay sequence in the video stream.

Assignments (3)
SECURITY INTEREST Recorded Apr 14, 2026
From: STATS LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 075390/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: THUUZ, INC.
To: STATS LLC
Reel/Frame 063289/0137 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: STOJANCIC, MIHAILO; PACKARD, WARREN; KANYGIN, DENNIS
To: THUUZ, INC.
Reel/Frame 063297/0318 →
Continuity (8)
Continuation 16411704 · May 14, 2019
Provisional Application 62746454 · Oct 16, 2018
Provisional Application 62712041 · Jul 30, 2018
Provisional Application 62680955 · Jun 5, 2018
Provisional Application 62673413 · May 18, 2018
Provisional Application 62673412 · May 18, 2018
Provisional Application 62673411 · May 18, 2018
Related Publication 20230222797A1 · Jul 13, 2023