IP Library Granted Patent US 10,657,653
Granted Patent B2
US 10,657,653 · App. 15/480,694 · Granted May 19, 2020

Determining one or more events in content

Inventors: Erik Schwartz (Kensington, MD); Jan Neumann (Arlington, VA); Hans Sayyadi (Washington, DC); Stefan Deichmann (Alexandria, VA)
Assignee: Comcast Cable Communications, LLC
G06T7/20G06F16/48G06F16/745G06F16/7867G06K9/00724G06K9/00765H04N5/783H04N21/44008H04N21/84H04N21/8456G06K2009/00738G06T2207/10016G06T2207/30221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,653
App. No.
15/480,694
Granted
May 19, 2020
Kind
B2
Abstract

According to some aspects, methods and systems may include receiving, by a computing device, metadata identifying an event occurring in a video program, and determining an expected motion of objects in the identified event. The methods and systems may further include analyzing motion energy in the video program to identify video frames in which the event occurs, and storing information identifying the video frames in which the event occurs.

Claims (65)

1. A method comprising:

receiving, by a first computing device, an indication of an occurrence of an event within content;

determining, based on the indication of the occurrence of the event within the content:

an expected motion of objects associated with the event; and

a portion, of the content, in which the event is expected to occur;

determining, after receiving the indication of the occurrence of the event within the content, and based on comparing the expected motion of objects with a motion of objects in the portion, a subset, of the portion, in which the event occurs; and

sending, to a second computing device, the subset of the portion.

2. The method of claim 1 , wherein determining the portion comprises using optical character recognition to detect a displayed time, within the content, for the occurrence of the event.

3. The method of claim 1 , wherein the portion comprises video frames,

wherein the expected motion of objects within the content is detected based on the video frames having motion energy satisfying a threshold energy level, and

wherein the subset of the portion comprises fewer than all of the video frames.

4. The method of claim 1 , further comprising:

determining, for the portion, a first motion energy vector; and

determining, for another portion of the content, a second motion energy vector,

wherein determining the subset of the portion is performed based on comparing the first motion energy vector with the second motion energy vector.

5. The method of claim 1 , further comprising:

determining, for the event, an expected audio,

wherein determining the subset of the portion is performed based on audio of the portion and based on the expected audio.

6. The method of claim 1 , further comprising:

determining, for the event, one or more expected camera angles,

wherein determining the subset of the portion is performed based on one or more camera angles of the portion and based on the one or more expected camera angles.

7. A method comprising:

receiving an indication of a time, within content, of an occurrence of an event;

determining, by a first computing device and after receiving the indication of the time, that the event occurs within a portion of the content;

determining, for the event, an indication of an expected motion of objects;

determining, after determining the indication of the expected motion of objects and based on a motion of objects within the portion, information that indicates a content segment in which the event occurs; and

sending, based on the information and to a second computing device, the content segment.

8. The method of claim 7 , wherein the portion comprises video frames, and wherein the method further comprises:

determining, based on the video frames having motion energy satisfying a threshold energy level, the motion of objects within the portion,

wherein the information indicates fewer than all of the video frames.

9. The method of claim 7 , further comprising:

determining, for the portion, a first motion energy vector; and

determining, for another portion of the content, a second motion energy vector,

wherein determining the information is performed based on comparing the first motion energy vector with the second motion energy vector.

10. The method of claim 7 , further comprising:

determining, for the event, an expected audio,

wherein determining the information is performed based on audio of the portion and based on the expected audio.

11. The method of claim 7 , further comprising:

determining, for the event, one or more expected camera angles,

wherein determining the information is performed based on one or more camera angles of the portion and based on the one or more expected camera angles.

12. The method of claim 7 , wherein the expected motion of objects comprises one or more video frames.

13. A method comprising:

determining, based on a description of a content item, a portion of the content item to be processed to determine a time of an occurrence of an event;

conducting, based on an expected motion of objects, image analysis on the portion of the content item to detect a motion of objects associated with the event;

determining, based on the image analysis, information indicating the time, in the content item, of the occurrence of the event; and

sending information indicating the time of the occurrence of the event.

14. The method of claim 13 wherein determining the portion of the content item to be processed comprises determining, by a computing device, an indication of a range of time, within the content item, for the occurrence of the event.

15. The method of claim 13 , wherein the portion comprises video frames, and wherein conducting the image analysis is based on video frames having motion energy satisfying a threshold energy level.

16. The method of claim 13 , further comprising:

determining, for the portion of the content item, a first motion energy vector; and

determining, for another portion of the content item, a second motion energy vector,

wherein the information indicating the time is determined based on comparing the first motion energy vector with the second motion energy vector.

17. The method of claim 13 , further comprising:

determining, for the event, an expected audio,

wherein the information indicating the time is further determined based on audio of the portion of the content item and based on the expected audio.

18. The method of claim 13 , further comprising:

determining, for the event, one or more expected camera angles,

wherein conducting the image analysis is based on one or more camera angles of the portion of the content item and based on the one or more expected camera angles.

19. The method of claim 13 , wherein determining the portion comprises using optical character recognition to detect a displayed time, within the content item, for the occurrence of the event.

20. The method of claim 1 , wherein the subset of the portion comprises a time portion of the content based on a metadata identifier that indicates a time, within the content, of a play in a sporting event.

21. The method of claim 1 , wherein the event is a sporting event, and the expected motion of objects indicates an expected movement of players in the sporting event.

22. The method of claim 1 , wherein the expected motion of objects comprises one or more motion energy vectors.

23. The method of claim 1 , wherein the portion of the content comprises an entirety of the content.

24. The method of claim 7 , wherein the portion of the content comprises an entirety of the content.

25. The method of claim 13 , wherein the portion of the content item comprises the entire content item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2019
From: SCHWARTZ, ERIK; NEUMANN, JAN; SAYYADI-HARIKANDEHEI, HASSAN; DEICHMANN, STEFAN
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 051100/0632 →
Continuity (2)
Continuation 14514602 · Oct 15, 2014
Related Publication 20180061064A1 · Mar 1, 2018