Event-based media playback
A method and apparatus for event-based media playback. A media device infers one or more actionable events in a media content item using one or more neural network models and determines a respective start location for each of the actionable events in the media content item. The media device receives user input indicating a selection of one of the actionable events and selectively initiates playback of the media content item at the start location associated with the selected actionable event.
1. A method of playing back media content by a media device, comprising:
inferring one or more actionable events in a media content item using one or more neural network models by:
determining a probability of an actionable event occurring at each of a plurality of frames spanning a duration of the media content item; and
identifying peaks in the probabilities over the duration of the media content item;
determining a respective start location for each of the actionable events in the media content item;
receiving user input indicating a selection of one of the actionable events; and
selectively initiating playback of the media content item at the start location associated with the selected actionable event.
2. The method of claim 1 , wherein each of the start locations is associated with a respective one of the identified peaks.
3. The method of claim 2 , wherein each of the start locations identifies a frame of the media content item preceding the respective peak.
4. The method of claim 2 , further comprising:
selecting each of the start locations based at least in part on a duration of each of the actionable events.
5. The method of claim 2 , further comprising:
selecting each of the start locations from a number of intra-coded frames (i-frames) of the media content item preceding the respective peak.
6. The method of claim 1 , wherein the selectively initiating playback comprises:
detecting a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and
rejecting the user input in response to detecting the restricted event.
7. The method of claim 6 , wherein the rejecting comprises:
continuing playback of the media content item from the current frame.
8. The method of claim 6 , wherein the rejecting comprises:
initiating playback of the media content item at the restricted event.
9. The method of claim 6 , wherein the restricted event is detected based at least in part on a series of consecutive blank frames in the media content item.
10. The method of claim 1 , further comprising:
retrieving a supplemental content item based at least in part on the selected actionable event; and
playing back the supplemental content item together with a portion of the media content item from the start location associated with the selected actionable event.
11. A media device comprising:
processing circuitry; and
a memory storing instructions that, when executed by the processing circuitry, causes the media device to:
infer one or more actionable events in a media content item using one or more neural network models wherein the inference comprises:
determining a probability of an actionable event occurring at each of a plurality of frames spanning a during of the media content;
identifying peaks in the probabilities over the duration of the media content item;
determine a respective start location for each of the actionable events in the media content item;
receive user input indicating a selection of one of the actionable events; and
selectively initiate playback of the media content item at the start location associated with the selected actionable event.
12. The media device of claim 11 , wherein each of the start locations identifies a frame of the media content item preceding a respective one of the identified peaks.
13. The media device of claim 12 , wherein execution of the instructions further causes the media device to:
select each of the start locations based at least in part on a duration of each of the actionable events.
14. The media device of claim 12 , wherein execution of the instructions further causes the media device to:
select each of the start locations from a number of intra-coded frames (i-frames) of the media content item preceding the respective peak.
15. The media device of claim 11 , wherein execution of the instructions for selectively initiating playback of the media content item causes the media device to:
detect a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and
rejecting the user input in response to detecting the restricted event.
16. The media device of claim 15 , wherein the restricted event is detected based at least in part on a series of consecutive blank frames in the media content item.
17. The media device of claim 11 , wherein execution of the instructions further causes the media device to:
retrieve a supplemental content item based at least in part on the selected actionable event; and
play back the supplemental content item together with a portion of the media content item from the start location associated with the selected actionable event.
18. A method of playing back media content by a media device, comprising:
receiving a first media content item;
detecting one or more actionable events in the first media content item by:
determining a probability of an actionable event occurring at each of a plurality of frames spanning a duration of the media content item; and
identifying peaks in the probabilities over the duration of the media content item;
determining a respective start location for each of the actionable events in the first media content item;
receiving user input indicating a selection of one of the actionable events; and
initiating playback of the first media content item at the start location associated with the selected actionable event by:
detecting a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and
rejecting the user input in response to detecting the restricted event.