IP Library Granted Patent US 11,017,818
Granted Patent B2
US 11,017,818 · App. 16/534,212 · Granted May 25, 2021

Event-based media playback

Inventors: Karthikeyan Shanmuga Vadivel (San Jose, CA); Tae won Kang (Cupertino, CA); Umha Mahesh Srinivasan (San Jose, CA)
Assignee: SYNAPTICS INCORPORATED
G11B27/3081G06N3/08H04N21/4666H04N21/47217H04N21/8133
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,017,818
App. No.
16/534,212
Granted
May 25, 2021
Kind
B2
Abstract

A method and apparatus for event-based media playback. A media device infers one or more actionable events in a media content item using one or more neural network models and determines a respective start location for each of the actionable events in the media content item. The media device receives user input indicating a selection of one of the actionable events and selectively initiates playback of the media content item at the start location associated with the selected actionable event.

Claims (55)

1. A method of playing back media content by a media device, comprising:

inferring one or more actionable events in a media content item using one or more neural network models by:

determining a probability of an actionable event occurring at each of a plurality of frames spanning a duration of the media content item; and

identifying peaks in the probabilities over the duration of the media content item;

determining a respective start location for each of the actionable events in the media content item;

receiving user input indicating a selection of one of the actionable events; and

selectively initiating playback of the media content item at the start location associated with the selected actionable event.

2. The method of claim 1 , wherein each of the start locations is associated with a respective one of the identified peaks.

3. The method of claim 2 , wherein each of the start locations identifies a frame of the media content item preceding the respective peak.

4. The method of claim 2 , further comprising:

selecting each of the start locations based at least in part on a duration of each of the actionable events.

5. The method of claim 2 , further comprising:

selecting each of the start locations from a number of intra-coded frames (i-frames) of the media content item preceding the respective peak.

6. The method of claim 1 , wherein the selectively initiating playback comprises:

detecting a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and

rejecting the user input in response to detecting the restricted event.

7. The method of claim 6 , wherein the rejecting comprises:

continuing playback of the media content item from the current frame.

8. The method of claim 6 , wherein the rejecting comprises:

initiating playback of the media content item at the restricted event.

9. The method of claim 6 , wherein the restricted event is detected based at least in part on a series of consecutive blank frames in the media content item.

10. The method of claim 1 , further comprising:

retrieving a supplemental content item based at least in part on the selected actionable event; and

playing back the supplemental content item together with a portion of the media content item from the start location associated with the selected actionable event.

11. A media device comprising:

processing circuitry; and

a memory storing instructions that, when executed by the processing circuitry, causes the media device to:

infer one or more actionable events in a media content item using one or more neural network models wherein the inference comprises:

determining a probability of an actionable event occurring at each of a plurality of frames spanning a during of the media content;

identifying peaks in the probabilities over the duration of the media content item;

determine a respective start location for each of the actionable events in the media content item;

receive user input indicating a selection of one of the actionable events; and

selectively initiate playback of the media content item at the start location associated with the selected actionable event.

12. The media device of claim 11 , wherein each of the start locations identifies a frame of the media content item preceding a respective one of the identified peaks.

13. The media device of claim 12 , wherein execution of the instructions further causes the media device to:

select each of the start locations based at least in part on a duration of each of the actionable events.

14. The media device of claim 12 , wherein execution of the instructions further causes the media device to:

select each of the start locations from a number of intra-coded frames (i-frames) of the media content item preceding the respective peak.

15. The media device of claim 11 , wherein execution of the instructions for selectively initiating playback of the media content item causes the media device to:

detect a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and

rejecting the user input in response to detecting the restricted event.

16. The media device of claim 15 , wherein the restricted event is detected based at least in part on a series of consecutive blank frames in the media content item.

17. The media device of claim 11 , wherein execution of the instructions further causes the media device to:

retrieve a supplemental content item based at least in part on the selected actionable event; and

play back the supplemental content item together with a portion of the media content item from the start location associated with the selected actionable event.

18. A method of playing back media content by a media device, comprising:

receiving a first media content item;

detecting one or more actionable events in the first media content item by:

determining a probability of an actionable event occurring at each of a plurality of frames spanning a duration of the media content item; and

identifying peaks in the probabilities over the duration of the media content item;

determining a respective start location for each of the actionable events in the first media content item;

receiving user input indicating a selection of one of the actionable events; and

initiating playback of the first media content item at the start location associated with the selected actionable event by:

detecting a restricted event occurring subsequent to a current frame of the media content item being displayed and prior to the actionable event; and

rejecting the user input in response to detecting the restricted event.

Assignments (2)
SECURITY INTEREST Recorded Feb 14, 2020
From: SYNAPTICS INCORPORATED
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 051936/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2019
From: SHANMUGA VADIVEL, KARTHIKEYAN; KANG, TAE WON; SRINIVASAN, UMHA MAHESH
To: SYNAPTICS INCORPORATED
Reel/Frame 049989/0779 →