IP Library Granted Patent US 10,681,391
Granted Patent B2
US 10,681,391 · App. 15/209,051 · Granted Jun 9, 2020

Computerized system and method for automatic highlight detection from live streaming media and rendering within a specialized media player

Inventors: Bin Ni (Fremont, CA); Kirk Lieb (Sunnyvale, CA); Rick Hawes (Sunnyvale, CA); Yale Song (New York, NY); Benoit Schillings (Los Altos Hills, CA); Vahe Oughourlian (Sunnyvale, CA); Jordi Vallmitjana (New York, NY); Jennelle Nystrom (Sunnyvale, CA); Hardik Ruparel (Sunnyvale, CA); Michael Chen (Sunnyvale, CA); Adam Mathes (Sunnyvale, CA); Arunkumar Balasubramanian (Sunnyvale, CA); Jian Zhou (Sunnyvale, CA); Matt Edelman (Sunnyvale, CA)
Assignee: OATH INC.
H04N21/2187G11B27/031G11B27/28H04N21/2387H04N21/23418H04N21/4882H04N21/8549
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,681,391
App. No.
15/209,051
Filed
Jul 13, 2016
Granted
Jun 9, 2020
Kind
B2
Art Unit
2426
USPC
725/37
Abstract

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.

Claims (53)

1. A computing device for rendering a media player, comprising:

a processor; and

a non-transitory computer-readable storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising logic executed by the processor for rendering the media player on the computing device via the processor, said media player logic comprising:

logic executed by the processor for playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

logic executed by the processor for receiving an indication that a set of frames is classified as a highlight scene;

logic executed by the processor for automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene;

logic executed by the processor for receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

logic executed by the processor for automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

logic executed by the processor for automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

2. The computing device of claim 1 , further comprising:

logic executed by the processor for receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

logic executed by the processor for automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

3. The computing device of claim 1 , further comprising:

logic executed by the processor automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

logic executed by the processor for automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

4. The computing device of claim 1 , further comprising:

logic executed by the processor for receiving a request to render the highlight scene;

logic executed by the processor for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

logic executed by the processor for rendering, using said playlist, said set of frames in response to said request.

5. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a processor associated with a computing device, perform a method comprising:

playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

receiving an indication that a set of frames is classified as a highlight scene;

automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene;

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

6. The non-transitory computer-readable storage medium of claim 5 , further comprising:

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

7. The non-transitory computer-readable storage medium of claim 5 , further comprising:

automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

8. The non-transitory computer-readable storage medium of claim 5 , further comprising:

receiving a request to render the highlight scene;

for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

for rendering, using said playlist, said set of frames in response to said request.

9. A method comprising:

playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

receiving an indication that a set of frames is classified as a highlight scene;

automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

10. The method of claim 9 , further comprising:

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

11. The method of claim 9 , further comprising:

automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

12. The method of claim 9 , further comprising:

receiving a request to render the highlight scene;

for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

for rendering, using said playlist, said set of frames in response to said request.

Assignments (6)
PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 29, 2022
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 061571/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 058982/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: YAHOO HOLDINGS, INC.
To: OATH INC.
Reel/Frame 045240/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2017
From: YAHOO! INC.
To: YAHOO HOLDINGS, INC.
Reel/Frame 042963/0211 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2016
From: NI, BIN; LIEB, KIRK; HAWES, RICK; SONG, YALE; SCHILLINGS, BENOIT; OUGHOURLIAN, VAHE; VALLMITJANA, JORDI; NYSTROM, JENNELLE; RUPAREL, HARDIK; CHEN, MICHAEL; MATHES, ADAM; BALASUBRAMANIAN, ARUNKUMAR; ZHOU, JIAN; EDELMAN, MATT
To: YAHOO! INC.
Reel/Frame 039327/0964 →
Continuity (1)
Related Publication 20180020243A1 · Jan 18, 2018