User interface for viewing targeted segments of multimedia content based on time-based metadata search criteria
A system and method for navigating digital media assets including a navigation system configured to receive a search query in response to a user input and process the search query by applying the search query to a search index of digital media asset conventional and time-based metadata and determining search results of titles of and start points in time within digital media assets that satisfy the search query. The navigation system may then display the search results to the user through the user interface. The search results may be displayed in a hierarchical format, wherein the title of the digital media asset is displayed and upon selecting the title of the digital media asset, the start points in time within that digital media asset are displayed or played as a video to the user through the user interface.
1 . A method for navigating digital media comprising: receiving, by a computer server, a search query comprising one or more search terms; searching, by the computer server, at least one database based on the one or more search
terms, wherein the searching by the computer server comprises searching indices in the at least one database where the indices are indexed automatically based on time-based metadata, the database comprising attributes of at least a plurality of digital videos, each video in the plurality of digital videos comprising two or more time-based segments that include attributes matching the one or more search terms;
based on the searching of the database by the computer server, causing a display of a summary search result interface;
receiving, by the computer server, a user selection of a first thumbnail associated with a first digital video, from the plurality of digital videos, to display on the summary search result interface, wherein the first digital video includes at least one time-based segment having attributes that match the one or more search terms and the selection of the first thumbnail associated with the first digital video is based on a selection criterion;
causing to display, by the computer server, the selected first thumbnail with a summary of the first digital video on the summary search result interface;
receiving, by the computer server, a selection of the displayed first thumbnail; and in response to the received selection:
identifying, by the computer server, a first time-based segment of the first digital video associated with the first thumbnail; and
causing display, by the computer server, of a video player interface for playing the identified first time-based segment of the first digital video, wherein;
the time-based metadata for the first digital video is organized into a data structure comprising one or more tracks, each track of the one or more tracks representing a timeline-based attribute and comprising a set of non-overlapping segment data;
each set of non-overlapping segment data indicates a specific start time and duration for the attribute along a timeline for the first digital video; and
the data structure is populated based on an automatic analysis of the first digital video.
2 . The method of claim 1 , wherein the selection criterion for selecting the first thumbnail associated with a first digital video further comprises:
cycling through a plurality of images in the first digital video;
determining whether an image, from the plurality of images matches the one or more search terms of the search query; and
in response to the determination that a first image, from the plurality of images, includes attributes matching the one or more search terms of the search query:
selecting the first image as the first thumbnail for display on the summary search result interface.
3 . The method of claim 2 , wherein the selection criterion comprises selecting an image from a first frame in the first time-based segment of the first digital video as the first thumbnail.
4 . The method of claim 1 , further comprising:
determining that a second time-based segment includes attributes that match the one or more search terms; and
in response to the determination, generating a filmstrip of thumbnails.
5 . The method of claim 4 , wherein the filmstrip includes the first thumbnail associated with the first time-based segment and a second thumbnail associated with the second time-based segment.
6 . The method of claim 5 , wherein the first and second thumbnails are arranged in a time sequence order.
7 . The method of claim 5 , wherein the first and second thumbnails are arranged in order of their relevance to the one or more search terms.
8 . The method of claim 5 , further comprising:
receiving a selection of the second thumbnail displayed in the filmstrip; and
in response to the selection, jumping from a current time-based segment that is being displayed on the video player interface to displaying the second time-based segment which is associated with the second thumbnail on the video player interface.
9 . The method of claim 1 , wherein the first thumbnail is semi-transparent.
10 . The method of claim 1 , wherein the first thumbnail is overlayed on a main video display that is displayed in the video player interface.
11 . The method of claim 1 , wherein the first thumbnail is an image of a key point in the first time-based segment.
12 . A system comprising:
control circuitry configured to:
receive a search query comprising one or more search terms;
search, by the computer server, at least one database based on the one or more search terms, wherein the control circuitry configured to search by the server is further configured to search indices in the at least one database where the indices are indexed automatically based on time-based metadata, the database comprising attributes of at least a plurality of digital videos, each video in the plurality of digital videos comprising two or more time-based segments that include attributes matching the one or more search terms;
based on the searching of the database by the computer server, cause a display of a summary search result interface;
receive, by a computer server, a user selection of a first thumbnail associated with a first digital video, from the plurality of digital videos, to display on the summary search result interface, wherein the first digital video includes at least one time-based segment having attributes that match the one or more search terms and the selection of the first thumbnail associated with the first digital video is based on a selection criterion;
cause to display, by the computer server, the selected first thumbnail with a summary of the first digital video on the summary search result interface;
receive a selection of the displayed first thumbnail; and in response to the received selection:
identify, by the computer server, a first time-based segment of the first digital video associated with the first thumbnail; and
cause display, by the computer server, of a video player interface for playing the identified first time-based segment of the first digital video, wherein;
the time-based metadata for the first digital video is organized into a data structure comprising one or more tracks, each track of the one or more tracks representing a timeline-based attribute and comprising a set of non-overlapping segment data;
each set of non-overlapping segment data indicates a specific start time and duration for the attribute along a timeline for the first digital video; and
the data structure is populated based on an automatic analysis of the first digital video.
13 . The system of claim 12 , wherein the selection criterion for selecting the first thumbnail associated with a first digital video further comprises, the control circuitry configured to: cycle through a plurality of images in the first digital video;
determine whether an image, from the plurality of images matches the one or more search terms of the search query; and
in response to the determination that a first image, from the plurality of images, includes attributes matching the one or more search terms of the search query:
select the first image as the first thumbnail for display on the summary search result interface.
14 . The system of claim 13 , wherein the selection criterion comprises the control circuitry configured to select an image from a first frame in the first time-based segment of the first digital video as the first thumbnail.
15 . The system of claim 12 , further comprising, the control circuitry configured to: determine that a second time-based segment includes attributes that match the one or more search terms; and
in response to the determination, generate a filmstrip of thumbnails.
16 . The system of claim 15 , wherein the filmstrip includes the first thumbnail associated with the first time-based segment and a second thumbnail associated with the second time-based segment.
17 . The system of claim 16 , wherein the first and second thumbnails are arranged by the control circuitry in a time sequence order.
18 . The system of claim 16 , further comprising, the control circuitry configured to: receive a selection of the second thumbnail displayed in the filmstrip; and
in response to the selection, jump from a current time-based segment that is being displayed on the video player interface to displaying the second time-based segment which is associated with the second thumbnail on the video player interface.
19 . The system of claim 12 , wherein the first thumbnail is overlayed by the control circuitry on a main video display that is displayed in the video player interface.
20 . The system of claim 12 , wherein the first thumbnail is an image of a key point in the first time-based segment.