Methods and Systems for Switching Between Summary, Time-shifted, or Live Content

1 . A method of providing multiple viewing states to a user, comprising:

creating a video summary and providing the video summary to the user;

providing a video stream, wherein the video stream comprises live or stored video broadcast or streamed in real-time to the user; and

providing a switching mode to the user, whereby the user can select to view one or both of the video summary and video stream.

2 . The method of claim 1 , further comprising:

providing a time shifted version of the video stream to the user.

3 . The method of claim 1 , wherein the video summary comprises one or more of a linear video summary, a video storyboard, a semantic summary, and an audio summary and wherein the user can select which type of video summary to view.

4 . The method of claim 1 , wherein the video summary comprises a linear video summary and the method of creating the linear video summary comprises:

identifying one or more key frames or shots; and

sequentially placing the one or more key frames or shots in order to create a visual video summary.

5 . The method of claim 4 , further comprising:

providing descriptive text that describes the visual video summary with the visual video summary.

6 . The method of claim 5 , wherein the descriptive text and visual video summary appear as a single video screen shot for a user.

7 . The method of claim 5 , further comprising:

saving the descriptive text and visual video summary.

8 . The method of claim 1 , wherein the video summary comprises an audio video summary and the audio video summary comprises extraction of audio events in the form of one or more of: volume, audio energy, speech vs. music, pause, tempo, and frequency.

9 . The method of claim 1 , wherein the video summary comprises an audio video summary and the audio video summary comprises an audio only version of the entire video content or descriptive audio in the form of audio narration, or a combination thereof

10 . The method of claim 1 , wherein the video summary is accessible to the user on a primary screen such that the viewer can view the video stream with the video summary as a picture in picture (PiP) window.

11 . The method of claim 1 , wherein the video summary accessible to the user on a secondary screen such that the viewer can view the video stream on a primary screen and the video summary on the secondary screen.

12 . The method of claim 1 , wherein the user can switch between viewing the video summary and video stream and wherein said switching mode uses a time compression factor k of the video summary along with the time the summary segment takes for playout T summary in order to seek back into the video stream after a video summary segment has been consumed.

13 . The method of claim 12 , further comprising signaling the time compression factor k as metadata associated with the video stream.

14 . The method of claim 13 , wherein said metadata can be signaled in one or more of the following ways: a field in the playlist of an adaptive bitrate streaming content, supplemental enhancement information (SEI) in AVC, HEVC elementary streams, and picture user data in MPEG-2 video.

15 . The method of claim 13 , wherein if there are multiple summary versions each associated with a different time compression factor k, the user can make a choice in his request for a specific version among the available versions.

16 . The method of claim 1 , wherein the user can specify the amount of video summary requested in terms of the incremental absolute time or incremental percentage of total time of full-version video.

17 . In a network for distributing video over the network, a system for providing multiple viewing states to a user, comprising:

a streaming server configured to receive video content from a source;

an encoder configured to encode the video content and configured to provide a video summary for the video content; and

a client device configured to receive the video content and the video summary and provide the video content and video summary to the user for viewing.

18 . The system of claim 17 , wherein the video content comprises live video content and/or a time shifted version of the live video content.

19 . The system of claim 17 , wherein the video summary comprises one or more of a linear video summary, a video storyboard, a semantic summary, and an audio summary.

20 . The system of claim 17 , wherein the video summary is dependent on human annotation to provide or match the video summary to the video content.