Picture-in-picture mosaic
View Patent ↗The PIP system enables display of a mosaic of favorite channels in a Picture-in-Picture (PIP) format to a subscriber terminal. Picture-in-Picture support is efficiently provided by sending only I-Frames of the secondary video channel to the end-user. That is, any unnecessary packets (null, B-P frames, audio, etc.) in the secondary video channel are stripped away. This method uses very little bandwidth and is STB agnostic.
1. A method for producing thumbnail images of video content in a video stream carrying frames of compressed video data, comprising:
storing, in an input buffer, a preset amount of the video data from said video stream;
selecting from, said input buffer, a plurality of frames, each of the plurality of frames resulting in a significant change in the video data from an immediately previous frame;
generating a preview signal, the preview signal consisting of the plurality of frames resulting in a significant change;
converting said preview signal into a picture-in-picture (PIP) stream and broadcasting said PIP stream to subscriber terminals (ST) over an access network according to a transmission protocol recognized by said network; and
at a ST, joining a PIP stream of interest for playback of a thumbnail moving image with the video content in said video stream, overlaid on a full size image of the video content in any video stream that is currently played-back on said ST,
wherein said PIP stream uses a portion of network bandwidth otherwise needed if all frames of said video streams were broadcast over said access network.
2. A method as claimed in claim 1 , wherein said video stream is an elementary video stream broadcast from an interactive broadcast delivery system in a MPEG2 transport stream, and said frames identified by a significant change in the video data are I-Frames.
3. A method as claimed in claim 1 , wherein said PIP stream is broadcast in a vestigial sideband frequency modulation format, carried on a secondary channel.
4. A method as claimed in claim 1 , further comprising:
providing a user interface (UI) for said thumbnail moving image for enabling selection of said corresponding video stream at said ST.
5. A method as claimed in claim 4 , wherein said step of providing a user interface comprises:
processing stream data pertinent to said video stream for generating a UI signal associated with said preview signal;
encoding said UI signal into an UI stream according to a transmission protocol recognized by said network; and
broadcasting said UI stream over said network.
6. A method as claimed in claim 5 , wherein said UI is a Hypertext Markup Language (HTML) frame which presents channel identification information to the respective thumbnail image.
7. A method as claimed in claim 5 , wherein said stream data includes channel and program identification data pertinent to said preview signal.
8. A method as claimed in claim 5 , further comprising including in said UI signal presentation data for presenting said thumbnail image with at least one of a background and frame of choice.
9. A server for producing thumbnail images of video content in video streams carrying frames of compressed video data, comprising:
n input buffers, each for storing a preset amount of the video data from a respective video stream, under control of a controller;
m preprocessing units, each associated with an input buffer, wherein each of the preprocessing units is configured to:
from said associated input buffer a plurality of frames, each of the plurality of frames resulting in a significant change in the video data from an immediately previous frame, and
generate a preview signal, the preview signal consisting of the plurality of frames resulting in a significant change, where m and n are integers and m≦n;
a network interface for converting each said preview signal into a picture-in-picture (PIP) stream and broadcasting said PIP streams to subscriber terminals (ST) over an access network,
wherein each PIP stream uses a portion of bandwidth otherwise needed if all frames of said video stream were broadcast to said ST.
10. A server as claimed in claim 9 , wherein said video stream is an elementary video stream broadcast from an interactive broadcast delivery system over a MPEG2 transport stream.
11. A server as claimed in claim 10 , wherein said frames resulting in a significant change in the video data are I-Frames.
12. A server as claimed in claim 9 , wherein said network interface comprises m PIP senders for encoding said preview signals into said PIP streams according to a transmission protocol recognized by said network.
13. A server as claimed in claim 9 , further comprising a PIP presentation subsystem for receiving, from said controller, stream data pertinent to each said video stream and providing a user interface (UI) signal for each preview signal.
14. A server as claimed in claim 13 , wherein said network interface further comprises a UI sender for encoding said UI signal into a UI stream according to a transmission protocol recognized by said network and broadcasting said UI streams over said network.
15. A server as claimed in claim 13 , wherein said UI is a Hypertext Markup Language (HTML) frame which presents channel identification information to the respective thumbnail video image for enabling selection of said corresponding video stream at said ST.
16. A server as claimed in claim 13 , wherein said UI signal comprises additional presentation data for said corresponding thumbnail image.
17. A server as claimed in claim 13 , further comprising a database for maintaining said stream data for all video streams processed by said server.
18. A server as claimed in claim 9 , further comprising a video multiplexer for multiplexing said preview signals into a composite preview signal.
19. A server as claimed in claim 18 , wherein said network interface converts said preview signal into a PIP mosaic stream, and broadcasts said PIP mosaic stream to said STs for enabling said STs to join said PIP mosaic stream for playback of a preview mosaic of thumbnail moving images of the video content.
20. A server as claimed in claim 18 , further comprising a PIP presentation subsystem for receiving, from said controller, stream data pertinent to each said video stream and providing a user interface (UI) signal for said preview signal.
21. A server as claimed in claim 9 , further comprising a translation unit for further reducing the number of video frames in each said preview signal.
22. A server as claimed in claim 9 , further comprising j video multiplexers, each for multiplexing a set of said preview signals into a distinct composite preview signal.
23. A server as claimed in claim 22 , wherein said network interface converts each said distinct composite preview signal into a respective PIP mosaic stream, and broadcasts said PIP mosaic stream to said ST, for enabling said STs to join any of said distinct PIP mosaic stream for playback of a corresponding preview mosaic of thumbnail moving images of the video content.
24. A picture-in-picture (PIP) receiving unit for enabling a subscriber terminal (ST) to join a PIP stream for playback of a thumbnail moving image of video content in a corresponding video stream, overlaid on a full size image of the video content in any video stream that is currently played-back on said ST, comprising:
a network interface for interaction with a PIP server over an access network for requesting, receiving, and demodulating a reduced bandwidth PIP stream into a preview signal,
the preview signal consisting of a plurality of frames of video data selected from a video stream carrying frames of compressed video data, wherein each of the plurality of frames included in the preview signal results in a significant change in the video data from an immediately previous frame;
a user interface for enabling a user of said ST to request said PIP stream from said PIP server; and
a PIP decoder for converting said preview signal into a video signal for enabling playback of a thumbnail moving image of the video content in said video stream at said ST.