Overlay rendering of user interface onto source video
A method of generating a blended output including an interactive user interface and one or more supplemental images. At a client device, a video stream containing an interactive user interface is received from a server using a first data communications channel configured to communicate video content and a command is transmitted to the server that relates to a user input received through the interactive user interface. In response to the transmitting, an updated user interface is received using the first data communications channel, and one or more supplemental images are received using a second data communications channel. Each supplemental image is associated with a corresponding transparency coefficient. The updated user interface and the one or more supplemental images are blended according to the transparency coefficient for each supplemental image to generate a blended output and the blended output is transmitted toward the display device for display thereon.
1. A method of providing an interactive user interface for generating a blended output that includes the interactive user interface and one or more supplemental images, the method comprising:
at a server remote from a client device:
transmitting a video stream that includes an interactive user interface towards the client device using a first data communications channel configured to communicate video content;
receiving a command that relates to a user input received through the interactive user interface;
generating an updated interactive user interface in accordance with the command;
in accordance with a determination that the client device is not capable of overlaying the updated interactive user interface and one or more supplemental images:
determining, at the server, a state of a decoder at the client device by retrieving one or more frames buffered on the server to obtain a state that corresponds to a frame corresponding to the command related to the user input; and
blending the updated interactive user interface and the one or more supplemental images determined based on the state of the decoder at the client device to generate a blended output frame with the one or more supplemental images over the updated interactive user interface, wherein each supplemental image of the one or more supplemental images is associated with a corresponding transparency coefficient and the blending is performed according to the transparency coefficient for each supplemental image of the one or more supplemental images; and
transmitting the blended output frame toward the client device for display on a display device.
2. The method according to claim 1 , further comprising:
switching between transmitting the blended output frame and transmitting the updated interactive user interface; and
transmitting the updated interactive user interface toward the client device for display on the display device.
3. The method according to claim 1 , wherein an encoding specification for the video stream is an MPEG specification, an AVS specification, or a VC-1 specification.
4. The method according to claim 1 , wherein the first data communications channel comprises at least one of: quadrature amplitude modulation (QAM) using a cable network infrastructure, user datagram protocol over internet protocol (UDP/IP) using an internet protocol television (IPTV) infrastructure, or hypertext transfer protocol (HTTP) using a public or private internet infrastructure, and wherein an image format of the one or more supplemental images is a bitmap (BMP) file format, a portable network graphics (PNG) file format, a joint photographic experts group (JPEG) file format, or a graphics interchange format (GIF) file format.
5. The method according to claim 1 , further comprising, prior to determining, at the server, the state of the decoder at the client device that corresponds to the frame corresponding to the command related to the user input, determining that the client device is not capable of overlaying the updated interactive user interface and the one or more supplemental images.