Overlay rendering of user interface onto source video
View Patent ↗A method of combining an interactive user interface for generating a blended output that includes the interactive user interface and one or more supplemental images. At a client device remote from a server, a video stream that contains an interactive user interface is received from the server using a first data communications channel configured to communicate video content, and a command that relates to an interactive user interface is transmitted to the server. In response to the transmitting, an updated user interface is received from the server using the first data communications channel, and one or more supplemental images for supplementing the interactive user interface are received using a second data communications channel different from the first data communications channel. The updated user interface and the one or more supplemental images are blended to generate a blended output, which is transmitted toward the display device for display thereon.
1. A method of combining an interactive user interface for generating a blended output that includes the interactive user interface and one or more supplemental images, the method comprising:
at a client device remote from a server:
receiving a video stream that contains an interactive user interface from the server using a first data communications channel configured to communicate video content;
transmitting to the server a command that relates to a user input received through the interactive user interface, wherein the command is a request for secure content;
receiving, in response to the transmitting, an updated user interface from the server using the first data communications channel,
receiving from a third-party server, in response to the transmitting, one or more supplemental images for supplementing the interactive user interface using a second data communications channel that is different from the first data communications channel and uses a secure transport protocol, wherein each supplemental image of the one or more supplemental images is associated with a corresponding transparency coefficient;
blending the updated user interface and the one or more supplemental images according to the transparency coefficient for each supplemental image of the one or more supplemental images to generate a blended output; and
transmitting the blended output toward the display device for display thereon.
2. The method according to claim 1 , wherein the interactive user interface comprises a source video stitched with user interface content.
3. The method according to claim 1 , wherein an encoding specification for the video stream is an MPEG specification, an AVS specification, or a VC-1 specification.
4. The method according to claim 1 , wherein the first data communications channel comprises at least one of: quadrature amplitude modulation (QAM) using a cable network infrastructure, user datagram protocol over internet protocol (UDP/IP) using an internet protocol television (IPTV) infrastructure, or hypertext transfer protocol (HTTP) using a public or private internet infrastructure, and the second data communications channel comprises at least one of transmission control protocol over internet protocol (TCP/IP), remote frame buffer (RFB) protocol, and extended remoting technology (XRT) protocol.
5. The method according to claim 1 , wherein the blending comprises blending in a spatial domain.
6. A method of providing an interactive user interface for generating a blended output that includes the interactive user interface and one or more supplemental images, the method comprising:
at a server remote from a client device:
transmitting a video stream that includes an interactive user interface towards the client device using a first data communications channel configured to communicate video content;
receiving a command that relates to a user input received through the interactive user interface;
generating an updated interactive user interface;
blending the updated interactive user interface and one or more supplemental images to generate a blended output frame, wherein each supplemental image of the one or more supplemental images is associated with a corresponding transparency coefficient and the blending is performed according to the transparency coefficient for each supplemental image of the one or more supplemental images;
transmitting the blended output frame toward the client device for display on a display device;
switching between transmitting the blended output frame and transmitting the updated interactive user interface; and
transmitting the updated interactive user interface toward the client device for display on the display device.
7. The method according to claim 6 , wherein an encoding specification for the video stream is an MPEG specification, an AVS specification, or a VC-1 specification.
8. The method according to claim 6 , wherein the first data communications channel comprises at least one of: quadrature amplitude modulation (QAM) using a cable network infrastructure, user datagram protocol over internet protocol (UDP/IP) using an internet protocol television (IPTV) infrastructure, or hypertext transfer protocol (HTTP) using a public or private internet infrastructure, and wherein an image format of the one or more supplemental images is a bitmap (BMP) file format, a portable network graphics (PNG) file format, a joint photographic experts group (JPEG) file format, or a graphics interchange format (GIF) file format.
9. The method according to claim 6 , further comprising first determining that the client device is not capable of overlaying.