Displaying multiple videos on sink device using display information of source device
View Patent ↗Embodiments relate to customizing contents displayed at a sink device by converting received contents from a source device. The source device provides, to the sink device, the contents and display information of the source device. The display information of the source device may indicate spatial arrangements (e.g., locations and sizes) of the contents in the source device. The sink device may map sub-display regions of the source device to sub-display regions of the sink device. Moreover, the sink device generates output images for display in sub-display regions of the sink device according to the mapping. By mapping display regions at the sink device, images can be displayed in different arrangements at the sink device without the source device having any information on the configuration of sub-display regions of the sink device.
1. A method of transmitting video data, the method comprising:
generating images for display in sub-display regions of a first device;
generating, at the first device, display information indicating coordinates corresponding to locations of the sub-display regions of the first device;
transmitting the images from the first device to a second device through a communication link; and
transmitting the display information indicating the coordinates corresponding to locations of the sub-display regions of the first device to the second device through the communication link to cause the second device to display the transmitted images in sub-display regions of the second device based upon the received display information, relative locations of at least two of the sub-display regions of the first device being different from relative locations of corresponding two of the sub-display regions of the second device, at least one of the sub-display regions displayed in a first display device of the second device and another of the sub-display regions displayed in a second display device of the second device physically separate from the first display device; and
receiving, at the first device, an input command from the second device in response to receiving user input at an interaction coordinate of the sub-display regions of the second device, the input command from the second device indicating a coordinate of the sub-display regions of the first device mapped by the second device from the interaction coordinate of the sub-display regions of the second device.
2. The method of claim 1 , wherein the images are transmitted to the second device through the communication link during first times, and the display information indicating at least the locations of the sub-display regions of the first device is transmitted to the second device through the communication link during second times.
3. The method of claim 1 , wherein the input command is generated to indicate a location on the sub-display regions of the first device that corresponds to a location of a touch on one of the sub-display regions of the second device.
4. The method of claim 1 , wherein the images and the display information are transmitted using a Mobile High-Definition Link (MHL) protocol or a High-Definition Multimedia Interface (HDMI) protocol.
5. The method of claim 1 , wherein the display information further indicates a size of each of the sub-display regions of the first device.
6. A method of displaying video data, the method comprising:
receiving images in sub-display regions of a first device through a communication link;
receiving display information indicating coordinates corresponding to locations of the sub-display regions of the first device for display at the first device through the communication link;
mapping, at a second device, the sub-display regions of the first device to sub-display regions of the second device based upon the received coordinates, relative locations of at least two of the sub-display regions of the first device being different from relative locations of corresponding two of the sub-display regions of the second device, at least one of the sub-display regions displayed in a first display device of the second device and another of the sub-display regions displayed in a second display device of the second device physically separate from the first display device; and
displaying, at the second device, the images in the sub-display regions of the second device based on the mapping;
receiving user input at a first coordinate of one of the sub-display regions of the second device;
converting the first coordinate to a second coordinate of one of the sub-display regions of the first device based on the mapping; and
transmitting the second coordinate from the second device to the first device.
7. The method of claim 6 , wherein the images are received at the second device through the communication link during first times, and the display information indicating at least the locations of the sub-display regions of the first device is received at the second device through the communication link during second times.
8. The method of claim 6 , wherein the user input corresponds to a touch signal indicating a location of a touch on the one of the sub-display regions of the second device.
9. The method of claim 6 , wherein the display information further indicates a size of each of the sub-display regions of the first device.
10. The method of claim 6 , wherein the images and the display information are received using a Mobile High-Definition Link (MHL) protocol or a High-Definition Multimedia Interface (HDMI) protocol.
11. The method of claim 6 , further comprising transcoding the received images at the second device for display in the sub-display regions of the second device.
12. The method of claim 6 , further comprising:
receiving, at the second device, audio streams;
receiving a selection of a sub-display region of the sub-display regions of the second device; and
generating, at the second device, an audio signal based on an audio stream of the audio streams, the audio stream associated with the selected sub-display region of the second device.
13. A device for displaying video data, the device comprising:
a communication module configured to receive, through a communication link, images in sub-display regions of another device for display at the other device and display information indicating coordinates corresponding to locations of the sub-display regions of the other device for display at the other device; and
a mapping converter configured to map, for displaying the images at the device, the sub-display regions of the other device to sub-display regions of the device based upon the received coordinates, relative locations of at least two of the sub-display regions of the other device being different from relative locations of corresponding two of the sub-display regions of the device, at least one of the sub-display regions of the device displayed in a first display device and another of the sub-display regions of the device displayed in a second display device physically separate from the first display device, and
wherein the mapping converter is further configured to convert a first coordinate representing a user input at one of the sub-display regions of the device to a second coordinate of one of the sub-display regions of the other device based on the mapping for transmitting to the other device.
14. The device of claim 13 , wherein the communication module receives the images through the communication link during first times, and the display information indicating at least the locations of the sub-display regions of the other device during second times.