System and method of controlling a screen of a display device using a mobile terminal

1. A mobile terminal, the mobile terminal comprising:

a camera configured to obtain an image including a screen displayed by an external display device;

an internal display device in communication with the camera, configured to display the obtained image to a user;

a user input device in communication with the internal display device, configured to receive touch information on the internal display device from the user;

a screen-detecting device in communication with the camera, configured to detect angular points of the screen in the obtained image;

a screen control device in communication with the screen-detecting device, configured to adjust a length/width of the screen on the internal display device and a degree of rotation of the screen based on the detected angular points such that the screen is displayed through the whole internal display device; and

a transmission device in communication with the screen control device and the user input device, configured to transmit screen display information about how the screen is displayed on the internal display device and the touch information to a broadcast receiving terminal connected to the external display device,

wherein the touch information includes selection information of a first point on the internal display device and movement direction information of the first point when the first point moves,

wherein the screen display information includes length/width information of the internal display device and location information of angular points of the screen on the internal display device, and wherein the selection information of the first point includes location information of the first point on the internal display device.

2. The mobile terminal according to claim 1 , wherein the broadcast receiving terminal executes a menu contained in the screen or performs one of zooming in, zooming out, rotating and scrolling the screen on the external display device using the screen display information and the touch information.

3. The mobile terminal according to claim 2 , wherein when the first point is one and the first point does not move, the broadcast receiving terminal calculates a second point on the external display device corresponding to the first point and executes a menu displayed at the second point on the external display device.

4. The mobile terminal according to claim 2 , wherein when the first point is one and the first point moves, the broadcast receiving terminal scrolls the screen on the external display device in a same direction as a movement direction of the first point using the movement direction information of the first point.

5. The mobile terminal according to claim 2 , wherein when the first point is two and the two first points become more distant from each other due to movement of at least one of the two first points, the broadcast receiving terminal zooms in the screen on the external display device, and when the first point is two and the two first points get closer to each other due to movement of at least one of the two first points, the broadcast receiving terminal zooms out the screen on the external display device.

6. The mobile terminal according to claim 1 , wherein the obtained image is a still image or a moving image.

7. A method of controlling a screen displayed by a display device using a mobile terminal including an image-obtaining unit, a display unit, a user input unit and a transmission unit, the method comprising:

obtaining an image including the screen using the image-obtaining unit;

displaying the obtained image to a user using the display unit;

detecting angular points of the screen in the obtained image;

adjusting a length/width of the screen on the display unit and a degree of rotation of the screen based on the angular points such that the screen is displayed through the whole display unit;

receiving touch information from the user using the user input unit; and

transmitting screen display information about how the screen is displayed on the display unit and the touch information to a broadcast receiving terminal connected to the display device using the transmission unit,

wherein the touch information includes selection information of a first point on the display unit and movement direction information of the first point when the first point moves,

wherein the screen display information includes length/width information of the display unit and location information of angular points of the screen on the display unit, and wherein the selection information of the first point includes location information of the first point on the display unit,

wherein the broadcast receiving terminal receives the length/width information of the display unit and coordinate information of the first point on the display unit from the mobile terminal, calculates the second point corresponding to the first point using the ratio of the length/width of the display unit and the length/width of the display device and executes a menu contained in the screen or performs one of zooming in, zooming out, rotating and scrolling the screen on the display device using the screen display information and the touch information.

8. A computer-readable non-transitory storage, in which programs of instruction languages that can be executed by a digital processing device are materially embodied to control a screen displayed on a display device using a mobile terminal that includes an image-obtaining unit, a display unit, a user input unit and a transmission unit and which can be read by the digital processing device, the record medium recording the programs that performs a process comprising:

obtaining an image including the screen using the image-obtaining unit;

displaying the obtained image to the user using the display unit;

detecting angular points of the screen in the obtained image;

adjusting a length/width of the screen on the display unit and a degree of rotation of the screen based on the angular points such that the screen is displayed through the whole display unit;

receiving touch information from the user using the user input unit, wherein the touch information includes selection information of a first point on the display unit and movement direction information of the first point when the first point moves; and

transmitting screen display information about how the screen is displayed on the display unit and the touch information to a broadcast receiving terminal using the transmission unit,

wherein the touch information includes selection information of a first point on the display unit and movement direction information of the first point when the first point moves,

wherein the screen display information includes length/width information of the display unit and location information of angular points of the screen on the display unit, and wherein the selection information of the first point includes location information of the first point on the display unit,

wherein the broadcast receiving terminal receives the length/width information of the display unit and coordinate information of the first point on the display unit from the mobile terminal, calculates the second point corresponding to the first point using the ratio of the length/width of the display unit and the length/width of the display device and executes a menu contained in the screen or performs one of zooming in, zooming out, rotating and scrolling the screen on the display device using the screen display information and the touch information.