Mobile terminal displaying writing information generated by pen device based on voice received via microphone and control method thereof

1. A mobile terminal comprising:

a microphone;

a display;

a communication module configured to perform communication with a pen device having a first end and a second end; and

a controller configured to:

control the microphone, the display, and the communication module;

cause the display to display a window including specific text;

recognize that the pen device operates in a first mode when the first end of the pen device is not in contact with the display for a predetermined time;

recognize a specific voice received via the microphone while the window including the specific text is displayed in the first mode, the specific voice corresponding to the specific text; and

cause the display to display writing information at a position corresponding to the specific text in the window in response to the recognized specific voice when the writing information is generated by the pen device on a surface other than a surface of the display in the first mode.

2. The mobile terminal of claim 1 , wherein, while the pen device operates in the first mode, the controller is further configured to:

cause the display to display a black screen; and

cause the display to display the writing information on the black screen.

3. The mobile terminal of claim 1 , wherein the controller is further configured to cause the display to display the writing information in a post-it form when the first end is in contact with the display such that the writing information is displayed in at least one post-it area of the display.

4. The mobile terminal of claim 1 , wherein the surface comprises a display area of another mobile terminal or any type of surface.

5. The mobile terminal of claim 1 , wherein the controller is further configured to:

determine an angle between the pen device and the mobile terminal set by the pen device; and

detect a memorization write mode and an eraser mode of the pen device, which are included in the first mode, based on the determined angle.

6. The mobile terminal of claim 5 , wherein:

the memorization write mode is a mode in which a portion of the displayed writing information is covered by the second end of the pen device when the angle is within a first angle range; and

the eraser mode is a mode in which the displayed writing information is erased by the second end of the pen device when the angle is within a second angle range.

7. The mobile terminal of claim 6 , wherein the controller is further configured to:

recognize a touch applied by the second end of the pen device at a portion of the writing information; and

cause the display to display a black box at the touched portion in response to the touch.

8. The mobile terminal of claim 7 , wherein the controller is further configured to delete the black box when a writing generated by the second end corresponds to the covered portion after the black box is touched by the second end of the pen device for a predetermined time.

9. The mobile terminal of claim 1 , wherein the controller is further configured to change an attribute of a writing window displayed on the display based on a user pattern by a user of the pen device.

10. The mobile terminal of claim 1 , wherein:

an operation mode of the pen device includes the first mode and a second mode;

the first mode is a mode for performing an operation except for a writing function of the pen device; and

the second mode is a mode in which a writing is input via the display by the first end of the pen device.

11. A method for operating a mobile terminal, the method comprising:

displaying a window including specific text on a display of the mobile terminal;

recognizing that a pen device operates in a first mode when a first end of the pen device is not in contact with the display for a predetermined time;

recognizing a specific voice received via a microphone while the window including the specific text is displayed in the first mode, the specific voice corresponding to the specific text; and

displaying writing information at a position corresponding to the specific text in the window in response to the recognized specific voice when the writing information is generated by the pen device on a surface other than a surface of the display in the first mode.

12. The method of claim 11 , wherein when the pen device operates in the first mode, the method further comprises:

changing a screen of the display to a black screen; and

displaying the writing information on the black screen.

13. The method of claim 11 , further comprising displaying the writing information in a post-it form when the first end is in contact with the display such that the writing information is displayed in at least one post-it area of the display.

14. The method of claim 11 , wherein the surface comprises a display area of another mobile terminal or any type of surface.

15. The method of claim 11 , further comprising:

determining an angle between the pen device and the mobile terminal set by the pen device; and

detecting a memorization write mode and an eraser mode of the pen device, which are included in the first mode, based on the determined angle.

16. The method of claim 15 , wherein:

the memorization write mode is a mode in which a portion of the displayed writing information is covered by a second end of the pen device when the angle is within a first angle range; and

the eraser mode is a mode in which the displayed writing information is erased by the second end of the pen device when the angle is within a second angle range.

17. The method of claim 16 , further comprising:

recognizing a touch applied by the second end of the pen device at a portion of the writing information; and

displaying a black box at the touched portion in response to the touch.

18. The method of claim 17 , further comprising deleting the black box when a writing generated by the second end corresponds to the covered portion after the black box is touched by the second end of the pen device for a predetermined time.

19. The method of claim 11 , further comprising changing an attribute of a writing window displayed on the display based on a user pattern by a user of the pen device.

20. The method of claim 11 , wherein:

an operation mode of the pen device includes the first mode and a second mode;

the first mode is a mode for performing an operation except for a writing function of the pen device; and

the second mode is a mode in which a writing is input via the display by the first end of the pen device.