Device and method for inputting note information into image of photographed object

1. An apparatus comprising:

a display; and

a processor configured to:

detect a note-taking operation that inserts note information, performed by an input of a user, on a first area of an image of a shot object, the note information comprising handwritten characters;

detect an association operation, performed by another input of the user, that associates the note information with a position for content related to the note information; and

after the association operation is detected, detect a distance between the first area and the position for the content related to the note information and automatically adjust a display position and a display size of the handwritten characters when the distance between the first area and the position for the content related to the note information is larger than a predefined threshold distance,

wherein the processor is configured to automatically adjust the display position and the display size of the handwritten characters by:

identifying a blank area of the image adjacent to the position for the content related to the note information, the blank area being different than the first area;

identifying, based on a size of the identified blank area, a display size of the handwritten characters of the note information to be displayed in the blank area;

controlling the display to display an image of the shot object in which the handwritten characters having the identified display size are displayed in the blank area;

converting the handwritten characters of the note information into printed characters; and

controlling the display to display an image of the shot object in which the printed characters are displayed in the blank area.

2. The apparatus of claim 1 , wherein the processor is further configured to detect the note-taking operation of the user on the image of the shot object or a screen on which the image of the shot object is displayed, and determine the note information made on the shot object corresponding to the detected note-taking operation.

3. The apparatus of claim 1 , wherein the processor is further configured to trace a position of a finger tip of the user or a nib of a writing utensil to detect an operation of the finger tip or the nib on the shot object as the note-taking operation.

4. The apparatus of claim 1 , wherein the processor is further configured to:

apply an adaptive layout to the image of the shot object, and

when the adaptive layout is applied to the image of the shot object:

perform character recognition on the image of the shot object; and

determine a change of a font size or performance of word wrapping of the printed characters based on a result of the character recognition.

5. The apparatus of claim 1 , wherein the note information comprises edit information,

wherein the edit information comprises at least one of an insertion symbol, inserted content, a deletion symbol, or a position adjustment symbol, and

wherein content of the image is adjusted according to the edit information.

6. The apparatus of claim 1 , wherein, if at least one of a vibration of the shot object, a vibration of the apparatus for inputting the note information to the image of the shot object, or a vibration of a writing utensil is detected, the processor is further configured to perform a deviation calibration processing on the note information.

7. A method comprising:

obtaining an image of a shot object;

detecting a note-taking operation that inserts note information, performed by an input of a user, on a first area of the image of the shot object, the note information comprising handwritten characters;

detecting an association operation, performed by another input of the user, that associates the note information with a position for content related to the note information; and

after the association operation is detected, detecting a distance between the first area and the position for the content related to the note information and automatically adjusting a display position and a display size of the handwritten characters when the distance between the first area and the position for the content related to the note information is larger than a predefined threshold distance,

wherein the automatically adjusting of the display position and the display size of the handwritten characters includes:

identifying a blank area of the image adjacent to the position for the content related to the note information, the blank area being different than the first area;

identifying, based on a size of the identified blank area, a display size of the handwritten characters of the note information to be displayed in the blank area;

displaying an image of the shot object in which the handwritten characters having the identified display size are displayed in the blank area;

converting handwritten characters of the note information into printed characters; and

displaying an image of the shot object in which the printed characters are displayed in the blank area.

8. The method of claim 7 , wherein the obtaining of the note information comprises:

detecting the note-taking operation of the user on the image of the shot object or a screen on which the image of the shot object is displayed; and

determining the note information made on the shot object corresponding to the detected note-taking operation.

9. The method of claim 7 , wherein the detecting of the note-taking operation comprises detecting incremental information between image frames of the shot object as the note-taking operation.

10. The method of claim 7 , further comprising:

applying an adaptive layout to the image of the shot object, and

when the adaptive layout is applied to the image of the shot object:

performing character recognition on the image of the shot object; and

determining a change of a font size or performance of word wrapping of the printed characters based on a result of the character recognition.

11. The method of claim 7 , wherein the note information comprises edit information,

wherein the edit information comprises at least one of an insertion symbol, inserted content, a deletion symbol, or a position adjustment symbol, and

wherein content of the image is adjusted according to the edit information.

12. The method of claim 7 , further comprising, if at least one of a vibration of the shot object, a vibration of an apparatus for inputting the note information to the image of the shot object, or a vibration of a writing utensil is detected, performing a deviation calibration processing on the note information.

13. A non-transitory computer-readable recording medium having recorded thereon a computer program, which, when executed by a computer, performs the method of claim 7 .