IP Library Granted Patent US 10,049,094
Granted Patent B2
US 10,049,094 · App. 15/077,116 · Granted Aug 14, 2018

Mobile terminal and method of controlling the same

Inventors: Jie Seol (Seoul, KR); Soyeon Yim (Seoul, KR)
Assignee: LG Electronics Inc.
G06F17/243G06F3/0482G06F3/04842G06F3/04883G06F3/04886G06K9/18G06K9/2081G06K9/228G06K9/325G06K9/344H04M1/7258H04M1/72522H04M1/72583H04M2250/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,049,094
App. No.
15/077,116
Granted
Aug 14, 2018
Kind
B2
Abstract

Provided is a mobile terminal including: a camera; a touch screen; and a controller that outputs to the touch screen a keypad that includes at least one graphic object of a first graphic object in conjunction with an optical character reader (OCR) function relating to the camera and a second graphic object in conjunction with a photographing function relating to the camera, in which the first and second graphic objects are together displayed on the keypad or one graphic object of the first and second graphic objects is displayed on the keypad, and in which, in a case where one graphic object of the first and second graphic objects is displayed on the keypad, based on application of a predetermined-type touch to the one graphic object, the controller changes one graphic object to the other graphic object.

Claims (72)

1. A mobile terminal comprising:

a camera;

a touch screen; and

a controller configured to display, on the touch screen, a keypad comprising at least one of a first graphic object or a second graphic object, the controller configured to display the first graphic object in conjunction with an optical character reader (OCR) function relating to the camera and to display the second graphic object in conjunction with a photographing function relating to the camera,

wherein the controller is configured to display both the first graphic object and the second graphic object together on the keypad or to display one graphic object among the first graphic object and the second graphic object on the keypad, and

wherein the controller is configured to:

based on displaying one graphic object among the first graphic object and the second graphic object on the keypad, determine whether a predetermined type of touch input has been applied to the displayed one graphic object; and

based on a determination that the predetermined type of touch input has been applied to the displayed one graphic object, change the displayed one graphic object to the other graphic object among the first graphic object and the second graphic object that is different from the displayed one graphic object.

2. The mobile terminal of claim 1 , wherein:

based on the displayed one graphic object being the first graphic object, the other graphic object is the second graphic object, and

based on the displayed one graphic object being the second graphic object, the other graphic object is the first graphic object.

3. The mobile terminal of claim 1 , wherein the touch screen comprises one or more input fields, and

wherein the controller is configured to:

determine that a touch input has been applied to one of the one or more input fields;

based on the determination that a touch input has been applied to the one of the one or more input fields, map the one of the one or more input fields to the first graphic object, the second graphic object, or both the first graphic object and the second graphic object; and

based on the mapping, display, on the touch screen, the keypad comprising at least one of the first graphic object or the second graphic object.

4. The mobile terminal of claim 3 , wherein the controller is further configured to:

determine information associated with the one of the one or more input fields to which the touch input is applied;

determine an input capability for the one of the one or more input fields; and

map the one of the one or more input fields to the first graphic object, the second graphic object, or both the first graphic object and the second graphic object based on the information associated with the one of the one or more input fields to which the touch input is applied and based on the determined input capability for the one of the one or more input fields to which the touch input is applied.

5. The mobile terminal of claim 4 , wherein the controller is further configured to:

determine whether the input capability for the one of the one or more input fields to which the touch input is applied corresponds to a text input or an image input;

based on a determination that the input capability for the one of the one or more input fields to which the touch input is applied corresponds to a text input, display the first graphic object on the keypad; and

based on a determination that the input capability for the one of the one or more input fields to which the touch input is applied corresponds to an image input, display the second graphic object on the keypad.

6. The mobile terminal of claim 1 , wherein the controller is further configured to:

determine that one of the first graphic object or the second graphic object has been selected by a user;

receive, through the camera, an image; and

based on the determination that one of the first graphic object or the second graphic object has been selected by the user, display, on the touch screen, the image that was received through the camera.

7. The mobile terminal of claim 6 , wherein the controller is further configured to:

based on a determination that the selected one of the first graphic object or the second graphic object is the first graphic object:

determine a partial region of the touch screen in which to output the received image; and

output the received image to the determined partial region of the touch screen; and

based on a determination that the selected one of the first graphic object or the second graphic object is the second graphic object, output the received image to an entire region of the touch screen.

8. The mobile terminal of claim 7 , wherein the controller is configured to determine the partial region of the touch screen in which to output the received image by:

determining a type of the touch input that has been applied to the first graphic object by the user; and

determining the partial region of the touch screen based on the determined type of touch input that has been applied to the first graphic object by the user.

9. The mobile terminal of claim 8 , wherein the controller is configured to:

determine whether the type of the touch input that has been applied to the first graphic object by the user is a first type of touch input or a second type of touch input;

based on a determination that the type of the touch input that has been applied to the first graphic object by the user is the first type of touch input, display the received image on an already-selected input field displayed on the touch screen; and

based on a determination that the type of the touch input that has been applied to the first graphic object by the user is the second type of touch input, display the received image on at least one portion of the keypad.

10. The mobile terminal of claim 6 , wherein the controller is further configured to:

determine that the one of the first graphic object or the second graphic object that has been selected by a user is the first graphic object;

based on the determination that the one of the first graphic object or the second graphic object that has been selected by a user is the first graphic object and that the received image is displayed on the touch screen, determine that a drag type of touch input has been applied to a region of the touch screen on which the image is displayed;

determine that the region of the touch screen on which the drag type of touch has been applied displays image information that corresponds to text included in the image; and

select the image information displayed in the region of the touch screen to which the drag type of touch input has been applied and that corresponds to the text included in the image.

11. The mobile terminal of claim 10 , wherein the controller is further configured to:

determine that a user request has been received; and

based on the determination that the user request has been received:

convert, into text, the selected image information displayed in the region of the touch screen to which the drag type of touch input has been applied;

determine an input field that has been selected by the user; and

input the converted text into the selected input field.

12. The mobile terminal of claim 10 , wherein the controller is further configured to:

determine that the drag type of touch input has been applied in a first direction;

based on the determination that the drag type of touch input has been applied in the first direction, select the image information displayed in the region of the touch screen to which the drag type of touch input has been applied in the first direction;

determine that a second drag type of touch input, subsequent to the drag type of touch input applied in the first direction, has been applied to the touch screen in a second direction perpendicular to the first direction; and

based on the determination that the second drag type of touch input has been applied in the second direction, cancel the selection of at least a portion of the selected image information.

13. The mobile terminal of claim 10 , wherein the controller is further configured to:

determine that a user request has been received;

based on the determination that the user request has been received, convert, into text, the image information displayed on the touch screen that corresponds to text included in the image;

determine whether the drag type of touch input has been applied in a first direction or in a third direction opposite to the first direction;

based on a determination that the drag type of touch input has been applied in the first direction, select, for conversion into text, a portion of the image information displayed in the region of the touch screen to which the drag type of touch input has been applied in the first direction; and

based on a determination that the drag type of touch input has been applied in the third direction that is opposite to the first direction, select, for conversion into text, portions of the image information other than a portion to which the drag type of touch input has been applied in the third direction.

14. The mobile terminal of claim 6 , wherein the controller is further configured to:

determine that the one of the first graphic object or the second graphic object that has been selected by a user is the second graphic object;

determine that a touch input has been applied to a photographing button of the mobile terminal; and

based on the determination that the one of the first graphic object or the second graphic object that has been selected by a user is the second graphic object and that a touch input has been applied to the photographing button of the mobile terminal:

determine an input field that has been selected by the user;

capture the received image; and

display the captured image in the selected input field.

15. The mobile terminal of claim 14 , wherein the controller is further configured to:

determine that a drag type of touch input has been applied to a region of the touch screen displaying the received image; and

capture the image such that a portion of the image that corresponds to the region of the touch screen to which the drag type of touch input has been applied is not output.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2016
From: SEOL, JIE; YIM, SOYEON
To: LG ELECTRONICS INC.
Reel/Frame 038068/0048 →
Priority Claims (1)
KR 10-2015-0117552 · Aug 20, 2015 · national
Continuity (1)
Related Publication 20170052939A1 · Feb 23, 2017