IP Library Granted Patent US 9,628,604
Granted Patent B2
US 9,628,604 · App. 14/867,869 · Granted Apr 18, 2017

Mobile terminal and controlling method thereof

Inventors: Seojin Lee (Seoul, KR); Samsick Kim (Seoul, KR); Donghwan Yu (Seoul, KR)
Assignee: LG Electronics Inc.
H04M1/72552G06F3/017G06F3/0346G06F3/0484G06F3/04883G06F3/167G06F17/289G10L15/26H04M1/7253G10L13/00H04M2250/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,628,604
App. No.
14/867,869
Granted
Apr 18, 2017
Kind
B2
Abstract

A mobile terminal and controlling method thereof are disclosed, by which a prescribed function can be performed using a more intuitive gesture and voice input. The present invention includes a display unit, a microphone, a sensing unit configured to detect a gesture, and a controller configured to convert voice data, received based on the microphone, to a text in a first language, detect, using the sensing unit, a first gesture, and in response to detecting the first gesture, translate the text in the first language to text in a second language.

Claims (38)

1. A mobile terminal of a watch type, comprising:

a display unit;

a microphone;

a sensing unit configured to detect a gesture; and

a controller configured to:

convert voice data, received based on the microphone, to a text in a first language,

when a first gesture is not detected, translate the text in the first language to text in a second language, and

when the first gesture is detected, translate the text in the second language to text in the first language.

2. The mobile terminal of claim 1 ,

wherein the first gesture is a gesture of changing an exposed surface, on which the microphone or display unit is provided, to another person, or is a gesture of moving of the mobile terminal in a prescribed direction.

3. The mobile terminal of claim 1 , wherein in direct response to detecting the first gesture, the controller is configured to start translating the text in the first language into the text in the second language.

4. The mobile terminal of claim 3 , wherein in response to detecting a second gesture, the controller is configured to stop translating the text in the first language into the text of the second language.

5. The mobile terminal of claim 4 , wherein the second gesture is a gesture for changing an exposed surface on which the microphone is provided.

6. The mobile terminal of claim 1 , wherein the controller is configured to start converting the voice data into the text when a second gesture and a third gesture are consecutively detected, the second gesture is a moving of the mobile terminal in a first direction, and the third gesture is moving the mobile terminal in a second direction which is different from the first direction.

7. The mobile terminal of claim 1 , further comprising an audio output unit, wherein the controller is configured to control the audio output unit to output audio based on the text in the first language or in the second language.

8. The mobile terminal of claim 7 , wherein in response to detecting a second gesture, the controller is configured to control the audio output unit to again output the audio.

9. The mobile terminal of claim 1 , wherein in response to detecting a second gesture, the controller is configured to stop converting the voice data into the text.

10. The mobile terminal of claim 9 , wherein the first gesture is a gesture of moving the mobile terminal in a first direction, and the second gesture is a gesture of moving the mobile terminal in a second direction which is different from the first direction.

11. A method of controlling a watch type mobile terminal comprising:

receiving voice data at a microphone;

converting the voice data into a text in a first language;

when a first gesture is not detected, translating the text in the first language into text in a second language, and

when the first gesture is detected, translating the text in the second language to text in the first language.

12. The method of claim 11 , wherein the first gesture is a gesture of changing an exposed surface on which the microphone or a display unit is provided, or is a gesture of moving the mobile terminal in a prescribed direction.

13. The method of claim 11 , wherein translating the text includes starting to translate the text in direct response to the detecting of the first gesture.

14. The method of claim 13 , further comprising:

detecting a second gesture; and

in response to detecting the second gesture, stopping the translating of the text in the first language into text in the second language.

15. The method of claim 14 , wherein the second gesture is a gesture for changing an exposed surface on which the microphone is provided.

16. The method of claim 11 , wherein converting the voice data into the text includes starting the converting when a second gesture and a third gesture are consecutively detected, the second gesture is a moving of the mobile terminal in a first direction, and the third gesture is a moving of the mobile terminal in a second direction which is different from the first direction.

17. The method of claim 11 , further comprising outputting audio, via an audio output unit, based on the text in the first language or the text in the second language.

18. The method of claim 17 , further comprising:

detecting a second gesture, and

in response to detecting the second gesture, outputting the audio data again via the audio output unit.

19. The method of claim 11 , further comprising:

detecting a second gesture; and

in response to detecting the second gesture, stopping the converting of the voice data into the text.

20. The method of claim 19 , wherein the first gesture is a gesture of moving the mobile terminal in a first direction, and the second gesture is a gesture of moving the mobile terminal in a second direction which is different from the first direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2015
From: LEE, SEOJIN; KIM, SAMSICK; YU, DONGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 036672/0653 →
Priority Claims (1)
KR 10-2014-0135758 · Oct 8, 2014 · national
Continuity (1)
Related Publication 20160248899A1 · Aug 25, 2016