IP Library › Granted Patent US 9,723,369
Granted Patent B2
US 9,723,369 · App. 14/543,952 · Granted Aug 1, 2017

Mobile terminal and controlling method thereof for saving audio in association with an image

Inventors: Jonghwan Kim (Seoul, KR); Hyungjun Jin (Seoul, KR); Heejung Ohe (Seoul, KR); Hyungjin Kim (Seoul, KR); Seungtae Park (Seoul, KR); Sangyeong Jang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N21/4852G06F3/167G11B27/036H04M1/72522H04N1/00185H04N1/00403H04N1/00411H04M1/72547H04M1/72558H04M2250/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,723,369
App. No.
14/543,952
Filed
Nov 18, 2014
Granted
Aug 1, 2017
Kind
B2
Art Unit
2481
USPC
386/285
Abstract

A method of controlling a mobile terminal, and which includes displaying an image on a touchscreen of the mobile terminal; receiving an audio synthesis command for synthesizing audio with the image; saving at least one audio candidate in association with the image, based on the received audio synthesis command; and displaying an indicator on the touchscreen indicating the at least one audio candidate is saved with the image.

Claims (43)

1. A method of controlling a mobile terminal, the method comprising:

displaying an image on a touchscreen of the mobile terminal;

searching at least one of audio candidates related to the displayed image from at least one multimedia file;

displaying a list of at least one of the searched audio candidates, the list comprising a thumbnail corresponding to the multimedia file;

receiving a selection of at least one of audio candidates from the displayed list;

saving an audio of the selected audio candidates in association with the image;

displaying an indicator on the touchscreen indicating the at least one audio candidate is saved with the image;

in response to a first type of input of the indicator, playing the saved audio; and

in response to a second type of input, adding a shortcut to a source content corresponding to the saved audio.

2. The method of claim 1 , wherein the at least one multimedia file is included in at least one of a music file, a recording file, a video file and a streaming content.

3. The method of claim 1 , wherein the thumbnail comprises a play menu button, and

wherein if the play menu button of the thumbnail is selected, the method further comprises playing the audio candidate corresponding to the selected thumbnail.

4. The method of claim 3 , further comprising:

when the audio candidate corresponding to the selected thumbnail is played, and in response to a first touch input, changing a play timing point of the played audio candidate; and

in response to a second touch input, playing another audio candidate.

5. The method of claim 1 , wherein the at least one audio saved in association with the image comprises an audio candidate having a highest association degree with the image among a plurality of searched audio candidates.

6. The method of claim 1 , further comprising:

receiving a selection of a specific object from the image; and

saving an audio of a prescribed audio candidate in association with the selected object.

7. The method of claim 1 , further comprising:

selecting the at least one audio candidate based on at least one of a use frequency of an audio saved in association with a different image similar to the selected image, a tag set for the selected image, a file name of the selected image, a recognition result of an object included in the selected image, a created time of the selected image, or a created place of the selected image.

8. A mobile terminal, comprising:

a touchscreen configured to display an image; and

a controller configured to:

search for at least one of audio candidates related to the displayed image from at least one multimedia file,

display a list of at least one of the searched audio candidates on the touchscreen, the list comprising a thumbnail corresponding to the multimedia file,

receive a selection of at least one of audio candidates from the displayed list,

save an audio of the selected audio candidates in association with the image,

display an indicator on the touchscreen indicating the at least one audio candidate is saved with the image,

in response to a first type of input of the indicator, play the saved audio, and

in response to a second type of input, add a shortcut to a source content corresponding to the saved audio.

9. The mobile terminal of claim 8 , wherein the at least one multimedia file is included in at least one of a music file, a recording file, a video file and a streaming content.

10. The mobile terminal of claim 8 , wherein the thumbnail comprises a play menu button, and

wherein if the play menu button of the thumbnail is selected, the controller is further configured to play the audio candidate corresponding to the selected thumbnail.

11. The mobile terminal of claim 10 , wherein the controller is further configured to:

when the audio candidate corresponding to the selected thumbnail is played, and in response to a first touch input, change a play timing point of the played audio candidate; and

in response to a second touch input, play another audio candidate.

12. The mobile terminal of claim 8 , wherein the at least one audio saved in association with the image comprises an audio candidate having a highest association degree with the image among a plurality of searched audio candidates.

13. The mobile terminal of claim 8 , wherein the controller is further configured to:

receive a selection of a specific object from the image, and

save an audio of a prescribed audio candidate in association with the selected object.

14. The mobile terminal of claim 8 , wherein the controller is further configured to:

select the at least one audio candidate based on at least one of a use frequency of an audio saved in association with a different image similar to the selected image, a tag set for the selected image, a file name of the selected image, a recognition result of an object included in the selected image, a created time of the selected image, or a created place of the selected image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2014
From: KIM, JONGHWAN; JIN, HYUNGJUN; OHE, HEEJUNG; KIM, HYUNGJIN; PARK, SEUNGTAE; JANG, SANGYEONG
To: LG ELECTRONICS INC.
Reel/Frame 034211/0224 →
Priority Claims (2)
KR 10-2013-0146561 · Nov 28, 2013 · national
KR 10-2013-0157859 · Dec 18, 2013 · national
Continuity (1)
Related Publication 20150147048A1 · May 28, 2015