IP Library Granted Patent US 8,229,935
Granted Patent B2
US 8,229,935 · App. 11/826,006 · Granted Jul 24, 2012

Photo recommendation method using mood of music and system thereof

Assignee: Samsung Electronics Co., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,229,935
App. No.
11/826,006
Granted
Jul 24, 2012
Kind
B2
Abstract

A photo recommendation method using a mood of music is provided. The photo recommendation method using the mood of the music includes: categorizing the music into a mood by analyzing a sound source of the music; searching for a photo using meta information of the music; and recommending the photo corresponding to the categorized mood of the music according to a result of the searching.

Claims (69)

1. A photo recommendation method using a mood of music, the method comprising:

categorizing, by a processor, the music into a mood by analyzing a sound source of the music;

searching for a photo using meta information of the music; and

recommending the photo corresponding to the categorized mood of the music according to a result of the searching,

wherein the recommending of the photo comprises

filtering the retrieved photo based on the mood of the music, a color of the photo, and a category of the photo; and

recommending a photo according to a result of the filtering,

wherein the searching for the photo comprises:

extracting a search vocabulary to search for the photo using information of music title, lyrics, singer, and genre, included in the meta information of the music; and

searching for the photo associated with the music, based on the extracted search vocabulary, and

wherein the detecting of the search vocabulary comprises:

analyzing a morpheme with respect to the information of the music title, the lyrics, the singer, and the genre;

detecting a keyword associated with the searching for the photo based on a result of the analysis of the morpheme;

detecting a feature for categorizing the music into a theme based on a result of the analysis of the morpheme;

categorizing the music into the theme using the detected feature for categorizing the music into the theme; and

expanding a keyword using an associated keyword with the theme of the music and the mood of the music.

2. The method of claim 1 , wherein the categorizing of the music into the mood comprises:

analyzing the sound source of the music using a previously trained categorizer; and

categorizing the music into the mood according to a result of the analysis.

3. The method of claim 1 , wherein the detecting of the keyword detects the keyword associated with a location, an object, a person, a time, an event, and a motion, based on the result of the analysis of the morpheme.

4. The method of claim 1 , wherein the detecting of the keyword detects the keyword associated with the searching for the photo using an ontology with respect to the result of the analysis of the morpheme, based on a six W's principle and a hierarchy relation.

5. The method of claim 1 , wherein the detecting of the feature detects the feature for categorizing the music into the theme based on the result of the analysis of the morpheme.

6. The method of claim 1 , further comprising:

recommending the photo as a result of the filtering;

editing the filtered photo into a moving picture; and

playing the edited moving picture.

7. A non-transitory computer-readable storage medium storing a program for implementing a photo recommendation method, the method comprising:

categorizing music into a mood by analyzing a sound source of the music;

searching for a photo using meta information of the music; and

recommending a photo corresponding to the categorized mood of the music according to a result of the searching,

wherein the recommending of the photo comprises

filtering the retrieved photo based on the mood of the music, a color of the photo, and a category of the photo; and

recommending a photo according to a result of the filtering,

wherein the searching for the photo comprises:

extracting a search vocabulary to search for the photo using information of music title, lyrics, singer, and genre, included in the meta information of the music; and

searching for the photo associated with the music, based on the extracted search vocabulary, and

wherein the detecting of the search vocabulary comprises:

analyzing a morpheme with respect to the information of the music title, the lyrics, the singer, and the genre;

detecting a keyword associated with the searching for the photo based on a result of the analysis of the morpheme;

detecting a feature for categorizing the music into a theme based on a result of the analysis of the morpheme;

categorizing the music into the theme using the detected feature for categorizing the music into the theme; and

expanding a keyword using an associated keyword with the theme of the music and the mood of the music.

8. A multimedia device, including a computer, recommending a photo using a mood of music, the device comprising:

a music mood categorizer, using at least one processing device, categorizing the music into a mood using the computer;

a photo search module searching for a photo using meta information of the music using the computer; and

a photo recommendation module recommending the photo corresponding to the categorized mood of the music according to a result of the searching using the computer,

wherein the photo recommendation module comprises

a photo categorizer categorizing the photo into a category;

a color analyzer analyzing a color of the photo; and

a photo filter filtering the retrieved photo based on the mood of the music, the color of the photo, and the category of the photo,

wherein the photo search module comprises:

a search vocabulary extraction detection module detecting a search vocabulary to search for the photo using information of music title, lyrics, singer, and genre, included in the meta information of the music; and

a search module searching for the photo associated with the music, using the detected search vocabulary, and

wherein the search vocabulary extraction module comprises:

a morpheme analyzer analyzing a morpheme with respect to the information of the music title, the lyrics, the singer, and the genre, included in the meta information of the music;

a first detector detecting a keyword based on a result of the morpheme analysis;

a second detector detecting a feature for categorizing the music into a theme based on a result of the analysis of the morpheme;

a theme categorizer categorizing the music into the theme according to the detected feature for categorizing the music into the theme; and

a keyword expansion module expanding a photo keyword using an associated keyword with the theme of the music and the mood of the music.

9. The multimedia device of claim 8 , wherein the music mood categorizer comprises:

a music storage module storing a sound source of the music and the meta information of the music;

a sound source analyzer analyzing the sound source of the music; and

a mood categorizer categorizing the music into the mood according to a result of the analysis.

10. The multimedia device of claim 8 , wherein the first detector detects the keyword associated with a location, an object, a person, a time, an event, and a motion, based on the result of the analysis of the morpheme.

11. The multimedia device of claim 8 , wherein the theme categorizer categorizes the music into the theme using a previously trained categorizer, based on the detected feature for categorizing the music into the theme.

12. The multimedia device of claim 8 , wherein the recommendation module comprises:

a photo editor editing the recommended photo into a photo moving picture; and

a photo player module playing the edited moving picture.

13. The multimedia device of claim 12 , wherein the photo editor edits the plurality of recommended photos into the photo moving picture in a form of a slide show.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2007
From: LEE, JAE WON; KIM, HYOUNG GOOK; KIM, JUNG EUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 019595/0013 →
Priority Claims (1)
KR 10 2006 0111769 · Nov 13, 2006 · national
Continuity (1)
Related Publication 20080110322A1 · May 15, 2008