IP Library Granted Patent US 9,047,320
Granted Patent B2
US 9,047,320 · App. 13/513,418 · Granted Jun 2, 2015

Music recommendation system, information processing device, and information processing method

Inventors: Shoichi Ikenoue (Tokyo, JP); Takayuki Sakamoto (Tokyo, JP)
Assignees: SONY CORPORATION; SONY COMPUTER ENTERTAINMENT INC.
G06F17/30256G06F17/30749
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,047,320
App. No.
13/513,418
Granted
Jun 2, 2015
Kind
B2
Abstract

A photograph classification unit classifies the photographs for each scene in a music-feature information determination unit. A photograph feature acquisition unit identifies a feature of the photograph based on additional information of the photograph and a result of face recognition of the image. A tempo determination unit determines a tempo of music based on a time zone of image capturing, a range of the number of people captured in a photograph, the degree of smile, activities, etc. A melody determination unit determines information that confines a title, a feature value, a genre, etc., based on an event, a time zone, and a season at the time of image capturing, a city and a country in which the image capturing has occurred, etc. Based on the determined feature of the music, a music data output unit extracts and then presents matching music.

Claims (54)

1. An information processing device comprising:

a content feature acquisition unit configured to acquire, based on additional information of content to be processed, a feature of the content;

a music feature determination unit configured to determine, in reference to a table prepared in advance associating the feature of the content with a feature of music, the feature of the music based on the feature of the content; and

a music data output unit configured to detect music that has the feature of the said music from a database and to present the information thereof as recommended music that matches the content,

wherein the content feature acquisition unit acquires, as the feature of the content,

a recording location based on information regarding a geographic position of recording of the content, and

a category for an activity occurred at the time of recording of the content based on information regarding a change in an activity of a content recorder,

wherein the music feature determination unit determines the feature of the music based on the recording location and the category for the activity.

2. The information processing device according to claim 1 , further comprising:

a classification unit configured to classify a plurality of content items to be processed by putting together content items whose respective geographic recording positions are in a predetermined location range,

wherein the content feature acquisition unit acquires, for each classification, a centroid value or a center value of values representing the features of contents belonging to each classification, and

wherein the music feature determination unit determines a feature of music to be recommended for each classification in reference to the table based on the centroid value or the center value.

3. The information processing device according to claim 2 , wherein the classification unit groups content items with a recording time interval smaller than a predetermined threshold value and then puts together, in unit of the group, content items whose respective geographic recording positions are in a predetermined location range.

4. The information processing device according to claim 1 ,

wherein the content feature acquisition unit acquires, as the feature of the content, the season in which recording occurred based on a recording geographic position and a recording date and time, and

wherein the music feature determination unit determines the feature of the music based on the season.

5. The information processing device according to claim 1 ,

wherein the content feature acquisition unit acquires, as the feature of the content, an event held on a day on which recording occurred based on a geographic recording position and a recording date and time, and

wherein the music feature determination unit determines to include, as a feature of music, the name of the event in any one of the following: a title, lyrics, and bibliographic information.

6. The information processing device according to claim 1 , wherein the music feature determination unit determines the feature of the music from at least any one of the following: the name of a place, the type of recording facility, and the city, the region, and the country to which the recording location belongs.

7. The information processing device according to claim 1 ,

wherein the content feature acquisition unit further acquires, by performing a face recognition process on an image serving as content to be processed, at least any one of the following as the feature of the content: the number of people existing in the image, the facial expression of the people, and attribute information of the people, and

wherein the music feature determination unit determines the feature of the music from at least any one of the following: the acquired number of the people, the acquired facial expression of the people, and the acquired attribute information of the people.

8. The information processing device according to claim 1 ,

wherein the content feature acquisition unit further acquires, by performing an image analysis process on an image serving as content to be processed, at least any one of the following as the feature of the content: the brightness distribution, color distribution, and frequency characteristics of the image, and

wherein the music feature determination unit determines the feature of the music from at least any one of the following: the acquired brightness distribution, the acquired color distribution, and the acquired frequency characteristics.

9. The information processing device according to claim 1 ,

wherein the content feature acquisition unit identifies a transportation means for a person who records the content by obtaining the speed of travelling based on position history, in which the position of the person is recorded at a predetermined interval, acquired as additional information of the content, and

wherein the music feature determination unit determines the feature of the music based on the transportation means.

10. The information processing device according to claim 1 ,

wherein the content feature acquisition unit acquires, as the feature of the content, information regarding an actual climate value that corresponds to a geographic recording position and recording date and time of the content from a server connected via a network, and

wherein the music feature determination unit determines the feature of the music based on the actual climate value.

11. A music recommendation system for acquiring information pertaining to recommended music from a server via a network in an information processing device,

wherein the information processing device comprises:

a content feature acquisition unit configured to acquire, based on additional information of content to be processed, a feature of the content;

a music feature determination unit configured to determine, in reference to a table prepared in advance associating the feature of the content with a feature of music, the feature of the music based on the feature of the content; and

a music data output unit configured to transmit the feature of the music to the server so as to request recommendation of music that matches the content and to acquire information pertaining to recommended music from the server so as to present the acquired information,

wherein the server comprises:

a music data output unit configured to detect, from a database, music that has the feature of the music transmitted from the information processing device and to transmit the information thereof as recommended music to the information processing device,

wherein the content feature acquisition unit acquires, as the feature of the content, a recording location based on information regarding a geographic recording position of the content, and

wherein the music feature determination unit determines the feature of the music based on the recording location, and further

wherein the music feature determination unit determines the feature of the music from at least any one of the following: the name of a place, the type of recording facility, and the city, the region, and the country to which the recording location belongs.

12. An information processing method comprising:

reading out additional information of content to be processed and then acquiring a feature of the content based on additional information;

determining, in reference to a table prepared in advance associating the feature of the content with a feature of music, the feature of the music based on the feature of the content; and

detecting music that has the feature of said music from a database and then presenting the information thereof as recommended music that matches the content,

wherein, in the acquiring of the feature of the content, a recording location is acquired based on information regarding a geographic recording position as the feature of the content and a season in which recording occurred based on kite recording geographic position and a recording date and time, and

wherein, in the determining of the feature of the music, the feature of the music is determined based on the recording location and the season.

13. A non-transitory computer-readable recording medium having embodied thereon a computer program product comprising:

a module configured to read out additional information of content to be processed and then to acquire a feature of the content based on additional information;

a module configured to determine, in reference to a table prepared in advance associating the feature of the content with a feature of music, the feature of the music based on the feature of the content; and

a module configured to detect music that has the feature of said music from a database and then to present the information thereof as recommended music that matches the content,

wherein the module configured to acquire the feature of the content acquires a recording location based on information regarding a geographic recording position as the feature of the content and an event held on a day on which recording occurred based on the geographic recording position and a recording date and time, and

wherein the module configured to determine the feature of the music determines the feature of the music based on the recording location and any one of the following: a title, lyrics, and bibliographic information.

Assignments (4)
CHANGE OF NAME Recorded Sep 6, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2015
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 035142/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2012
From: IKENOUE, SHOICHI; SAKAMOTO, TAKAYUKI
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 028305/0174 →
Priority Claims (1)
JP 2009-275990 · Dec 4, 2009 · national
Continuity (1)
Related Publication 20120237090A1 · Sep 20, 2012