IP Library Granted Patent US 8,891,909
Granted Patent B2
US 8,891,909 · App. 12/557,858 · Granted Nov 18, 2014

Information processing apparatus capable of modifying images based on audio data, program and information processing method

Inventors: Daisuke Mochizuki (Chiba, JP); Kazuto Nishizawa (Kanagawa, JP); Mitsuo Okumura (Tokyo, JP); Takaomi Kimura (Tokyo, JP); Tomohiko Gotoh (Kanagawa, JP)
Assignee: Sony Corporation
G06T5/00G06T13/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,891,909
App. No.
12/557,858
Granted
Nov 18, 2014
Kind
B2
Abstract

An information processing apparatus is provided that includes a playback unit to play back music data, an analysis unit to analyze a feature of a relevant image of the music data, an image correction unit to perform image correction with use of any of a plurality of correction types, a storage unit to store one or more than one image, a selection unit to select a correction type corresponding to the feature of the relevant image analyzed by the analysis unit from the plurality of correction types, a correction control unit to cause the image correction unit to perform image correction of an image stored in the storage unit with use of the correction type selected by the selection unit, and an output unit to output the image corrected by the image correction unit.

Claims (41)

1. An information processing apparatus embodied in a computer having a microprocessor, the apparatus comprising:

an analysis unit to analyze a feature of a reference image relevant to audio data;

an image selection unit to select one or more images based on a mood of the audio data;

a layout control unit to separate the audio data into a plurality of time frames, wherein the image selection unit selects a number of images based on a number of the time frames;

a selection unit to select an image modification type based on the feature of the reference image from a plurality of image modification types;

an image correction unit to modify the selected one or more images with use of the selected image modification type;

a control unit, performed by the computer, to cause the image correction unit to modify the selected one or more images with use of the modification type selected by the selection unit; and

an output unit to output the modified one or more images with the audio data.

2. The information processing apparatus according to claim 1 , further comprising:

a creation unit to create a display screen including the modified one or more images.

3. The information processing apparatus according to claim 1 , wherein

the selected image modification type includes a change to a visual effect performed on the one or more images; and

the control unit causes the image correction unit to change the visual effect over a lapse of time.

4. The information processing apparatus according to claim 1 , wherein

the image selection unit selects the one or more images further based on one of a release date, title, genre of the audio data.

5. The information processing apparatus according to claim 1 , wherein

the layout control unit separates the audio data into a plurality of time frames based on the mood of the audio data.

6. The information processing apparatus according to claim 2 , wherein

the analysis unit further analyzes a font of a character contained in the reference image, and

the display screen further includes additional information represented by a font identical or similar to the font analyzed by the analysis unit.

7. The information processing apparatus according to claim 2 , wherein

the display screen further includes additional information of the reference image represented by a font corresponding to a feature of the audio data.

8. A non-transitory memory storing a program for causing a computer to:

analyze a feature of a reference image relevant to audio data;

select one or more images based on a mood of the audio data;

separate the audio data into a plurality of time frames;

determine a number of selected images based on a number of the time frames:

select an image modification type based on the feature of the reference image from a plurality of image modification types;

modify the selected one or more images with use of the selected image modification type; and

output the modified one or more images with the audio data.

9. An information processing method comprising the steps of:

analyzing a feature of a reference image relevant to audio data;

selecting one or more images based on a mood of the audio data;

separating the audio data into a plurality of time frames;

determining a number of selected images based on a number of the time frames:

selecting an image modification type based on the feature of the reference image from a plurality of modification types;

modifying the selected one or more images with use of the selected modification type; and

outputting the modified one or more images with the audio data.

10. The information processing apparatus according to claim 1 , further comprising:

a feature analyzing unit to identify a feature of the audio data.

11. The method according to claim 9 , wherein the audio data is separated based on the mood of the audio data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2009
From: MOCHIZUKI, DAISUKE; NISHIZAWA, KAZUTO; OKUMURA, MITSUO; KIMURA, TAKAOMI; GOTOH, TOMOHIKO
To: SONY CORPORATION
Reel/Frame 023218/0835 →
Continuity (1)
Related Publication 20100092107A1 · Apr 15, 2010