IP Library › Granted Patent US 10,847,185
Granted Patent B2
US 10,847,185 · App. 16/410,079 · Granted Nov 24, 2020

Information processing method and image processing apparatus

Inventors: Hiroshi Ikeda (Tokyo, JP); Atsushi Kimura (Tokyo, JP); Kazuhiro Shimauchi (Tokyo, JP); Nobuho Ikeda (Kanagawa, JP)
Assignee: SONY CORPORATION
G11B27/034G06K9/00751G10H1/368G10H1/40G11B27/031G11B27/28H04N5/91G10H2210/021G10H2210/061G10H2210/071G10H2210/076G10H2220/355G10H2220/391G10H2220/395G10H2220/455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,847,185
App. No.
16/410,079
Granted
Nov 24, 2020
Kind
B2
Abstract

There is provided an information processing method including analyzing a beat of input music, extracting a plurality of unit images from an input image, and generating, by a processor, editing information for switching the extracted unit images depending on the analyzed beat.

Claims (56)

1. An information processing method, comprising:

analyzing, by circuitry, a first beat in a unit of a measure of input music;

analyzing, by the circuitry, an input image comprising a plurality of unit images;

detecting, by the circuitry, highlights in the input image based on the analysis of the input image, wherein the highlights correspond to a set of the plurality of unit images;

detecting, by the circuitry, scene segments in the input image based on at least one of information associated with a position of capture of each of the plurality of unit images or color information associated with the plurality of unit images;

associating, by the circuitry, the detected highlights in the input image with the detected scene segments;

extracting, by the circuitry, the plurality of unit images from the input image based on the association of the detected highlights with the detected scene segments

generating, by the circuitry, editing information based on the extracted plurality of unit images and the first beat analyzed in the unit of the measure of the input music;

switching, by the circuitry, a first unit image of the plurality of unit images with a second unit image of the plurality of unit images, based on the generated editing information, wherein the first unit image and the second unit image are similar;

generating, by the circuitry, a summary image based on the switching of the first unit image with the second unit image; and

playing, by the circuitry, the generated summary image.

2. The information processing method according to claim 1 , further comprising:

analyzing the measure of the input music; and

selecting whether to perform the switch in the unit of the analyzed measure of the input music.

3. The information processing method according to claim 1 , wherein each of the first unit image and the second unit image includes a specific subject.

4. The information processing method according to claim 1 , wherein at least one of the first unit image or the second unit image is adopted at least twice in the measure of the input music.

5. The information processing method according to claim 1 , further comprising switching, by the circuitry, the plurality of unit images in a plurality of measures, wherein

a first measure of the plurality of measures is separated from a second measure of the plurality of measures.

6. The information processing method according to claim 5 , further comprising:

analyzing, by the circuitry, a structure of the input music; and

setting, by the circuitry, a number that indicates the switching of the plurality of unit images for each type of the analyzed structure of the input music.

7. The information processing method according to claim 1 , further comprising:

specifying, by the circuitry, a part of the input music satisfying a specific condition in the input music; and

switching, by the circuitry, the first unit image with the second unit image based on a second beat in the specified part of the input music.

8. The information processing method according to claim 7 , wherein

specifying the part of the input music is based on a music theory, and the specified part corresponds to a chorus part of the input music.

9. The information processing method according to claim 1 , further comprising:

generating, by the circuitry, the editing information for each beat of a plurality of beats of the input music.

10. The information processing method according to claim 1 , further comprising:

generating, by the circuitry, the editing information for a plurality of beats of the input music based on a rate of the plurality of beats of the input music that exceeds a threshold value.

11. An image processing apparatus, comprising:

circuitry configured to:

analyze a beat in a unit of a measure of input music;

analyze an input image comprising a plurality of unit images;

detect highlights in the input image based on the analysis of the input image, wherein the highlights correspond to a set of the plurality of unit images;

detect scene segments in the input image based on at least one of information associated with a position of capture of each of the plurality of unit images or color information associated with the plurality of unit images;

associate the detected highlights in the input image with the detected scene segments;

extract the plurality of unit images from the input image based on the association of the detected highlights with the detected scene segments analysis

generate editing information, based on the extracted plurality of unit images and the beat analyzed in the unit of the measure of the input music;

switch a first unit image of the plurality of unit images with a second unit image of the plurality of unit images, based on the generated editing information, wherein the first unit image and the second unit image are similar;

generate a summary image based on the switching of the first unit image with the second unit image; and

play the generated summary image.

12. The image processing apparatus according to claim 11 , wherein the circuitry is further configured to:

analyze the measure of the input music; and

select whether to perform the switch in the unit of the analyzed measure of the input music.

13. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

analyzing a beat in a unit of a measure of input music;

analyzing an input image comprising a plurality of unit images;

detecting highlights in the input image based on the analysis of the input image, wherein the highlights correspond to a set of the plurality of unit images;

detecting scene segments in the input image based on at least one of information associated with a position of capture of each of the plurality of unit images or color information associated with the plurality of unit images;

associating the detected highlights in the input image with the detected scene segments;

extracting the plurality of unit images from the input image based on the association of the detected highlights with the detected scene segments

generating editing information, based on the extracted plurality of unit images and the beat analyzed in the unit of the measure of the input music;

switching a first unit image of the plurality of unit images with a second unit image of the plurality of unit images, based on the generated editing information, wherein the first unit image and the second unit image are similar;

generating a summary image based on the switching of the first unit image with the second unit image; and

playing the generated summary image.

Priority Claims (1)
JP 2014-253214 · Dec 15, 2014 · national
Continuity (2)
Continuation 15531732
Related Publication 20190267040A1 · Aug 29, 2019