Image sorting device, method, program, and integrated circuit and storage medium storing said program
Image group feature information indicating features of an image group composed of a plurality of images is calculated for each image group and, based on the calculated image group feature information and information indicating features of events into which image groups are to be classified, images are classified by image group.
1. An image classification device comprising:
a face clustering unit configured to, for each of a plurality of images, extract features of each face included in the image and to classify each face into a face group containing one or more faces determined to be of a same person;
an image group feature calculation unit configured to calculate image group feature information, indicating features of an image group composed of a plurality of images, based on the face group into which the face clustering unit classifies at least one face among any faces included in images of the image group;
an image group classification unit configured to classify an image group into at least one of a plurality of different classifications based on the image group feature information for the image group; and
a person group sorting unit configured to sort each face group into one of one or more person groups indicating a predetermined human relationship, wherein
the image group feature information includes person group information indicating the one person group into which each face group is sorted, and
the image group classification unit classifies the image group based on the person group information included in the image group feature information.
2. The image classification device of claim 1 , wherein the person group sorting unit sorts each face group based on a count of image groups that include any face classified into the face group by the face clustering unit.
3. The image classification device of claim 2 , wherein the person group sorting unit sorts a face group into a first person group when faces classified by the face clustering unit as belonging to the face group occur in two or more image groups, sorts a face group into a second person group when faces classified by the face clustering unit as belonging to the face group occur in only one image group and occur a plurality of times, and sorts a face group into a third person group when the face group is not sorted into the first person group or into the second person group.
4. The image classification device of claim 3 , wherein the first person group indicates a family member, the second person group indicates a friend, and the third person group indicates a stranger.
5. The image classification device of claim 1 , wherein the image group feature calculation unit calculates the image group feature information for the image group based on the face group by including, in the person group information, face area information on an area of each face, among faces in the face group, that is included in the image group.
6. The image classification device of claim 1 , wherein the image group feature calculation unit calculates the image group feature information for the image group based on the face group by including, in the person group information, face count information on a count of faces included in the image group.
7. The image classification device of claim 1 , wherein the image group classification unit classifies the image group based on the face group and based on a standard defined for each of the plurality of different classifications.
8. The image classification device of claim 7 , further comprising: a standard generation unit configured to generate the standard based on a plurality of pieces of the image group feature information.
9. An image classification method of using an image classification device, the image classification method comprising:
extracting, for each of a plurality of images, features of each face included in the image and classifying each face into a face group containing one or more faces determined to be of a same person, said extracting being performed using a face clustering unit of the image classification device;
calculating image group feature information, indicating features of an image group composed of a plurality of images, based on the face group into which at least one face among any faces included in images of the image group is classified in said extracting, said calculating being performed using an image group feature calculation unit of the image classification device;
classifying an image group into at least one of a plurality of different classifications based on the image group feature information for the image group, said classifying being performed using an image group classification unit of the image group classification device; and
sorting each face group into one of one or more person groups indicating a predetermined human relationship, said sorting being performed using a person group sorting unit of the image classification device, wherein
the image group feature information includes person group information indicating the one person group into which each face group is sorted, and
said classifying of the image group classifies the image group based on the person group information included in the image group feature information.
10. A non-transitory computer-readable recording medium having an image classification program recorded thereon, the image classification program causing a computer to function as an image classification device for classifying images by executing a method, comprising:
extracting, for each of a plurality of images, features of each face included in the image and classifying each face into a face group containing one or more faces determined to be of a same person;
calculating image group feature information, indicating features of an image group composed of a plurality of images, based on the face group into which at least one face among any faces included in images of the image group is classified in said extracting;
classifying an image group into at least one of a plurality of different classifications based on the image group feature information for the image group; and
sorting each face group into one of one or more person groups indicating a predetermined human relationship, wherein
the image group feature information includes person group information indicating the one person group into which each face group is sorted, and
said classifying of the image group classifies the image group based on the person group information included in the image group feature information.
11. An integrated circuit comprising:
a face clustering unit configured to, for each of a plurality of images, extract features of each face included in the image and to classify each face into a face group containing one or more faces determined to be of a same person;
an image group feature calculation unit configured to calculate image group feature information, indicating features of an image group composed of a plurality of images, based on the face group into which the face clustering unit classifies at least one face among any faces included in images of the image group;
an image group classification unit configured to classify an image group into at least one of a plurality of different classifications based on the image group feature information for the image group; and
a person group sorting unit configured to sort each face group into one of one or more person groups indicating a predetermined human relationship, wherein
the image group feature information includes person group information indicating the one person group into which each face group is sorted, and
the image group classification unit classifies the image group based on the person group information included in the image group feature information.