Representative image display device and representative image selection method
A person cluster selection part selects one or more person clusters as representative person clusters in order of largest number of facial images included therein. A unit selection part selects, from each representative person cluster, (i) a unit having the highest likelihood as a first representative unit, and (ii) units in order of lowest likelihood as a second representative unit onward. A representative facial image selection part selects, from each representative unit, (i) a facial image having the highest likelihood as a first representative facial image, and (ii) facial images in order of lowest likelihood as a second representative facial image onward.
1. A representative image display device that selects representative images according to grouping results of a plurality of images and sub-clusters and displays the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display device comprising:
a cluster selection unit operable to select one or more of the clusters as representative clusters;
a sub-cluster selection unit operable to select, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection unit operable to select, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection unit (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub-clusters in order of a lowest first likelihood, and wherein
the sub-cluster selection unit uses, as the first likelihood of each sub-cluster, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative cluster and (ii) a central position or a center of mass of a feature space of the sub-cluster.
2. The representative image display device of claim 1 further comprising
a number determination unit operable to determine the number of representative images to be displayed on the display, according to a size of a display area of the display and an image size that can be visually recognized by a user.
3. A representative image display device that selects representative images according to grouping results of a plurality of images and sub-clusters and displays the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display device comprising:
a cluster selection unit operable to select one or more of the clusters as representative clusters;
a sub-cluster selection unit operable to select, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection unit operable to select, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection unit (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub-clusters in order of a lowest first likelihood, and
wherein when selecting the first representative sub-cluster, the sub-cluster selection unit uses, as the first likelihood of each sub-cluster, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative cluster and (ii) a central position or a center of mass of a feature space of the sub-cluster, and
when selecting the second to M th representative sub- clusters, the sub-cluster selection unit uses, as the first likelihood of each sub-cluster, information showing whether the grouping result of the sub-cluster has been corrected by a user.
4. The representative image display device of claim 1 , wherein
each image is a facial image of a human being.
5. A representative image display device that selects representative images according to grouping results of a plurality of images and sub-clusters and displays the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display device comprising:
a cluster selection unit operable to select one or more of the clusters as representative clusters;
a sub-cluster selection unit operable to select, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection unit operable to select, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection unit (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub-clusters in order of a lowest first likelihood,
the representative image selection unit (i) selects, from each representative sub-cluster, the image having the highest second likelihood in the representative sub-cluster as a first representative image, and (ii) when N is greater than or equal to 2, further selects, from each representative sub-cluster, (N−1) images as second to N th representative images in order of the lowest second likelihood, and
wherein when selecting the first representative image, the representative image selection unit uses, as the second likelihood of each image, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative sub-cluster and (ii) a position in a feature space of the image, and
when selecting the second to N th representative images, the representative image selection unit uses, as the second likelihood of each image, information showing whether the grouping result of the image has been corrected by a user.
6. The representative image display device of Claim 5 further comprising
a display layout control unit operable to display the first representative image by using a display method that is different from a display method used for the second to N th representative images.
7. A representative image display method for selecting representative images according to grouping results of a plurality of images and sub-clusters and displaying the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display method comprising:
a cluster selection step for selecting one or more of the clusters as representative clusters;
a sub-cluster selection step for selecting, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection step for selecting, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection unit (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub-clusters in order of a lowest first likelihood,
wherein the sub-cluster selection step uses, as the first likelihood of each sub-cluster, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative cluster and (ii) a central position or a center of mass of a feature space of the sub-cluster.
8. A representative image display method for selecting representative images according to grouping results of a plurality of images and sub-clusters and displaying the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display method comprising:
a cluster selection step for selecting one or more of the clusters as representative clusters;
a sub-cluster selection step for selecting, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection step for selecting, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection step (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub-clusters in order of a lowest first likelihood, and
wherein when selecting the first representative sub-cluster, the sub-cluster selection step uses, as the first likelihood of each sub-cluster, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative cluster and (ii) a central position or a center of mass of a feature space of the sub-cluster, and
when selecting the second to M th representative sub-clusters, the sub-cluster selection step uses, as the first likelihood of each sub-cluster, information showing whether the grouping result of the sub-cluster has been corrected by a user.
9. A representative image display method for selecting representative images according to grouping results of a plurality of images and sub-clusters and displaying the selected representative images on a display, the images being grouped into the sub-clusters such that each sub-cluster includes similar images, the sub-clusters being grouped into a plurality of clusters such that each cluster includes similar sub-clusters, the representative image display method comprising:
a cluster selection step of selecting one or more of the clusters as representative clusters;
a sub-cluster selection step of selecting, from each representative cluster, M sub-clusters as representative sub-clusters based on first likelihoods of the sub-clusters in the representative cluster, each first likelihood indicating accuracy of the grouping result of the corresponding sub-cluster (M is an integer satisfying a relationship 1≦M≦the number of the sub-clusters in the representative cluster); and
a representative image selection step of selecting, from each representative sub-cluster, N images as representative images based on second likelihoods of the images in the representative sub-cluster, each second likelihood indicating accuracy of the grouping result of the corresponding image (N is an integer satisfying a relationship 1≦N≦the number of the images in the representative sub-cluster),
wherein the sub-cluster selection step (i) selects, from each representative cluster, the sub-cluster having a highest first likelihood in the representative cluster as a first representative sub-cluster, and (ii) when M is greater than or equal to 2, further selects, from each representative cluster, (M−1) sub-clusters as second to M th representative sub- clusters in order of a lowest first likelihood,
the representative image selection step (i) selects, from each representative sub-cluster, the image having the highest second likelihood in the representative sub-cluster as a first representative image, and (ii) when N is greater than or equal to 2, further selects, from each representative sub-cluster, (N−1) images as second to N th representative images in order of the lowest second likelihood, and
wherein when selecting the first representative image, the representative image selection step uses, as the second likelihood of each image, a distance between (i) a central position or a center of mass of a feature space of the corresponding representative sub-cluster and (ii) a position in a feature space of the image, and
when selecting the second to N th representative images, the representative image selection unit uses, as the second likelihood of each image, information showing whether the grouping result of the image has been corrected by a user.