Video search device, video search method, recording medium, and program
A video search device for video searches in which a user specifies the position and orientation of an object that should appear in a video. A receiver receives input of a still image, two reference positions in the still image and two target positions in a video frame. An extractor extracts a reference image containing the two reference positions from the still image. A searcher searches for similar frame images in which local images similar to the reference image are depicted, from frame images in the video, traces movement tracks of two noteworthy pixels at start positions corresponding to the two reference positions in a local image when time advances or regresses from a similar frame image in the video, searches for a target frame image where the two movement tracks approach two target positions, and produces videos containing the similar frame image and the target frame image.
1. A video search device, comprising:
a receiver for receiving input of a still image in which a reference object is depicted, a first reference position and a second reference position contained in a reference region in which the reference object in the still image is depicted, and a first target position and a second target position within a frame image contained in a video;
an extractor for extracting a reference image depicted in the reference region based on the first reference position and the second reference position; and
a searcher for searching for, similar frame images that are frame images contained in the videos and in which local images similar to the reference image are depicted, finding a first start position and a second start position corresponding to the first reference position and the second reference position in the reference region, in a local region in which the local image is depicted in the searched similar frame image, tracing a first movement track along which a first noteworthy pixel depicted at the first start position moves in the searched similar frame image and a second movement track along which a second noteworthy pixel depicted at the second start position moves, by scanning frame images contained in the video including the searched similar frame image in the chronological progress or retrogression direction from the searched similar frame image, searching a target frame image at which the first movement track reaches the neighborhood of the first target position and the second movement track reaches the neighborhood of the second target position, and producing as a search result a video including the searched similar frame image and the searched target frame image.
2. The video search device according to claim 1 , wherein:
the receiver further receives input of a target track in a frame image including the video; and
the searcher, for each of the searched videos, traces a representative track along which a representative pixel of a local image depicted in the searched target frame image moves, by scanning frame images contained in the searched video in the chronological direction from a target frame image included in the video, and produces as the search result a video in which the target track and the representative track are similar.
3. The video search device according to claim 1 , wherein the searcher, for each of the searched videos, traces a representative track along which a representative pixel of a local image depicted in the searched target frame image moves, by scanning frame images contained in the searched video in the chronological direction from a target frame image included in the video, and produces as the search result the representative track of those videos along with those videos.
4. The video search device according to claim 1 , wherein:
the extractor obtains image characteristic amounts for the reference image; and
the searcher searches for the similar frame images by searching for frame images having image characteristic amounts similar to the image characteristic amounts of the reference image.
5. The video search device according to claim 4 , wherein:
the extractor further obtains image characteristic amounts of a mirror image that is a reversal of the reference image; and
the searcher searches for the similar frame images by searching for frame images similar to the image characteristic amounts of the reference image or the image characteristic amounts of the mirror image.
6. A video search method executed in the video search device including a receiver, an extractor and a searcher comprising the steps of:
receiving input of a still image in which a reference object is depicted, a first reference position and a second reference position contained in a reference region in which the reference object in the still image is depicted, and a first target position and a second target position within a frame image contained in a video;
extracting a reference image depicted in the reference region based on the first reference position and the second reference position; and
searching for, similar frame images that are frame images contained in the videos and in which local images similar to the reference image are depicted, finding a first start position and a second start position corresponding to the first reference position and the second reference position in the reference region, in a local region in which the local image is depicted in the searched similar frame image, tracing a first movement track along which a first noteworthy pixel depicted at the first start position moves in the searched similar frame image and a second movement track along which a second noteworthy pixel depicted at the second start position moves, by scanning frame images contained in the video including the searched similar frame image in the chronological progress or retrogression direction from the searched similar frame image, searching a target frame image at which the first movement track reaches the neighborhood of the first target position and the second movement track reaches the neighborhood of the second target position, and producing as a search result a video including the searched similar frame image and the searched target frame image.
7. A video search device, comprising:
a receiver for receiving input of a still image in which a reference object is depicted, a first reference position and a second reference position contained in a reference region in which the reference object in the still image is depicted, and a first target position and a second target position within a frame image contained in a video;
an extractor for extracting a reference image depicted in the reference region based on the first reference position and the second reference position; and
a searcher for searching for similar frame images that are frame images contained in videos and in which local images similar to the reference image are depicted, finding a first start position and a second start position corresponding to the first reference position and the second reference position in the reference region, in a local region in which the local image is depicted in the searched similar frame image, tracing a first movement track along which a first noteworthy pixel depicted at the first start position moves in the searched similar frame image and a second movement track along which a second noteworthy pixel depicted at the second start position moves, by scanning frame images contained in the video including the searched similar frame image in the chronological progress or retrogression direction from the searched similar frame image, and searching a target frame image at which the first movement track reaches the neighborhood of the first target position and the second movement track reaches the neighborhood of the second target position.
8. A video search method comprising the steps of:
receiving input of a still image in which a reference object is depicted, a first reference position and a second reference position contained in a reference region in which the reference object in the still image is depicted, and a first target position and a second target position within a frame image contained in a video;
extracting a reference image depicted in the reference region based on the first reference position and the second reference position; and
searching for similar frame images that are frame images contained in videos and in which local images similar to the reference image are depicted, finding a first start position and a second start position corresponding to the first reference position and the second reference position in the reference region, in a local region in which the local image is depicted in the searched similar frame image, tracing a first movement track along which a first noteworthy pixel depicted at the first start position moves in the searched similar frame image and a second movement track along which a second noteworthy pixel depicted at the second start position moves, by scanning frame images contained in the video including the searched similar frame image in the chronological progress or retrogression direction from the searched similar frame image, and searching a target frame image at which the first movement track reaches the neighborhood of the first target position and the second movement track reaches the neighborhood of the second target position.