Video signature
View Patent ↗A system for creating a video signature, including a video retrieval module to retrieve a video sequence having a plurality of frames, each of the frames including an image, a region definition module to define a plurality of image regions for the image of each of the frames, such that the image regions occupy the same portions of the image for each of the frames, a motion analysis module to calculate a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion, and a signature creation module to create the video signature including data indicative of the direction of motion and the magnitude of motion for each of the image regions of each of the frames. Related apparatus and methods are also described.
1. A system for creating a video signature, comprising:
a video retrieval module to retrieve a video sequence having a plurality of frames, each of the frames including an image;
a region definition module to define a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
a motion analysis module to:
calculate a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion; and
determine a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined by angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors; and
a signature creation module to create the video signature including: data indicative of the direction of motion and the magnitude of motion for each of the image regions of each of the frames; and the set of angles for each of the frames.
2. the system according to claim 1 , wherein:
the image of each of the frames includes at least four of the image regions; and
the signature creation module is operative to create the video signature including data indicative of the direction of motion and the magnitude of motion for each of the four image regions of each of the frames.
3. the system according to claim 1 , wherein:
each of the image regions includes a plurality of sub-regions; and
the motion analysis module is operative to calculate the one motion vector for each of the image regions of each of the frames by averaging a multiplicity of other motion vectors calculated for the sub-regions.
4. the system according to claim 1 , wherein the angles in the set of angles are ordered consistently with respect to the motion vectors for each of the frames.
5. the system according to claim 1 , further comprising an image identification module to: identify the image within one of the frames; and determine a measurement of a size of the image, wherein the signature creation module is operative to create the video signature including the measurement of the size of the image.
6. the system according to claim 5 , wherein:
the image identification module is operative to determine a measurement of an orientation of the image; and
the signature creation module is operative to create the video signature including a measurement of the orientation of the image.
7. the system according to claim 1 , further comprising a discrete cosine transform module to: perform at least one discrete cosine transform for each of the image regions of each of the frames yielding at least one DC coefficient for each of the image regions of each of the frames; and determine a value based on the at least one DC coefficient, wherein the signature creation module is operative to create the video signature including the value for each of the image regions of each of the frames.
8. A system for comparing a video sequence with at least one video signature, the system comprising:
a storage arrangement to store the at least one video signature;
a video retrieval module to retrieve the video sequence having a plurality of frames, each of the frames including an image;
a region definition module to define a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
a motion analysis module to:
calculate a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion; and
determine a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined by angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors; and
a signature comparison module to compare: the set of angles for each of the frames with the at least one video signature; and the magnitude of motion of the one motion vector for each of the image regions of each of the frames with the at least one video signature.
9. the system according to claim 8 , wherein the signature comparison module is operative to compare the direction of motion of the one motion vector for each of the image regions of each of the frames with the at least one video signature.
10. the system according to claim 8 , wherein the image of each of the frames includes at least four of the image regions.
11. the system according to claim 8 , wherein:
each of the image regions includes a plurality of sub-regions; and
the motion analysis module is operative to calculate the one motion vector for each of the image regions of each of the frames by averaging a multiplicity of other motion vectors calculated for the sub-regions.
12. the system according to claim 8 , wherein the angles in the set of angles are ordered consistently with respect to the motion vectors for each of the frames.
13. the system according to claim 8 , further comprising an image identification module to: identify the image within one of the frames; and determine a measurement of a size of the image, wherein the signature comparison module is operative to compare the one motion vector for each of the image regions of at least one of the frames with the at least one video signature based on the measurement of the size of the image.
14. the system according to claim 13 , wherein:
the image identification module is operative to determine a measurement of an orientation of the image; and
wherein the signature comparison module is operative to compare the one motion vector for each of the image regions of at least one of the frames with the at least one video signature based on the measurement of the orientation of the image.
15. the system according to claim 8 , further comprising a discrete cosine transform module to: perform at least one discrete cosine transform for each of the image regions of each of the frames yielding at least one DC coefficient for each of the image regions of each of the frames; and determine a value based on the at least one DC coefficient, wherein the signature comparison module is operative to compare the value for each of the image regions of each of the frames with the at least one video signature.
16. A method for creating a video signature, comprising:
retrieving a video sequence having a plurality of frames, each of the frames including an image;
defining a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
calculating a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion;
determining a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors; and
creating the video signature including: data indicative of the direction of motion and the magnitude of motion for each of the image regions of each of the frames; and the set of angles for each of the frames.
17. A method for comparing a video sequence with at least one video signature, the method comprising:
storing the at least one video signature;
retrieving the video sequence having a plurality of frames, each of the frames including an image;
defining a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
calculating a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion;
determining a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined by angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors;
comparing the set of angles for each of the frames with the at least one video signature; and
comparing the magnitude of motion of the one motion vector for each of the image regions of each of the frames with the at least one video signature.
18. A system for creating a video signature, comprising:
means for retrieving a video sequence having a plurality of frames, each of the frames including an image;
means for defining a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
means for calculating a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion;
means for determining a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined by angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors; and
means for creating the video signature including: data indicative of the direction of motion and the magnitude of motion for each of the image regions of each of the frames; and the set of angles for each of the frames.
19. A system for comparing a video sequence with at least one video signature, the system comprising:
means for storing the at least one video signature;
means for retrieving the video sequence having a plurality of frames, each of the frames including an image;
means for defining a plurality of image regions for the image of each of the frames, such that each of the plurality of image regions occupies the same portion of the image for each of the frames;
means for calculating a plurality of motion vectors, such that one of the motion vectors is calculated for each of the image regions of each of the frames by comparison to the image of another one of the frames, each of the motion vectors having a direction of motion and a magnitude of motion;
means for determining a plurality of angles including a set of the angles for each of the frames so that for each one of the frames, the set of the angles being defined by angles between the motion vectors for the one frame and a plurality of connecting vectors connecting the motion vectors of the one frame such that each of the angles is defined by one of the motion vectors and one of the connecting vectors; wherein each of the motion vectors has a head and tail, each of the connecting vectors being connected to a tail of one of the motion vectors and a head of another one of the motion vectors; and
means for comparing: the set of angles for each of the frames with the at least one video signature; and the magnitude of motion of the one motion vector for each of the image regions of each of the frames with the at least one video signature.