Method and apparatus for representing and searching for an object in an image
A method representing an object appearing in still or video image for use in searching, wherein the object appears in the image with a first two-dimensional outline, by processing signals corresponding to the image, comprises deriving a view descriptor of the first outline of the object and deriving at least one additional view descriptor of the outline of the object in a different view, and associating the two or more view descriptors to form an object descriptor.
1. A method of representing an object appearing in an image using one or more processors, the method comprising:
deriving, using a processor, a plurality of view descriptors of the object, each view descriptor corresponding to a different view of the object;
associating, using a processor, the view descriptors to form an object descriptor, wherein at least one view descriptor comprises a representation of the colour or texture of the object in the respective view; and
identifying the object in the image, and identifying a first view of said object;
determining the colour or texture of said object in said first view and therefrom deriving a colour first view descriptor or a texture first view descriptor;
identifying another image of the object, showing the object in a second view, different from the first view;
determining the colour or texture of said object in said second view, and therefrom deriving a colour second view descriptor or a texture second view descriptor; and
associating at least said colour first view descriptor and said colour second view descriptor, or at least said texture first view descriptor and said texture second view descriptor, to form a colour multiview object descriptor or a texture multiview object descriptor.
2. An apparatus comprising:
an image database storing still images or groups of images;
a descriptor database storing descriptors for objects appearing in the images stored in the image database; and
a processor configured to perform the method as claimed in claim 1 .
3. A computer-readable storage medium storing computer-executable process steps, for implementing a method as claimed in claim 1 .
4. A computer system comprising:
an image database storing still image or groups of images;
a descriptor database storing descriptors for objects appearing in the images stored in the image database; and
a control unit programmed to perform the method as claimed in claim 1 .
5. A method as claimed in claim 1 , further comprising:
associating a descriptor of the shape or 2-dimensional outline of the object, together with the colour multiview object descriptor or texture multiview object descriptor.
6. A method of representing an object appearing in a group of images using one or more processors, the method comprising:
deriving, using a processor, a plurality of view descriptors of the object, each view descriptor corresponding to a different view of the object;
associating, using a processor, the view descriptors to form an object descriptor, wherein at least one view descriptor comprises a representation of the colour or texture of the object in the respective view; and
identifying the object in the image, and identifying a first view of said object;
determining the colour or texture of said object in said first view and therefrom deriving a colour first view descriptor or a texture first view descriptor;
identifying another image of the object, showing the object in a second view, different from the first view;
determining the colour or texture of said object in said second view, and therefrom deriving a colour second view descriptor or a texture second view descriptor; and
associating at least said colour first view descriptor and said colour second view descriptor, or at least said texture first view descriptor and said texture second view descriptor, to form a colour multiview object descriptor or a texture multiview object descriptor.
7. A method as claimed in claim 6 wherein the group of images is a sequence of images.
8. A method as claimed in claim 7 wherein the sequence of images is from a video or film.
9. A method as claimed in claim 6 , further comprising:
associating a descriptor of the shape or 2-dimensional outline of the object, together with the colour multiview object descriptor or texture multiview object descriptor.
10. A method of indexing images or groups of images stored in a database using one or more processors, the method comprising:
identifying an object appearing in an image or group of images;
deriving, using a processor, representations of a plurality of different views of the object;
associating, using a processor, the view descriptors to form an object descriptor, wherein at least one view descriptor comprises a representation of the colour or texture of the object in the respective view; and
identifying the object in a first image in the group of images, and identifying a first view of said object;
determining the colour or texture of said object in said first view and therefrom deriving a colour first view descriptor or a texture first view descriptor;
identifying another image of the object, showing the object in a second view, different from the first view, which may or may not be a second view in a second image in the group of images;
determining the colour or texture of said object in said second view, and therefrom deriving a colour second view descriptor or a texture second view descriptor; and
associating at least said colour first view descriptor and said colour second view descriptor, or at least said texture first view descriptor and said texture second view descriptor, to form a colour multiview object descriptor or a texture multiview object descriptor.
11. A method as claimed in claim 10 , further comprising:
associating a descriptor of the shape or 2-dimensional outline of the object, together with the colour multiview object descriptor or texture multiview object descriptor.