GENERATING SPATIAL MULTIMEDIA INDICES FOR MULTIMEDIA CORPUSES
A method, system and media for generating and querying spatial multimedia indices are provided. A multimedia corpus representing varying view points and distributed across a large network, such as the Internet, is crawled to extract properties from the multimedia. The extracted properties and relationships among multimedia are stored and indexed in clusters associated with a space-scale hierarchy. Accordingly, a spatial multimedia service may utilize the space-scale hierarchy to update the spatial multimedia indices and to respond to user queries.
1 . A computer-implemented method to generate a spatial multimedia index, the method comprising:
extracting properties from a collection of multimedia having different view points;
associating each multimedia with the extracted properties; and
clustering multimedia based on the extracted properties.
2 . The method of claim 1 , wherein the collection of multimedia is generated by receiving at least one multimedia of the collection of multimedia from one or more multimedia capture devices.
3 . The method of claim 1 , wherein the collection of multimedia is generated by crawling a network.
4 . The method of claim 3 , wherein multimedia in the collection of multimedia are stored at different locations on the network.
5 . The method of claim 4 , wherein the network is the Internet.
6 . The method of claim 1 , wherein the multimedia are stored at a central location.
7 . The method of claim 1 , further comprising storing the clustered multimedia in a hierarchy having a plurality of levels.
8 . The method of claim 7 , wherein the multimedia are stored at varying levels of the hierarchy based on geographic location.
9 . The method of claim 7 , wherein the multimedia is stored at varying levels of the hierarchy based on physical scale.
10 . The method of claim 9 , wherein the physical scale is one of: universe, planet, continent, country, state, city, street, shop, department, aisle, or goods.
11 . The method of claim 1 , wherein semantic information is associated with at least one of a multimedia cluster and a particular multimedia included in a multimedia cluster.
12 - 20 . (canceled)
21 . One or more computer-readable media having stored thereon a data structure, comprising:
one or more fields for spatial multimedia indices that store spatial relationships and semantic relationships between multimedia having different view points; and
one or more spatial relationship fields for indicating whether at least two multimedia share one or more extracted properties and for providing a reference to the multimedia and one or more extracted properties, the extracted properties including two-dimensional information and three-dimensional information estimated from the two-dimensional information, wherein the estimated three-dimensional information is utilized to render and transition between the multimedia.
22 . The media of claim 21 , wherein the one or more fields for spatial multimedia includes an island index for clustering multimedia sharing extracted or estimated properties.
23 . The media of claim 21 , wherein the one or more fields for spatial multimedia includes a viewpoint index that stores virtual camera information that is utilized to render the multimedia.
24 . The media of claim 21 , wherein the one or more fields for spatial multimedia includes a projection index that describes planar or non-planar screens associated with each multimedia in the cluster index.
25 . The media of claim 21 , wherein the one or more fields includes a projection index that describes variable screens utilized to transition between multimedia having shared properties.
26 . The media of claim 21 , wherein the properties include one or more of geographic location and physical scale.
27 . A method to query spatial multimedia indices, the method comprising:
receiving a request having multimedia or extracted properties from the multimedia;
generating one or more hints from the multimedia or extracted properties;
refining the request with the hints; and
submitting the request and hints to a query engine that interfaces with the spatial multimedia indices.
28 . The method of claim 27 , wherein the hints are spatial hints that specify at least one of a physical scale associated with the multimedia or extracted properties or a geographic region associated with the multimedia or extracted properties.
29 . The method of claim 18 , wherein the hints include travel information received from an electronic calendar associated with the multimedia capture device that captured the multimedia.