SYSTEM AND METHOD FOR MANAGING VIDEO, IMAGE AND ACTIVITY DATA
A computer-implemented method for an object and activity query language wherein an object is a data type representing a thing or a being with a visual shape in an image or video frame and said activity is a data type representing an action or an event visually shown in an image or video or video frame, the method comprising the steps of storing a plurality of items in a raw data storage, said items comprising images and/or videos, processing said items in a processor and to generate and/or segment annotated information from said items and to extract object, activity and/or metadata information from said items in said first data storage, storing said annotated information in a secondary data storage, storing said extracted object, activity, and/or metadata information and said annotated information in a primary data storage, executing on a processor an identify function, wherein given a query item said identify function identifies said query item and/or finds a list of items similar to said first item; and a said query item comprises a video, a video frame, an image, a set of images, a template extracted from a video or image or images, an object, an activity, or annotated information, and displaying results of said identify function.
1 . A computer-implemented method for an object and activity query language wherein an object is a data type representing a thing or a being with a visual shape in an image or video frame and said activity is a data type representing an action or an event visually shown in an image or video or video frame, the method comprising the steps of:
storing a plurality of items in a raw data storage, said items comprising images and/or videos;
processing said items in a processor and to generate and/or segment annotated information from said items and to extract object, activity and/or metadata information from said items in said first data storage;
storing said annotated information in a secondary data storage;
storing said extracted object, activity, and/or metadata information and said annotated information in a primary data storage;
executing on a processor an identify function, wherein given a query item said identify function identifies said query item and/or finds a list of items similar to said first item; and a said query item comprises a video, a video frame, an image, a set of images, a template extracted from a video or image or images, an object, an activity, or annotated information; and
displaying results of said identify function.
2 . A computer-implemented method for an object and activity query language according to claim 1 , further comprising the steps of:
generating on said processor a complex object and/or activity from a plurality of existing objects or activities; and
storing said generated complex object and/or activity in said primary data storage.
3 . A computer-implemented method for an object and activity query language according to claim 2 , wherein said generated complex object and/or activity has a defined manor, said defined manor comprising an orientation or an order in which objects are located in physically or logically.
4 . A computer-implemented method for an object and activity query language according to claim 1 , further comprising the steps of:
providing a graphic user interface on a display, wherein graphic symbols are used to visually represent objects or activities.
5 . A computer-implemented method for an object and activity query language according to claim 4 , wherein said graphic query interface translates the graphic symbols entered by a user into query statements executed on said processor and displays a query result.
6 . A computer-implemented method for an object and activity query language according to claim 5 , wherein said graphic query interface combines multiple graphic symbols to form a query statement for a complex activity.
7 . A computer-implemented method for an object and activity query language according to claim 6 , wherein said graphic symbols comprise object graphic symbols representing a thing or a being with visual shape in an image or video frame.
8 . A computer-implemented method for an object and activity query language according to claim 5 , wherein said graphic user interface provides logic symbols permitting a user to form logical relationships between sub-statements.
9 . A computer-implemented method for an object and activity query language according to claim 7 , wherein said logic symbols comprise OR and AND.
10 . A computer-implemented method for an object and activity query language according to claim 1 , wherein said activity data type comprises one of an explosion, a movement of a person, or a movement of a vehicle.
11 . A computer-implemented method for an object and activity query language according to claim 1 , wherein said step of executing an identify function comprises combining a plurality of query score results.
12 . A computer-implemented method for an object and activity query language according to claim 11 , wherein said plurality of query score results come from a plurality of search engines.