METHOD AND SYSTEM FOR AUTOMATIC POSE AND TRAJECTORY TRACKING IN VIDEO
A system and method, the method including stabilizing a video sequence captured by an image capturing system, extracting a subject of interest in the stabilized video sequence to isolate the subject from other objects in the video sequence, determining a trajectory associated with the subject, tracking the trajectory of the subject over a period of time; extracting data associated with the trajectory of the subject based on the tracking; and presenting the extracted data in a user-understandable format.
1 . A method comprising:
stabilizing a video sequence captured by an image capturing system;
extracting a subject of interest in the stabilized video sequence to isolate the subject from other objects in the video sequence;
determining a trajectory associated with the subject;
tracking the trajectory of the subject over a period of time;
extracting data associated with the trajectory of the subject based on the tracking; and
presenting the extracted data in a user-understandable format.
2 . The method of claim 1 , wherein the trajectory provides one of a two-dimensional (2-D) location of the subject and a three-dimensional (3-D) location of the subject.
3 . The method of claim 1 , wherein the extracting of the subject of interest in the stabilized video sequence is manually initialized by a user.
4 . The method of claim 1 , wherein the extracting of the subject of interest in the stabilized video sequence is automatically initialized by a machine.
5 . The method of claim 1 , further comprising determining a pose associated with the subject.
6 . The method of claim 5 , further comprising:
tracking the pose of the subject over a period of time; and
extracting data associated with the pose of the subject based on the tracking.
7 . The method of claim 1 , wherein the image capturing includes a plurality of image capture devices.
8 . The method of claim 1 , wherein the user-understandable format comprises at least one of an image, a video, graphics, a textual presentation, and an audio presentation.
9 . The method of claim 1 , wherein the presenting of the extracted data in a user-understandable format is provided in at least one of the following: in combination with a broadcast of the video sequence and in combination with a re-visualization of the video sequence.
10 . The method of claim 9 wherein the re-visualization includes generating a model representation of at least the subject.
11 . The method of claim 1 , wherein the image capturing system captures the video sequence including the subject without a marker being located on the subject to aid the image capturing and the subject detecting.
12 . A system, comprising:
image capturing system; and
a computing system connected to the image capturing system, the computing system adapted to:
stabilize a video sequence captured by an image capturing system;
extract a subject of interest in the stabilized video sequence to isolate the subject from other objects in the video sequence;
determine a trajectory associated with the subject;
track the trajectory of the subject over a period of time;
extract data associated with the trajectory of the subject based on the tracking; and
present the extracted data in a user-understandable format.
13 . The system of claim 12 , wherein the trajectory provides one of a two-dimensional (2-D) location of the subject and a three-dimensional (3-D) location of the subject.
14 . The system of claim 12 , wherein the extracting of the subject of interest in the stabilized video sequence is manually initialized by a user.
15 . The system of claim 12 , wherein the extracting of the subject of interest in the stabilized video sequence is automatically initialized by a machine.
16 . The system of claim 12 , wherein the processor is further adapted to determine a pose associated with the subject.
17 . The system of claim 16 , wherein the processor is further adapted to:
track the pose of the subject over a period of time; and
extract data associated with the pose of the subject based on the tracking.
18 . The system of claim 12 , wherein the image capturing includes a plurality of image capture devices.
19 . The system of claim 12 , wherein the user-understandable format comprises at least one of an image, a video, graphics, a textual presentation, and an audio presentation.
20 . The system of claim 12 , wherein the processor is further adapted to present the extracted data in the user-understandable format in at least on of the following: in combination with a broadcast of the video sequence and in combination with a re-visualization of the video sequence.
21 . The system of claim 12 , wherein the image capturing system captures the video sequence including the subject without a marker being located on the subject to aid the image capturing and the subject detecting.