Methods and system for blasting video analysis
View Patent ↗Blasting video analysis techniques and systems are presented using vibration compensated background analysis with automated determination of blast origin coordinates and highest point coordinates using blast outline coordinates for post-origin frames. Blast expansion trajectories of the highest particle are estimated in frames preceding the highest point frame, and estimated blast parameters including maximum height and initial blast velocity are computed independent of blast data.
1. A method for analyzing blasting video data comprising a plurality of video frames, the method comprising:
modeling background data using a first set of video frames corresponding to images before a blasting event;
masking at least some of the plurality of video frames according to the modeled background data to generate foreground video data representing deviations from the modeled background data;
using at least one processor, determining an origin frame corresponding to a first occurrence of foreground video data in the plurality of the video frames;
identifying blast outline coordinates based on the foreground video data of a second set of video frames including the origin frame and plurality of subsequent video frames;
determining a highest point reached by a highest identified blast particle based on the blast outline coordinates in the second set of video frames;
determining a blast highest point frame corresponding to the determined highest point;
estimating a linear or parabolic blast expansion trajectory associated with the identified highest blast particle based on the blast outline coordinates of the second set of video frames;
determining an original location of the identified highest blast particle, and identifying an original frame at which the identified highest blast particle initially moved from the original location based on the blast expansion trajectory and the second set of video frames;
determining a travel time representing the time between the original frame and the blast highest point frame according to a frame rate of the blasting video data;
estimating a maximum height associated with the identified highest blast particle based on the determined travel time;
generating overlay indicia for replay of the blasting video data based on at least one of the determined highest point, the estimated linear or parabolic blast expansion trajectory associated with the identified highest blast particle, the determined original location of the identified highest blast particle, and the estimated maximum height associated with the identified highest blast particle; and
rendering the blasting video data on a graphical display together with the overlay indicia.
2. The method of claim 1 , comprising estimating an initial blast velocity based on the estimated maximum height associated with the identified highest blast particle.
3. The method of claim 2 , comprising modeling the background data with simulated camera vibration using the first set of video frames.
4. The method of claim 2 , comprising categorizing correctness of the estimated maximum height.
5. The method of claim 2 , comprising analyzing color of the second set of video frames to detect toxic smoke.
6. The method of claim 2 , comprising:
estimating an unseen final location where the identified highest blast particle is assumed to have stopped rising based on the estimated blast expansion trajectory associated with the identified highest blast particle;
determining an additional travel time from a last identified location of the identified highest blast particle to the estimated final location based on the estimated blast expansion trajectory;
determining the blast highest point frame corresponding to the estimated final location and the estimated blast expansion trajectory;
determining the travel time representing the time between the original frame and the estimated final location according to the frame rate; and
estimating the maximum height associated with the identified highest blast particle based on the determined travel time.
7. The method of claim 1 , comprising modeling the background data with simulated camera vibration using the first set of video frames.
8. The method of claim 1 , comprising categorizing correctness of the estimated maximum height.
9. The method of claim 1 , comprising analyzing color of the second set of video frames to detect toxic smoke.
10. The method of claim 1 , comprising:
estimating an unseen final location where the identified highest blast particle is assumed to have stopped rising based on the estimated blast expansion trajectory associated with the identified highest blast particle;
determining an additional travel time from a last identified location of the identified highest blast particle to the estimated final location based on the estimated blast expansion trajectory;
determining the blast highest point frame corresponding to the estimated final location and the estimated blast expansion trajectory;
determining the travel time representing the time between the original frame and the estimated final location according to the frame rate; and
estimating the maximum height associated with the identified highest blast particle based on the determined travel time.
11. A system for analyzing blasting video data, comprising:
a processor programmed to:
model background data using a first set of video frames corresponding to images before a blasting event;
mask at least some of the plurality of video frames according to the modeled background data to generate foreground video data representing deviations from the modeled background data;
determine an origin frame corresponding to a first occurrence of foreground video data in the plurality of the video frames;
identify blast outline coordinates based on the foreground video data of a second set of video frames including the origin frame and plurality of subsequent video frames;
determine a highest point reached by a highest identified blast particle based on the blast outline coordinates in the second set of video frames;
determine a blast highest point frame corresponding to the determined highest point;
estimate a linear or parabolic blast expansion trajectory associated with the identified highest blast particle based on the blast outline coordinates of the second set of video frames;
determine an original location of the identified highest blast particle, and identifying an original frame at which the identified highest blast particle initially moved from the original location based on the blast expansion trajectory and the second set of video frames;
determine a travel time representing the time between the original frame and the blast highest point frame according to a frame rate of the blasting video data;
estimate a maximum height associated with the identified highest blast particle based on the determined travel time;
generate overlay indicia for replay of the blasting video data based on at least one of a determined highest point, an estimated linear or parabolic blast expansion trajectory associated with the identified highest blast particle, a determined original location of the identified highest blast particle, and an estimated maximum height associated with the identified highest blast particle; and
render the blasting video data on a graphical display together with the overlay indicia.
12. A non-transitory computer readable medium with computer executable instructions for analyzing blasting video data, the computer readable medium comprising computer executable instructions for:
modeling background data using a first set of video frames corresponding to images before a blasting event;
masking at least some of the plurality of video frames according to the modeled background data to generate foreground video data representing deviations from the modeled background data;
using at least one processor, determining an origin frame corresponding to a first occurrence of foreground video data in the plurality of the video frames;
identifying blast outline coordinates based on the foreground video data of a second set of video frames including the origin frame and plurality of subsequent video frames;
determining a highest point reached by a highest identified blast particle based on the blast outline coordinates in the second set of video frames;
determining a blast highest point frame corresponding to the determined highest point;
estimating a linear or parabolic blast expansion trajectory associated with the identified highest blast particle based on the blast outline coordinates of the second set of video frames;
determining an original location of the identified highest blast particle, and identifying an original frame at which the identified highest blast particle initially moved from the original location based on the blast expansion trajectory and the second set of video frames;
determining a travel time representing the time between the original frame and the blast highest point frame according to a frame rate of the blasting video data;
estimating a maximum height associated with the identified highest blast particle based on the determined travel time;
generating overlay indicia for replay of the blasting video data based on at least one of the determined highest point, the estimated linear or parabolic blast expansion trajectory associated with the identified highest blast particle, the determined original location of the identified highest blast particle, and the estimated maximum height associated with the identified highest blast particle; and
rendering the blasting video data on a graphical display together with the overlay indicia.
13. The computer readable medium of claim 12 , comprising computer executable instructions for estimating an initial blast velocity based on the estimated maximum height associated with the identified highest blast particle.
14. The computer readable medium of claim 12 , comprising computer executable instructions for modeling the background data with simulated camera vibration using the first set of video frames.
15. The computer readable medium of claim 12 , comprising computer executable instructions for categorizing correctness of the estimated maximum height.
16. The computer readable medium of claim 12 , comprising computer executable instructions for analyzing color of the second set of video frames to detect toxic smoke.
17. The computer readable medium of claim 12 , comprising computer executable instructions for:
estimating an unseen final location where the identified highest blast particle is assumed to have stopped rising based on the estimated blast expansion trajectory associated with the identified highest blast particle;
determining an additional travel time from a last identified location of the identified highest blast particle to the estimated final location based on the estimated blast expansion trajectory;
determining the blast highest point frame corresponding to the estimated final location and the estimated blast expansion trajectory;
determining the travel time representing the time between the original frame and the estimated final location according to the frame rate; and
estimating the maximum height associated with the identified highest blast particle based on the determined travel time.