Apparatus and method for visualizing periodic motions in mechanical components
An apparatus for visualizing physical movements includes: a device for acquiring video image files; a data analysis system including processor and memory; a computer program operating in the processor to identify an area in the images where periodic motions associated with physical movement of an object may be detected and quantified, and compute a new image sequence in which the motions are visually amplified; and, a user interface that displays the motion-amplified video image of the mechanical component. An associated method for using the apparatus is also disclosed.
1. An apparatus for visualizing physical movements comprising:
a processor and a memory for storage;
a device for acquiring video image files, each video file having a sequence of video images comprising at least two individual still image frames, which are stored in memory and divided into pixels defined by two or more spatial coordinates within the frame, wherein pixel intensity is determined by brightness of light reflected or thermal energy emitted at that pixel with such intensity values expressed as amplitude;
a computer program operating in said processor to:
compare the amplitude of at least one set of corresponding pixels in a first image frame to that in a second image frame;
determine an amplitude that corresponds with movement in an object in an area of the frame defined by one or more pixels that includes the at least one corresponding pixel;
create motion amplification by the steps of:
identifying one of the image frames as a reference frame;
combining frames by identifying another of said image frames as a difference frame and overlaying the difference frame over the reference frame;
wherein the combining step comprises increasing the amplitude of the difference frame by an amplification factor that increases the intensity value of the corresponding pixel in the difference frame as representation of motion;
and compute a new image sequence in which said motions are visually amplified which the apparatus is configured to display via a user interface that displays a motion-amplified video image of said object.
2. The apparatus of claim 1 wherein said device for acquiring video files is selected from the group consisting of: video cameras, webcams, digital cameras integral in a mobile device, and memory devices containing prerecorded video files.
3. The apparatus of claim 1 wherein said user interface further displays the raw video images of said object for visual comparison to said motion-amplified video of said object.
4. The apparatus of claim 1 wherein said computer program detects a triggering event associated with exceeding a threshold level of movement the system determines based on an amplitude of motion level versus time during which video files are acquired, wherein the data analysis system creates motion amplification upon detecting the triggering event.
5. The apparatus of claim 4 wherein said user interface allows a user to vary said selected amplification factor over a selected range.
6. The apparatus of claim 1 wherein said user interface allows a user to select a frame rate for displaying said motion-amplified video that is less than the frame rate of said acquired video image file.
7. The apparatus of claim 1 wherein said user interface allows a user to display a single frame of video corresponding to a selected time.
8. The apparatus of claim 1 wherein said user interface displays the instant value of at least one parameter selected from the group consisting of: motion amplification factor; frame rate of said motion-amplified video display; and the time corresponding to a selected single video frame.
9. The apparatus of claim 1 wherein said user interface allows a user to export said motion-amplified video file.
10. The apparatus of claim 9 wherein said user interface allows the user to export said motion-amplified video file along with data selected from the group consisting of: the corresponding raw video file, and, metadata associated with said motion-amplified video file.
11. A method for visualizing physical movements comprising the steps of:
acquiring video image files, each video file having a sequence of video images comprising at least two individual still image frames, which are stored in memory and divided into pixels defined by two or more spatial coordinates within the frame, wherein pixel intensity is determined by brightness of light reflected or thermal energy emitted at that pixel with such intensity values expressed as amplitude;
configuring a memory to store two or more image frames;
in the operation of a computer program, comparing the amplitude of at least one set of corresponding pixels in a first image frame to that in a second image frame;
determining an amplitude that corresponds with movement in an object in an area of the frame defined by one or more pixels that includes the at least one corresponding pixel;
creating motion amplification by the steps of:
identifying one of the image frames as a reference frame;
combining frames by identifying another of said image frames as a difference frame and overlaying the difference frame over the reference frame;
wherein the combining step comprises increasing the amplitude of the difference frame by an amplification factor that increases the intensity value of the corresponding pixel in the difference frame as representation of motion; and,
computing a new image sequence file in which said motions are visually amplified; and
displaying a motion-amplified video image of said object.
12. The method of claim 11 wherein said GUI allows a user to select a motion amplification factor.
13. The method of claim 11 wherein said GUI allows a user to select a frame rate for displaying said motion-amplified images.
14. The method of claim 11 wherein said GUI further displays corresponding raw images of said component for visual comparison.
15. The method of claim 11 further including the step of: exporting said motion-amplified video images of said object along with any user-selected metadata.
16. The method of claim 11 wherein said object is selected from the group consisting of: bridges, tracks, beams, cables and guy wires, structural members, motors and pumps, linkages, shafts, and airfoils.
17. A system for visualizing physical movements in an object, comprising:
a device for acquiring video image files, each video file having a sequence of video images comprising at least two individual still image frames, which are stored in memory and divided into pixels defined by two or more spatial coordinates within the frame, wherein pixel intensity is determined by brightness of light reflected or thermal energy emitted at that pixel with such intensity values expressed as amplitude;
a data analysis system including processor and memory for storage;
a computer program operating in said processor to:
compare the amplitude of at least one set of corresponding pixels in a first image frame to that in a second image frame;
determine an amplitude that corresponds with movement in an object in an area of the frame defined by one or more pixels that includes the at least one corresponding pixel;
create motion amplification by the steps of: identifying one of the image frames as a reference frame; combining frames by identifying another of said image frames as a difference frame and overlaying the difference frame over the reference frame; wherein the combining step comprises increasing the amplitude of the difference frame by an amplification factor that increases the intensity value of the corresponding pixel in the difference frame as representation of motion; and,
compute a new image sequence in which said motions are visually amplified; and
further comprising a user interface configured to allow display of a motion-amplified video file or an image frame of said object.
18. The system of claim 17 wherein said user interface further displays the raw video images of said object for visual comparison to said motion-amplified video of said object.
19. The system of claim 17 wherein said user interface allows a user to vary said selected amplification factor over a selected range.
20. The system of claim 17 wherein said user interface allows a user to select a frame rate for displaying said motion-amplified video that is less than the frame rate of said acquired video image file.
21. The system of claim 17 wherein said user interface displays the instant value of at least one parameter selected from the group consisting of: motion amplification factor; frame rate of said motion-amplified video display; and the time corresponding to a selected single video frame.