Real-time marine snow noise removal from underwater video
View Patent ↗Optical flow refers to the pattern of apparent motion of objects, surfaces, and edges in a visual scene caused by the relative motion between an observer and a scene. Optical flow algorithms can be used to detect and delineate independently moving objects, even in the presence of camera motion. The present invention uses optical-flow algorithms to detect and remove marine snow particles from live video. Portions of an image scene which are identified as marine snow are reconstructed in a manner intended to reveal underwater scenery which had been occluded by the marine snow. Pixel locations within the regions of marine snow are replaced with new pixel values that are determined based on either historical data for each pixel or a mathematical operation, such as one which uses data from neighboring pixels.
1. An optical flow sensor to detect the fluctuations in water while immersed within bodies of said water comprising:
a camera for detecting optical flow events within said water;
an optical flow comparison process wherein independently moving objects in proximity of said body of water are isolated against a backdrop of water flow not associated with said moving objects and wherein movement of said camera is subtracted from movement associated with said object;
a process performed by a computer wherein video signals produced by said camera wherein marine snow noise is identified and removed from an overall underwater image, so that said overall underwater image consists of said moving objects and wherein said overall underwater image is relatively clear for human observation, and
wherein underwater scenery otherwise occluded by marine snow noise become more clearly visible for human observation.
2. An optical flow sensor according to claim 1 wherein pixel locations within water columns with distributions of marine snow noise are replaced with new pixel values that are determined based on either historical data for each pixel or a mathematical operation, such as one which uses data from neighboring pixels by way of geo-positioning.
3. A method for an optical flow sensor to detect the fluctuations in water while immersed within bodies of said water and producing a corresponding data output comprising:
a camera for detecting optical flow events within said water;
an optical flow comparison process wherein independently moving objects in proximity of said body of water are isolated against a backdrop of water flow not associated with said moving objects and wherein movement of said camera is subtracted from movement associated with said object;
a process performed by a computer wherein video signals produced by said camera wherein marine snow noise is identified and removed from an overall underwater image, so that said overall underwater image consists of said moving objects and wherein said overall underwater image is relatively clear for human observation, and
wherein underwater scenery otherwise occluded by marine snow noise become more clearly visible for human observation.
4. A method according to claim 3 wherein pixel locations within water columns with distributions of marine snow noise are replaced with new pixel values that are determined based on either historical data for each pixel or a mathematical operation, such as one which uses data from neighboring pixels by way of geo-positioning.
5. A system for providing clear underwater visualization using an optical flow sensor to detect the fluctuations in water while immersed within bodies of said water comprising:
a camera for detecting optical flow events within said water;
an optical flow comparison process wherein independently moving objects in proximity of said body of water are isolated against a backdrop of water flow not associated with said moving objects and wherein movement of said camera is subtracted from movement associated with said object;
a process performed by a computer wherein video signals produced by said camera wherein marine snow noise is identified and removed from an overall underwater image, so that said overall underwater image consists of said moving objects and wherein said overall underwater image is relatively clear for human observation, and wherein underwater scenery otherwise occluded by marine snow noise become more clearly visible for human observation, and
wherein pixel locations within water columns with distributions of marine snow noise are replaced with new pixel values that are determined based on either historical data for each pixel or a mathematical operation, such as one which uses data from neighboring pixels.
6. A system according to claim 5 wherein said neighboring pixels include at least said historical data for each of said pixels and wherein said historical data is shared with other third party users of said system's user interface.