Fish identification apparatus and method
View Patent ↗A fish detection system that is deployed behind a vessel and is trolled therebehind wherein the invention provides surveillance, tracking and identification of marine species. The invention includes a species database having a multitude of frames of video footage wherein the video footage has had the grid cell structure thereof analyzed. The video data within the species database is subjected to data augmentation and data optimization. A camera captures a live video stream sourced from behind a vessel in motion wherein the live video stream is analyzed utilizing the metrics and images from the species database. The fish identification system provides elimination of baitfish and baitfish rigs from the video stream. Detection of a marine species occurs and subject to detection the marine species is tracked and surrounded by bounding boxes while all other image data is rejected. Notification of the identified marine species is provided both visually and audially.
1 . A fish identification method that is configured to be deployed behind a marine vessel wherein the fish identification method comprises the steps of:
collecting a multitude of underwater visual video footage, wherein the underwater visual video footage includes images of fish species;
analyzing the underwater visual video footage, wherein the underwater visual video footage is analyzed for fish species identification;
distinguishing the fish species identification;
storing the fish species identification in a database, wherein the fish species identification is labeled in the database;
mounting a camera assembly to the marine vessel, wherein the camera assembly is mounted to the marine vessel utilizing a camera mount;
deploying the camera assembly into water behind the vessel, wherein the camera assembly includes a camera operably coupled to a housing;
towing the camera assembly behind the vessel;
capturing a video data, wherein the camera is employed to capture video feed of the area of water behind the vessel;
analyzing the video data, wherein the video data captured by the camera is continuously analyzed;
identifying a presence of at least one fish, wherein the at least one fish is captured in the video data from the camera assembly;
comparing the video data of the at least one fish to the database;
establishing an identity of the at least one fish, wherein the data comparison of the video data with the fish species identification confirms an identity of the at least one fish;
providing a notification to a user of the presence of the at least one fish, wherein the notification provides the confirmation of the identity of the species of the at least one fish in the video data;
tracking the at least one fish, wherein the at least one fish is tracked in the video data;
augmenting the underwater visual video footage, wherein the underwater visual video footage is augmented and optimized prior to storing in the database;
providing identification of a plurality of types of baitfish and baitfish rigs, wherein video data of baitfish and baitfish rigs is stored in the database;
eliminating video data of baitfish and baitfish rigs from the video data captured by the camera.
2 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 1 , and further including a step of segmenting the underwater visual video footage, wherein the underwater visual video footage is segmented at a rate of approximately five to ten frames per second.
3 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 2 , and further including a step of establishing a grid structure of the underwater visual video footage, wherein the grid structure is analyzed and annotated for fish species identification.
4 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 3 , wherein the camera housing includes a central portion having a first upper lateral wing member and a second upper lateral wing member, said camera housing further having a first lower lateral wing member and a second lower lateral wing member.
5 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 4 , and further including a step of displaying the video data on a graphical display unit.
6 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 5 , wherein the camera mount further includes a controller, said controller configured to operate a cable spool, said cable spool having a video data cable stored thereon, wherein the video data cable is operably coupled to the camera.
7 . The fish identification method that is configured to be deployed behind the marine vessel as recited in claim 6 , and further including a step of surrounding the at least one fish present in the video data from the camera with bounding boxes.
8 . A method of identifying fish behind a marine vessel wherein the method comprises the steps of:
collecting a multitude of underwater visual video footage, wherein the underwater visual video footage includes images of fish species;
analyzing the underwater visual video footage, wherein the underwater visual video footage is analyzed for fish species identification;
segmenting the underwater visual video footage, wherein the underwater visual video footage is segmented into frames at a frequency of five to ten frames per second;
annotating each frame of the underwater visual video footage, wherein the frames are annotated for fish species and baitfish types;
establishing a database, wherein the database is created from the underwater visual video footage and has fish species identification stored therein;
mounting a camera assembly to the marine vessel, wherein the camera assembly is mounted to the marine vessel utilizing a camera mount, wherein the camera mount includes a portion configured to be journaled into a rod holder of the marine vessel, said camera mount having operably coupled thereto a controller and a cable spool, said cable spool having a video cable operably coupled to the camera assembly;
deploying the camera assembly into water behind the marine vessel, wherein the camera assembly includes a camera operably coupled to a housing;
towing the camera assembly behind the vessel;
capturing a video data, wherein the camera is employed to capture video feed of the area of water behind the vessel;
segmenting the video data into a grid structure, wherein the video data from the camera is segmented into a grid structure;
eliminating baitfish and baitfish rigs from the video data, wherein the baitfish and baitfish rigs present in the video data from the camera is eliminated;
identifying a presence of at least one fish, wherein the at least one fish is captured in the video data from the camera assembly;
surrounding the at least one fish with bounding boxes, wherein in the video data from the camera the at least one fish is surrounded with bounding boxes;
comparing the video data of the at least one fish to the database;
establishing an identity of the at least one fish, wherein the data comparison of the video data with the fish species identification in the database confirms an identity of the at least one fish;
providing a notification to a user of the presence of the at least one fish, wherein the notification provides the confirmation of the identity of the species of the at least one fish in the video data;
tracking the at least one fish, wherein the at least one fish is tracked in the video data.
9 . The method of identifying fish behind a marine vessel as recited in claim 8 , and further including a step of augmenting the underwater visual video footage, wherein the underwater visual video footage is augmented and optimized prior to storing in the database.
10 . The method of identifying fish behind a marine vessel as recited in claim 9 , and further including a step of reviewing the video data for accuracy and precision.
11 . The method of identifying fish behind a marine vessel as recited in claim 10 , wherein the camera housing includes a central portion having a first upper lateral wing member and a second upper lateral wing member, said camera housing further having a first lower lateral wing member and a second lower lateral wing member.
12 . The method of identifying fish behind a marine vessel as recited in claim 11 , wherein the first upper lateral wing member, second upper lateral wing member is parallel to the first lower lateral wing member and second lower lateral wing member, wherein the first upper lateral wing member, second upper lateral wing and first lower lateral wing member, second lower lateral wing member are angular in orientation.
13 . The method of identifying fish behind a marine vessel as recited in claim 12 , and further including a step of displaying the video data on a graphical display unit.
14 . The method of identifying fish behind a marine vessel as recited in claim 13 , and further including a step of updating the database, wherein the database is updated with augmented and optimized video data of fish species.