System and method for locating, measuring, counting, and aiding in the handling of drill pipes
Disclosed embodiments relate to systems and methods for locating, measuring, counting or aiding in the handling of drill pipes 106 . The system 100 comprises at least one camera 102 capable of gathering visual data 150 regarding detecting, localizing or both, pipes 106 , roughnecks 116 , elevators 118 and combinations thereof. The system 100 further comprises a processor 110 and a logging system 114 for recording the gathered visual data 150 . The method 200 comprises acquiring visual data 150 using a camera 106 , analyzing the acquired data 150 , and recording the acquired data 150.
1 . A computer vision system for drilling, the computer vision system comprising:
a processor;
a memory coupled to the processor, wherein the memory comprises instructions executable by the processor for:
receiving visual data from a camera, wherein the visual data comprises a view of a drill pipe as it is attached to or removed from a drill string;
receiving a plurality of object types associated with a drilling rig and defining a plurality of regions of interest in the view, each region of interest defined for a corresponding object type of the plurality of object types, wherein the plurality of object types are different object types;
determining, responsive to the visual data, a motion of the drill pipe;
adjusting a pipe tally for the drill string responsive to the determination of the motion of the drill pipe, wherein the pipe tally comprises a tally of length and width information for each of a plurality of drill pipes forming the drill string; and
generating an alarm in response to determining a condition exists.
2 . The computer vision system of claim 1 , further comprising the camera.
3 . The computer vision system of claim 1 , wherein the instructions further comprise instructions for adjusting or halting a drill pipe elevator operation or a roughneck operation upon determining that the condition exists.
4 . The computer vision system of claim 1 , wherein the plurality of object types comprises at least the drill pipe and one or more of an iron roughneck or an elevator.
5 . The computer vision system of claim 1 , wherein the instructions further comprise instructions for measuring at least one of a length or a width of the drill pipe.
6 . The computer vision system of claim 1 , wherein determining if the condition exists is responsive to at least one of the determined motion of the drill pipe, a detection of a marking system on the drill pipe in the visual data, a measured length or width of the drill pipe, or the adjusted pipe tally.
7 . The computer vision system of claim 1 , wherein the instructions further comprise instructions for displaying collected and/or analyzed data responsive to the received visual data.
8 . A method for drilling, the method comprising:
receiving visual data from a camera, wherein the visual data comprises a view of a drill pipe as it is attached to or removed from a drill string;
receiving a plurality of object types associated with a drilling rig and defining a plurality of regions of interest in the view, each region of interest defined for a corresponding object type of the plurality of object types, wherein the plurality of object types are different object types;
determining, responsive to the visual data, a motion of the drill pipe;
adjusting a pipe tally for the drill string responsive to the determination of the motion of the drill pipe, wherein the pipe tally comprises a tally of length and width information for each of a plurality of drill pipes forming the drill string; and
generating an alarm in response to determining a condition exists.
9 . The method of claim 8 , further comprising recording the visual data from the camera and displaying recorded data on a display.
10 . The method of claim 8 , wherein determining the condition exists is responsive to at least one of the determining of the motion of the drill pipe, detecting of a marking system on the drill pipe in the visual data, measuring length or width of the drill pipe, or the adjusting of the pipe tally.
11 . The method of claim 8 , further comprising adjusting or halting a drill pipe elevator operation or a roughneck operation upon determining that the condition exists.
12 . A non-transitory computer readable storage medium comprising a plurality of instructions executable by one or more processors, the instructions comprising instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
receiving visual data from a camera, wherein the visual data comprises a view of a drill pipe as it is attached to or removed from a drill string;
receiving a plurality of object types associated with a drilling rig and defining a plurality of regions of interest in the view, each region of interest defined for a corresponding object type of the plurality of object types, wherein the plurality of object types are different object types;
determining, responsive to the visual data, a motion of the drill pipe;
adjusting a pipe tally for the drill string responsive to the determination of the motion of the drill pipe, wherein the pipe tally comprises a tally of length and width information for each of a plurality of drill pipes forming the drill string; and
generating an alarm in response to determining a condition exists.
13 . The non-transitory computer readable storage medium of claim 12 , wherein the instructions further comprise instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
determining, responsive to the visual data, at least one of a length or a width of the drill pipe.
14 . The non-transitory computer readable storage medium of claim 12 , wherein the instructions further comprise instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
determining if the determined condition exists responsive to at least one of a detection of a marking system on the drill pipe in the visual data, a measured length of the drill pipe, a measured width of the drill pipe, or the adjustment of the pipe tally.
15 . The non-transitory computer readable storage medium of claim 12 , wherein the instructions further comprise instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including displaying collected or analyzed data responsive to the visual data.
16 . The non-transitory computer readable storage medium of claim 12 , wherein the plurality of object types comprises at least the drill pipe and one or more of an iron roughneck or an elevator.
17 . The non-transitory computer readable storage medium of claim 12 , wherein the instructions further comprise instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
providing instructions to adjust or halt a drill pipe elevator operation or a roughneck operation upon determining that the condition exists.