IP Library Granted Patent US 10,957,177
Granted Patent B2
US 10,957,177 · App. 16/660,250 · Granted Mar 23, 2021

Systems and methods for oilfield drilling operations using computer vision

Inventors: George Michalopulos (Tulsa, OK); Richard Kulavik (Frisco, TX); Todd W. Benson (Dallas, TX)
Assignee: MOTIVE DRILLING TECHNOLOGIES, INC.
G08B21/02E21B41/0021G06K9/00362G06T7/20G06T7/70G06T17/00G08B7/06H04N5/247E21B7/04G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,957,177
App. No.
16/660,250
Granted
Mar 23, 2021
Kind
B2
Abstract

Computer vision drilling systems and methods may be used with a drilling rig. The computer vision systems and methods may be used during drilling of a well to monitor the drilling equipment and personnel on the drilling site to provide safer drilling operations. The results from the computer vision drilling system may be used to cause corrective actions to be performed if a safety condition arises. In addition, computer vision systems and methods are provided to automatically monitor the drilling site and drilling operations, such as by tallying pipe in the drill string and by monitoring equipment for anomalous drilling conditions, and automatically taking corrective action as may be needed.

Claims (46)

1. A computer vision system for drilling operations, the system comprising:

a processor;

a memory coupled to the processor, wherein the memory comprises instructions executable by the processor for:

receiving a plurality of images from a plurality of cameras located at a drilling rig adapted for drilling a borehole, wherein the cameras define a drilling rig area within a field of vision of the cameras;

receiving first information associated with the location and orientation of each of the plurality of cameras;

determining, responsive to the first information associated with the location and orientation of each of the plurality of cameras, a person's location within the drilling rig area;

tracking movement of the person within the drilling rig area;

tracking movement of the one or more components of the drilling rig;

receiving second information associated with one or more drilling operations of the drilling rig;

generating a map of the person's location relative to one or more components of the drilling rig;

displaying the map of the person's location relative to the one or more components of the drilling rig;

determining whether the person is in an unsafe location;

responsive to determining whether the person is in the unsafe location, determining an appropriate corrective action; and

implementing the corrective action;

determining, responsive to the tracking of movement of the person, tracking the movement of the one or more components, and the second information associated with the one or more drilling operations, whether the one or more components may collide with the person;

projecting the movement of the person responsive to the tracking of the movement of the person, projecting the movement of the one or more components responsive to the tracking of the one or more components, and determining whether the projected movement of the person and the projected movement of the one or more components will result in the person and the one or more components occupying the same space; and

determining a confidence value associated with the determination that the person and the one or more components will occupy the same space, wherein the confidence value is responsive to at least one of consistency between time elements, accuracy, resolution, and whether the one or more components match with a database of patterns.

2. The computer vision system of claim 1 wherein the instructions for determining the appropriate corrective action further comprise instructions for determining, responsive to the second information associated with the one or more drilling operations, whether to increase, decrease, or cease the one or more drilling operations to avoid a collision between the person and the one or more components.

3. The computer vision system of claim 2 wherein the instructions further comprise instructions for tracking movement of a plurality of persons in the drilling rig area, tracking movement of a plurality of components of the drilling rig, and wherein the instructions for displaying the map further comprise instructions for displaying the map of the plurality of persons and the plurality of components and the movement of each of the plurality of persons and the plurality of components.

4. The computer vision system of claim 1 wherein the instructions further comprise instructions for repeating at least some of the instructions during the drilling of a well.

5. The computer vision system of claim 1 wherein the instructions for generating and displaying the map further comprise instructions for generating and displaying a spatial map, and, if the person is determined to be in the unsafe location, changing the display to provide a visual alert, wherein the visual alert comprises at least one of changing the color of the person on the display, changing the size of the person on the display, changing the size of the location of the person on the display, providing a flashing light on the display, providing a flashing representation of the person on the display, and adding a warning message on the display.

6. The computer vision system of claim 1 wherein the corrective action comprises one or more of an audible alert in the drilling rig area, a visual alert in the drilling rig area, an electronic message sent to the person, a change in the display of the map, an increase in the speed of the one or more drilling operations, a decrease in the speed of the one or more drilling operations, and a cessation of the one or more drilling operations.

7. The computer vision system of claim 1 wherein the instructions for displaying the map further comprise instructions for at least one of changing the display in response to a user input, changing the display to provide a visual alert of an unsafe condition, changing the display to provide a visual alert of the resolution of the unsafe condition.

8. A computer vision system for drilling operations, the system comprising:

a processor;

a memory coupled to the processor, wherein the memory comprises instructions executable by the processor for:

receiving a plurality of images from a plurality of cameras located at a drilling rig adapted for drilling a borehole, wherein the cameras define a drilling rig area within a field of vision of the cameras;

receiving first information associated with the location and orientation of each of the plurality of cameras;

determining, responsive to the first information, a person's location within the drilling rig area;

generating a map of the person's location relative to one or more components of the drilling rig;

displaying the map of the person's location relative to the one or more components of the drilling rig;

determining whether the person is in an unsafe location;

responsive to determining whether the person is in the unsafe location, determining an appropriate corrective action;

implementing the corrective action; and

determining a confidence value associated with the determination that the person is in the unsafe location, wherein the confidence value is responsive to at least one of consistency between time elements, accuracy, resolution, and whether the one or more components match with a database of patterns.

9. The computer vision system of claim 8 , wherein the instructions further comprise instructions for tracking movement of the person within the drilling rig area.

10. The computer vision system of claim 9 , wherein the instructions further comprise instructions for tracking movement of the one or more components of the drilling rig.

11. The computer vision system of claim 10 , wherein the instructions further comprise instructions for receiving second information associated with one or more drilling operations of the drilling rig.

12. The computer vision system of claim 11 , wherein the instructions further comprise instructions for determining, responsive to the tracking of movement of the person, tracking the movement of the one or more components, and the second information, whether the one or more components may collide with the person.

13. The computer vision system of claim 12 , wherein the instructions for determining the appropriate corrective action further comprise instructions for determining, responsive to the second information, whether to increase, decrease, or cease the one or more drilling operations to avoid a collision between the person and the one or more components.

14. The computer vision system of claim 13 , wherein the instructions further comprise instructions for tracking movement of a plurality of persons in the drilling rig area, tracking movement of a plurality of components of the drilling rig, and wherein the instructions for displaying the map further comprise instructions for displaying the map of the plurality of persons and the plurality of components and the movement of each of the plurality of persons and the plurality of components.

15. The computer vision system of claim 12 , wherein the instructions further comprise instructions for projecting the movement of the person responsive to the tracking of the movement of the person, projecting the movement of the one or more components responsive to the tracking of the one or more components, and determining whether the projected movement of the person and the projected movement of the one or more components will result in the person and the one or more components occupying the same space.

16. The computer vision system of claim 8 , wherein the instructions further comprise instructions for repeating at least some of the instructions during the drilling of a well.

17. The computer vision system of claim 8 , wherein the instructions for generating and displaying the map further comprise instructions for generating and displaying a spatial map, and, if the person is determined to be in the unsafe location, changing the display to provide a visual alert, wherein the visual alert comprises at least one of changing the color of the person on the display, changing the size of the person on the display, changing the size of the location of the person on the display, providing a flashing light on the display, providing a flashing representation of the person on the display, and adding a warning message on the display.

18. The computer vision system of claim 8 , wherein the corrective action comprises one or more of an audible alert in the drilling rig area, a visual alert in the drilling rig area, an electronic message sent to the person, a change in the display of the map, an increase in the speed of the one or more drilling operations, a decrease in the speed of the one or more drilling operations, and a cessation of the one or more drilling operations.

19. The computer vision system of claim 8 , wherein the instructions for displaying the map further comprise instructions for at least one of changing the display in response to a user input, changing the display to provide a visual alert of an unsafe condition, changing the display to provide a visual alert of the resolution of the unsafe condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2020
From: MICHALOPULOS, GEORGE; KULAVIK, RICHARD; BENSON, TODD W.
To: MOTIVE DRILLING TECHNOLOGIES, INC.
Reel/Frame 054556/0062 →
Continuity (2)
Provisional Application 62748996 · Oct 22, 2018
Related Publication 20200126386A1 · Apr 23, 2020
Cited By (3)
US 12,393,912 US 12,444,040 US 12,704,057