IP Library Granted Patent US 11,608,148
Granted Patent B2
US 11,608,148 · App. 16/460,467 · Granted Mar 21, 2023

Submersible remote operated vehicle tool change control

Inventors: Mark Leonhardt (Sacramento, CA); Bijou Abraham (Sacramento, CA); Peter Boissiere (Los Ranchos, NM); Steve Cohan (Davis, CA); Kevin Hjelden (Sacramento, CA); Doug Mayne (Vacaville, CA); Tim Ranstrom (Davis, CA); Sean Rogers (Sacramento, CA); Kevin Schell (Davis, CA); Spencer Slam (Sacramento, CA); Adwait Jayant Gandhe (Mountain View, CA)
Assignee: FMC Technologies, Inc.
B63G8/001B25J9/1633B25J9/1664B25J13/085B25J15/0491B63C11/52B63G2008/002B63G2008/005G05B2219/40271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,608,148
App. No.
16/460,467
Granted
Mar 21, 2023
Kind
B2
Abstract

A system receives data from a submersible remote operated vehicle (ROV), the data being about the operation of an arm of the ROV. The system automatically controls, based on the data, movement of the arm in docking the arm to a tool holder. In certain instances, the system implements an image based control. In certain instances, the system implements a force accommodation control. In certain instances, the system implements both.

Claims (58)

1. A method, comprising:

receiving data from a submersible remote operated vehicle (ROV) about the operation of an arm of the ROV;

automatically controlling, based on the data, movement of the arm relative to a target;

where receiving data comprises receiving data from a camera, the data comprising an image of an alignment fiducial associated with the target; and

where automatically controlling movement of the arm comprises automatically controlling the movement of the arm to align the arm relative to the target.

2. The method of claim 1 , where automatically controlling movement of the arm relative to a target, comprises automatically controlling movement of the arm in docking the arm to a tool holder, where the tool holder is the target.

3. The method of claim 2 , where docking the arm to the tool holder comprises inserting a tool on the arm into the tool holder; and comprising releasing the tool from the arm.

4. A method comprising:

receiving data from a submersible remote operated vehicle (ROV) about the operation of an arm of the ROV;

automatically controlling, based on the data, movement of the arm relative to a target;

where automatically controlling movement of the arm relative to the target, comprises automatically controlling movement of the arm in docking the arm to a tool holder, where the tool holder is the target;

receiving an input from a human operator identifying a tool; and

in response to the input operating a tool carousel to present the tool holder containing the tool to an access position.

5. The method of claim 1 , where aligning the arm relative to the target comprises aligning a device coupled to the arm relative to the target.

6. The method of claim 5 , where the device comprises a tool.

7. A method comprising receiving data from a submersible remote operated vehicle (ROV) about the operation of an arm of the ROV; and

automatically controlling, based on the data, movement of the arm relative to a target;

where receiving data comprises receiving data from a force sensor of the arm; and

where automatically controlling movement of the arm comprises automatically controlling movement of the arm based on a force threshold and an automatically determined nominal path to the target.

8. The method of claim 7 , where the force sensor comprises a torque sensor; and

where automatically controlling movement of the arm comprises automatically controlling movement of the arm based on a torque threshold and an automatically determined nominal path to the target.

9. The method of claim 7 , where automatically controlling movement of the arm further comprises automatically controlling movement of the arm based on a second, different force threshold in a different direction than the first mentioned force threshold.

10. The method of claim 9 , where the first mentioned threshold is in an extension direction of the arm and the second force threshold is lateral to the extension direction, and where the first mentioned threshold is greater than the second threshold.

11. The method of claim 7 , where receiving data comprises receiving data from a camera, the data comprising an image of the target; and

where automatically controlling movement of the arm further comprises automatically controlling the movement of the arm based on the image to align the arm relative to the target.

12. The method of claim 1 , comprising repeatedly receiving arm movement input from a human operator during the automatically controlling.

13. A system comprising a processor and memory with instruction stored on the memory operable to cause the system to perform operations comprising:

receive data from a submersible ROV about the operation of an arm of the ROV;

automatically control, based on the data, movement of the arm relative to a target

where receiving data comprises receiving data from a camera, the data comprising an image of an alignment fiducial associated with the target; and

where automatically controlling movement of the arm comprises automatically controlling the movement of the arm to align the arm relative to the target.

14. The system of claim 13 , where automatically controlling comprises automatically controlling, based on the data, movement of the arm in docking the arm to a tool holder.

15. The system of claim 13 , where receiving data comprises receiving data from a force sensor of the arm; and

where automatically controlling movement of the arm comprises automatically controlling movement of the arm based on a force threshold and an automatically determined nominal path to the target.

16. The system of claim 15 , where receiving data comprises receiving data from a camera, the data comprising an image of the target; and

where automatically controlling movement of the arm further comprises automatically controlling the movement of the arm based on the image to align the arm relative to the target.

17. The system of claim 15 , where automatically controlling movement of the arm further comprises automatically controlling movement of the arm based on a second, different force threshold in a different direction than the first mentioned force threshold.

18. The system of claim 17 , where the first mentioned threshold is in an extension direction of the arm and the second force threshold is lateral to the extension direction, and where the first mentioned threshold is greater than the second threshold.

19. A submersible ROV system, comprising:

a submersible ROV with a manipulator arm for carrying a tool;

a tool holder for storing the tool;

a control system configured to receive data from sensors of the ROV about the operation of the arm and automatically control, based on the data, movement of the arm in docking the arm to the tool holder;

where receiving data comprises receiving data from a camera, the data comprising an image of an alignment fiducial associated with the target; and

where automatically controlling movement of the arm comprises automatically controlling the movement of the arm to align the arm relative to the target.

20. The submersible ROV system of claim 19 , where the tool holder is carried by the ROV.

21. The submersible ROV system of claim 19 , where the sensors comprise a camera; and

where the control system is configured to receive image data from the camera.

22. The submersible ROV system of claim 19 , where the sensors comprise a force sensor configured to sense forces exerted by the manipulator arm; and

where the control system is configured to receive force data from the sensor.

23. The submersible ROV system of claim 19 , where the tool holder comprises:

an opening through which the tool is passed when docking the arm to the tool holder; and

a conical guide, surrounding the opening and decreasing in diameter toward the opening.

24. The submersible ROV system of claim 23 , where the conical guide comprises a plurality of lead-in ramps, each having a ramped inward facing surface.

25. A submersible ROV system, comprising:

a submersible ROV with a manipulator arm for carrying a tool;

a tool holder for storing the tool;

a control system configured to receive data from sensors of the ROV about the operation of the arm and automatically control, based on the data, movement of the arm in docking the arm to the tool holder; and

a key or keyway on the tool holder configured to interface with a corresponding keyway or key on the tool and lock the tool to the tool holder.

Assignments (6)
RELEASE OF PATENT SECURITY AGREEMENT RECORDED AT R/F 064193/0810 Recorded Aug 9, 2024
From: DNB BANK ASA, NEW YORK BRANCH
To: FMC TECHNOLOGIES, INC.; SCHILLING ROBOTICS, LLC
Reel/Frame 068525/0717 →
RELEASE OF PATENT SECURITY AGREEMENT RECORDED AT R/F 064193/0870 Recorded Aug 9, 2024
From: JPMORGAN CHASE BANK, N.A.
To: FMC TECHNOLOGIES, INC.; SCHILLING ROBOTICS, LLC
Reel/Frame 068527/0127 →
SECURITY INTEREST Recorded Jul 3, 2023
From: FMC TECHNOLOGIES, INC.; SCHILLING ROBOTICS, LLC
To: DNB BANK ASA, NEW YORK BRANCH, AS ADMINISTRATIVE AGENT
Reel/Frame 064193/0810 →
SECURITY INTEREST Recorded Jul 3, 2023
From: FMC TECHNOLOGIES, INC.; SCHILLING ROBOTICS, LLC
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 064193/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2023
From: GANDHE, ADWAIT JAYANT
To: FMC TECHNOLOGIES, INC.
Reel/Frame 062486/0070 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2022
From: RANSTROM, TIM; LEONHARDT, MARK; ABRAHAM, BIJOU; BOISSIERE, PETER; COHAN, STEVE; HJELDEN, KEVIN; MAYNE, DOUG; ROGERS, SEAN; SCHELL, KEVIN; SLAM, SPENCER
To: FMC TECHNOLOGIES, INC.
Reel/Frame 059177/0320 →