IP Library Granted Patent US 10,859,510
Granted Patent B2
US 10,859,510 · App. 16/684,866 · Granted Dec 8, 2020

Robotic sensor system for measuring parameters of a structure

Inventors: Jonathan Bohren (Brooklyn, NY); Jack Wilson (Brooklyn, NY); Anthony G. Musco (Secaucus, NJ); Christopher D. Bolger (Hastings-on-Hudson, NY)
Assignee: HONEYBEE ROBOTICS, LTD.
G01N21/952
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,859,510
App. No.
16/684,866
Granted
Dec 8, 2020
Kind
B2
Abstract

A sensor system for measuring and locating parameters of a structure includes a robot configured to move between a first position and a second position along the structure. An inspection sensor is coupled to the robot and configured to measure a parameter associated with the structure. A localization sensor suite includes an inertial measurement unit and is configured to capture data associated with translational degrees of freedom and a rotational degree of freedom of the robot determined by the structure and an image capture system mounted to the robot. The image capture system acquires images of the structure. One or more processors is operatively connected to the localization sensor suite. The one or more processors is responsive to non-transitory executable computer instructions for generating a map of the route including features of the structure, the measured parameters, and a position of the robot relative to the structure.

Claims (38)

1. A sensor system for measuring and locating parameters of a structure, the sensor system comprising:

a robot configured to move along a route in an environment between a first position and a second position along an external surface of the structure;

at least one inspection sensor coupled to the robot and configured to measure at least one parameter associated with the structure;

a localization sensor suite including an inertial measurement unit configured to capture data associated with translational degrees of freedom and a rotational degree of freedom of the robot determined by the structure, and at least one image capture system mounted to the robot, the at least one image capture system being operable to acquire a plurality of images of the structure; and

one or more processors operatively connected to the localization sensor suite, the one or more processors being responsive to non-transitory executable computer instructions for generating a map of the route followed along the structure by the robot between the first position and the second position, the map including one or more features of the structure captured from the plurality of images, the measured parameters associated with the structure, and a position of the robot relative to the structure based on the translational degrees of freedom and the rotational degree of freedom of the robot determined by the structure, wherein the executable computer instructions are further responsive for determining when the parameter is out of specification and storing the position of the robot on the map when the parameter is out of specification.

2. The system of claim 1 , further comprising a display separate from and coupled for communication to the robot, the display having a first element showing the map, a second element showing an image acquired by the at least one image capture system with identified natural features of the environment superimposed thereon, and a third element showing the image and locations of sensor measurements superimposed thereon.

3. The system of claim 1 , wherein the at least one parameter comprises a level of corrosion on the structure.

4. The system of claim 1 , wherein the structure is a pipe.

5. The system of claim 1 , wherein the robot includes a movement assembly for moving the robot along and in contact with the structure.

6. A sensor system comprising:

a structure including an external surface;

a robot configured to move along a route in an environment between a first position and a second position along the external surface of the structure;

at least one inspection sensor coupled to the robot and configured to measure at least one parameter associated with the structure;

a localization sensor suite including an inertial measurement unit configured to determine translational degrees of freedom and rotational degrees of freedom of the robot as determined by the structure, and at least one image capture system mounted to the robot, the at least one image capture system being operable to acquire a plurality of images of the structure; and

one or more processors operatively connected to the localization sensor suite, the one or more processors being responsive to non-transitory executable computer instructions for generating a map of the route followed along the structure by the robot between the first position and the second position, the map including one or more features of the structure captured from the plurality of images, the at least one parameter associated with the structure, and the position of the robot relative to the structure based on the translational degrees of freedom and the rotational degrees of freedom of the robot determined by the structure, wherein the executable computer instructions are further responsive for determining when the parameter is out of specification and storing the position of the robot on the map when the parameter is out of specification.

7. The sensor system of claim 6 , further comprising a display separate from and coupled for communication to the robot, the display having a first element showing the map, a second element showing an image acquired by the at least one image capture system with identified natural features of the environment superimposed thereon, and a third element showing the image and locations of sensor measurements superimposed thereon.

8. The sensor system of claim 6 , wherein the at least one parameter comprises a level of corrosion on the structure.

9. The system of claim 6 , wherein the structure is a pipe.

10. The sensor system of claim 6 , wherein the robot is attached to the structure.

11. The sensor system according to claim 6 , wherein the robot includes a movement assembly for moving the robot along the route.

12. The sensor system according to claim 11 , wherein the movement assembly includes a clamping mechanism that secures the robot to the structure.

13. A method of inspecting a structure comprising:

positioning a robot on an external surface of a structure;

moving the robot from a first position to a second position along the external surface of the structure;

measuring at least one parameter associated with the structure through a sensor supported by the robot;

determining three translational degrees of freedom and a rotational degree of freedom of the robot;

acquiring one or more images of the structure with an image capture system supported by the robot;

generating a map of a route followed along the structure by the robot, the map including one or more features of the structure captured from the one or more images, and the position of the robot relative to the structure based on the three translational degrees of freedom and the rotational degree of freedom;

determining, at the robot when the parameter is out of specification; and

storing the position of the robot on the map when the parameter is out of specification.

14. The method of claim 13 , further comprising: displaying the map on a display that is remote from the robot.

15. The method of claim 14 , wherein displaying the map includes displaying an image acquired by the image capture system with identified natural features of the structure superimposed thereon.

16. The method of claim 15 wherein displaying the map includes showing the image and locations of sensor measurements superimposed thereon.

17. The method of claim 16 , wherein displaying the map includes displaying features in an environment surrounding, at least in part, the structure.

18. The method of claim 13 , wherein determining when the parameter is out of specification includes measuring a level of corrosion on the structure as the robot moves from the first position to the second position.

19. The method of claim 13 , wherein positioning the robot at the structure includes positioning the robot on a pipe.

20. The method of claim 13 , wherein positioning the robot at the structure includes attaching the robot to the structure.

21. The method of claim 13 , wherein moving the robot from the first position to the second position includes operating a movement assembly of the robot.

Assignments (4)
MERGER AND CHANGE OF NAME Recorded Jun 29, 2022
From: APIARY HOLDINGS, LLC; HONEYBEE ROBOTICS, LLC
To: HONEYBEE ROBOTICS, LLC
Reel/Frame 060541/0926 →
RELEASE OF SECURITY INTEREST Recorded Feb 11, 2022
From: U.S. BANK NATIONAL ASSOCIATION
To: HONEYBEE ROBOTICS, LTD.
Reel/Frame 058992/0669 →
SECURITY INTEREST Recorded Feb 4, 2021
From: ENSIGN-BICKFORD INDUSTRIES, INC.; APPLIED FOOD BIOTECHNOLOGY, INC.; ENSIGN-BICKFORD AEROSPACE & DEFENSE COMPANY; EB ANALYTICS, INC.; ENVIROLOGIX INC.; HONEYBEE ROBOTICS, LTD.
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 055223/0048 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2019
From: BOHREN, JONATHAN; WILSON, JACK; MUSCO, ANTHONY G.; BOLGER, CHRISTOPHER D.
To: HONEYBEE ROBOTICS, LTD.
Reel/Frame 051019/0281 →
Continuity (2)
Provisional Application 62792980 · Jan 16, 2019
Related Publication 20200225170A1 · Jul 16, 2020