IP Library Granted Patent US 12,169,406
Granted Patent B2
US 12,169,406 · App. 18/520,089 · Granted Dec 17, 2024

Unmanned aerial vehicle adaptable to obstructions

Inventors: Peter Henry (San Francisco, CA); Jack Zhu (San Francisco, CA); Brian Richman (San Francisco, CA); Harrison Zheng (Palo Alto, CA); Hayk Martirosyan (San Francisco, CA); Matthew Donahoe (Redwood City, CA); Abraham Bachrach (Redwood City, CA); Adam Bry (Redwood City, CA); Ryan David Kennedy (Redwood City, CA); Himel Mondal (Windsor, CA); Quentin Allen Wah Yen Delepine (Cupertino, CA)
Assignee: SKYDIO, INC.
G05D1/0094B64C39/024B64D31/06B64D47/08G05B13/0265G05B17/02G05D1/0088G05D1/101G05D1/227G05D1/689G05D1/69G06T7/55G06T7/74G06T17/00G06T19/20G06V20/13G06V20/64H04N23/64H04N23/695H04N23/90B64U10/13B64U2101/30G06T2207/10032G06T2207/20221G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,169,406
App. No.
18/520,089
Granted
Dec 17, 2024
Kind
B2
Abstract

In some examples, one or more processors of an aerial vehicle access a scan plan including a sequence of poses for the aerial vehicle to assume to capture, using the one or more image sensors, images of a scan target. A next pose of the scan plan is checked for obstructions, and based at least on detection of an obstruction, the one or more processors determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point. Responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, image capture of the targeted point is performed at an oblique angle to the normal of the targeted point.

Claims (53)

1. An unmanned aerial vehicle (UAV) comprising:

one or more image sensors;

a propulsion mechanism; and

one or more processors configured by executable instructions to at least:

access a scan plan including a sequence of poses for the UAV to assume to capture, using the one or more image sensors, images of a scan target;

check a next pose of the scan plan for obstructions;

based at least on detection of an obstruction, determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point; and

responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, perform image capture of the targeted point at an oblique angle to the normal of the targeted point.

2. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to determine the backup pose based at least on determining a location for the backup pose at a position along a normal of a surface of the scan target at a center of a field of view of the next pose.

3. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to check the next pose of the scan plan for obstructions based at least on performing object recognition of one or more images captured by the one or more image sensors of a space corresponding to the next pose for detecting an object in the space corresponding to the next pose.

4. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to determine that the backup pose is unavailable based at least on using a ray test to check for occlusion of a targeted point corresponding to the next pose, wherein a location of the targeted point is based at least in part on a three-dimensional model of the scan target.

5. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to capture one or more images based on the backup pose at least one of:

farther from the targeted point than a sampling distance specified for image capture; or

closer to the targeted point than a sampling distance specified for image capture.

6. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to:

determine whether the oblique angle satisfies a threshold indicative that the targeted point is not covered; and

based on the oblique angle satisfying the threshold, add the targeted point to a set of uncovered points for use, at least in part, for determining an updated scan plan.

7. The UAV as recited in claim 1 , the executable instructions further configuring the one or more processors to:

responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, control the propulsion mechanism to navigate the UAV to a position relative to the scan target to perform the image capture of the targeted point at the oblique angle to the normal of the targeted point.

8. A method comprising:

accessing, by one or more processors of an unmanned aerial vehicle (UAV), a scan plan including a sequence of poses for the UAV to assume to capture, using the one or more image sensors, images of a scan target;

checking, by the one or more processors of the UAV, a next pose of the scan plan for obstructions;

based at least on detection of an obstruction, determining whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point; and

responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, performing image capture of the targeted point at an oblique angle to the normal of the targeted point.

9. The method as recited in claim 8 , further comprising:

determining the backup pose based at least on determining a location for the backup pose at a position along a normal of a surface of the scan target at a center of a field of view of the next pose.

10. The method as recited in claim 8 , wherein checking the next pose of the scan plan for obstructions comprises performing object recognition of one or more images captured by the one or more image sensors of a space corresponding to the next pose for detecting an object in the space corresponding to the next pose.

11. The method as recited in claim 8 , wherein determining that the backup pose is unavailable is based at least on using a ray test to check for occlusion of a targeted point corresponding to the next pose, wherein a location of the targeted point is based at least in part on a three-dimensional model of the scan target.

12. The method as recited in claim 8 , further comprising:

capturing one or more images based on the backup pose at least one of:

farther from the targeted point than a sampling distance specified for image capture; or

closer to the targeted point than a sampling distance specified for image capture.

13. The method as recited in claim 8 , further comprising:

determining whether the oblique angle satisfies a threshold indicative that the targeted point is not covered; and

based on the oblique angle satisfying the threshold, adding the targeted point to a set of uncovered points for use, at least in part, for determining an updated scan plan.

14. The method as recited in claim 8 , further comprising:

responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, controlling the propulsion mechanism to navigate the UAV to a position relative to the scan target to perform the image capture of the targeted point at the oblique angle to the normal of the targeted point.

15. An aerial vehicle comprising:

one or more image sensors;

one or more processors configured by executable instructions to at least:

access a scan plan including a sequence of poses for the aerial vehicle to assume to capture, using the one or more image sensors, images of a scan target;

check a next pose of the scan plan for obstructions;

based at least on detection of an obstruction, determine whether a backup pose is available for capturing an image of the targeted point orthogonally along a normal of the targeted point; and

responsive to determining that the backup pose is unavailable for capturing an image of the targeted point orthogonally along the normal of the targeted point, perform image capture of the targeted point at an oblique angle to the normal of the targeted point.

16. The aerial vehicle as recited in claim 15 , the executable instructions further configuring the one or more processors to determine the backup pose based at least on determining a location for the backup pose at a position along a normal of a surface of the scan target at a center of a field of view of the next pose.

17. The aerial vehicle as recited in claim 15 , the executable instructions further configuring the one or more processors to check the next pose of the scan plan for obstructions based at least on performing object recognition of one or more images captured by the one or more image sensors of a space corresponding to the next pose for detecting an object in the space corresponding to the next pose.

18. The aerial vehicle as recited in claim 15 , the executable instructions further configuring the one or more processors to determine that the backup pose is unavailable based at least on using a ray test to check for occlusion of a targeted point corresponding to the next pose, wherein a location of the targeted point is based at least in part on a three-dimensional model of the scan target.

19. The aerial vehicle as recited in claim 15 , the executable instructions further configuring the one or more processors to capture one or more images based on the backup pose at least one of:

farther from the targeted point than a sampling distance specified for image capture; or

closer to the targeted point than a sampling distance specified for image capture.

20. The aerial vehicle as recited in claim 15 , the executable instructions further configuring the one or more processors to:

determine whether the oblique angle satisfies a threshold indicative that the targeted point is not covered; and

based on the oblique angle satisfying the threshold, adding the targeted point to a set of uncovered points for use, at least in part, for determining an updated scan plan.

Assignments (2)
SECURITY INTEREST Recorded Dec 5, 2024
From: SKYDIO, INC.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 069516/0452 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2023
From: HENRY, PETER; ZHU, JACK; RICHMAN, BRIAN; ZHENG, HARRISON; MARTIROSYAN, HAYK; DONAHOE, MATTHEW; BACHRACH, ABRAHAM; BRY, ADAM; KENNEDY, RYAN DAVID; MONDAL, HIMEL; DELEPINE, QUENTIN ALLEN WAH YEN
To: SKYDIO, INC.
Reel/Frame 065692/0098 →
Continuity (5)
Continuation 18120669 · Mar 13, 2023
Continuation 17174583 · Feb 12, 2021
Provisional Application 63050860 · Jul 12, 2020
Provisional Application 62976231 · Feb 13, 2020
Related Publication 20240310834A1 · Sep 19, 2024
Cited By (2)
US 1,085,942 US 12,643,691