IP Library Granted Patent US 12,025,983
Granted Patent B2
US 12,025,983 · App. 18/222,786 · Granted Jul 2, 2024

Indicating a scan target for an unmanned aerial vehicle

Inventors: Peter Henry (San Francisco, CA); Jack Zhu (San Francisco, CA); Brian Richman (San Francisco, CA); Harrison Zheng (Palo Alto, CA); Hayk Martirosyan (San Francisco, CA); Matthew Donahoe (Redwood City, CA); Abraham Bachrach (Redwood City, CA); Adam Bry (Redwood City, CA); Ryan David Kennedy (Redwood City, CA); Himel Mondal (Windsor, CA); Quentin Allen Wah Yen Delepine (Cupertino, CA)
Assignee: SKYDIO, INC.
G05D1/0094B64C39/024B64D31/06B64D47/08G05B13/0265G05B17/02G05D1/0088G05D1/101G06T7/55G06T7/74G06T17/00G06T19/20G06V20/13G06V20/64H04N23/64H04N23/695H04N23/90B64U10/13B64U2101/30G06T2207/10032G06T2207/20221G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,025,983
App. No.
18/222,786
Granted
Jul 2, 2024
Kind
B2
Abstract

In some examples, an image of a scan target is presented in a user interface on a display associated with a computing device. The user interface receives at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target. A graphical representation of the volume in relation to the image of the scan target is generated in the user interface. Information for defining a location of at least a portion of the volume in three-dimensional space is sent to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

Claims (54)

1. A computing device comprising:

a display; and

one or more processors in communication with the display, the one or more processors configured by executable instructions to:

present an image of a scan target in a user interface presented on the display;

receive at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target;

generate, in the user interface, a graphical representation of the volume in relation to the image of the scan target; and

send information for defining a location of at least a portion of the volume in three-dimensional (3D) space to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

2. The computing device as recited in claim 1 , the one or more processors further configured to generate the graphical representation of the volume with least one interactive element presented in the user interface and associated with the graphical representation of the volume, the at least one interactive element movable via at least one user input for adjusting at least one of a size or position of the graphical representation of the volume relative to the scan target, the at least one interactive element corresponding to coordinates in the 3D space.

3. The computing device as recited in claim 2 , the one or more processors further configured to receive one or more user inputs to the interactive element associated with the graphical representation of the volume to change at least one of the size of the position of the graphical representation of the volume with respect to the image of the scan target prior to sending the information to the UAV.

4. The computing device as recited in claim 1 , wherein the display includes a touchscreen, and the interactive element is movable by a user touch input for changing at least one of the size or position of the graphical representation of the volume.

5. The computing device as recited in claim 1 , the one or more processors are further configured to:

based at least on sending the information, receive, from the UAV, a scan plan for scanning the scan target indicated by the graphical representation of the volume, the scan plan including an indication of a plurality of points associated with a surface of the scan target to be scanned by the UAV; and

present, in the user interface, information related to the plurality of points associated with the surface of the scan target to be scanned.

6. The computing device as recited in claim 1 , the one or more processors are further configured to:

based at least on sending the information, receive, from the UAV, information related to a 3D model of the scan target, the 3D model including a plurality of points corresponding to one or more surfaces of the scan target; and

present, in the user interface, an image corresponding to the 3D model of the scan target.

7. The computing device as recited in claim 1 , the one or more processors further configured to:

receive the image of the scan target from the UAV while the UAV is flying in a vicinity of the scan target; and

send the information for defining the location of at least the portion of the volume in 3D space while the UAV is flying in the vicinity of the scan target.

8. The computing device as recited in claim 1 , the one or more processors further configured to send, to the UAV, with the information for defining the location of at least the portion of the volume in 3D space, at least one of:

a specified image resolution for capturing images of the scan target;

a specified distance from a surface of the scan target for capturing the images of the scan target;

a specified speed of travel of the UAV for capturing the images of the scan target; or

a specified amount of image overlap for capturing the images of the scan target.

9. The computing device as recited in claim 1 , wherein the at least one user input comprises at least one of: drawing a loop around at least a portion of the image of the scan target, drawing a representation of a polygon around at least a portion of the image of the scan target, or selecting a portion of the image of the scan target.

10. The computing device as recited in claim 1 , the one or more processors further configured to present the graphical representation of the volume in the user interface with a plurality of interactive elements for adjusting at least one of a location of an edge or a location of a corner of the graphical representation of the volume, wherein receiving at least one user input indicating at least one point in the perimeter or edge of the volume for encompassing the scan target comprises receiving a plurality of user inputs to move the plurality of interactive elements to position the graphical representation of the volume encompassing the scan target.

11. A method comprising:

presenting, by one or more processors, on a display, a user interface including an image of a scan target;

receiving, by the one or more processors, at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target;

generating, by the one or more processors, in the user interface, a graphical representation of the volume in relation to the image of the scan target; and

sending by the one or more processors, information for defining a location of at least a portion of the volume in three-dimensional (3D) space to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

12. The method as recited in claim 11 , further comprising generating the graphical representation of the volume with least one interactive element presented in the user interface and associated with the graphical representation of the volume, the at least one interactive element movable via at least one user input for adjusting at least one of a size or position of the graphical representation of the volume relative to the scan target, the at least one interactive element corresponding to coordinates in the 3D space.

13. The method as recited in claim 12 , further comprising receiving one or more user inputs to the interactive element associated with the graphical representation of the volume to change at least one of the size of the position of the graphical representation of the volume with respect to the image of the scan target prior to sending the information to the UAV.

14. The method as recited in claim 11 , further comprising

based at least on sending the information, receiving, from the UAV, a scan plan for scanning the scan target indicated by the graphical representation of the volume, the scan plan including an indication of a plurality of points associated with a surface of the scan target to be scanned by the UAV; and

presenting, in the user interface, information related to the plurality of points associated with the surface of the scan target to be scanned.

15. The method as recited in claim 11 , further comprising:

based at least on sending the information, receiving, from the UAV, information related to a 3D model of the scan target, the 3D model including a plurality of points corresponding to one or more surfaces of the scan target; and

presenting, in the user interface, an image corresponding to the 3D model of the scan target.

16. The method as recited in claim 11 , further comprising:

receiving the image of the scan target from the UAV while the UAV is flying in a vicinity of the scan target; and

sending the information for defining the location of at least the portion of the volume in 3D space while the UAV is flying in the vicinity of the scan target.

17. The method as recited in claim 11 , further comprising sending, to the UAV, with the information for defining the location of at least the portion of the volume in 3D space, at least one of:

target;

a specified image resolution for capturing images of the scan target;

a specified distance from a surface of the scan target for capturing the images of the scan a specified speed of travel of the UAV for capturing the images of the scan target; or

a specified amount of image overlap for capturing the images of the scan target.

18. The method as recited in claim 11 , wherein the at least one user input comprises at least one of: drawing a loop around at least a portion of the image of the scan target, drawing a representation of a polygon around at least a portion of the image of the scan target, or selecting a portion of the image of the scan target.

19. The method as recited in claim 11 , further comprising presenting the graphical representation of the volume in the user interface with a plurality of interactive elements for adjusting at least one of a location of an edge or a location of a corner of the graphical representation of the volume, wherein receiving at least one user input indicating at least one point in a perimeter or edge of the volume for encompassing the scan target comprises receiving a plurality of user inputs to move the plurality of interactive elements to position the graphical representation of the volume encompassing the scan target.

20. A non-transitory computer readable medium storing instructions executable by one or more processors to cause the one or more processors to perform operations comprising:

presenting, on a display, a user interface including an image of a scan target;

receiving at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target;

generating, in the user interface, a graphical representation of the volume in relation to the image; and

sending information for defining a location of at least a portion of the volume in three-dimensional (3D) space to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

Assignments (2)
SECURITY INTEREST Recorded Dec 5, 2024
From: SKYDIO, INC.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 069516/0452 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2023
From: HENRY, PETER; ZHU, JACK; RICHMAN, BRIAN; ZHENG, HARRISON; MARTIROSYAN, HAYK; DONAHOE, MATTHEW; BACHRACH, ABRAHAM; BRY, ADAM; KENNEDY, RYAN DAVID; MONDAL, HIMEL; DELEPINE, QUENTIN ALLEN WAH YEN
To: SKYDIO, INC.
Reel/Frame 064293/0598 →
Continuity (4)
Continuation 17174583 · Feb 12, 2021
Provisional Application 63050860 · Jul 12, 2020
Provisional Application 62976231 · Feb 13, 2020
Related Publication 20230359205A1 · Nov 9, 2023