IP Library Granted Patent US 11,960,284
Granted Patent B2
US 11,960,284 · App. 18/096,238 · Granted Apr 16, 2024

Multipoint cable cam system and method

Inventors: William Silva (San Francisco, CA); Vikrant More (San Mateo, CA); Ashwani Arya (Encinitas, CA); Mehran Ferdowsi (Foster City, CA); Stephen Yui (Pacifica, CA)
Assignee: GoPro, Inc.
G05D1/0202B64C39/024B64D47/08G05D1/0094B64U10/13B64U30/20B64U2201/20G01S19/48H04N23/661H04N23/685
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,960,284
App. No.
18/096,238
Granted
Apr 16, 2024
Kind
B2
Abstract

This disclosure describes a method of controlling an unmanned aerial vehicle (UAV). The steps of controlling include acquiring images with an image capture device of an unmanned aerial vehicle (UAV). The steps include analyzing the images to determine navigation information of the UAV with a vision-based navigation system. The steps include tracking a position of the UAV with the vision-based navigation system. The steps include controlling rotors of the UAV to prevent deviations in movement from a desired flight path or position of the UAV. The steps include limiting travel or flight of the UAV to a physical region determined by the desired flight path.

Claims (47)

1. A method, comprising:

acquiring images with an image capture device of an unmanned aerial vehicle (UAV);

analyzing the images to determine navigation information of the UAV with a vision-based navigation system;

tracking a position of the UAV with the vision-based navigation system;

controlling rotors of the UAV to prevent deviations in movement from a desired flight path or position of the UAV; and

limiting travel or flight of the UAV to a physical region determined by the desired flight path.

2. The method of claim 1 , wherein the navigation information of the UAV includes position, velocity, orientation, or orientation rate.

3. The method of claim 1 , wherein the desired flight path is a flight path determined by a user-defined input.

4. The method of claim 1 , further comprising:

implementing the vision-based navigation system when a GPS system of the UAV is inoperable or unreliable.

5. The method of claim 4 , wherein the GPS system includes stored GPS data that is obtained from a publicly available GPS data source.

6. The method of claim 1 , further comprising:

recognizing, with the vision-based navigation system, a path, trail, road, waterway, building, or other geographic elements.

7. The method of claim 6 , further comprising:

dynamically updating a flight trajectory and the position of the UAV with the vision-based navigation system based upon the path, the trail, the road, the waterway, the building, or the other geographic elements recognized by the vision-based navigation system.

8. The method of claim 1 , further comprising:

providing inputs and outputs, with the vision-based navigation system, to the rotors, a movement mechanism, a remoter controller, or metadata sources.

9. A method, comprising:

generating waypoints associated with an unmanned aerial vehicle (UAV);

creating a flight trajectory based upon user-defined keyframes;

recording keyframes of the user-defined keyframes;

recording images as the UAV travels between the waypoints; and

generating a virtual cable that is smooth and continuous by stitching a position of the UAV and the keyframes in an order that were defined by the user-defined keyframes so that smooth, continuous, cinematic footage is recorded.

10. The method of claim 9 , further comprising:

maintaining a safe cable traversal speed as the UAV travels along the virtual cable.

11. The method of claim 10 , wherein the safe cable traversal speed is maintained regardless of a trajectory geometry generated by the user-defined keyframes.

12. The method of claim 9 , further comprising:

blending camera transitions between the user-defined keyframes.

13. The method of claim 9 , wherein the keyframes are a target subject material.

14. The method of claim 13 , comprising:

generating a spline-based flight path and the flight trajectory of the UAV based upon the user-defined keyframes.

15. A method, comprising:

generating waypoints based upon stored GPS data;

generating a flight path based upon the waypoints;

storing the flight path;

transmitting the flight path to an unmanned aerial vehicle (UAV);

flying the UAV along the flight path; and

capturing images or videos at the waypoints to generate captured images.

16. The method of claim 15 , wherein a software application performs operations comprising:

positioning a movement mechanism of the UAV;

controlling the capturing of the images or the videos; and/or

displaying the captured images or the videos.

17. The method of claim 16 , wherein the software application is located on a remote controller.

18. The method of claim 16 , wherein the software application is configured to enable a user to create short video clips, perform full remote control of an imaging device of the UAV, or wirelessly control software of an image capture device.

19. The method of claim 16 , wherein the software application is connected to a cloud service so that the software application is configured to upload the images or the video to the cloud service.

20. The method of claim 15 , further comprising:

smoothing corners at the waypoints so that a curvature is formed along segments between the waypoints.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2023
From: SILVA, WILLIAM; MORE, VIKRANT; ARYA, ASHWANI; FERDOWSI, MEHRAN; YUI, STEPHEN
To: GOPRO, INC.
Reel/Frame 062360/0529 →
Continuity (4)
Continuation 17521541 · Nov 8, 2021
Continuation 15906716 · Feb 27, 2018
Provisional Application 62564426 · Sep 28, 2017
Related Publication 20230168676A1 · Jun 1, 2023