IP Library Granted Patent US 10,317,915
Granted Patent B2
US 10,317,915 · App. 15/445,464 · Granted Jun 11, 2019

Autonomous tracking based on radius

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,317,915
App. No.
15/445,464
Granted
Jun 11, 2019
Kind
B2
Abstract

Disclosed is a configuration of an autonomous vehicle for autonomously following a moving subject based on a radius of a virtual sphere surrounding the autonomous vehicle. The autonomous vehicle may be an unmanned ground vehicle or an unmanned aerial vehicle, which autonomously follows the subject (e.g., a device, a live entity, or any object) based on the virtual sphere. The radius of the virtual sphere may be dynamically configured according to a velocity of the autonomous vehicle or configurations of a camera coupled to the autonomous vehicle. Accordingly, the autonomous vehicle can follow the subject along a smooth trajectory, and capture images of abrupt movements of the subject in a cinematically pleasing manner.

Claims (39)

1. A vehicle comprising:

a body;

a camera coupled to the body, the camera configured to capture an image of a subject;

a radius tracking controller coupled to the body, the radius tracking controller configured to:

determine a radius of a virtual sphere around the vehicle based on a configuration of the camera, and

determine an updated target position of the vehicle based on a comparison between (i) a distance between a vehicle position of the vehicle and a previous target position of the vehicle and (ii) the radius; and

a vehicle controller interface module coupled to the body, the vehicle controller interface module configured to move the vehicle towards the updated target position of the vehicle.

2. The vehicle of claim 1 , wherein the configuration of the camera includes at least one of an orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

3. The vehicle of claim 1 , wherein the radius tracking controller is further configured to set the previous target position of the vehicle to be the updated target position of the vehicle in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is larger than the radius.

4. The vehicle of claim 1 , wherein the radius tracking controller is further configured to determine an intersection between (i) a path between the previous target position of the vehicle and a subject position of the subject, and (ii) a surface of the virtual sphere surrounding the vehicle with the radius in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is less than the radius.

5. The vehicle of claim 4 , further comprising:

a subject position estimation subsystem coupled to the body, the subject position estimation subsystem configured to estimate the subject position, and provide the estimated subject position to the radius tracking controller.

6. The vehicle of claim 4 , further comprising:

a communication subsystem coupled to the body, the communication subsystem configured to receive information describing the subject position, and provide the subject position to the radius tracking controller.

7. The vehicle of claim 1 , further comprising:

a telemetric subsystem coupled to the body, the telemetric subsystem configured to determine the vehicle position and to provide the vehicle position to the radius tracking controller.

8. The vehicle of claim 1 , wherein the radius tracking controller is further configured to determine a pitch and a heading of the camera to face an anticipated position of the subject based on the updated target position of the vehicle, wherein the vehicle further comprises a gimbal controller securing the camera, the gimbal controller configured to situate the camera according to the determined pitch and the heading.

9. A method of following a subject comprising:

determining a radius of a virtual sphere around a vehicle based on a configuration of a camera coupled to the vehicle, and

determining an updated target position of the vehicle based on a comparison between (i) a distance between a vehicle position of the vehicle and a previous target position of the vehicle and (ii) the radius; and

moving the vehicle towards the updated target position of the vehicle.

10. The method of claim 9 , wherein the configuration of the camera includes at least one of an orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

11. The method of claim 9 , further comprising:

setting the previous target position of the vehicle to be the updated target position of the vehicle in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is larger than the radius.

12. The method of claim 9 , further comprising:

determining an intersection between (i) a path between the previous target position of the vehicle and a subject position of the subject, and (ii) a surface of the virtual sphere surrounding the vehicle with the radius in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is less than the radius.

13. The method of claim 9 , further comprising:

determining a pitch and a heading of the camera to face an anticipated position of the subject based on the updated target position of the vehicle; and

situating the camera according to the determined pitch and the heading.

14. A vehicle comprising:

a body;

a radius tracking controller coupled to the body, the radius tracking controller configured to:

determine a radius of a virtual sphere around the vehicle based on a velocity of the vehicle, and

determine an updated target position of the vehicle based on a comparison between (i) a distance between a vehicle position of the vehicle and a previous target position of the vehicle and (ii) the radius; and

a vehicle controller interface module coupled to the body, the vehicle controller interface module configured to move the vehicle towards the updated target position of the vehicle.

15. The vehicle of claim 14 , further comprising a gimbal configured to secure a camera, wherein the radius is determined further based on a configuration of the camera.

16. The vehicle of claim 15 , wherein the configuration of the camera includes at least one of an orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

17. The vehicle of claim 14 , wherein the radius tracking controller is further configured to set the previous target position of the vehicle to be the updated target position of the vehicle in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is larger than the radius.

18. The vehicle of claim 14 , wherein the radius tracking controller is further configured to determine an intersection between (i) a path between the previous target position of the vehicle and a subject position of the subject, and (ii) a surface of the virtual sphere surrounding the vehicle with the radius in response to the determination that the distance between the vehicle position and the previous target position of the vehicle is less than the radius.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2017
From: TANKERSLEY, BENJAMIN
To: GOPRO, INC.
Reel/Frame 041404/0821 →