IP Library Patent Application 16361013
Patent Application
App. No. 16/361,013

QUADCOPTER ARTIFICIAL INTELLIGENCE CONTROLLER AND QUADCOPTER SIMULATOR

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/361,013
Abstract

An apparatus includes a quadcopter simulator coupled to an Artificial Intelligence (AI) controller. The quadcopter controller is configured to receive quadcopter flight control commands and to generate simulated sensor output and simulated camera output for a plurality of stereoscopic cameras of a simulated quadcopter. The AI controller is configured to receive the simulated sensor and camera output from the quadcopter simulator, determine a flight path for the simulated quadcopter according to the simulated sensor and camera output, generate the quadcopter flight control commands according to the flight path, and provide the quadcopter flight control commands to the quadcopter simulator.

Claims (32)

1 . An apparatus comprising:

a quadcopter simulator configured to receive quadcopter flight control commands and to generate simulated sensor output and simulated camera output for a plurality of stereoscopic cameras of a simulated quadcopter; and

an Artificial Intelligence (Al) controller coupled to the quadcopter simulator, the AI controller configured to receive the simulated sensor output and the simulated camera output for the plurality of stereoscopic cameras from the quadcopter simulator, determine a flight path for the simulated quadcopter according to the simulated sensor output and the simulated camera output, generate the quadcopter flight control commands according to the flight path, and provide the quadcopter flight control commands to the quadcopter simulator.

2 . The apparatus of claim 1 wherein the simulated camera output for a plurality of stereoscopic cameras includes simulated camera output for three stereoscopic cameras, the quadcopter simulator operates on a workstation having three High Definition Multimedia Interface (HDMI) ports, and simulated camera output for each of the three stereoscopic cameras is sent from a corresponding HDMI port.

3 . The apparatus of claim 2 further comprising a converter coupled between the quadcopter simulator and the AI controller, the converter configured to convert the simulated camera output for the plurality of stereoscopic cameras from the quadcopter simulator from HDMI format to Mobile Industry Processor Interface (MIPI) format.

4 . The apparatus of claim 3 wherein the workstation further includes a first Ethernet port, the AI controller includes a second Ethernet port that is coupled to the first Ethernet port by an Ethernet connection that carries simulated sensor output and out of band communication between the AI controller and the workstation.

5 . The apparatus of claim 4 wherein the simulated sensor output is in User Datagram Protocol (UDP) format.

6 . The apparatus of claim 4 wherein the workstation further includes a debugger configured to debug AI code operating on the AI controller, the debugger configured to communicate with the AI code over the Ethernet connection.

7 . The apparatus of claim 4 wherein the workstation and the AI controller are configured to communicate using a private Internet Protocol (IP) address range.

8 . The apparatus of claim 1 further comprising one or more cameras configured to connect to the AI controller for hardware-in-the-loop testing.

9 . The apparatus of claim 1 wherein the AI includes a system-on-chip, non-volatile data storage, volatile memory, and a plurality of connectors.

10 . A method comprising:

generating, in a quadcopter simulator, a plurality of simulated stereoscopic camera views of a simulated environment around a simulated quadcopter having a position and orientation in the simulated environment;

sending the plurality of simulated stereoscopic camera views to a quadcopter Artificial Intelligence (Al) controller that is configured to autonomously pilot a simulated quadcopter according to the plurality of simulated stereoscopic camera views;

determining, by the AI controller, a flight path for the simulated quadcopter according to the plurality of simulated stereoscopic camera views;

generating, in the AI controller, a plurality of flight control commands to pilot the simulated quadcopter along the flight path;

sending the plurality of flight control commands to the quadcopter simulator; and

in the quadcopter simulator, simulating execution of the plurality of flight control commands to obtain updated position and orientation for the simulated quadcopter and repeating generating of simulated stereoscopic camera views for the updated position and orientation in the simulated environment.

11 . The method of claim 10 wherein sending the plurality of simulated stereoscopic camera views to the quadcopter AI controller includes converting High Definition Multimedia Interface (HDMI) format signals from the quadcopter simulator to Mobile Industry Processor Interface (MIPI) signals to provide to the quadcopter AI controller.

12 . The method of claim 10 wherein the plurality of simulated stereoscopic camera views of the simulated environment around a simulated quadcopter include three stereoscopic camera views at different angles with respect to the simulated quadcopter.

13 . The method of claim 10 further comprising, teaching the AI controller to pilot a quadcopter by providing a plurality of simulated environments in the quadcopter simulator and initiating piloting of the simulated quadcopter in the plurality of simulated environments by the Al controller.

14 . The method of claim 10 further comprising, while generating, in the AI controller, the plurality of flight control commands to pilot the simulated quadcopter along the flight path, performing debugging of AI code operating in the AI controller using a debugger, the debugger and the quadcopter simulator operating on a common platform.

15 . The method of claim 14 further comprising, logging simulated execution of the plurality of flight control commands, rewriting the AI code, and comparing logging data from execution of different AI code versions to select an AI code version for deployment.

16 . The method of claim 15 wherein the AI code version for deployment is selected according to fastest time piloting a simulated quadcopter around a simulated quadcopter racecourse.

17 . The method of claim 16 further comprising deploying the AI code version for deployment by loading the AI code for deployment into an AI controller in a real quadcopter and racing the real quadcopter autonomously, under control of the AI controller, around a racecourse.

18 . An apparatus comprising:

a quadcopter simulator configured to receive quadcopter flight control commands and to generate simulated sensor output and simulated camera output for a plurality of stereoscopic cameras of a simulated quadcopter;

an Artificial Intelligence (Al) controller coupled to the quadcopter simulator, the AI controller configured to receive the simulated sensor output and the simulated camera output for the plurality of stereoscopic cameras from the quadcopter simulator, determine a flight path for the simulated quadcopter according to the simulated sensor output and the simulated camera output, generate the quadcopter flight control commands according to the flight path, and provide the quadcopter flight control commands to the quadcopter simulator;

one or more quadcopter hardware components coupled to the AI controller to perform hardware-in-the loop testing, the one or more quadcopter hardware components including at least one of: a sensor, a stereoscopic camera, and a quadcopter motor; and

a debugger coupled to the quadcopter simulator and the AI controller, the debugger coupled to perform debugging of AI code of the AI controller while the AI controller generates the quadcopter flight control commands.

19 . The apparatus of claim 18 further comprising a workstation, the quadcopter simulator and the debugger operating on the workstation, the workstation coupled to the AI controller by an Ethernet connection and by a plurality of camera connections.

20 . The apparatus of claim 19 wherein the plurality of camera connections include three High Definition Multimedia Interface (HDMI) outputs from the workstation, each carrying simulated camera output for two cameras forming a stereoscopic camera, a plurality of HDMI to Mobile Industry Processor Interface (MIPI) converters, and a plurality of MIPI inputs to the AI controller.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Oct 7, 2025
From: RSE VENTURES, LLC, AS COLLATERAL AGENT
To: PDW HOLDINGS, INC.; PERFORMANCE DRONE WORKS, LLC
Reel/Frame 072496/0680 →
SECURITY INTEREST Recorded Aug 27, 2021
From: PDW HOLDINGS, INC.; PERFORMANCE DRONE WORKS LLC
To: RSE VENTURES, LLC
Reel/Frame 057316/0253 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2020
From: DRONE RACING LEAGUE, INC.
To: PERFORMANCE DRONE WORKS LLC
Reel/Frame 054008/0100 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2019
From: RESTIFO, JORDAN; SKARICA, VEDRAN; MILLER, CHRIS
To: DRONE RACING LEAGUE, INC.
Reel/Frame 048782/0627 →