IP Library Granted Patent US 12,024,276
Granted Patent B2
US 12,024,276 · App. 16/973,153 · Granted Jul 2, 2024

Control device and control method for controlling flight of aerial vehicle

Inventors: Mitsuru Nakazawa (Tokyo, JP); Jun Takizawa (Chino, TW)
Assignee: Rakuten Group, Inc.
B64C13/18B64C39/024B64D47/08G05D1/0816G05D1/0858G05D1/102B64U2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,024,276
App. No.
16/973,153
Granted
Jul 2, 2024
Kind
B2
Abstract

A first attitude estimation unit 16 estimates an attitude of an UAV 1 by performing a Visual-SLAM on the basis of detection values detected by an imaging unit 14 , and a second attitude estimation unit 17 estimates an attitude of the UAV 1 on the basis of detection values detected by a rotation angle detection unit 15 . And then a control unit 18 controls the attitude of the UAV 1 by utilizing a first attitude estimation result from the first attitude estimation unit 16 and a second attitude estimation result from the second attitude estimation unit 17 at a ratio based on positional information of the UAV 1.

Claims (21)

1. A control device that controls flight of an aerial vehicle including an optical sensor and at least one type of a triaxial sensor, the control device comprising:

at least one memory configured to store program code; and at least one processor configured to access the program code and operate as instructed by the program code, the program code including:

first acquisition code configured to cause the at least one processor to acquire a first detection value detected by the optical sensor;

second acquisition code configured to cause the at least one processor to acquire a second detection value detected by the triaxial sensor;

first attitude estimation code configured to cause the at least one processor to estimate an attitude of the aerial vehicle based on the first detection value;

second attitude estimation code configured to cause the at least one processor to estimate an attitude of the aerial vehicle based on the second detection value; and

flight control code configured to cause the at least one processor to control flight of the aerial vehicle,

wherein the flight control code causes the at least one processor to utilize at least the result of the attitude estimation by the first attitude estimation code in a case where a deviation amount between the result of the attitude estimation by the first attitude estimation code and the result of the attitude estimation by the second attitude estimation code is a threshold value or more, and the flight control code causes the at least one processor to utilize the result of the attitude estimation by the second attitude estimation code in a case where the deviation amount is less than the threshold value.

2. The control device according to claim 1 , the program code further including distance calculation code configured to cause the at least one processor to calculate a distance from a takeoff point of the aerial vehicle on the basis of positional information, wherein the flight control code causes the at least one processor to utilize the result of the attitude estimation by the first attitude estimation code and the result of the attitude estimation by the second attitude estimation code at a ratio based on the distance.

3. The control device according to claim 2 , wherein the flight control code causes the at least one processor to utilize at least the result of the attitude estimation by the first attitude estimation code until the aerial vehicle reaches a predetermined distance after taking off, and the flight control code causes the at least one processor to utilize the result of the attitude estimation by the second attitude estimation code after the aerial vehicle has reached the predetermined distance.

4. The control device according to claim 1 , wherein the flight control code causes the at least one processor to utilize the result of the attitude estimation by the first attitude estimation code when the aerial vehicle is located inside a predetermined area, and the flight control code causes the at least one processor to utilizes the result of the attitude estimation by the second attitude estimation code when the aerial vehicle is located outside the predetermined area.

5. A control device that controls flight of an aerial vehicle including an optical sensor and at least one type of a triaxial sensor, the control device comprising:

at least one memory configured to store program code; and at least one processor configured to access the program code and operate as instructed by the program code, the program code including:

first acquisition code configured to cause the at least one processor to acquire a first detection value detected by the optical sensor;

second acquisition code configured to cause the at least one processor to acquire a second detection value detected by the triaxial sensor;

first attitude estimation code configured to cause the at least one processor to estimate an attitude of the aerial vehicle based on the first detection value;

second attitude estimation code configured to cause the at least one processor to estimate an attitude of the aerial vehicle based on the second detection value; and

flight control code configured to cause the at least one processor to control flight of the aerial vehicle,

wherein the triaxial sensor includes a geomagnetic sensor,

wherein the program code further comprises calibration code configured to cause the at least one processor to calibrate a reference azimuth to a true value before takeoff of the aerial vehicle, and

wherein the flight control code causes the at least one processor to utilize at least the result of the attitude estimation by the first attitude estimation code in a case where a deviation amount between the true value and a value indicating the reference azimuth detected by the geomagnetic sensor is a threshold value or more, and the flight control code causes the at least one processor to utilize the result of the attitude estimation by the second attitude estimation code in a case where the deviation amount is less than the threshold value.

Assignments (2)
CHANGE OF NAME Recorded Jul 9, 2021
From: RAKUTEN INC
To: RAKUTEN GROUP INC
Reel/Frame 056816/0068 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2020
From: NAKAZAWA, MITSURU; TAKIZAWA, JUN
To: RAKUTEN, INC.
Reel/Frame 054580/0808 →