IP Library Granted Patent US 10,587,790
Granted Patent B2
US 10,587,790 · App. 15/957,749 · Granted Mar 10, 2020

Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle

Inventors: Jialun Li (Shenzhen, CN); Kaifeng Li (Shenzhen, CN); Jing Ning (Shenzhen, CN)
Assignee: Tencent Technology (Shenzhen) Company Limited
H04N5/23206B64C39/024G05D1/0011G05D1/0016G05D1/0022G05D1/0038G05D1/0094G05D1/10G05D1/101G06F3/0416G06F3/0488G06F3/04845G08C17/02H04N5/23212H04N5/23216H04N5/23245H04N5/23293H04N5/23296H04N5/23299H04N5/232061H04W76/14B64C27/08B64C2201/127B64C2201/146G06F1/1694G06F3/04883G08C2201/30G08C2201/32G08C2201/91G08C2201/93H04N1/00127H04N1/00251H04N1/00307H04N1/00411H04N1/00424H04N1/00435H04N1/00482H04N2201/0013H04N2201/0055H04N2201/0096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,587,790
App. No.
15/957,749
Granted
Mar 10, 2020
Kind
B2
Abstract

A method for controlling photography using an unmanned aerial vehicle (UAV) is performed by a mobile terminal. After obtaining a photographing start command, the photographing start command being associated with a photographic sample, the mobile terminal generates a combined operation command according to the photographic sample. The combined operation command may include one or more flight parameters of the UAV. Next, the mobile terminal establishes a wireless connection with the UAV and then sends the combined operation command to the UAV via the wireless connection. The UAV then performs a corresponding series of actions sequentially according to the combined operation command to capture an image.

Claims (45)

1. A method for controlling photography using an unmanned aerial vehicle (UAV) performed by a mobile terminal, the mobile terminal having one or more processors and memory for storing a plurality of instructions to be executed by the one or more processors, the method comprising:

obtaining a plurality of sample photos of a sample object selected by a user;

processing the plurality of sample photos to extract (1) location parameters and (2) camera parameters for shooting the plurality of sample photos of the sample object;

calculating operation parameters of the UAV while taking the sample photos of the sample object, wherein the operation parameters are calculated based on the location parameters;

generating a combined operation command based on (1) the camera parameters of the camera and (2) the operation parameters of the UAV, wherein the combined operation command is used for autonomously operating the UAV and the camera onboard the UAV to perform a series of actions in a predetermined sequence to take photos similar to the sample photos;

obtaining a photographing start command to take photos of an object using the camera onboard the UAV in accordance with a user selection of an automatic photographing mode without a locked target displayed on the mobile terminal;

automatically updating the combined operation command in accordance with a comparison between a current state of the UAV and the operation parameters of the UAV obtained from the sample photos associated with the sample object; and

sending the updated combined operation command to the UAV via a wireless connection between the UAV and the mobile terminal, wherein the UAV is configured to sequentially perform the series of actions in the predetermined sequence according to the combined operation command to capture one or more images of the object,

wherein, the UAV is configured to acquire one or more preset flight parameters and one or more preset photographing parameters from the combined operation command and fly along a preset flight trajectory and capture an image according to the one or more preset photographing parameters according to the one or more preset flight parameters after the UAV flies to a geographical location corresponding to the photographic sample.

2. The method according to claim 1 , wherein the series of actions comprises at least one of a UAV flight action, a photographing view adjustment action, and a photographing parameter adjustment action.

3. The method according to claim 1 , wherein, when an automatic photographing mode with a locked target displayed on the mobile terminal is selected, the UAV is configured to acquire a locked target, a preset flight parameter, and a preset photographing parameter from the combined operation command, so as to keep the locked target in a photographing view, adjust, according to the preset flight parameter, a spatial location of the UAV relative to the locked target to fly, and capture an image according to the photographing parameter in flight.

4. The method according to claim 1 , wherein, when the automatic photographing mode without a locked target displayed on the mobile terminal is selected, while the UAV is controlled according to the one or more preset flight parameters to fly along a preset flight trajectory, the UAV is configured to capture an image according to the preset photographing parameters.

5. The method according to claim 1 , wherein the instruction for generating a combined operation command further comprises:

associating the combined operation command with a preset automatic photographing mode; and

storing the combined operation command and the preset automatic photographing mode in the memory.

6. A mobile terminal comprising:

one or more processors;

memory; and

a plurality of computer readable instructions stored in the memory, wherein the computer readable instructions, when executed by the one or more processors, cause the one or more processors to perform the following steps:

obtaining a plurality of sample photos of a sample object selected by a user;

processing the plurality of sample photos to extract (1) location parameters and (2) camera parameters for shooting the plurality of sample photos of the sample object;

calculating operation parameters of the UAV while taking the sample photos of the sample object, wherein the operation parameters are calculated based on the location parameters;

generating a combined operation command based on (1) the camera parameters of the camera and (2) the operation parameters of the UAV, wherein the combined operation command is used for autonomously operating the UAV and the camera onboard the UAV to perform a series of actions in a predetermined sequence to take photos similar to the sample photos;

obtaining a photographing start command to take photos of an object using the camera onboard the UAV in accordance with a user selection of an automatic photographing mode without a locked target displayed on the mobile terminal;

automatically updating the combined operation command in accordance with a comparison between a current state of the UAV and the operation parameters of the UAV obtained from the sample photos associated with the sample object; and

sending the updated combined operation command to the UAV via a wireless connection between the UAV and the mobile terminal, wherein the UAV is configured to sequentially perform the series of actions in the predetermined sequence according to the combined operation command to capture one or more images of the object,

wherein, the UAV is configured to acquire one or more preset flight parameters and one or more preset photographing parameters from the combined operation command and fly along a preset flight trajectory and capture an image according to the one or more preset photographing parameters according to the one or more preset flight parameters after the UAV flies to a geographical location corresponding to the photographic sample.

7. The mobile terminal according to claim 6 , wherein the series of actions comprises at least one of a UAV flight action, a photographing view adjustment action, and a photographing parameter adjustment action.

8. The mobile terminal according to claim 6 , wherein, when an automatic photographing mode with a locked target displayed on the mobile terminal is selected, the UAV is configured to acquire a locked target, a preset flight parameter, and a preset photographing parameter from the combined operation command, so as to keep the locked target in a photographing view, adjust, according to the preset flight parameter, a spatial location of the UAV relative to the locked target to fly, and capture an image according to the photographing parameter in flight.

9. The mobile terminal according to claim 6 , wherein, when the automatic photographing mode without a locked target displayed on the mobile terminal is selected, while the UAV is controlled according to the one or more preset flight parameters to fly along a preset flight trajectory, the UAV is configured to capture an image according to the preset photographing parameters.

10. The mobile terminal according to claim 6 , wherein the step of generating a combined operation command further comprises:

associating the combined operation command with a corresponding preset automatic photographing mode; and

storing the combined operation command and the preset automatic photographing mode in the memory.

11. A non-transitory computer-readable storage medium storing instructions, the instructions, when executed by a mobile terminal having one or more processors, cause the one or more processors to perform a plurality of operations including:

obtaining a plurality of sample photos of a sample object selected by a user;

processing the plurality of sample photos to extract (1) location parameters and (2) camera parameters for shooting the plurality of sample photos of the sample object;

calculating operation parameters of the UAV while taking the sample photos of the sample object, wherein the operation parameters are calculated based on the location parameters;

generating a combined operation command based on (1) the camera parameters of the camera and (2) the operation parameters of the UAV, wherein the combined operation command is used for autonomously operating the UAV and the camera onboard the UAV to perform a series of actions in a predetermined sequence to take photos similar to the sample photos;

obtaining a photographing start command to take photos of an object using the camera onboard the UAV in accordance with a user selection of an automatic photographing mode without a locked target displayed on the mobile terminal;

automatically updating the combined operation command in accordance with a comparison between a current state of the UAV and the operation parameters of the UAV obtained from the sample photos associated with the sample object; and

sending the updated combined operation command to the UAV via a wireless connection between the UAV and the mobile terminal, wherein the UAV is configured to sequentially perform the series of actions in the predetermined sequence according to the combined operation command to capture one or more images of the object,

wherein, the UAV is configured to acquire one or more preset flight parameters and one or more preset photographing parameters from the combined operation command and fly along a preset flight trajectory and capture an image according to the one or more preset photographing parameters according to the one or more preset flight parameters after the UAV flies to a geographical location corresponding to the photographic sample.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the series of actions comprises at least one of a UAV flight action, a photographing view adjustment action, and a photographing parameter adjustment action.

13. The non-transitory computer-readable storage medium according to claim 11 , wherein, when an automatic photographing mode with a locked target displayed on the mobile terminal is selected, the UAV is configured to acquire a locked target, a preset flight parameter, and a preset photographing parameter from the combined operation command, so as to keep the locked target in a photographing view, adjust, according to the preset flight parameter, a spatial location of the UAV relative to the locked target to fly, and capture an image according to the photographing parameter in flight.

14. The non-transitory computer-readable storage medium according to claim 11 , wherein, when the automatic photographing mode without a locked target displayed on the mobile terminal is selected, while the UAV is controlled according to the one or more preset flight parameters to fly along a preset flight trajectory, the UAV is configured to capture an image according to the preset photographing parameters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2018
From: LI, JIALUN; LI, KAIFENG; NING, JING
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 046852/0380 →
Priority Claims (4)
CN 2015 1 0741059 · Nov 4, 2015 · national
CN 2015 1 0741750 · Nov 4, 2015 · national
CN 2015 1 0919245 · Dec 10, 2015 · national
CN 2015 1 0981628 · Dec 23, 2015 · national
Continuity (5)
Continuation In Part PCTCN2016084973 · Jun 6, 2016
Continuation In Part PCTCN2016083287 · May 25, 2016
Continuation In Part PCTCN2016082925 · May 20, 2016
Continuation In Part PCTCN2016082610 · May 19, 2016
Related Publication 20180241931A1 · Aug 23, 2018