IP Library › Granted Patent US 9,615,014
Granted Patent B2
US 9,615,014 · App. 14/338,847 · Granted Apr 4, 2017

Portable device controlling unmanned aerial vehicle and method of controlling therefor

Inventors: Jihwan Kim (Seoul, KR); Kihyung Kim (Seoul, KR); Sihwa Park (Seoul, KR); Kichu Hong (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N5/23203G06F3/013G06F3/0488G06F3/04815H04N5/2251H04N5/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,615,014
App. No.
14/338,847
Granted
Apr 4, 2017
Kind
B2
Abstract

The present specification relates to a portable device controlling an unmanned aerial vehicle and a method of controlling therefor. According to one embodiment, a method of controlling a portable device controlling an unmanned aerial vehicle capturing an image includes the steps of obtaining first image information of a target object using a camera unit, transmitting a capture control signal controlling image capture for the target object to the unmanned aerial vehicle, receiving second image information of the target object captured based on the capture control signal from the unmanned aerial vehicle and generating a 3D image corresponding to the target object using the first image information and the second image information.

Claims (56)

1. A portable device controlling an unmanned aerial vehicle capturing an image, comprising:

a camera unit configured to capture a target object;

a display unit configured to display visual information;

a communication unit configured to communicate with the unmanned aerial vehicle (UAV); and

a processor configured to control the camera unit, the display unit and the communication unit,

wherein the processor is further configured to:

obtain first image information of the target object using the camera unit,

transmit a capture control signal controlling image capture for the target object to the unmanned aerial vehicle,

receive second image information of the target object captured based on the capture control signal from the unmanned aerial vehicle,

generate a 3D image corresponding to the target object using the first image information and the second image information.

2. The portable device of claim 1 , wherein the capture control signal comprises at least one selected from a group consisting of flight path information of the unmanned aerial vehicle, flight time information, capture location information and capture speed information.

3. The portable device of claim 1 , wherein the processor is further configured to set the capture control signal based on location information of the portable device at a time point of capturing the target object.

4. The portable device of claim 1 , wherein the first image information comprises a first image of the target object captured in a first location by the portable device.

5. The portable device of claim 4 , wherein the second image information comprises a second image of the target object captured in a second location by the unmanned aerial vehicle, and

wherein the second location is different from the first location.

6. The portable device of claim 5 , wherein the second image corresponds to an image of the target object captured based on the capture control signal while the unmanned aerial vehicle is flying according to a flight path.

7. The portable device of claim 1 , wherein the processor is further configured to set the capture control signal based on an object property of the target object.

8. The portable device of claim 7 , wherein the object property comprises at least one of a shape and a size of the target object.

9. The portable device of claim 1 , further comprising a sensor unit configured to detect a touch input of a user, and to deliver the detected touch input to the processor.

10. The portable device of claim 9 , wherein the processor is further configured to:

display the captured target object using the display unit,

select the target object based on the touch input touching the displayed target object, and

transmit the capture control signal for the selected target object to the unmanned aerial vehicle.

11. The portable device of claim 1 , further comprising a sensor unit configured to detect a gaze position of a user, and to deliver the detected gaze position of the user to the processor.

12. The portable device of claim 11 , wherein the processor is further configured to:

display the captured target object using the display unit,

select the target object when the gaze position of the user is detected in a point in which the target object is displayed, and

transmit the capture control signal for the selected target object to the unmanned aerial vehicle.

13. The portable device of claim 1 , wherein the processor is further configured to:

execute a 3D capture mode, and

transmit the capture control signal for the target object to the unmanned aerial vehicle when the target object is selected in a state in which the 3D capture mode is executed.

14. The portable device of claim 1 , wherein the processor is further configured to display an image loading a bar representing a progress of generating the 3D image when the 3D image of the target object is generated.

15. The portable device of claim 14 , wherein the processor is further configured to:

receive capture progress information from the unmanned aerial vehicle, and

display the image loading bar based on the capture progress information.

16. The portable device of claim 1 , wherein the processor is further configured to:

select a recapture area from the generated 3D image,

transmit a recapture control signal for the selected recapture area to the unmanned aerial vehicle,

receive image update information for the captured target object from the unmanned aerial vehicle based on the recapture control signal, and

update the 3D image based on the received image update information.

17. The portable device of claim 1 , wherein the processor is further configured to:

transmit a sub-capture control signal controlling image capture for the selected target object to a sub-unmanned aerial vehicle,

receive third image information of the target object captured by the sub-unmanned aerial vehicle based on the sub-capture control signal, and

generate a 3D image corresponding to the target object using the first image information, the second image information and the third image information.

18. The portable device of claim 1 , wherein the processor is further configured to:

capture a first surrounding image containing the target object using the camera unit, and

obtain the first image information of the target object from the captured first surrounding image.

19. The portable device of claim 18 , wherein the processor is further configured to:

capture a second surrounding image containing the target object using the camera unit,

obtain third image information of the target object from the captured second surrounding image, and

generate a 3D image corresponding to the target object further using the first image information, the second image information and the third image information.

20. A method of controlling a portable device controlling an unmanned aerial vehicle capturing an image, comprising the steps of:

obtaining first image information of a target object using a camera unit;

transmitting a capture control signal controlling image capture for the target object to the unmanned aerial vehicle;

receiving second image information of the target object captured based on the capture control signal from the unmanned aerial vehicle; and

generating a 3D image corresponding to the target object using the first image information and the second image information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2014
From: KIM, JIHWAN; KIM, KIHYUNG; PARK, SIHWA; HONG, KICHU
To: LG ELECTRONICS INC.
Reel/Frame 033382/0395 →
Priority Claims (1)
KR 10-2014-0061515 · May 22, 2014 · national
Continuity (1)
Related Publication 20150341540A1 · Nov 26, 2015