IP Library Granted Patent US 10,104,300
Granted Patent B2
US 10,104,300 · App. 15/348,549 · Granted Oct 16, 2018

System and method for supporting photography with different effects

Inventors: Zhuo Guo (Hong Kong, CN); Guanhua Su (Shenzhen, CN); Ye Tao (Shenzhen, CN); Zisheng Cao (Shenzhen, CN); Linchao Bao (Shenzhen, CN); Mingyu Wang (Shenzhen, CN)
Assignee: SZ DJI OSMO TECHNOLOGY CO., LTD.
H04N5/23296G06K9/32G06T7/246G06T7/73G08B13/1963G08B13/19608H04N5/232H04N5/23293G06T7/70G06T2207/10016G08B13/19689
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,104,300
App. No.
15/348,549
Filed
Nov 10, 2016
Granted
Oct 16, 2018
Kind
B2
Examiner
PHAM, QUAN L
Art Unit
2662
USPC
348/222.1
Abstract

System and method can support photography. A controller can configure a carrier to move an imaging device along a moving path. Furthermore, the controller can apply a time-dependent configuration on the imaging device, and use the imaging device for capturing a set of image frames along the moving path based on the one or more time-dependent parameters.

Claims (96)

1. A method for supporting photography, comprising:

acquiring a target in an image view based on one or more images that are captured by an imaging device associated with a carrier;

obtaining characterization information of the target as indicated in said one or more images;

determining a moving path having at least two sections for tracking the target with the imaging device;

determining a corresponding speed for each section of the moving path;

directing the carrier to move the imaging device, at the corresponding speeds, along each of the at least two sections of the moving path to track the target based on the obtained characterization information of the target; and

capturing one or more images using the imaging device along the moving path based on a time-dependent configuration of the imaging device.

2. The method of claim 1 , further comprising:

receiving, from an application, one or more signals to configure the imaging device and the carrier, wherein the application provides a user interface via a display on a terminal.

3. The method of claim 1 , further comprising:

displaying the image view on a terminal that operates to receive one or more signals from the imaging device.

4. The method of claim 3 , wherein:

said one or more signals contains real-time images that are captured by the imaging device.

5. The method of claim 3 , further comprising:

allowing a user to designate the target in the image view that is displayed on the terminal.

6. The method of claim 5 , further comprising:

receiving information that is indicative of a position of the target in the image view based on said one or more images.

7. The method of claim 1 , further comprising:

determining a position of the target in the image view as the target moves, and

detecting whether the target is outside a designated area in the image view.

8. The method of claim 7 , wherein:

the designated area in the image view is configurable.

9. The method of claim 8 , wherein:

the designated area in the image view is in a rectangular shape with an up boundary, a down boundary, a left boundary and a right boundary.

10. The method of claim 7 , wherein:

the carrier includes a gimbal that operates to rotate about one or more axes to maintain the target within the designated area in the image view.

11. The method of claim 10 , further comprising:

directing the carrier to rotate about a yaw axis when the target moves outside a left or a right boundary of the designated area; and

directing the carrier to rotate about a pitch axis when the target moves outside an up or a down boundary of the designated area.

12. The method of claim 1 , further comprising:

receiving one or more signals to switch target.

13. The method of claim 12 , further comprising:

directing the carrier to move the imaging device tracking another target based on obtained characterization information of the another target.

14. The method of claim 1 , further comprising:

capturing one or more images and/or recording a video of the target while tracking the target.

15. The method of claim 1 , wherein the carrier includes a gimbal that operates to rotate the imaging device around one or more axes, the rotating causing the imaging device to move along the at least two sections of the moving path at the corresponding speeds.

16. The method of claim 1 , wherein the carrier couples the imaging device to a portable device.

17. The method of claim 16 , wherein the portable device includes one or more mechanisms for moving a gimbal along the at least two sections of the moving path at the corresponding speeds.

18. A system for supporting photography, comprising:

one or more microprocessors; and

a controller running on the one or more microprocessors, wherein the controller operates to:

acquire a target in an image view based on one or more images that are captured by an imaging device associated with a carrier;

obtain characterization information of the target as indicated in said one or more images;

determine a moving path having at least two sections for tracking the target with the imaging device;

determine a corresponding speed for each section of the moving path;

direct the carrier to move the imaging device, at the corresponding speeds, along each of the at least two sections of the moving path to track the target based on the obtained characterization information of the target; and

capture one or more images using the imaging device along the moving path based on a time-dependent configuration of the imaging device.

19. The system of claim 18 , wherein:

the controller operates to receive, from an application, one or more signals to configure the imaging device and the carrier, wherein the application provides a user interface via a display on a terminal.

20. The system of claim 18 , wherein:

the controller operates to display the image view on a terminal that operates to receive one or more signals from the imaging device.

21. The system of claim 20 , wherein:

said one or more signals contains real-time images that are captured by the imaging device.

22. The system of claim 20 , wherein:

a user is allowed to designate the target in the image view that is displayed on the terminal.

23. The system of claim 22 , further comprising:

the controller operates to receive information that is indicative of a position of the target in the image view based on said one or more images.

24. The system of claim 18 , wherein:

the controller operates to

determine a position of the target in the image view as the target moves, and

detect whether the target is outside a designated area in the image view.

25. The system of claim 24 , wherein:

the designated area in the image view is configurable.

26. The system of claim 25 , wherein:

the designated area in the image view is in a rectangular shape with an up boundary, a down boundary, a left boundary and a right boundary.

27. The system of claim 24 , wherein:

the carrier includes a gimbal that operates to rotate about one or more axes to maintain the target within the designated area in the image view.

28. The system of claim 27 , wherein:

the controller operates to

direct the carrier to rotate about a yaw axis when the target moves outside a left or a right boundary of the designated area; and

direct the carrier to rotate about a pitch axis when the target moves outside an up or a down boundary of the designated area.

29. The system of claim 18 , wherein:

the controller operates to receive one or more signals to switch to another target.

30. The system of claim 29 , wherein:

the controller operates to direct the carrier to move the imaging device tracking said another target based on obtained characterization information of said another target.

31. The system of claim 18 , wherein:

the controller operates to capture one or more images and/or recording a video of the target while tracking the target.

32. The system of claim 18 , wherein the carrier includes a gimbal that operates to rotate the imaging device around one or more axes, the rotating causing the imaging device to move along the at least two sections of the moving path at the corresponding speeds.

33. The system of claim 18 , wherein the carrier couples the imaging device to a portable device.

34. The system of claim 33 , wherein the portable device includes one or more mechanisms for moving a gimbal along the at least two sections of the moving path at the corresponding speeds.

35. A non-transitory computer-readable medium with instructions stored thereon, that when executed by a processor, perform the steps comprising:

acquiring a target in an image view based on one or more images that are captured by an imaging device associated with a carrier;

obtaining characterization information of the target as indicated in said one or more images;

determining a moving path having at least two sections for tracking the target with the imaging device;

determining a corresponding speed for each section of the moving path;

directing the carrier to move the imaging device, at the corresponding speeds, along each of the at least two sections of the moving path to track the target based on the obtained characterization information of the target; and

capturing one or more images using the imaging device along the moving path based on a time-dependent configuration of the imaging device.

36. A system for supporting photography, comprising:

an imaging device, which is associated with an carrier; and

a control device, wherein the control device operates to:

acquire a target in an image view based on one or more images that are captured by an imaging device associated with a carrier;

obtain characterization information of the target as indicated in said one or more images;

determine a moving path having at least two sections for tracking the target with the imaging device;

determine a corresponding speed for each section of the moving path;

direct the carrier to move the imaging device, at the corresponding speeds, along each of the at least two sections of the moving path to track the target based on the obtained characterization information of the target; and

capture one or more images using the imaging device along the moving path based on a time-dependent configuration of the imaging device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2017
From: SZ DJI TECHNOLOGY CO., LTD.
To: SZ DJI OSMO TECHNOLOGY CO., LTD.
Reel/Frame 042002/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2016
From: GUO, ZHUO; SU, GUANHUA; TAO, YE; CAO, ZISHENG; BAO, LINCHAO; WANG, MINGYU
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 040284/0014 →
Continuity (2)
Continuation PCTCN2015089692 · Sep 16, 2015
Related Publication 20170078587A1 · Mar 16, 2017
Cited By (4)
US 12,381,995 US 12,441,491 US 12,654,886 US 12,715,628