IP Library Granted Patent US 10,585,441
Granted Patent B2
US 10,585,441 · App. 16/169,284 · Granted Mar 10, 2020

Unmanned aerial vehicle system and method with environmental sensing

Inventors: Yusen Qin (Zhejiang, CN); Tong Zhang (Zhejiang, CN); Mengqiu Wang (Zhejiang, CN)
Assignee: Hangzhou Zero Zero Technology Co., Ltd.
G05D1/102B64C39/024B64D45/04B64D47/02B64D47/08G01S17/89G05D1/0038G05D1/0094H04N5/2252H04N5/2256H04N7/185B64C2201/027B64C2201/108B64C2201/123B64C2201/127B64C2201/141G01S13/08G01S13/867G01S13/882G01S13/93G01S13/94G01S15/025G01S15/08G01S15/93G01S17/023G01S17/08G01S17/933Y02T50/53
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,585,441
App. No.
16/169,284
Granted
Mar 10, 2020
Kind
B2
Abstract

An aerial system and method of operating an aerial system is provided. The aerial system includes a body, a lift mechanism, a processing system, a camera, and a sensor module. The lift mechanism is coupled to the body and configured to controllably provide lift and/or thrust. The processing system is configured to control the lift mechanism to provide flight to the aerial system. The camera is coupled to the body and is configured to obtain images of an environment proximate the aerial system. The sensor module is coupled to the body and includes an emitter and a receiver. The receiver is configured to sense data related to an ambient environment associated with the aerial system. The processing system controls a controllable parameter of the lift mechanism or the emitter as a function of the sensed data.

Claims (78)

1. An aerial system, comprising:

a body;

a lift mechanism coupled to the body and configured to controllably provide lift and/or thrust;

a processing system configured to control the lift mechanism to provide flight to the aerial system; and

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

the vision location system being further configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images;

the processing system being further configured to control a controllable parameter of the emitter as a function of the at least one signal, wherein the controllable parameter is flux, and

the processing system being further configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system.

2. The system of claim 1 , wherein the camera is downward-facing.

3. The system of claim 1 , wherein the emitter is downward-facing.

4. The system of claim 1 , wherein the emitter is configured to emit visible light.

5. The system of claim 4 , wherein the emitter is one of: a light emitting diode (LED), a laser diode, an incandescent light, and a halogen light.

6. The system of claim 4 , wherein the emitter is configured to selectively illuminate a target object in the ambient environment for image recordation by the camera.

7. The system of claim 4 , wherein the emitter is configured to selectively illuminate a region in the ambient environment for image recordation by the camera.

8. The system of claim 4 , wherein the processing system is further configured to control luminance of the emitter.

9. The system of claim 4 , wherein the processing system is further configured to control wavelength of the emitter.

10. The system of claim 1 , wherein the processing system is further configured to use the at least one signal to perform image analysis to determine the one of the position, the altitude, and the orientation of the aerial system.

11. The system of claim 1 , wherein the processing system is further configured to send the determination of one of the position, the altitude, and the orientation of the aerial system to a remote user device.

12. The aerial system, of claim 1 , wherein the emitter is one of a light source, a sound source, an electromagnetic radiation source, and other suitable emitter.

13. An aerial system, comprising:

a body;

a lift mechanism coupled to the body and configured to controllably provide lift and/or thrust;

a processing system configured to control the lift mechanism to provide flight to the aerial system; and

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, wherein the emitter is configured to emit visible light, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

the vision location system being further configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images;

the processing system being further configured to control a controllable parameter of the emitter as a function of the at least one signal, and the processing system being further configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system, wherein the controllable parameter of the emitter is flux.

14. An aerial system, comprising:

a body;

a lift mechanism coupled to the body and configured to controllably provide lift and/or thrust;

a processing system configured to control the lift mechanism to provide flight to the aerial system; and

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

the vision location system being further configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images;

the processing system being further configured to control a controllable parameter of the emitter as a function of the at least one signal, and the processing system being further configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system, wherein the at least one signal is a streamed signal.

15. An aerial system comprising:

a body;

a lift mechanism coupled to the body and configured to controllably provide lift and/or thrust;

a processing system configured to control the lift mechanism to provide flight to the aerial system; and

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

the vision location system being further configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images;

the processing system being further configured to control a controllable parameter of the emitter as a function of the at least one signal, and

the processing system being further configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system, wherein the processing system is further configured to use the at least one signal to perform image analysis to determine the one of the position, the altitude, and the orientation of the aerial system, wherein the image analysis comprises optical flow analysis.

16. An aerial system, comprising:

a body;

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

wherein the vision location system is configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images; and

a processing system configured to control a controllable parameter of the emitter as a function of the at least one signal, wherein the controllable parameter is flux, the processing system is further configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system.

17. The system of claim 16 , wherein the camera is downward-facing.

18. The system of claim 16 , wherein the emitter is downward-facing.

19. The system of claim 16 , wherein the emitter is configured to emit visible light.

20. The system of claim 19 , wherein the emitter is one of: a light emitting diode (LED), a laser diode, an incandescent light, and a halogen light.

21. The system of claim 19 , wherein the emitter is configured to selectively illuminate a target object in the ambient environment for image recordation by the camera.

22. The system of claim 19 , wherein the emitter is configured to selectively illuminate a region in the ambient environment for image recordation by the camera.

23. The system of claim 16 , wherein the processing system is further configured to use the at least one signal to perform image analysis to determine the one of the position, the altitude, and the orientation of the aerial system.

24. The system of claim 16 , wherein the processing system is further configured to send the determination of one of the position, the altitude, and the orientation of the aerial system to a remote user device.

25. An aerial system, comprising:

a body;

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

wherein the vision location system is configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images; and

a processing system configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system, wherein the at least one signal is a streamed signal.

26. An aerial system, comprising:

a body;

a vision location system coupled to the body, comprising:

a camera configured to obtain one or more images of an environment proximate the aerial system, and

an emitter and a receiver, the receiver being configured to sense data related to an ambient environment associated with the aerial system,

wherein the vision location system is configured to send at least one signal to the processing system, wherein the at least one signal includes the sensed data and the one or more images; and

a processing system configured to analyze the at least one signal to determine one of a position, an altitude, and an orientation of the aerial system, wherein the processing system is further configured to use the at least one signal to perform image analysis to determine the one of the position, the altitude, and the orientation of the aerial system, wherein the image analysis comprises optical flow analysis.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2018
From: QIN, YUSEN; ZHANG, TONG; WANG, MENGQIU
To: HANGZHOU ZERO ZERO TECHNOLOGY CO., LTD.
Reel/Frame 047601/0775 →
Continuity (3)
Continuation 15701740 · Sep 12, 2017
Provisional Application 62393771 · Sep 13, 2016
Related Publication 20190107844A1 · Apr 11, 2019
Cited By (1)
US 12,231,785