IP Library Granted Patent US 11,323,687
Granted Patent B2
US 11,323,687 · App. 16/045,795 · Granted May 3, 2022

Sensing on UAVs for mapping and obstacle avoidance

Inventors: Alberto Daniel Lacaze (Potomac, MD); Karl Nicholas Murphy (Cocoa Beach, FL); Raymond Paul Wilhelm, III (Gaithersburg, MD)
Assignee: Robotic Research OpCo, LLC
H04N13/243B64C39/024G01B11/245G01B11/2518G01B11/2545G01S7/4813G01S7/4815G01S7/4816G01S17/08G01S17/42G01S17/48G01S17/89G01S17/933H04N13/271B64C2201/024B64C2201/027B64C2201/108B64C2201/123B64C2201/14B64C2201/162H04N13/128H04N13/254H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,323,687
App. No.
16/045,795
Filed
Jul 26, 2018
Granted
May 3, 2022
Kind
B2
Art Unit
3662
USPC
701/3
Abstract

Structured light approaches utilize a laser to project features, which are then captured with a camera. By knowing the disparity between the laser emitter and the camera, the system can triangulate to find the range. Four, 185 degree field-of-view cameras provide overlapping views over nearly the whole unit sphere. The cameras are separated from each other to provide parallax. A near-infrared laser projection unit sends light out into the environment, which is reflected and viewed by the cameras. The laser projection system will create vertical lines, while the cameras will be displaced from each other horizontally. This relative shift of the lines, as viewed by different cameras, enables the lines to be triangulated in 3D space. At each point in time, a vertical stripe of the world will be triangulated. Over time, the laser line will be rotated over all yaw angles to provide full a 360 degree range.

Claims (14)

1. A low-light environment obstacle avoidance-enabled UAV, comprising:

a plurality of fisheye cameras displaced from each other horizontally, each camera comprising a wide-angle compound lens;

a plurality of near-infrared laser projection line scanners displaced to simultaneously project a plurality of vertical laser lines in an environment surrounding the UAV, thereby generating vertical line light pattern projections, each laser projection line scanner comprising a solid-state laser diode and an aspheric collimation lens coupled in front of a laser emitter and that splits a laser beam emitted from the emitter into upward and downward vertical line portions;

a UAV rotation mechanism operable to alter a yaw orientation of the plurality of near-infrared laser projection line scanners; and

a microprocessor in communication with the plurality of fisheye cameras, the plurality of near-infrared laser projection line scanners, and the UAV rotation mechanism, the microprocessor being configured to:

(i) operate the UAV rotation mechanism to alter a first yaw orientation of the plurality of near-infrared laser projection line scanners at a first point in time to a second yaw orientation of the plurality of near-infrared laser projection line scanners at a second point in time,

(ii) process images captured by the plurality of fisheye cameras to: (a) triangulate, at the first point in time and based on first identified locations of first vertical line light pattern projections from the near-infrared laser projection line scanners a first plurality of point locations in a 3-D space comprising the environment surrounding the UAV, and

(b) triangulate, at the second point in time and based on second identified locations of second vertical line light pattern projections from the near-infrared laser projection line scanners a second plurality of point locations in the 3-D space comprising the environment surrounding the UAV, thereby defining a point cloud, and

(iii) conduct, based on the point cloud, an obstacle avoidance navigation of the UAV.

2. The low-light environment obstacle avoidance-enabled UAV of claim 1 , wherein the downward vertical line portion of the laser beam creates a laser line that extends from horizontal to negative 80 degrees pitch.

3. The low-light environment obstacle avoidance-enabled UAV of claim 1 , wherein the upward vertical line portion of the laser beam creates a laser line that extends from horizontal to positive 80 degrees pitch.

4. The low-light environment obstacle avoidance-enabled UAV of claim 1 , wherein each camera comprises a spectral filter.

5. The low-light environment obstacle avoidance-enabled UAV of claim 1 , wherein each camera comprises an optical bandpass filter.

6. The low-light environment obstacle avoidance-enabled UAV of claim 1 , wherein the vertical laser lines are projected along a vertical sensor plane and wherein the vertical sensor plane is aligned with a direction of travel of the UAV.

Assignments (8)
SECURITY INTEREST Recorded Jul 14, 2025
From: ROBOTIC RESEARCH OPCO, LLC
To: CRESCENT COVE OPPORTUNITY LENDING, LLC
Reel/Frame 071945/0001 →
TERMINATION AND RELEASE OF PATENT SECURITY INTEREST RECORDED AT REEL 066382, FRAME 0141 Recorded Jul 16, 2024
From: CRESCENT COVE OPPORTUNITY LENDING, LLC, AS ADMINISTRATIVE AGENT
To: ROBOTIC RESEARCH OPCO, LLC
Reel/Frame 068389/0707 →
SECURITY INTEREST Recorded Jan 30, 2024
From: ROBOTIC RESEARCH OPCO, LLC
To: CRESCENT COVE OPPORTUNITY LENDING, LLC
Reel/Frame 066382/0141 →
MERGER Recorded Feb 17, 2022
From: ROBOTIC RESEARCH, LLC
To: ROBOTIC RESEARCH OPCO, LLC
Reel/Frame 059180/0413 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPLICATION NUMBER 15/903,136 PREVIOUSLY RECORDED ON REEL 049315 FRAME 0195. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 13, 2019
From: LACAZE, ALBERTO DANIEL, MR.; MURPHY, KARL NICHOLAS, MR.
To: ROBOTIC RESEARCH, LLC
Reel/Frame 049562/0200 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT ASSIGNMENT 15/903,136 PREVIOUSLY RECORDED ON REEL 049315 FRAME 0195. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 13, 2019
From: LACAZE, ALBERTO DANIEL, MR.; MURPHY, KARL NICHOLAS, MR.
To: ROBOTIC RESEARCH, LLC
Reel/Frame 049475/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2019
From: LACAZE, ALBERTO DANIEL, MR.; MURPHY, KARL NICHOLAS, MR.; WILHELM, RAYMOND PAUL, MR.
To: ROBOTIC RESEARCH, LLC
Reel/Frame 049458/0003 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2019
From: LACAZE, ALBERTO DANIEL, MR.; MURPHY, KARL NICHOLAS, MR.
To: ROBOTIC RESEARCH, LLC
Reel/Frame 049315/0195 →
Continuity (3)
Continuation 15176229 · Jun 8, 2016
Provisional Application 62175231 · Jun 13, 2015
Related Publication 20190068954A1 · Feb 28, 2019
Cited By (2)
US 12,480,763 US 12,657,766