IP Library Granted Patent US 8,577,538
Granted Patent B2
US 8,577,538 · App. 11/826,541 · Granted Nov 5, 2013

Method and system for controlling a remote vehicle

Inventors: Scott Raymond Lenser (Waltham, MA); Christopher Vernon Jones (Woburn, MA); Brian Masao Yamauchi (Boston, MA)
Assignee: iRobot Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,577,538
App. No.
11/826,541
Granted
Nov 5, 2013
Kind
B2
Abstract

A system for controlling more than one remote vehicle. The system comprises an operator control unit allowing an operator to receive information from the remote vehicles and send commands to the remote vehicles via a touch-screen interface, the remote vehicles being capable of performing autonomous behaviors using information received from at least one sensor on each remote vehicle. The operator control unit sends commands to the remote vehicles to perform autonomous behaviors in a cooperative effort, such that high-level mission commands entered by the operator cause the remote vehicles to perform more than one autonomous behavior sequentially or concurrently. The system may perform a method for generating obstacle detection information from image data received from one of a time-of-flight sensor and a stereo vision camera sensor.

Claims (26)

1. A method of maintaining an occupancy grid map having cells, the method comprising:

receiving image data from a sensor of a remote vehicle, the sensor being one of a time-of-flight sensor and a stereo vision camera sensor, the image data including one or more columns of pixels;

for each pixel of the image data from the sensor:

determining, at a processor operatively connected to the sensor, a direction for the pixel based on a field of view of the sensor; and

combining, at the processor, the direction with depth information of the image data for a potential obstacle in the pixel;

using, at the processor, the combined direction and depth information to plot points, sequentially, for each column of pixels of the image data, each point representing a distance of the potential obstacle from the remote vehicle and a direction of the potential obstacle;

creating, at the processor, one or more best-fit lines from a predetermined number of sequential plotted points;

determining, at the processor, a respective slope of each best-fit line, and determining the existence of the potential obstacle if the slope of the best-fit line is above a threshold slope;

generating, at the processor, a one-dimensional set of values, derived from the best-fit lines, representing the distance to any obstacle detected by the sensor, each value being indexed by its angle with respect to the field of view of the sensor;

updating, at the processor, the occupancy grid map based on the one-dimensional set of values by incrementing a cell of the occupancy grid map, if an obstacle was detected within that cell; and

adding, at the processor, a location of the remote vehicle to the occupancy grid map.

2. The method of claim 1 wherein, a value of the one dimensional set of values is set equal to infinity when an object is not detected in a portion of the image data corresponding to an index of the value.

3. The method of claim 1 , further comprising downsampling the one-dimensional set of values to a predetermined number of values.

4. The method of claim 1 , wherein creating the occupancy grid map from the one-dimensional set of values further comprises decrementing a cell of the occupancy grid map if no obstacle was detected within that cell.

5. The method of claim 1 , wherein more recent depth information is weighted to represent its greater importance in creating the occupancy grid map.

6. The method of claim 5 , wherein the time-of-flight sensor is a SwissRanger sensor or a flash LIDAR sensor.

7. A method for generating obstacle detection information, the method comprising:

receiving image data from a sensor of a remote vehicle, the sensor being one of a time-of-flight sensor and a stereo vision camera sensor, the image data including one or more columns of pixels;

for each pixel of the image data from the sensor:

determining, at a processor operatively connected to the sensor, a direction for the pixel based on a field of view of the sensor; and

combining, at the processor, the direction with a depth information of the image data for a potential obstacle in the pixel;

using, at the processor, the combined direction and depth information to plot points, sequentially, for each column of pixels of the image data, each point representing a distance of the potential obstacle from the remote vehicle and a direction of the potential obstacle;

creating, at the processor, one or more best-fit lines from a predetermined number of sequential plotted points;

determining, at the processor, a respective slope of each best-fit line, and determining the existence of the potential obstacle if the slope of the best-fit line is above a threshold slope; and

generating, at the processor, a one-dimensional set of values, derived from the best-fit lines, representing the distance to any obstacle detected by the sensor, each value being indexed by its angle with respect to the field of view of the sensor.

8. The method of claim 7 , further comprising downsampling the one-dimensional set of values to a predetermined number of values.

Assignments (6)
NOTICE OF ASSIGNMENT OF SECURITY INTEREST IN INTELLECTUAL PROPERTY Recorded Nov 25, 2025
From: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
To: SANTRUM HONG KONG CO., LIMITED, AS SUCCESSOR COLLATERAL AGENT
Reel/Frame 073707/0516 →
SECURITY INTEREST Recorded Aug 9, 2023
From: IROBOT CORPORATION
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 064532/0856 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2023
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: IROBOT CORPORATION
Reel/Frame 064430/0001 →
SECURITY INTEREST Recorded Nov 3, 2022
From: IROBOT CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061878/0097 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2011
From: YAMAUCHI, BRIAN MASAO
To: IROBOT CORPORATION
Reel/Frame 026958/0743 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2007
From: LENSER, SCOTT; JONES, CHRIS
To: IROBOT CORPORATION
Reel/Frame 019960/0463 →
Continuity (5)
Continuation In Part 11618742 · Dec 30, 2006
Provisional Application 60807434 · Jul 14, 2006
Provisional Application 60871771 · Dec 22, 2006
Provisional Application 60822176 · Aug 11, 2006
Related Publication 20080027591A1 · Jan 31, 2008