IP Library Granted Patent US 10,169,879
Granted Patent B2
US 10,169,879 · App. 15/919,553 · Granted Jan 1, 2019

Detection of obstructions

Inventors: Ben Z. Akselrod (Givat Shmuel, IL); Anthony Di Loreto (Toronto, CA); Steve McDuff (Toronto, CA); Kyle D. Robeson (Toronto, CA)
Assignee: International Business Machines Corporation
G06T7/13G06K9/00805H04N5/225G06T2207/10028G06T2207/30236G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,169,879
App. No.
15/919,553
Granted
Jan 1, 2019
Kind
B2
Abstract

A system and method for modifying an operation of a vehicle in response to detection of an obstruction. The system includes a camera coupled to a vehicle and configured to capture image data from a vehicle, and a computing device that includes a processor configured to: detect an edge of a roadway on which the vehicle is traveling; detect objects located proximate an edge of the roadway, based on the captured image data; calculate a distance between each detected object and the edge of the roadway, wherein a location of each detected object is determined based on the captured image data; and determine that one object of the detected objects is an obstruction, based on at least the calculated distance between the one object and the edge of the roadway being below a threshold.

Claims (58)

1. A computing system for modifying an operation of a vehicle in response to detection of an obstruction, said computing system comprising:

a camera coupled to a vehicle and configured to capture image data; and

a computing device that includes a processor configured to:

detect an edge of a roadway on which the vehicle is traveling, based on the captured image data;

detect a plurality of objects located proximate the edge of the roadway, based on the captured image data;

calculate a distance between each detected object and the edge of the roadway, wherein a location of each detected object is determined based on the captured image data;

determine that one object of the detected objects is an obstruction, based on at least the calculated distance between the one object and the edge of the roadway being below a threshold; and

modify an operation of the vehicle based on the obstruction.

2. The computing system of claim 1 , said computing system further comprising:

a range finder to (i) calculate the distance between each detected object and the edge of the roadway and (ii) calculate a size and shape of each detected object.

3. The computing system of claim 1 , wherein the camera is mounted at a predetermined location on the vehicle based on a ride height of the vehicle.

4. The computing system of claim 1 , wherein the processor is configured to:

determine that the vehicle is approaching an intersecting street; and

calculate a sight line based on a predetermined speed limit of pertaining to the intersecting street, wherein the threshold is based in part on the sight line, the sight line to be modified based on a speed of the vehicle at a time the image data is captured.

5. The computing system of claim 1 , wherein the processor is configured to:

collect the image data from a plurality of sensors distributed at different heights on the vehicle; and

aggregate the image data to detect the location of each detected object.

6. The computing system of claim 1 , wherein the processor is configured to:

transmit a message to an external device, said message indicating the location of the one object determined to be an obstruction.

7. The computing system of claim 1 , wherein the obstruction is proximate an intersection where the roadway and a road intersect, wherein the obstruction causes an obstructed view from the vehicle, wherein said to transmit the message comprises to transmit an alert to the external device of a government of a jurisdiction having responsibility for the intersection, the roadway, and the road, and wherein the processor is configured to:

determine that the obstruction and/or obstructed view is a violation of a law of the government; and

receive a communication indicating that the government has, in response to the determination that the obstruction and/or obstructed view is a violation of a law of the government, dispatched a service provider to remove the obstruction and/or perform an action with respect to the obstructed view.

8. A method for modifying an operation of a vehicle in response to detection of an obstruction, said method comprising:

detecting, by a processor of a computing device, a plurality of objects located proximate an edge of a roadway on which a vehicle is traveling, said detecting the plurality of objects being based on image data captured by a camera, wherein the edge of the roadway had been detected based on the captured image data;

calculating, by the processor, a distance between each detected object and the edge of the roadway, wherein a location of each detected object had been determined based on the captured image data;

determining, by the processor, that one object of the detected objects is an obstruction, based on at least the calculated distance between the one object and the edge of the roadway being below a threshold; and

modifying, via the processor, an operation of the vehicle based on the obstruction.

9. The method of claim 8 , said method comprising:

calculating the distance between each detected object and the edge of the roadway, based on depth data collected from a range finder.

10. The method of claim 8 , said method comprising

determining, by the processor, that the vehicle is approaching an intersecting street; and

calculating, by the processor, a sight line based on a predetermined speed limit pertaining to the intersecting street, wherein the threshold is based in part on the sight line, the sight line to be modified based on a speed of the vehicle at a time the image data is captured.

11. The method of claim 8 , said method comprising:

collecting, by the processor, the image data from a plurality of sensors distributed at different heights on the vehicle; and

aggregating, by the processor, the image data to detect the location of each detected object.

12. The method of claim 8 , said method comprising:

transmitting, by the processor, a message to an external device, said message indicating the location of the one object determined to be an obstruction.

13. The method of claim 8 , wherein the obstruction is proximate an intersection where the roadway and a road intersect, wherein the obstruction causes an obstructed view from the vehicle, wherein said transmitting the message comprises transmitting an alert to the external device of a government of a jurisdiction having responsibility for the intersection, the roadway, and the road, and wherein the method comprises:

determining, by the processor, that the obstruction and/or obstructed view is a violation of a law of the government; and

receiving, by the processor, a communication indicating that the government has, in response to the determination that the obstruction and/or obstructed view is a violation of a law of the government, dispatched a service provider to remove the obstruction and/or perform an action with respect to the obstructed view.

14. A computer program product, comprising a computer readable hardware storage device having computer readable program code stored therein, said program code containing instructions executable by a processor of a system to implement a method for modifying an operation of a vehicle in response to detection of an obstruction, said method comprising:

detecting, by a processor of a computing device, a plurality of objects located proximate an edge of a roadway on which a vehicle is traveling, said detecting the plurality of objects being based on image data captured by a camera, wherein the edge of the roadway had been detected based on the captured image data;

calculating, by the processor, a distance between each detected object and the edge of the roadway, wherein a location of each detected object had been determined based on the captured image data;

determining, by the processor, that one object of the detected objects is an obstruction, based on at least the calculated distance between each object of the one object and the edge of the roadway being below a threshold; and

modifying, via the processor, an operation of the vehicle based on the obstruction.

15. The computer program product of claim 14 , said method comprising:

calculating the distance between each detected object and the edge of the roadway, based on depth data collected from a range finder.

16. The computer program product of claim 14 , said method comprising

determining, by the processor, that the vehicle is approaching an intersecting street; and

calculating, by the processor, a sight line based on a predetermined speed limit pertaining to the intersecting street, wherein the threshold is based in part on the sight line, the sight line to be modified based on a speed of the vehicle at a time the image data is captured.

17. The computer program product of claim 14 , said method comprising:

collecting, by the processor, the image data from a plurality of sensors distributed at different heights on the vehicle; and

aggregating, by the processor, the image data to detect the location of each detected object.

18. The computer program product of claim 14 , said method comprising:

transmitting, by the processor, a message to an external device, said message indicating the location of the one object determined to be an obstruction.

19. The computer program product of claim 14 , wherein the obstruction is proximate an intersection where the roadway and a road intersect, wherein the obstruction causes an obstructed view from the vehicle, wherein said transmitting the message comprises transmitting an alert to the external device of a government of a jurisdiction having responsibility for the intersection, the roadway, and the road, and wherein the method comprises:

determining, by the processor, that the obstruction and/or obstructed view is a violation of a law of the government; and

receiving, by the processor, a communication indicating that the government has, in response to the determination that the obstruction and/or obstructed view is a violation of a law of the government, dispatched a service provider to remove the obstruction and/or perform an action with respect to the obstructed view.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 058780/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2018
From: AKSELROD, BEN Z.; DI LORETO, ANTHONY; MCDUFF, STEVE; ROBESON, KYLE D.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 045187/0327 →
Continuity (2)
Continuation 15182017 · Jun 14, 2016
Related Publication 20180204328A1 · Jul 19, 2018