IP Library Granted Patent US 9,224,054
Granted Patent B2
US 9,224,054 · App. 14/177,493 · Granted Dec 29, 2015

Machine vision based obstacle avoidance system

Inventors: Debasish Ghose (Bangalore, IN); Varun Raj Kompella (Bangalore, IN)
Assignee: Indian Institute of Science
G06K9/00805G05D1/0246G06K9/3233G06K9/54G06T7/0083G06T7/0097G06T2207/10016G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,224,054
App. No.
14/177,493
Granted
Dec 29, 2015
Kind
B2
Abstract

Machine vision based obstacle avoidance system is provided. The system utilizes a CCD camera to capture an image. A normalized image and dynamic masking is used in object detection.

Claims (42)

1. A method to detect an obstacle in a field of view, comprising:

performing a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value;

alternating between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value;

performing the HIS operation for a predetermined number of iterations;

performing the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations;

and performing an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.

2. The method of claim 1 , further comprising:

painting a ground surface a first intensity value; and

painting the obstacle a second intensity value.

3. The method of claim 2 , further comprising in response to the first intensity value of the ground surface changing to the second intensity value, shifting a maximum intensity value of a histogram, generated by a mask, to a zero intensity value.

4. The method of claim 3 , wherein the HIS operation includes providing an indication of an obstacle collision in response to the histogram shifting from the maximum intensity value to the zero intensity value.

5. The method of claim 2 , wherein the obstacle includes a first number of pixels that are less than a second number of pixels occupied by the ground surface.

6. The method of claim 5 , wherein the first intensity value of the ground surface corresponds to peak intensities of an intensity histogram using a mask.

7. The method of claim 2 , wherein the first intensity value includes a maximum intensity value and the second intensity value includes a zero intensity value.

8. The method of claim 7 , wherein the maximum intensity value is white and the zero intensity value is black.

9. The method of claim 1 , wherein the dynamic mask width being greater than the predetermined value corresponds to an amount of colored pixels in relation to an amount of pixels representing the ground surface.

10. A mobile platform comprising:

a base structure;

a drive mechanism coupled to the base structure; and

a computing device comprising a memory and at least one processor, the at least one processor configured to:

perform a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value,

alternate between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value,

perform the HIS operation for a predetermined number of iterations,

perform the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations, and

control the drive mechanism to perform an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.

11. The mobile platform of claim 10 , wherein the at least one processor is further configured to:

paint a ground surface a first intensity value; and

paint the obstacle a second intensity value.

12. The mobile platform of claim 11 , wherein the at least one processor is further configured to in response to the first intensity value of the ground surface changing to the second intensity value, shift a maximum intensity value of a histogram, generated by a mask, to a zero intensity value.

13. The mobile platform of claim 12 , wherein the HIS operation includes providing an indication of an obstacle collision in response to the histogram shifting from the maximum intensity value to the zero intensity value.

14. The mobile platform of claim 11 , wherein the obstacle includes a first number of pixels that are less than a second number of pixels occupied by the ground surface.

15. The mobile platform of claim 14 , wherein the first intensity value of the ground surface corresponds to peak intensities of an intensity histogram using a mask.

16. The mobile platform of claim 11 , wherein the first intensity value includes a maximum intensity value and the second intensity value includes a zero intensity value.

17. The mobile platform of claim 16 , wherein the maximum intensity value is white and the zero intensity value is black.

18. The mobile platform of claim 10 , wherein the dynamic mask width being greater than the predetermined value corresponds to an amount of colored pixels in relation to an amount of pixels representing the ground surface.

19. The mobile platform of claim 18 , wherein the amount of colored pixels is greater than the amount of pixels representing the ground surface.

20. A non-transitory computer-readable medium storing executable instructions that, in response to being executed, cause a computer to perform operations comprising:

performing a dynamic mask (DMA) operation to detect an obstacle that includes generating a dynamic mask and comparing a dynamic mask width with a predetermined value;

alternating between performing the DMA operation to performing a histogram intensity switching (HIS) operation in response to the dynamic mask width being greater than the predetermined value;

performing the HIS operation for a predetermined number of iterations;

performing the HIS operation and the DMA operation for one additional iteration each following the performance of the HIS operation for the predetermined number of iterations; and

performing an obstacle avoidance maneuver in response to the dynamic mask width being greater than the predetermined value.

Assignments (3)
RELEASE OF SECURITY INTEREST IN PATENTS, RECORDED ON JANUARY 29, 2019 AT REEL 048373 FRAME 0217 Recorded Sep 22, 2025
From: CRESTLINE DIRECT FINANCE, L.P., AS COLLATERAL AGENT
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 072936/0464 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: CRESTLINE DIRECT FINANCE, L.P.
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 049924/0794 →
SECURITY INTEREST Recorded Jan 29, 2019
From: EMPIRE TECHNOLOGY DEVELOPMENT LLC
To: CRESTLINE DIRECT FINANCE, L.P.
Reel/Frame 048373/0217 →
Continuity (2)
Continuation 12643207 · Dec 21, 2009
Related Publication 20140219507A1 · Aug 7, 2014