IP Library › Granted Patent US 9,420,559
Granted Patent B2
US 9,420,559 · App. 14/462,697 · Granted Aug 16, 2016

Obstacle detection and warning system using a mobile device

Inventors: Kun Bai (Elmsford, NY); Christian B. Kau (Los Altos, CA); Jerald T. Schoudt (Douglassville, PA)
Assignee: International Business Machines Corporation
H04W64/00G08B21/02H04W4/027H04W4/043H04W68/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,420,559
App. No.
14/462,697
Granted
Aug 16, 2016
Kind
B2
Abstract

A method and system for detecting obstacles in a user's path by obtaining the user's location and direction of movement, as well as visual and audio inputs of the surrounding environment, and alarming the user if the method and system detect an obstacle approaching the user.

Claims (52)

1. A method for detecting obstacles using a computing device, comprising:

identifying, by one or more processors, environmental information related to an external surrounding environment in relation to one or more computing devices, wherein the environmental information comprises of an audio data and a visual data;

determining, by one or more processors, geographic information of the one or more computing devices;

determining, by one or more processors, whether one or more obstacles are present based on the audio data, the visual data, and the geographic information, wherein determining whether one or more obstacles are present comprises:

obtaining information pertaining to obstacles based on the geographic information, wherein the information pertaining to obstacles comprises an audio signature; and

determining the obstacle is present based on the audio data matching the audio signature;

based on determining one or more obstacles are present, transmitting an alert.

2. The method of claim 1 , wherein the alert comprises at least one of an audio warning, a visual warning and a tactile warning.

3. The method of claim 1 , wherein the one or more computing devices includes one or more visual sensing devices and one or more auditory sensing devices.

4. The method of claim 1 , further comprising:

determining, by one or more processors, a type of obstacle for each of the one or more obstacles; and

transmitting an alert based on the determined type of the one or more obstacles.

5. The method of claim 1 , wherein the computing device is a mobile device.

6. The method of claim 1 , wherein determining the geographic information comprises:

identifying, by one or more processors, a location associated with the external surrounding environment; and

identifying the geographic information corresponding to the identified location.

7. The method of claim 1 , wherein the geographic information includes at least one or more audio cues or at least one or more visual cues related to a possible obstacle in the external surrounding environment.

8. A system for detecting obstacles using a mobile device, comprising:

a computer having a processor, and a computer-readable storage device; and

a program embodied on the storage device for execution by the processor, the program having a plurality of program modules, including:

an identifying module configured to identify environmental information related to an external surrounding environment in relation to one or more computing devices, wherein the environmental information comprises of an audio data and a visual;

a first determining module configured to determine geographic information of the one or more computing devices;

a second determining module configured to determine whether one or more obstacles are present based on the audio data, the visual data, and the geographic information, wherein determining whether one or more obstacles are present comprises:

a module to obtain information pertaining to obstacles based on the geographic information, wherein the information pertaining to obstacles comprises an audio signature; and

a module to determine the obstacle is present based on the audio data matching the audio signature; and

an alerting module configured to transmit an alert based on determining one or more obstacles are present.

9. The system of claim 8 , wherein the alert comprises at least one of an audio warning, a visual warning and a tactile warning.

10. The system of claim 8 , wherein the one or more computing devices includes one or more visual sensing devices and one or more auditory sensing devices.

11. The system of claim 8 , further comprising:

a third determining module configured to determine a type of obstacle for each of the one or more obstacles; and

the alerting module configured to transmit an alert based on the determined type of the one or more obstacles.

12. The system of claim 8 , wherein the computing device is a mobile device.

13. The system of claim 8 , wherein determining the geographic information comprises:

identifying, by one or more processors, a location associated with the external surrounding environment; and

identifying the geographic information corresponding to the identified location.

14. The system of claim 8 , wherein the geographic information includes at least one or more audio cues or at least one or more visual cues related to a possible obstacle in the external surrounding environment.

15. A computer program product for detecting obstacles using a mobile device, comprising a computer-readable storage medium having program code embodied therewith, the program code executable by a processor of a computer to perform a method comprising:

identifying, by one or more processors, environmental information related to an external surrounding environment in relation to one or more computing devices, wherein the environmental information comprises of an audio data and a visual data;

determining, by one or more processors, geographic information of the one or more computing devices;

determining, by one or more processors, whether one or more obstacles are present based on the audio data, the visual data, and the geographic information, wherein determining whether one or more obstacles are present comprises:

obtaining information pertaining to obstacles based on the geographic information, wherein the information pertaining to obstacles comprises an audio signature; and

determining the obstacle is present based on the audio data matching the audio signature;

based on determining one or more obstacles are present, transmitting an alert.

16. The computer program product of claim 15 , wherein the alert comprises at least one of an audio warning, a visual warning and a tactile warning.

17. The computer program product of claim 15 , wherein the one or more computing devices includes one or more visual sensing devices and one or more auditory sensing devices.

18. The computer program product of claim 15 , further comprising:

determining a type of obstacle for each of the one or more obstacles; and

transmitting an alert based on the determined type of the one or more obstacles.

19. The computer program product of claim 15 , wherein the computing device is a mobile device.

20. The computer program product of claim 15 , wherein determining the geographic information comprises:

identifying, by one or more processors, a location associated with the external surrounding environment; and

identifying the geographic information corresponding to the identified location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2014
From: BAI, KUN; KAU, CHRISTIAN B.; SCHOUDT, JERALD T.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 033629/0318 →
Continuity (1)
Related Publication 20160057726A1 · Feb 25, 2016