IP Library › Granted Patent US 11,182,596
Granted Patent B2
US 11,182,596 · App. 16/183,993 · Granted Nov 23, 2021

Identifying a deficiency of a facility

Inventors: Wen Wang (Beijing, CN); Yan Bin Fu (Ningbo, CN); Yi Wu (Ningbo, CN); Qing Jun Gao (Beijing, CN); Shuang Yin Liu (Beijing, CN); Raymond Lee Man Kong (Shanghai, CN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06K9/00335G06K9/6262G06N5/048G06K9/00778G06K9/00785G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,182,596
App. No.
16/183,993
Granted
Nov 23, 2021
Kind
B2
Abstract

A computer-implemented method comprising: monitoring, by a computing device, live sensor data received from one or more sensor devices; detecting, by the computing device, abnormal behavior of one or more individuals or objects based on the monitoring the live sensor data; determining, by the computing device, a deficiency of a facility based on the detecting the abnormal behavior; and executing, by the computing device, a computer-based instruction based on the deficiency of the facility.

Claims (67)

1. A computer-implemented method comprising:

monitoring, by a computing device, live sensor data received from one or more sensor devices;

detecting, by the computing device, abnormal behavior of one or more pedestrians based on the monitoring the live sensor data;

determining details of the abnormal behavior, wherein the determining the details of the abnormal behavior comprises receiving feedback from one or more of the one or more pedestrians;

determining, by the computing device, a deficiency of a facility based on both the detecting the abnormal behavior and the determining the details of the abnormal behavior; and

executing, by the computing device, a computer-based instruction based on the deficiency of the facility.

2. The computer-implemented method of claim 1 , wherein the detecting the abnormal behavior comprises detecting that the live sensor data deviates a threshold degree from training data that defines normal behavior.

3. The computer-implemented method of claim 2 , wherein the training data is preconfigured or learned over a period of time via machine learning.

4. The computer-implemented method of claim 2 , wherein the sensor data and the training data are each associated with a plurality of dimensions comprising at least one selected from the group consisting of:

spatial dimensions,

time,

weather,

climate,

special needs factors of the one or more pedestrians,

biometrics data of the one or more pedestrians,

distress levels of the one or more pedestrians,

user facility ratings, and

personal information of the one or more pedestrians.

5. The computer-implemented method of claim 1 , wherein the facility includes at least one selected from the group consisting of:

a crosswalk,

a manhole cover,

a bus station,

a sidewalk, and

a staircase.

6. The computer-implemented method of claim 1 , wherein the computer-based instruction comprises at least one selected from the group consisting of:

providing a report regarding the deficiency,

providing an alert to user devices regarding the deficiency,

controlling the operations of an electronic billboard to display a warning regarding the deficiency, and

controlling the operations of a pedestrian crossing system.

7. The computer-implemented method of claim 1 , further comprising determining a type of the deficiency, wherein the computer-based instruction is based on the type of deficiency.

8. The computer-implemented method of claim 7 , wherein the type of deficiency comprises at least one selected from the group consisting of:

a design flaw in the deficiency indicating that the deficiency is inconvenient or unaccommodating, and

damage to the facility.

9. The computer-implemented method of claim 1 , wherein a service provider at least one of creates, maintains, deploys and supports the computing device.

10. The computer-implemented method of claim 1 , wherein the monitoring the live sensor data, the detecting the abnormal behavior, the determining the deficiency, and the executing the computer-based instruction are provided by a service provider on a subscription, advertising, and/or fee basis.

11. The computer-implemented method of claim 1 , wherein the computing device includes software provided as a service in a cloud environment.

12. The computer-implemented method of claim 1 , further comprising deploying a system, wherein the deploying the system comprises providing a computer infrastructure operable to perform the monitoring the live sensor data, the detecting the abnormal behavior, the determining the deficiency, and the executing the computer-based instruction.

13. The computer-implemented method of claim 1 , wherein the deficiency comprises an obstacle that causes the one or more pedestrians to walk in a manner that exhibits the abnormal behavior.

14. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:

monitor live video data of a plurality of individuals walking in a public facility;

detect abnormal behavior of the plurality of individuals based on the monitoring the live video data;

determine a deficiency of a facility based on the detecting the abnormal behavior, wherein the deficiency comprises an obstacle that causes the individuals to walk in a manner that exhibits the abnormal behavior; and

perform a mitigating action based on the deficiency of the facility.

15. The computer program product of claim 14 , wherein the program instructions further cause the computing device to determine details of the abnormal behavior, wherein:

the details comprise at least one from the group consisting of:

a difference between the live video data and training data that defines normal behavior, and

common traits between the one or more individuals, and

the determining the deficiency is based on the details of the abnormal behavior.

16. The computer program product of claim 14 , wherein the detecting the abnormal behavior comprises detecting that the live sensor data deviates a threshold degree from training data that defines normal behavior.

17. The computer program product of claim 14 , wherein the mitigating action comprises at least one selected from the group consisting of:

providing a report regarding the deficiency,

providing an alert to user devices regarding the deficiency,

controlling the operations of an electronic billboard to display a warning regarding the deficiency, and

controlling the operations of a traffic light or pedestrian crossing system.

18. The computer program product of claim 14 , wherein the program instructions further cause the computing device to determine a type of the deficiency, wherein the mitigating action is based on the type of deficiency.

19. A system comprising:

a processor, a computer readable memory and a computer readable storage medium associated with a computing device;

program instructions to detect a real-time behavior of a plurality of pedestrians from monitoring video data in real-time;

program instructions to detect that the real-time behavior of the plurality of pedestrians at a particular location of a sidewalk deviates from training data defining normal behavior;

program instructions to determine that the real-time behavior is abnormal based on the detecting that the real-time behavior deviates from the training data;

program instructions to determine a deficiency of the sidewalk at the particular location based on determining that the real-time behavior is abnormal, wherein the deficiency comprises an obstacle in the sidewalk that causes the plurality of pedestrians to walk in a manner that exhibits the abnormal behavior; and

program instructions to execute a computer-based instruction based on the determining the deficiency,

wherein the program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

20. The system of claim 19 , wherein the computer-based instruction comprises at least one selected from the group consisting of:

providing a report regarding the deficiency,

providing an alert to user devices regarding the deficiency, and

controlling the operations of an electronic billboard to display a warning regarding the deficiency.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2018
From: WANG, WEN; FU, YAN BIN; WU, YI; GAO, QING JUN; LIU, SHUANG YIN; KONG, RAYMOND LEE MAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047451/0702 →
Continuity (1)
Related Publication 20200151440A1 · May 14, 2020