IP Library › Granted Patent US 10,325,155
Granted Patent B2
US 10,325,155 · App. 15/132,376 · Granted Jun 18, 2019

Analyzing video streams in an industrial environment to identify potential problems and select recipients for a display of video streams related to the potential problems

Inventors: Sharon M. Billi (Euclid, OH); Christopher Wayne Como (Chagrin Falls, OH); Edward A. Gray (Olmsted Township, OH); Kyle Reissner (Hudson, OH); Jonathan D. Walter (Broadview Heights, OH); Mohit Singhai (Lyndhurst, OH); Douglas J. Reichard (Fairview Park, OH); Scott N. Sandler (Chagrin Falls, OH); Ronald E. Bliss (Twinsburg, OH); Michael John Pantaleano (Willoughby, OH); Ryan Cahalane (Chagrin Falls, OH); Jessica L. Korpela (Milwaukee, WI); Bruce T. McCleave (Mission Viejo, CA)
Assignee: Rockwell Automation Technologies, Inc.
G06K9/00718G06K9/00771G06K9/6269H04N5/765H04N7/181G06K2209/19
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,325,155
App. No.
15/132,376
Granted
Jun 18, 2019
Kind
B2
Abstract

The subject matter disclosed herein relates generally to industrial automation systems, and, more particularly, to collecting video streams from a variety of video devices in an industrial environment, identifying and analyzing potential problems in the industrial environment using the video streams, and presenting the video streams and data associated with the potential problem to appropriate recipients.

Claims (41)

1. A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:

a video receiving component configured to obtain video streams captured by cameras in an industrial environment;

a video monitoring component configured to employ at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content;

a recipient identification component configured to select a recipient for the first portion of the first video content of the first video stream from a plurality of recipients according to a selection criteria associated with the potential problem; and

a video presentation component configured to transmit a message to a display device associated with the selected recipient that initiates the display device to present a display comprising at least the first portion of the first video content of the first video stream.

2. The system of claim 1 , further comprising a data monitoring component that identifies data produced in the industrial environment associated with the potential problem; and

wherein the display further comprises the identified data.

3. The system of claim 2 , wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

4. The system of claim 1 , wherein the video monitoring component is further configured to employ the at least one video recognition technique to analyze a second video content of a second video stream of the video streams and identify a potential instigator of the potential problem based on a second portion of the second video content; and

wherein the display further comprises the second portion of the second video content of the second video stream.

5. The system of claim 1 , wherein the selection criteria comprises an ability of the recipient to resolve the potential problem.

6. The system of claim 1 , further comprising a display device identification component configured to select the display device out of a plurality of display devices associated with the recipient based upon respective availability of the display devices to the recipient.

7. The system of claim 1 , further comprising a video tagging component configured to tag at least the first portion of the first video content of the first video stream with a unique identifier associated with the potential problem.

8. The system of claim 2 , further comprising a data tagging component configured to tag the identified data with the unique identifier associated with the potential problem.

9. The system of claim 2 , further comprising a video/data synchronization component configured to time synchronize the first video stream with the identified data; and

wherein the display is configured to present a playback of the first video stream in time synchronization with the identified data.

10. The system of claim 4 , further comprising a video/data synchronization component configured to time synchronize the first video stream with the second video stream; and

wherein the display is configured to present a playback of the first video stream in time synchronization with the second video stream.

11. A method, comprising:

receiving, by a system comprising a processor, video streams captured by cameras in an industrial environment;

employing, by the system, at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content;

selecting, by the system, a recipient from a plurality of recipients for the first portion of the first video content of the first video stream according to a selection criteria associated with the potential problem; and

transmitting, by the system, a message to a display device associated with the selected recipient that initiates the display device to present a display comprising at least the first portion of the first video content of the first video stream.

12. The method of claim 11 , further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem; and

wherein the display further comprises the identified data.

13. The method of claim 12 , wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

14. The method of claim 12 , further comprising tagging, by the system, at least the first portion of the first video content of the first video stream and the identified data with a unique identifier associated with the potential problem.

15. The method of claim 11 , further comprising employing, by the system, the at least one video recognition technique to analyze a second video content of a second video stream of the video streams and identify a potential instigator of the potential problem based on a second portion of the second video content; and

wherein the display further comprises the second portion of the second video content of the second video stream.

16. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:

accessing video streams captured by cameras in an industrial environment;

employing at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content; and

selecting at least one recipient from a plurality of recipients for the first portion of the first video content of the first video stream according to a selection criteria associated with the potential problem; and

sending a transmission to at least one display device associated with the at least one selected recipient that initiates the at least one display device to present a display comprising at least the first portion of the first video content of the first video stream.

17. The non-transitory computer-readable medium of claim 16 , the operations further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem; and

wherein the display further comprises the identified data.

18. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises a maintenance history of a recipient with a machine involved in the potential problem.

19. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises a physical proximity of a recipient to a location of the potential problem.

20. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises an availability of particular display device to a recipient.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2016
From: BILLI, SHARON M.; COMO, CHRISTOPHER W.; GRAY, EDWARD A.; REISSNER, KYLE K.; WALTER, JONATHAN D.; SINGHAI, MOHIT; REICHARD, DOUGLAS J.; SANDLER, SCOTT N.; BLISS, RONALD E.; PANTALEANO, MICHAEL J.; CAHALANE, RYAN; KORPELA, JESSICA L.; MCCLEAVE, BRUCE T., JR.
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 038315/0384 →
Continuity (1)
Related Publication 20170300753A1 · Oct 19, 2017