IP Library Granted Patent US 11,816,893
Granted Patent B1
US 11,816,893 · App. 18/131,920 · Granted Nov 14, 2023

Systems and methods for monitoring and controlling industrial processes

Inventors: Slawek Frackowiak (Fairfax, VA); Leszek Frackowiak (Vienna, VA)
Assignee: Industrial Video Solutions Inc.
G06V20/41G05B19/41865G05B19/4185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,816,893
App. No.
18/131,920
Granted
Nov 14, 2023
Kind
B1
Abstract

Various embodiments include methods, apparatuses, systems, and computing devices that are configured to: (1) receive media of a processing region of an industrial process, where the processing region comprises at least one object, the media comprises a plurality of media elements, and each of the media elements comprises a field of view of the at least one object; (2) identify based on an area of interest, a set of pixels, wherein the field of view comprises the area of interest; (3) for each media element of the plurality of media elements: (a) extract an attribute value from each pixel of the set of pixels found in the media element, and (b) construct a respective array comprising each attribute value; (4) combine each of the respective arrays in a data structure; and (5) analyze the data structure to provide data on a processing parameter associated with the industrial process.

Claims (87)

1. A method comprising:

receiving, by computing hardware, media of a processing region of an industrial process, wherein:

the processing region comprises at least one object,

the media comprises a plurality of media elements, and

each media element of the plurality of media elements comprises a field of view of the at least one object;

identifying, by the computing hardware and based on an area of interest, a set of pixels, wherein the field of view comprises the area of interest;

for each media element of the plurality of media elements:

extracting, by the computing hardware, an attribute value from each pixel of the set of pixels found in the media element; and

constructing, by the computing hardware, a respective array comprising each attribute value;

combining, by the computing hardware, each of the respective arrays in a data structure; and

analyzing, by the computing hardware, the data structure to provide data on a processing parameter associated with the industrial process.

2. The method of claim 1 , wherein analyzing the data structure comprises facilitating generation and transmission of a graphical representation of the data structure to a user device for display.

3. The method of claim 2 , wherein:

the respective arrays are indexed in the data structure according to a sequence of the plurality of media elements found in the media, and

the graphical representation comprises a visual representation displaying each respective array being arranged at least substantially sequentially along an axis of the graphical representation according to how the respective arrays are indexed in the data structure.

4. The method of claim 1 , wherein the media comprises an interstitial portion, and the method further comprises:

determining, by the computing hardware, a beginning media element of the interstitial portion;

determining, by the computing hardware, an ending media element of the interstitial portion; and

excluding, by the computing hardware, media elements between the beginning media element and the ending media element from the plurality of media elements.

5. The method of claim 4 , wherein:

determining the beginning media element of the interstitial portion comprises receiving a first trigger signal indicating an ending of a movement cycle of the at least one object; and

determining the ending media element of the interstitial portion comprises receiving a second trigger signal indicating a beginning of the movement cycle of the at least one object.

6. The method of claim 4 , wherein:

determining the beginning media element of the interstitial portion comprises detecting a first change in the attribute value for a particular pixel of the set of pixels; and

determining the ending media element of the interstitial portion comprises detecting a second change in the attribute value for the particular pixel of the set of pixels.

7. The method of claim 6 , wherein the second change corresponds to the beginning media element of a processing portion, the first change corresponds to the ending media element of the processing portion, and the method further comprises:

determining, by the computing hardware, an elapsed time of the processing portion;

removing, by the computing hardware, media elements of the plurality of media elements based at least in part on the elapsed time being greater than a baseline processing time; and

adding, by the computing hardware, media elements to the plurality of media elements based at least in part on the elapsed time being less than the baseline processing time.

8. A system comprising:

a non-transitory computer-readable medium storing instructions; and

a processing device communicatively coupled to the non-transitory computer-readable medium,

wherein, the processing device is configured to execute the instructions and thereby perform operations comprising:

receiving media of a processing region involving processing of an object,

wherein:

the media comprises a plurality of media elements, and

each media element of the plurality of media elements comprises a field of view of the object;

identifying, based on an area of interest, a set of pixels, wherein the field of view comprises the area of interest;

for each media element of the plurality of media elements:

extracting an attribute value for the object from the set of pixels found in the media element; and

constructing a respective array comprising each attribute value;

combining each of the arrays into a data structure; and

analyzing the data structure to provide data on a property of the object.

9. The system of claim 8 , wherein the media is received at least substantially in real time from recording equipment, and the operations further comprise:

receiving a speed measurement indicating a speed at which the object is being processed; and

adjusting a frame rate of the recording equipment based on a difference between the speed measurement and a baseline speed.

10. The system of claim 8 , wherein the operations further comprise:

retrieving a template data structure representing a baseline attribute value;

generating a difference data structure by subtracting the data structure from the template data structure; and

facilitating transmission of a graphical representation of the difference data structure to a user device for display.

11. The system of claim 8 , wherein the operations further comprise:

retrieving a template data structure representing baseline attribute value;

generating a difference data structure by subtracting the data structure from the template data structure; and

modifying an industrial process associated with processing the object based on determining that an aspect of the difference data structure satisfies a threshold.

12. The system of claim 11 , wherein modifying the industrial process comprises at least one of:

facilitating discarding production of the object; or

facilitating adjustment of a processing parameter of the industrial process.

13. The system of claim 8 , wherein the operations further comprise:

identifying a location of the object in each of a plurality of arrays;

constructing a dataset comprising the locations and corresponding times; and

determining a frequency of movement of the object by performing a Fourier transform on the dataset.

14. The system of claim 8 further comprising at least one motion sensor communicatively coupled to the processing device, wherein the operations further comprise:

determining a beginning media element of an interstitial portion based on a first trigger signal from the at least one motion sensor, the first trigger signal indicating an end of a movement cycle of the object;

determining an ending media element of the interstitial portion based on a second trigger signal from the at least one motion sensor, the second trigger signal indicating a beginning of the movement cycle of the object; and

excluding media elements between the beginning media element and the ending media element from the plurality of media elements.

15. A non-transitory computer-readable medium storing computer-executable instructions that, when executed by computing hardware, configure the computing hardware to perform operations comprising:

receiving media of an industrial process, wherein:

the media comprises a plurality of media elements, and

each media element of the plurality of media elements comprises a field of view of at least one object;

identifying a set of pixels within the field of view;

for each media element of the plurality of media elements:

extracting an attribute value for the at least one object from the set of pixels found in the media element; and

constructing a respective array comprising each attribute value;

combining each of the arrays into a data structure; and

analyzing the data structure to provide data on a processing parameter associated with the at least one object.

16. The non-transitory computer-readable medium of claim 15 , wherein the at least one object comprises at least one of a component of equipment or an item being manufactured.

17. The non-transitory computer-readable medium of claim 15 , wherein analyzing the data structure comprises facilitating generation and transmission of a graphical representation of the data structure to a user device for display.

18. The non-transitory computer-readable medium of claim 17 , wherein:

the respective arrays are indexed in the data structure according to a sequence of the plurality of media elements found in the media, and

the graphical representation comprises a visual representation displaying each respective array being arranged at least substantially sequentially along an axis of the graphical representation according to how the respective arrays are indexed in the data structure.

19. The non-transitory computer-readable medium of claim 15 , wherein the operations further comprise:

retrieving a template data structure representing baseline attribute value;

generating a difference data structure by subtracting the data structure from the template data structure; and

modifying the industrial process based on determining that an aspect of the difference data structure satisfies a threshold.

20. The non-transitory computer-readable medium of claim 19 , wherein modifying the industrial process comprises at least one of:

facilitating discarding production of the at least one object; or

facilitating adjustment of the processing parameter of the industrial process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2023
From: FRACKOWIAK, SLAWEK; FRACKOWIAK, LES
To: INDUSTRIAL VIDEO SOLUTIONS INC.
Reel/Frame 063254/0380 →
Continuity (1)
Provisional Application 63394805 · Aug 3, 2022
Cited By (2)
US 12,198,438 US 12,379,717