IP Library Granted Patent US 11,674,839
Granted Patent B1
US 11,674,839 · App. 17/649,927 · Granted Jun 13, 2023

System and method of detecting fluid levels in tanks

Inventors: Logan Spears (Kingston, WA); Carlos Anchia (Plano, TX); Corey Staten (Columbus, OH); Wei Xu (Seattle, WA)
Assignee: Plainsight Corp.
G01F23/292H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,674,839
App. No.
17/649,927
Granted
Jun 13, 2023
Kind
B1
Abstract

A method comprising receiving, from a infrared image capture device, an image including a fluid storage tank storing a fluid, the image including an image intensity associated with a temperature of the fluid storage tank with an internal surface that is in contact with the fluid and an image intensity associated with a temperature of the first fluid storage tank with an internal surface that is not in contact with the fluid, generating feature maps, sliding a window to obtain a plurality of anchor shapes using a region proposal network, determining if each anchor shape contains an object to generate a plurality of regions of interest, extracting feature maps from each region of interest, classifying objects in each region of interest, identifying stored fluid using the objects, determining volume of stored fluid based on the stored fluid, and providing the volume to a digital device for display.

Claims (60)

1. A system comprising:

at least one processor; and

memory, the memory containing instructions to control any number of the at least one processor to:

receive, from a first infrared image capture device with a first field of view, a first image including a first fluid storage tank storing a first fluid, the image including a plurality of image intensities, a first image intensity associated with a first temperature of a first portion of the first fluid storage tank with a first internal surface that is in contact with the first fluid stored therein and a second image intensity associated with a second temperature of a second portion of the first fluid storage tank with a second internal surface that is not in contact with the first fluid;

generate feature maps from the first image by applying at least a first convolutional neural network;

slide a first window across the feature maps to obtain a plurality of anchor shapes using a region proposal network;

determine if each anchor shape of the plurality of anchor shapes contains an object to generate a plurality of regions of interest;

extract feature maps from each region of interest;

classify objects in each region of interest;

identify first stored fluid using the objects based on classifications and segmentation masks;

determine first volume of stored fluid based on the first stored fluid; and

provide first volume to a digital device for display.

2. The system of claim 1 , wherein the memory contains the instructions to control any number of the at least one processor to further determine a fluid level of the first stored fluid within the first fluid storage tank.

3. The system of claim 1 , wherein the memory contains the instructions to control any number of the at least one processor to further determine provide the first image and first volume to the digital device for display.

4. The system of claim 1 , wherein the memory contains the instructions to control any number of the at least one processor to further:

compare the first volume to a previously determined volume of the first storage tank taken at a different time to generate a volume rate change;

compare the volume rate change to threshold; and

provide a notification to the digital device based on the comparison of the volume rate change to the threshold.

5. The system of claim 4 , wherein the memory contains the instructions to control any number of the at least one processor to further receive the threshold from the digital device.

6. The system of claim 4 , wherein the memory contains the instructions to control any number of the at least one processor to further compare previous historical volumes of the first storage tank to a historical rate change for a particular duration of time, wherein the threshold is the historical rate change.

7. The system of claim 6 , wherein the memory contains the instructions to control any number of the at least one processor to further update the threshold using the previous historical volumes of the first storage tank for an updated duration of time.

8. The system of claim 1 , wherein each of the plurality of regions of interest being a non-rectangular, polygonal shape.

9. The system of claim 1 wherein the first image further includes a second fluid storage tank storing a second fluid, a third image intensity associated with a third temperature of a first portion of the second fluid storage tank with a third internal surface that is in contact with the second fluid stored therein and a fourth image intensity associated with a fourth temperature of a second portion of the second fluid storage tank with a fourth internal surface that is not in contact with the second fluid, the memory contains the instructions to control any number of the at least one processor to further:

identify second stored fluid using the objects based on classifications and the segmentation masks;

determine second volume of stored fluid based on the second stored fluid; and

provide first volume to a digital device for display.

10. A non-transitory computer readable medium comprising instructions to a control at least one processor to perform a method, the method comprising:

receiving, from a first infrared image capture device with a first field of view, a first image including a first fluid storage tank storing a first fluid, the image including a plurality of image intensities, a first image intensity associated with a first temperature of a first portion of the first fluid storage tank with a first internal surface that is in contact with the first fluid stored therein and a second image intensity associated with a second temperature of a second portion of the first fluid storage tank with a second internal surface that is not in contact with the first fluid;

generating feature maps from the first image by applying at least a first convolutional neural network;

sliding a first window across the feature maps to obtain a plurality of anchor shapes using a region proposal network;

determining if each anchor shape of the plurality of anchor shapes contains an object to generate a plurality of regions of interest;

extracting feature maps from each region of interest;

classifying objects in each region of interest;

identifying first stored fluid using the objects based on classifications and segmentation masks;

determining first volume of stored fluid based on the first stored fluid; and

providing first volume to a digital device for display.

11. The non-transitory computer readable medium of claim 10 , the method further comprising determining a fluid level of the first stored fluid within the first fluid storage tank.

12. The non-transitory computer readable medium of claim 10 , the method further comprising determining provide the first image and first volume to the digital device for display.

13. The non-transitory computer readable medium of claim 10 , the method further comprising:

comparing the first volume to a previously determined volume of the first storage tank taken at a different time to generate a volume rate change;

comparing the volume rate change to threshold; and

providing a notification to the digital device based on the comparison of the volume rate change to the threshold.

14. The non-transitory computer readable medium of claim 13 , the method further comprising receiving the threshold from the digital device.

15. The non-transitory computer readable medium of claim 13 , the method further comprising comparing previous historical volumes of the first storage tank to a historical rate change for a particular duration of time, wherein the threshold is the historical rate change.

16. The non-transitory computer readable medium of claim 15 , the method further comprising updating the threshold using the previous historical volumes of the first storage tank for an updated duration of time.

17. The non-transitory computer readable medium of claim 10 , wherein each of the plurality of regions of interest being a non-rectangular, polygonal shape.

18. The non-transitory computer readable medium of claim 10 , wherein the first image further includes a second fluid storage tank storing a second fluid, a third image intensity associated with a third temperature of a first portion of the second fluid storage tank with a third internal surface that is in contact with the second fluid stored therein and a fourth image intensity associated with a fourth temperature of a second portion of the second fluid storage tank with a fourth internal surface that is not in contact with the second fluid, the method further comprising:

identifying second stored fluid using the objects based on classifications and the segmentation masks;

determining second volume of stored fluid based on the second stored fluid; and

providing first volume to a digital device for display.

19. A method comprising:

receiving, from a first infrared image capture device with a first field of view, a first image including a first fluid storage tank storing a first fluid, the image including a plurality of image intensities, a first image intensity associated with a first temperature of a first portion of the first fluid storage tank with a first internal surface that is in contact with the first fluid stored therein and a second image intensity associated with a second temperature of a second portion of the first fluid storage tank with a second internal surface that is not in contact with the first fluid;

generating feature maps from the first image by applying at least a first convolutional neural network;

sliding a first window across the feature maps to obtain a plurality of anchor shapes using a region proposal network;

determining if each anchor shape of the plurality of anchor shapes contains an object to generate a plurality of regions of interest;

extracting feature maps from each region of interest;

classifying objects in each region of interest;

identifying first stored fluid using the objects based on classifications and segmentation masks;

determining first volume of stored fluid based on the first stored fluid; and

providing first volume to a digital device for display.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2024
From: PLAINSIGHT CORP.
To: PLAINSIGHT TECHNOLOGIES INC.
Reel/Frame 066836/0208 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2023
From: SIXGILL, LLC
To: PLAINSIGHT CORP.
Reel/Frame 063137/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2023
From: SPEARS, LOGAN; ANCHIA, CARLOS; STATEN, COREY; XU, WEI
To: SIXGILL, LLC
Reel/Frame 063098/0664 →
Cited By (2)
US 12,613,008 US 12,669,397