Optical gas imaging camera with navigation and targeting control, learning and operating methods for the camera, and compliance auditing system
View Patent ↗An optical gas imaging camera, methods of operating the optical gas imaging camera in a learning mode and in an operating mode, and a compliance auditing system are disclosed, where the optical gas imaging camera has on-board hardware, devices, and software used for generating images of fugitive emissions of a target object along with generating a multitude of other information associated with the time of generating images of the target object, which is all combined into compliance data that can be stored on-board the optical gas imaging camera or transmitted to a central computer in the auditing system. The compliance data is stored and can be retrieved to add additional information such as repair of a fugitive emission or for compliance auditing purposes.
1. A method comprising:
capturing, by an optical gas imaging camera, an infrared image and a visible light image of a target object;
determining, by the optical gas imaging camera, a distance data between the target object and the optical gas imaging camera;
measuring, by the optical gas imaging camera, a temperature data at the optical gas imaging camera;
determining, by the optical gas imaging camera, pose data of the optical gas imaging camera;
determining, by the optical gas imaging camera, geographic position data of the optical gas imaging camera; and
encoding, by the optical gas imaging camera, the captured infrared image, the captured visible light image, the distance data, the temperature data, the pose data, and the geographic position data into an encoded data stream or encoded data packet;
wherein each of the distance data, the temperature data, the pose data, and the geographic position data is associated with the captured infrared image and the captured visible light image.
2. The method of claim 1 , performed in real-time by the optical gas imaging camera.
3. The method of claim 1 , further comprising:
generating, in real-time by the optical gas imaging camera, a combined image by adjusting, combining, overlaying, or combinations thereof, the captured infrared image of the target object and the captured visible light image of the target object; and
displaying, in real-time by the optical gas imaging camera, the captured infrared image, the captured visible light image, or the combined image of the target object.
4. The method of claim 1 , further comprising:
determining, by the optical gas imaging camera, a localization of the optical gas imaging camera;
comparing, by the optical gas imaging camera, the captured visible light image of the target object to a reference visible light image of the target object; and
determining, by the optical gas imaging camera, an adjustment in a position of the optical gas imaging camera, an adjustment in a pose of the optical gas imaging camera, or an adjustment in both the position and the pose of the optical gas imaging camera.
5. The method of claim 4 , further comprising:
displaying, by the optical gas imaging camera, a real-time image comprising the captured infrared image of the target object, the captured visible light image of the target object, or a combined image of the target object;
generating, by the optical gas imaging camera, an augmented reality layer on top of the real-time image;
generating, by the optical gas imaging camera, augmented reality objects; and
displaying, by the optical gas imaging camera, one or more augmented reality objects in the augmented reality layer with the real-time image.
6. The method of claim 1 , further comprising:
receive, by the optical gas imaging camera, an ambient condition data associated with a location of the target object, wherein the ambient condition data comprises a wind speed data from an anemometer, a weather condition data from a weather station, or both the wind speed data and the weather condition data;
encoding, by the optical gas imaging camera, the ambient condition data into the encoded data.
7. The method of claim 1 , further comprising:
encoding, by the optical gas imaging camera, additional data into the encoded data, wherein the additional data comprises:
i) an operator identifier, ii) a camera identifier, iii) a target object identifier, iv) a date of image capture of the target object, v) a time of the image capture of the target object, vi) a name of a location of the target object, vii) an ambient temperature value, viii) a difference value between the temperature data and the ambient temperature value, ix) a yes or no indicator that the difference value is less than 0.5° C., x) calibration data including a most-recent date and time of a most-recent calibration of the optical gas imaging camera, a pass or fail indicator for the most-recent calibration, and a verification indicator whether or not the most-recent calibration meets a verification requirement, xi) a proof a verification check for the date that the captured infrared image was captured, xii) an operating mode of the optical gas imaging camera, xiii) whether a viewfinder or a peripheral smart device was utilized, xiv) a tag for the target object, xv) route tracing data, xvi) a length indicator for a time length of the captured infrared image, xvii) pose data, xviii) wind speed data, xix) weather condition data, xx) whether or not the distance data comprises a distance value that is greater than or less than a maximum allowed distance value, xxi) or combinations thereof.
8. The method of claim 1 , wherein:
the captured infrared image and the captured visible light image are captured in real-time;
the distance data, the temperature data, the pose data, and the geographic position data that are associated with the captured infrared image and the captured visible light image are determine or measured concurrently in real-time with the capture of the captured infrared image and the captured visible light image; and
the encoding occurs in real-time.
9. The method of claim 1 , further comprising:
capturing, by the optical gas imaging camera, a reference visible light image of the target object;
determining, by the optical gas imaging camera, a reference distance data between the target object and the optical gas imaging camera;
determining, by the optical gas imaging camera, a reference pose data of the optical gas imaging camera; and
determining, by the optical gas imaging camera, a reference geographic location or position of the optical gas imaging camera;
wherein each of the reference distance data, the reference pose data, and the reference geographic location or position is associated with the reference visible light image.
10. The method of claim 9 , further comprising:
determining, by the optical gas imaging camera, a first stage comparison of the geographic position data with the reference geographic location or position; and
based on the first stage comparison, outputting or displaying, by the optical gas imaging camera to a viewfinder or a computer device connected to the optical gas imaging camera, one or more first augmented reality object on the captured visible light image, wherein the one or more first augmented reality object is indicative of a direction to an observation point for the target object relative to a geographic position of the optical gas imaging camera.
11. The method of claim 10 , further comprising:
determining, by the optical gas imaging camera, a second stage comparison of i) the geographic position data with the reference geographic location or position, ii) the pose data with the reference pose data, iii) the distance data with the reference distance data, or iv) combinations thereof; and
based on the second stage comparison, outputting or displaying, by the optical gas imaging camera to the viewfinder or the computer device while at the observation point for the target object, one or more second augmented reality object on the captured visible light image, wherein the one or more second augmented reality object is indicative of a pose adjustment of the optical gas imaging camera at the observation point.
12. The method of claim 1 , further comprising:
transmitting, by the optical gas imaging camera, compliance data comprising the encoded data to a central computer.
13. A method comprising:
capturing, by an optical gas imaging camera, an infrared image of a target object;
capturing, by the optical gas imaging camera at a first time, a reference visible light image of the target object;
capturing, by the optical gas imaging camera at a second time that is after the first time, a captured visible light image of the target object;
determining, by the optical gas imaging camera at the first time, a reference distance between the target object and the optical gas imaging camera, a reference pose of the optical gas imaging camera, and a reference geographic location or position of the optical gas imaging camera; and
determining, by the optical gas imaging camera at the second time, an operating distance between the target object and the optical gas imaging camera, an operating pose of the optical gas imaging camera, and an operating geographic location or position of the optical gas imaging camera.
14. The method of claim 13 , further comprising:
determining, by the optical gas imaging camera, a first stage comparison of the operating geographic location or position with the reference geographic location or position; and
based on the first stage comparison, outputting or displaying, by the optical gas imaging camera to a viewfinder or a computer device connected to the optical gas imaging camera, one or more first augmented reality object on the captured visible light image, wherein the one or more first augmented reality object is indicative of a direction to an observation point for the target object relative to a geographic position of the optical gas imaging camera.
15. The method of claim 14 , further comprising:
determining, by the optical gas imaging camera, a second stage comparison of i) the operating geographic location or position with the reference geographic location or position, ii) the operating pose with the reference pose, iii) the operating distance with the reference distance, or iv) combinations thereof; and
based on the second stage comparison, outputting or displaying, by the optical gas imaging camera to the viewfinder or the computer device while at the observation point for the target object, one or more second augmented reality object on the captured visible light image, wherein the one or more second augmented reality object is indicative of a pose adjustment of the optical gas imaging camera at the observation point.
16. A method for operating a fugitive emissions compliance system, the method comprising:
encoding, by an optical gas imaging camera, a captured infrared image, a captured visible light image, distance data, temperature data, pose data, and geographic position data into an encoded data stream or encoded data packet;
transmitting, by an optical gas imaging camera, compliance data comprising the encoded data stream or the encoded data packet to a central computer;
receiving, by the central computer, the compliance data from the optical gas imaging camera; and
storing, by the central computer, the compliance data.
17. The method of claim 16 , further comprising:
receiving, by the central computer from a smart device, a request for the compliance data; and
upon receiving the request, sending, by the central computer, the compliance data to the smart device.
18. The method of claim 16 , further comprising:
receiving, by the central computer, additional data from one or more devices that are networked with the central computer.