IP Library Granted Patent US 11,582,397
Granted Patent B2
US 11,582,397 · App. 17/323,310 · Granted Feb 14, 2023

Enhanced controller synchronization verification

Inventors: Thomas Robert Swanson (Sunnyvale, CA); Andrew Rossignol (Mountain View, CA)
Assignee: X Development LLC
H04N5/2351A01K61/13H04N5/2354H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,582,397
App. No.
17/323,310
Granted
Feb 14, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that validate the synchronization of controllers in an aquaculture environment. One of the methods includes an image processor that receives images generated by a first image generating device that includes a light filter that is associated with light of a particular light frequency while an aquaculture environment was illuminated with light. Based on the image, the image processor determines whether the intensity value of the light frequency in the image satisfies a threshold value. Based on determining whether the intensity value of the light frequency in the image satisfies the threshold value, the image processor determines whether the aquaculture environment was illuminated with light of the particular light frequency when the image was generated. The image processor provides an indication of whether the aquaculture was illuminated with light of the particular frequency when the image was generated.

Claims (65)

1. A computer-implemented method comprising:

accessing, by an image processor, a synchronization schedule for:

synchronizing operation of a first camera having a filter that allows light of a first color to pass through, with a first illumination device that illuminates scenes with light of the first color, and

for synchronizing operation of a second camera having a filter that allows light of a second color to pass through, with a second illumination device that illuminates scenes with the light of the second color,

wherein the synchronization schedule:

indicates times when the first camera and the first illumination device are to operate so as to be in synchronization with each other, and

indicates other times when the second camera and the second illumination device are to operate so as to be in synchronization with each other, and

wherein the cameras and the illumination devices operate in an environment where synchronization according to the synchronization schedule can be disturbed by:

electrical disturbances that block signals used for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, or

spurious signals that are detected by the first and second camera or the first and second illumination devices as signals for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, but that are not actually signals used for instructing the first and second camera or the first and second illumination devices according to the synchronization schedule;

receiving a group of images each taken by the first camera or the second camera, wherein the group of images include a first image that was taken by the first camera and a second image that was taken by the second camera;

determining that synchronization according to the synchronization schedule has been disturbed, comprising:

at a time when the synchronization schedule indicates that the first camera and the first illumination device are to operate so as to be in synchronization with each other, receiving, by the image processor, the first image that was taken by the first camera that has the filter that allows the light of the first color to pass through, and the second image that was taken at the same time by the second camera that has the filter that allows the light of the second color to pass through, and

determining, by the image processor, that an intensity value of the first color in the first image that was taken by the first camera that has the filter that allows light of the first color to pass through does not satisfy a threshold value, or that an intensity value of the second color in the second image that was taken by the second camera that has the filter to allow light of the second color to pass through does satisfy the threshold value;

in response to determining that synchronization according to the synchronization schedule has been disturbed, excluding, by the image processor, the first and second images from evaluation by a machine learning model that evaluates images; and

evaluating the group of images excluding the first and second images by the machine learning model.

2. The method of claim 1 , wherein the first color comprises light having a first light frequency, and wherein first light frequency is in a range of 400 terahertz to 790 terahertz.

3. The method of claim 2 , wherein the first light frequency is in a range of 430 terahertz to 490 terahertz.

4. The method of claim 1 , wherein the second color comprises light having a second light frequency, wherein the second light frequency is in a range of 620 terahertz to 680 terahertz.

5. The method of claim 1 , comprising:

in response to determining that synchronization according to the synchronization schedule has been disturbed, generating, by the image processor, an error indicator.

6. The method of claim 1 , wherein the machine learning model that evaluates images that are taken by the first and second cameras comprises a machine learning model of a parasite detection system.

7. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

accessing, by an image processor, a synchronization schedule for:

synchronizing operation of a first camera having a filter that allows light of a first color to pass through, with a first illumination device that illuminates scenes with light of the first color, and

for synchronizing operation of a second camera having a filter that allows light of a second color to pass through, with a second illumination device that illuminates scenes with the light of the second color,

wherein the synchronization schedule:

indicates times when the first camera and the first illumination device are to operate so as to be in synchronization with each other, and

indicates other times when the second camera and the second illumination device are to operate so as to be in synchronization with each other, and

wherein the cameras and the illumination devices operate in an environment where synchronization according to the synchronization schedule can be disturbed by:

electrical disturbances that block signals used for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, or

spurious signals that are detected by the first and second camera or the first and second illumination devices as signals for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, but that are not actually signals used for instructing the first and second camera or the first and second illumination devices according to the synchronization schedule;

receiving a group of images each taken by the first camera or the second camera, wherein the group of images include a first image that was taken by the first camera and a second image that was taken by the second camera;

determining that synchronization according to the synchronization schedule has been disturbed, comprising:

at a time when the synchronization schedule indicates that the first camera and the first illumination device are to operate so as to be in synchronization with each other, receiving, by the image processor, the first image that was taken by the first camera that has the filter that allows the light of the first color to pass through, and the second image that was taken at the same time by the second camera that has the filter that allows the light of the second color to pass through, and

determining, by the image processor, that an intensity value of the first color in the first image that was taken by the first camera that has the filter that allows light of the first color to pass through does not satisfy a threshold value, or that an intensity value of the second color in the second image that was taken by the second camera that has the filter to allow light of the second color to pass through does satisfy the threshold value;

in response to determining that synchronization according to the synchronization schedule has been disturbed, excluding, by the image processor, the first and second images from evaluation by a machine learning model that evaluates images; and

evaluating the group of images excluding the first and second images by the machine learning model.

8. The non-transitory, computer-readable medium of claim 7 , wherein the first color comprises light having a first light frequency, and wherein first light frequency is in a range of 400 terahertz to 790 terahertz.

9. The non-transitory, computer-readable medium of claim 8 , wherein the first light frequency is in a range of 430 terahertz to 490 terahertz.

10. The non-transitory, computer-readable medium of claim 7 , wherein the second color comprises light having a second light frequency, wherein the second light frequency is in a range of 620 terahertz to 680 terahertz.

11. The non-transitory, computer-readable medium of claim 7 further comprising:

in response to determining that synchronization according to the synchronization schedule has been disturbed, generating, by the image processor, an error indicator.

12. The non-transitory, computer-readable medium of claim 7 , wherein the machine learning model that evaluates images that are taken by the first and second cameras comprises a machine learning model of a parasite detection system.

13. A computer-implemented system comprising:

one or more processors; and

machine-readable media interoperably coupled with the one or more processors and storing one or more instructions that, when executed by the one or more processors, perform operations comprising:

accessing, by an image processor, a synchronization schedule for:

synchronizing operation of a first camera having a filter that allows light of a first color to pass through, with a first illumination device that illuminates scenes with light of the first color, and

for synchronizing operation of a second camera having a filter that allows light of a second color to pass through, with a second illumination device that illuminates scenes with the light of the second color,

wherein the synchronization schedule:

indicates times when the first camera and the first illumination device are to operate so as to be in synchronization with each other, and

indicates other times when the second camera and the second illumination device are to operate so as to be in synchronization with each other, and

wherein the cameras and the illumination devices operate in an environment where synchronization according to the synchronization schedule can be disturbed by:

electrical disturbances that block signals used for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, or

spurious signals that are detected by the first and second camera or the first and second illumination devices as signals for instructing the operation of the first and second camera or the first and second illumination devices according to the synchronization schedule, but that are not actually signals used for instructing the first and second camera or the first and second illumination devices according to the synchronization schedule;

receiving a group of images each taken by the first camera or the second camera, wherein the group of images include a first image that was taken by the first camera and a second image that was taken by the second camera;

determining that synchronization according to the synchronization schedule has been disturbed, comprising:

at a time when the synchronization schedule indicates that the first camera and the first illumination device are to operate so as to be in synchronization with each other, receiving, by the image processor, the first image that was taken by the first camera that has the filter that allows the light of the first color to pass through, and the second image that was taken at the same time by the second camera that has the filter that allows the light of the second color to pass through, and

determining, by the image processor, that an intensity value of the first color in the first image that was taken by the first camera that has the filter that allows light of the first color to pass through does not satisfy a threshold value, or that an intensity value of the second color in the second image that was taken by the second camera that has the filter to allow light of the second color to pass through does satisfy the threshold value;

in response to determining that synchronization according to the synchronization schedule has been disturbed, excluding, by the image processor, the first and second images from evaluation by a machine learning model that evaluates images; and

evaluating the group of images excluding the first and second images by the machine learning model.

14. The computer-implemented system of claim 13 , wherein the first color comprises light having a first light frequency, and wherein first light frequency is in a range of 400 terahertz to 790 terahertz.

15. The computer-implemented system of claim 13 , wherein the operations comprise:

in response to determining that synchronization according to the synchronization schedule was not maintained at the particular time, generating, by the image processor, an error indicator.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: X DEVELOPMENT LLC
To: TIDALX AI INC.
Reel/Frame 068477/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: SWANSON, THOMAS ROBERT; ROSSIGNOL, ANDREW
To: X DEVELOPMENT LLC
Reel/Frame 056348/0744 →