Integrated hardware-software computer vision system for autonomous control and inspection of substrate processing systems
A substrate processing system comprises an edge computing device including processor that executes instructions stored in a memory to process an image or video captured by camera(s) of at least one of a substrate and a component of the substrate processing system. The component is associated with a robot transporting the substrate between processing chambers of the substrate processing system or between the substrate processing system and a second substrate processing system. The cameras are located along a travel path of the substrate. The instructions configure the processor to transmit first data from the image to a remote server via a network and to receive second data from the remote server via the network in response to transmitting the first data to the remote server. The instructions configure the processor to operate the substrate processing system according to the second data in an automated or autonomous manner.
1 . A substrate processing system comprising:
a processor; and
a memory storing instructions for execution by the processor to:
process an image captured by a camera of at least one of a substrate and a component of the substrate processing system, wherein the component is associated with transporting the substrate between processing chambers of the substrate processing system or between the substrate processing system and a second substrate processing system, and wherein the camera is located along a travel path of the substrate in the substrate processing system between the processing chambers;
transmit first data from the image to a remote server via a network; and
receive second data from the remote server via the network in response to transmitting the first data to the remote server;
wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the second data includes:
an indication that a serial number of the edge coupling ring is incorrect;
an indication that a problem associated with processing the substrate is due to the serial number of the edge coupling ring being incorrect; and
a recommendation to replace the edge coupling ring with another edge coupling ring with a correct serial number for the one of the processing chambers; and
wherein the instructions further cause the processor to:
generate a schedule for replacing the edge coupling ring with the other edge coupling ring with the correct serial number for the one of the processing chambers in response to the second data including the recommendation; and
operate the substrate processing system according to the schedule.
2 . The system of claim 1 wherein in response to the image being of the component and the component including a pad located in a load lock of the substrate processing system, the pad being used to support the substrate, an edge coupling ring associated with the substrate, or a robot transporting the substrate, the second data includes one or more of:
an indication of a condition of the pad; and
a recommendation regarding one or more of service and replacement of the pad; and
wherein the instructions further cause the processor to generate a schedule for one or more of servicing and replacing the pad in response to the second data including the recommendation regarding one or more of service and replacement of the pad.
3 . The system of claim 1 wherein in response to the image being of the substrate and the substrate being used during cleaning of one of the processing chambers in the substrate processing system, the second data includes one or more of:
an indication that the substrate is of a type that is used during cleaning of the one of the processing chambers in the substrate processing system;
an indication of a condition of the substrate;
a recommendation regarding replacement of the substrate; and
a recommendation regarding selecting a recipe in the one of the processing chambers; and
wherein the instructions further cause the processor to select the recipe in the one of the processing chambers in response to the second data including the recommendation regarding selecting the recipe.
4 . The system of claim 1 wherein in response to the image being of the substrate, the second data includes one or more of:
an indication of a type of the substrate; and
an indication for selecting a recipe for processing the substrate; and
wherein the instructions further cause the processor to select the recipe for processing the substrate in response to the second data including the indication regarding selecting the recipe.
5 . The system of claim 1 wherein in response to the image being of the substrate, the second data includes one or more of:
an indication of a type of the substrate;
an indication of a process performed on the substrate in one of the processing chambers;
an indication of a condition of the one of the processing chambers that processed the substrate; and
an indication for selecting a recipe for cleaning the one of the processing chambers that processed the substrate; and
wherein the instructions further cause the processor to:
schedule service for the one of the processing chambers in response to the second data including the indication of the condition of the one of the processing chambers; and
select the recipe for cleaning the one of the processing chambers that processed the substrate in response to the second data including the indication regarding selecting the recipe.
6 . The system of claim 1 wherein in response to the image being of the substrate captured by the camera located in a load lock of the substrate processing system, the second data includes one or more of:
an indication of a drift in placement of the substrate in the load lock by a robot transporting the substrate from one of the processing chambers that processed the substrate; and
a recommendation regarding servicing the robot or the one of the processing chambers that processed the substrate; and
wherein the instructions further cause the processor to:
generate a schedule for servicing the robot in response to the second data including the recommendation regarding servicing the robot; and
perform an adjustment in the one of the processing chambers relating to releasing the substrate to the robot in response to the second data including the recommendation regarding servicing the one of the processing chambers that processed the substrate.
7 . The system of claim 1 wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the second data includes one or more of:
an indication of an etch rate in the one of the processing chambers; and
an indication of an adjustment for a recipe used in the one of the processing chambers; and
wherein the instructions further cause the processor to adjust the recipe used in the one of the processing chambers in response to the second data including the indication regarding the adjustment.
8 . A substrate processing system comprising:
a processor; and
a memory storing instructions for execution by the processor to:
process an image captured by a camera of at least one of a substrate and a component of the substrate processing system, wherein the component is associated with transporting the substrate between processing chambers of the substrate processing system or between the substrate processing system and a second substrate processing system, and wherein the camera is located along a travel path of the substrate in the substrate processing system between the processing chambers;
transmit first data from the image to a remote server via a network; and
receive second data from the remote server via the network in response to transmitting the first data to the remote server;
wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the second data includes:
an indication to adjust at least one of the edge coupling ring and a recipe used in the one of the processing chambers in response to the edge coupling ring being correct for the one of the processing chambers, the processing chambers using the same recipe, and the edge coupling ring exhibiting a different change than edge coupling rings in other processing chambers in the substrate processing system; and
wherein the instructions further cause the processor to;
adjust at least one of the edge coupling ring and the recipe used in the one of the processing chambers; and
operate the substrate processing system according to the adjusted at least one of the edge coupling ring and the recipe used in the one of the processing chambers.
9 . A system comprising:
a processor; and
a memory storing instructions for execution by the processor to:
receive, via a network, data from an image captured by a camera of at least one of a substrate and a component of a substrate processing system, wherein the component is associated with transporting the substrate between processing chambers of the substrate processing system or between the substrate processing system and a second substrate processing system, and wherein the camera is located along a travel path of the substrate in the substrate processing system between the processing chambers;
input a portion of the data to a model trained to provide an output useful for operating the substrate processing system; and
transmit the output from the model to the substrate processing system via the network;
wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the output of the model includes:
an indication to adjust at least one of the edge coupling ring and a recipe used in the one of the processing chambers in response to the edge coupling ring being correct for the one of the processing chambers, the processing chambers using the same recipe, and the edge coupling ring exhibiting more change than edge coupling rings in other processing chambers in the substrate processing system.
10 . The system of claim 9 wherein in response to the image being of the component and the component including a pad located in a load lock of the substrate processing system, the pad being used to support the substrate, an edge coupling ring associated with the substrate, or a robot transporting the substrate, the output of the model indicates a condition of the pad and includes a recommendation regarding one or more of service and replacement of the pad.
11 . The system of claim 9 wherein in response to the image being of the substrate and the substrate being used during cleaning of one of the processing chambers in the substrate processing system, the output of the model includes one or more of:
an indication that the substrate is of a type that is used during cleaning of the one of the processing chambers in the substrate processing system;
an indication of a condition of the substrate;
a recommendation regarding replacement of the substrate; and
a recommendation regarding selecting a recipe in the one of the processing chambers.
12 . The system of claim 9 wherein in response to the image being of the substrate, the output of the model includes one or more of:
an indication of a type of the substrate; and
an indication for selecting a recipe for processing the substrate.
13 . The system of claim 9 wherein in response to the image being of the substrate, the output of the model includes one or more of:
an indication of a type of the substrate;
an indication of a process performed on the substrate in one of the processing chambers;
an indication of a condition of the one of the processing chambers that processed the substrate; and
an indication for selecting a recipe for cleaning the one of the processing chambers that processed the substrate.
14 . The system of claim 9 wherein in response to the image being of the substrate captured by the camera located in a load lock of the substrate processing system, the output of the model includes one or more of:
an indication of a drift in placement of the substrate in the load lock by a robot transporting the substrate from one of the processing chambers that processed the substrate; and
a recommendation regarding servicing the robot or the one of the processing chambers that processed the substrate.
15 . The system of claim 9 wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the output of the model includes one or more of:
a serial number of the edge coupling ring; and
a recommendation regarding replacing the edge coupling ring with a second edge coupling ring having a correct serial number for the one of the processing chambers.
16 . The system of claim 9 wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the output of the model includes one or more of:
an indication that the edge coupling ring is incorrect;
an indication that a problem associated with processing the substrate is due to the edge coupling ring being incorrect; and
a recommendation to replace the edge coupling ring with a correct edge coupling ring for the one of the processing chambers.
17 . The system of claim 9 wherein in response to the image being of the component and the component being an edge coupling ring associated with the substrate received from one of the processing chambers, the output of the model includes one or more of:
an indication of an etch rate in the one of the processing chambers; and
an indication of an adjustment for a recipe used in the one of the processing chambers.
18 . A system comprising:
a processor; and
a memory storing instructions for execution by the processor to:
receive a first image of an edge coupling ring captured by a single camera arranged in a substrate processing system;
move the edge coupling ring by a predetermined distance using a robot;
receive a second image of the edge coupling ring captured by the single camera after the robot moves the edge coupling ring by the predetermined distance;
perform triangulation using the first and second images to generate a three-dimensional point cloud representing a thickness profile of the edge coupling ring;
determine an amount of erosion of the edge coupling ring based on the thickness profile;
determine whether the amount of erosion is greater than or equal to a predetermined threshold; and
operate the robot to replace the edge coupling ring in response to the amount of erosion being greater than or equal to the predetermined threshold.
19 . The system of claim 18 wherein the instructions cause the processor to determine the predetermined threshold based on the thickness profile to a prior thickness profile generated from a prior three-dimensional point cloud created when the edge coupling ring is first installed in the substrate processing system.