Systems and methods using image recognition processes for improved operation of a laundry appliance
A method of operating a washing machine appliance includes obtaining an image of the wash basket and a load of articles therein from a camera assembly of a remote user interface device. The method also includes analyzing the obtained image using a machine learning image recognition process. Analyzing the obtained image may include determining a ratio of a diameter of an area occupied by the load of articles to a diameter of the wash basket or determining a ratio of a maximum height of an area occupied by the load of articles to a major axis of the wash basket. The method further includes estimating a load size of the load of articles based on the analysis and directing a wash cycle within the washing machine appliance based on the estimated load size.
1 . A method of determining a load size for a washing machine appliance, the washing machine appliance defining a vertical direction, a lateral direction, and a transverse direction, the vertical direction, the lateral direction, and the transverse direction being mutually perpendicular, the washing machine appliance comprising a cabinet, a wash tub mounted within the cabinet, and a wash basket, the wash basket defining a wash chamber, the wash basket rotatably mounted within the wash tub whereby the wash basket is rotatable about the vertical direction, the method comprising:
obtaining one or more images of the wash basket and a load of articles therein from a camera assembly of a remote user interface device;
analyzing at least one obtained image using a machine learning image recognition process, wherein analyzing the at least one obtained image comprises determining a ratio of a diameter of an area occupied by the load of articles to a diameter of the wash basket;
estimating the load size of the load of articles based on the analysis; and
directing a wash cycle within the washing machine appliance based on the estimated load size.
2 . The method of claim 1 , further comprising estimating an additional load attribute based on the analysis, wherein the additional load attribute comprises at least one of a fabric type or a load color.
3 . The method of claim 1 , further comprising displaying, on a display of the remote user interface device, a reticle configured to align with the wash basket.
4 . The method of claim 1 , further comprising receiving a plurality of angle readings from the remote user interface device, determining a position of the remote user interface device relative to the washing machine appliance based on the plurality of angle readings, and determining a set camera angle for a camera assembly of the remote user interface device is met based on the determined position of the remote user interface device.
5 . The method of claim 4 , wherein the plurality of angle readings are detected by an accelerometer of the remote user interface device.
6 . The method of claim 1 , wherein directing the wash cycle within the washing machine appliance based on the estimated load size comprises setting a dispense dosage for the wash cycle based on the estimated load size.
7 . The method of claim 1 , wherein directing the wash cycle within the washing machine appliance based on the estimated load size comprises setting a fill volume for the wash cycle based on the estimated load size.
8 . The method of claim 1 , wherein obtaining one or more images comprises receiving a video signal from the camera assembly, and wherein the method further comprises:
presenting a real-time feed of the camera assembly at the remote user interface device according to the received video signal; and
overlaying a two-dimensional reference shape over the real-time feed.
9 . The method of claim 1 , wherein the diameter of the area occupied by the load of articles is determined based on an image segmentation map.
10 . A method of determining a load size for a washing machine appliance, the washing machine appliance defining a vertical direction, a lateral direction, and a transverse direction, the vertical direction, the lateral direction, and the transverse direction being mutually perpendicular, the washing machine appliance comprising a cabinet, a wash tub mounted within the cabinet, and a wash basket, the wash basket defining a wash chamber, the wash basket rotatably mounted within the wash tub whereby the wash basket is rotatable about the vertical direction, the method comprising:
obtaining one or more images of the wash basket and a load of articles therein from a camera assembly of a remote user interface device;
analyzing at least one obtained image using a machine learning image recognition process, wherein analyzing the at least one obtained image comprises determining a ratio of a maximum height of an area occupied by the load of articles to a minor axis of the wash basket;
estimating the load size of the load of articles based on the analysis; and
directing a wash cycle within the washing machine appliance based on the estimated load size.
11 . The method of claim 10 , further comprising estimating an additional load attribute based on the analysis, wherein the additional load attribute comprises at least one of a fabric type or a load color.
12 . The method of claim 10 , further comprising displaying, on a display of the remote user interface device, a reticle configured to align with the wash basket.
13 . The method of claim 10 , further comprising determining a position of the remote user interface device relative to the washing machine appliance based on a plurality of angle readings, and determining a set camera angle for a camera assembly of the remote user interface device is met based on the determined position of the remote user interface device.
14 . The method of claim 13 , wherein the position of the remote user interface device is determined by analyzing a geometry of the wash basket in the at least one obtained image.
15 . The method of claim 14 , wherein the wash basket appears as an ellipse in the at least one obtained image, and wherein geometry of the wash basket is an eccentricity of the ellipse.
16 . The method of claim 10 , wherein directing the wash cycle within the washing machine appliance based on the estimated load size comprises setting a dispense dosage for the wash cycle based on the estimated load size.
17 . The method of claim 10 , wherein directing the wash cycle within the washing machine appliance based on the estimated load size comprises setting a fill volume for the wash cycle based on the estimated load size.
18 . The method of claim 10 , wherein obtaining one or more images comprises receiving a video signal from the camera assembly, and wherein the method further comprises:
presenting a real-time feed of the camera assembly at the remote user interface device according to the received video signal; and
overlaying a two-dimensional reference shape over the real-time feed.
19 . The method of claim 10 , wherein the maximum height of the area occupied by the load of articles is determined based on an image segmentation map.