System and method for targeted heating element control
View Patent ↗A method for targeted heating element control can include: sampling measurements, determining one or more occupied regions based on the measurements, determining one or more food types, controlling appliance operation based on the occupied regions and food types, optionally providing real-time feedback to the user for food placement within the cavity, optionally sampling training measurements, optionally determining a cavity occupancy region classifier, and/or any other suitable elements.
1. A method, comprising:
sampling a measurement depicting food within a cavity of an appliance;
classifying, based on the measurement, the food as being arranged within one of a predetermined set of cavity occupancy regions;
determining a food type for the food; and
controlling the appliance operation based on the classified one of the predetermined set of cavity occupancy regions and the food type by selectively operating, from among a set of individually controllable heating elements, one or more heating elements that are associated with the classified one of the predetermined set of cavity occupancy regions,
wherein each one of the set of individually controllable heating elements is configured to operate in a heating state in accordance with an independently adjustable output power range.
2. The method of claim 1 , wherein the measurement comprises an image.
3. The method of claim 1 , wherein the appliance comprises a grill or an oven.
4. The method of claim 1 , wherein the predetermined set of cavity occupancy regions are defined relative to the cavity.
5. The method of claim 1 , wherein the predetermined set of cavity occupancy regions are different sizes.
6. The method of claim 1 , wherein controlling the appliance operation comprises:
selecting a cooking program based on the classified one of the predetermined set of cavity occupancy regions and the food type; and
using the cooking program to control the appliance operation.
7. The method of claim 1 , wherein each one of the predetermined set of cavity occupancy regions comprises a different combination of a set of cooking zones, and
wherein the cooking zones comprise adjacent subregions defined along at least one axis of the cavity.
8. The method of claim 1 , wherein the measurement depicts multiple foods, and
wherein determining the food type for the food comprises:
determining a segment for each food instance present in the cavity using an instance-based segmentation module; and
assigning a food type to each respective segment using a classification module.
9. The method of claim 1 , wherein the classification of the food within one of the predetermined set of cavity occupancy regions is calculated using a trained classification neural network, and
wherein the trained classification neural network is trained on images with cavity occupancy region labels.
10. The method of claim 1 , wherein the appliance comprises a fiducial depicted in the measurement, and wherein the method further comprises:
determining a camera pose relative to the appliance based on the fiducial; and
classifying the food arranged within the cavity occupancy region based on the camera pose.
11. An appliance, comprising:
a cavity; and
a processing system configured to:
sample a measurement depicting food within the cavity;
classify, based on the measurement, the food as being arranged within one of a predetermined set of cavity occupancy regions;
determine a food type for the food; and
control the appliance operation based on the classified one of the predetermined set of cavity occupancy regions and the food type by selectively operating, from among a set of individually controllable heating elements, one or more heating elements that are associated with the classified one of the predetermined set of cavity occupancy regions,
wherein each one of the set of individually controllable heating elements is configured to operate in a heating state in accordance with an independently adjustable output power range.
12. The appliance of claim 11 , wherein the appliance comprises a grill or an oven.
13. The appliance of claim 11 , further comprising:
the set of independently controllable heating elements.
14. The appliance of claim 13 , wherein the set of independently controllable heating elements comprise infrared heating elements.
15. The appliance of claim 13 , wherein the set of independently controllable heating elements are arranged along a top of the cavity.
16. The appliance of claim 11 , wherein the processing system is configured to sample the measurement via a camera mounted to the cavity.
17. The appliance of claim 11 , wherein the processing system is configured to classify the food within one of the predetermined set of cavity occupancy regions using a first neural network, and to determine the food type using a second neural network.
18. The appliance of claim 11 , wherein the food type and the classification of the food within one of the predetermined set of cavity occupancy regions are calculated within 100 milliseconds of sampling the measurement.
19. The appliance of claim 11 , wherein the predetermined set of cavity occupancy regions are different sizes.
20. The method of claim 1 , wherein the measurement depicts multiple foods, and
wherein the set of individually controllable heating elements comprise radiant heating elements that are configured to direct radiant heat to cook each one of the multiple foods at different temperatures based upon a location of each respective one of the multiple foods within the cavity.