Method and system for sensor maintenance
The method for dirty camera detection including: detecting a first predetermined state change event; sampling a set of cavity measurements; optionally determining a set of features of the set of cavity measurements; determining a class label based on the cavity measurements; optionally verifying the classification; and facilitating use of the appliance based on the classification.
1. A method for dirty camera detection, comprising:
with a processing system:
detecting a first state change event at an appliance comprising a cook cavity and a camera;
after detecting the first state change event, sampling an image of the cook cavity;
determining a class label, from a plurality of class labels, for the cook cavity using the image, wherein the plurality of class labels represent a cook cavity occupancy state and a camera cleanliness state;
verifying the class label; and
facilitating use of the appliance based on the verified class label.
2. The method of claim 1 , wherein the plurality of class labels comprise an empty cavity-clean camera label and an empty cavity-dirty camera label.
3. The method of claim 2 , wherein the plurality of class labels further comprise food classes.
4. The method of claim 2 , wherein the plurality of class labels is determined by a neural network.
5. The method of claim 4 , wherein the neural network is trained on images of empty cavities taken with clean cameras and dirty cameras, images of occupied cavities taken with clean cameras and dirty cameras, and images of dirty cavities taken with clean cameras and dirty cameras.
6. The method of claim 4 , wherein the class label is used to update a set of parameters of the neural network.
7. The method of claim 1 , wherein the appliance is an oven.
8. The method of claim 1 , wherein the state change event is a door close event.
9. The method of claim 1 , wherein verifying the class label comprises:
storing previous class labels; and
verifying the class label when at least a predetermined proportion of previous class labels matches the class label.
10. The method of claim 1 , wherein facilitating use of the appliance comprises:
when the class label represents a clean camera state:
automatically identifying food subsequently placed in the cook cavity based on a subsequent image of the cook cavity; and
automatically cooking the identified food.
11. The method of claim 1 , wherein facilitating use of the appliance comprises requesting user input before cooking food subsequently placed in the cook cavity when the class label represents a dirty camera state.
12. The method of claim 1 , wherein facilitating use of the appliance comprises selectively disabling a functionality of the appliance when the class label represents a dirty camera state.
13. The method of claim 1 , wherein facilitating use of the appliance comprises notifying a user to clean the camera when the class label represents a dirty camera state.