METHOD AND SYSTEM FOR FOODSTUFF IDENTIFICATION
A method for foodstuff identification can include: detecting a trigger event; sampling a measurement set; optionally determining candidate measurements for subsequent analysis based on the measurement set; optionally determining a set of food parameter values from the measurements; optionally selecting a food parameter value for use; determining a cooking instruction based on the food parameter value; automatically operating the appliance based on the cooking instructions; optionally determining a foodstuff trajectory relative to the cook cavity; optionally training one or more modules; and/or any other suitable elements.
1 . A system comprising:
a cooking appliance comprising a cooking cavity;
a camera system comprising two or more cameras, wherein the camera system is separate from the cooking appliance; and
a processing system configured to:
select a subset of images, from a series of images of a foodstuff received from the camera system, based on a confidence score associated with each image of the subset of images satisfying a threshold, wherein the confidence score is based on a visibility of the foodstuff in each image;
determine, based on a determination of one or more food parameter values associated with the foodstuff, one or more cooking instructions; and
operate, based on a determination of the one or more cooking instructions, the cooking appliance.
2 . The system of claim 1 , wherein the processing system is remote from the cooking appliance.
3 . The system of claim 1 , wherein the camera system is external to the cooking appliance.
4 . The system of claim 1 , further comprising:
a suite of sensors configured to evaluate one of more aspects of the food as the food cooks.
5 . The system of claim 4 , wherein the suite of sensors comprises one or more of:
a motion sensor;
an inertial measurement unit (IMU) sensor;
a depth sensor;
a temperature sensor;
an audio sensor;
a door sensor; or
a weight sensor.
6 . The system of claim 1 , wherein the camera system is configured to sample images when a lid of the cooking appliance is open.
7 . The system of claim 1 , wherein the cooking appliance comprises at least one of:
a commercial oven;
an industrial oven;
a conventional oven;
a convection oven;
a smart oven;
a grill;
a smoker;
a pizza oven;
an appliance operable above a temperature threshold; or
an automated appliance.
8 . The system of claim 1 , wherein the processing system is further configured to:
detect a triggering event; and
sample a series of measurements from the camera system, wherein measurements within the series of measurements are determined after the triggering event.
9 . The system of claim 8 , wherein the processing system is further configured to:
determine, using the series of measurements, a foodstuff trajectory relative to the cooking cavity; and
adjusting, based on the foodstuff trajectory, a first cooking instruction of the one or more cooking instructions.
10 . The system of claim 1 , wherein the processing system is further configured to determine the one or more food parameter values associated with the foodstuff using a neural network.
11 . The system of claim 1 , wherein the processing system is further configured to receive, from the camera system, a second series of images of a second foodstuff;
select a second subset of images, from the second series of images, based on a confidence score associated with each image of the second subset of images satisfying the threshold;
determine, based on the second subset of images, one or more second food parameter values associated with the second foodstuff;
determine, based on a determination of the one or more second food parameter values, one or more second cooking instructions; and
operate, based on a determination of the one or more second cooking instructions, the cooking appliance.
12 . The system of claim 11 , wherein the processing system is further configured to:
detect that the foodstuff has been removed from the cooking cavity; and
adjust, based on removal of the foodstuff, a first cooking instruction of the one or more second cooking instructions.
13 . The system of claim 1 , wherein the processing system is further configured to:
send one or more notifications to a user device, wherein the notification comprises a status of the foodstuff.
14 . The system of claim 1 , wherein the camera system is mounted to a top surface of the cooking appliance and is angled outward relative to the cook cavity.
15 . A method comprising:
selecting, by a processing system, a subset of images, from a series of images of a foodstuff received from a camera system, based on a confidence score associated with each image of the subset of images satisfying a threshold, wherein the confidence score is based on a visibility of the foodstuff in each image;
determining, based on a determination of one or more food parameter values associated with the foodstuff, one or more cooking instructions; and
operating, based on a determination of the one or more cooking instructions, a cooking appliance.
16 . The method of claim 15 , wherein the processing system is remote from the cooking appliance.
17 . The method of claim 15 , wherein the camera system is external to the cooking appliance.
18 . The method of claim 15 , wherein the camera system is configured to sample images when a lid of the cooking appliance is open.
19 . The method of claim 15 , wherein the cooking appliance comprises at least one of:
a commercial oven;
an industrial oven;
a conventional oven;
a convection oven;
a smart oven;
a grill;
a smoker;
a pizza oven;
an appliance operable above a temperature threshold; or
an automated appliance.
20 . The method of claim 15 , further comprising:
sending, by the processing system to a user device, one or more notifications indicating a status of the foodstuff.