IP Library Granted Patent US 11,158,072
Granted Patent B2
US 11,158,072 · App. 15/887,566 · Granted Oct 26, 2021

Intelligent dishwashing systems and methods

Inventors: Kerkil Choi (Los Gatos, CA); Paul M. Birkmeyer (San Carlos, CA); Paul Baumgart (San Carlos, CA); Kenneth M. Peters (San Mateo, CA)
Assignee: Dishcraft Robotics, Inc.
G06T7/44A47L15/4295G06N3/04G06N3/08G06T7/0002G06T7/12G06T7/174A47L2401/04G06T2207/10048G06T2207/10064G06T2207/10152G06T2207/20081G06T2207/20084G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,158,072
App. No.
15/887,566
Granted
Oct 26, 2021
Kind
B2
Abstract

Example intelligent dishwashing systems and methods are described. In one implementation, a system includes a light source that is configured to illuminate an article of dishware. An imaging system is configured to capture at least one image of the article of dishware. A processing system is configured to analyze the at least one image to determine a presence of a stain on the article of dishware.

Claims (34)

1. An apparatus comprising:

a light source configured to illuminate an article of dishware;

an imaging system configured to capture at least two images of the article of dishware; and

a processing system configured to analyze the at least two one images to determine a presence of food soils on the article of dishware;

further comprising an optical filter system optically coupled to the light source or the imaging system, wherein the optical filter system is configured to change the characteristics of light transmitted through the optical filter system, wherein the optical filter system includes a first polarizing filter and a second polarizing filter, wherein a configuration of the first polarizing filter is different from a configuration of the second polarizing filter;

wherein the configurations of the first and second polarizing filters result in a first image and a second image having different specular reflections on different parts of the first and second images while signals corresponding to food soils on the article of dishware stay in the same spot on the first and second images; and

wherein the analyzing comprises analyzing the first image and the second image to determine the presence of food soils on the article of dishware by separating signals in the first and second images that are in the same spot on the first and second images from specular reflections that are on different parts of the first and second images.

2. The apparatus of claim 1 , further comprising a robotic actuator configured to change a pose of the article of dishware as viewed by the imaging system, wherein changing the pose of the article of dishware enables the imaging system to capture images of different portions of the article of dishware.

3. The apparatus of claim 1 , further comprising a plurality of light sources, wherein each of the plurality of light sources is configured to emit light with specific characteristics.

4. The apparatus of claim 1 , further comprising a plurality of imaging systems, wherein each of the plurality of imaging systems is configured to capture an image of a substantially separate portion of the article of dishware.

5. The apparatus of claim 1 , wherein the analysis is performed by a convolutional neural network associated with the processing system.

6. The apparatus of claim 1 , wherein the processing system is further configured to detect a presence of a defect on the article of dishware.

7. The apparatus of claim 1 , wherein the food soils are delineated by the processing system using at least one of a bounding box, a contour, or a polygon.

8. The apparatus of claim 1 , further comprising a cleanliness quantifier that is configured to determine a scale of cleanliness associated with the food soils.

9. The apparatus of claim 1 , further comprising a freshness estimator that is configured to determine an approximate age of the food soils.

10. A method comprising:

illuminating an article of dishware;

capturing, by an imaging system, at least two images of the article of dishware;

analyzing, by a processing system, the at least two images to determine a presence of food soils on the article of dishware; and

further comprising:

capturing a first image of the article of dishware via the imaging system and a first polarizing filter;

capturing a second image of the article of dishware via the imaging system and a second polarizing filter, wherein a configuration of the first polarizing filter is different from a configuration of the second polarizing filter, wherein the configurations of the first and second polarizing filters result in the first image and the second image having different specular reflections on different parts of the first and second images while signals corresponding to food soils on the article of dishware stay in the same spot on the first and second images; and

wherein the analyzing comprises analyzing the first image and the second image to determine the presence of food soils on the article of dishware by separating signals in the first and second images that are in the same spot on the first and second images from specular reflections that are on different parts of the first and second images.

11. The method of claim 10 , further comprising changing a pose of the article of dishware as viewed by the imaging system, wherein changing the pose of the article of dishware enables the imaging system to capture images of different portions of the article of dishware.

12. The method of claim 10 , further comprising filtering the light source, wherein the filtering changes the characteristics of light illuminating the article of dishware.

13. The method of claim 10 , wherein the analysis is performed by implementing deep learning algorithms.

14. The method of claim 10 , wherein the food soils are delineated by at least one of a bounding box, a contour, or a polygon.

15. The method of claim 10 , further comprising determining a cleanliness quantifier that is associated with the food soils.

16. The method of claim 10 , further comprising determining a freshness estimator associated with an approximate age of the food soils.

17. A method comprising:

illuminating an article of dishware;

capturing a first image of the article of dishware via a first polarizing filter;

capturing a second image of the article of dishware via a second polarizing filter, wherein a configuration of the first polarizing filter is different from a configuration of the second polarizing filter and wherein the configurations of the first and second polarizing filters result in the first image and the second image having different specular reflections on different parts of the first and second images while signals corresponding to food soils on the article of dishware stay in the same spot on the first and second images; and

analyzing, by a processing system, the first image and the second image captured by the camera of the imaging system to determine a presence of food soils on the article of dishware by separating signals in the first and second images that are in the same spot on the first and second images from specular reflections that are on different parts of the first and second images.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2023
From: DISHCRAFT ROBOTICS, INC.
To: DISHCRAFT (ABC), LLC
Reel/Frame 063773/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2023
From: DISHCRAFT (ABC), LLC
To: JORDAN, JAMES BUCKLY
Reel/Frame 063774/0512 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: CHOI, KERKIL; BIRKMEYER, PAUL M.; BAUMGART, PAUL; PETERS, KENNETH M.
To: DISHCRAFT ROBOTICS, INC.
Reel/Frame 044822/0309 →
Continuity (1)
Related Publication 20190244375A1 · Aug 8, 2019