IP Library Granted Patent US 9,697,436
Granted Patent B2
US 9,697,436 · App. 14/598,260 · Granted Jul 4, 2017

Method for selecting an image of an appliance with a suitable position or orientation of a door of the appliance

Inventors: Keith Wesley Wait (Louisville, KY); William Everette Gardner (Louisville, KY)
Assignee: Haier US Appliance Solutions, Inc.
G06K9/6202G06K9/4652F25D29/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,697,436
App. No.
14/598,260
Granted
Jul 4, 2017
Kind
B2
Abstract

A method for selecting an image of an appliance with a suitable position or orientation of a door of the appliance is provided. The method includes obtaining a digital RGB image from a camera of the appliance and converting the digital RGB image to a device independent color space in order to generate at least one of a first chromatic primary plane image or a second chromatic primary plane image from the digital RGB image. The method also includes comparing the first or second chromatic primary plane images to a reference image.

Claims (19)

1. A method for selecting an image of an appliance with a suitable position or orientation of a door of the appliance:

obtaining, by the controller, a digital RGB image from a camera of the appliance while the door of the appliance is opening, the camera positioned on the door of the appliance, the digital RGB image including a plurality of optical fiducials positioned on the appliance, each optical fiducial of the plurality of optical fiducials colored one of red, green, yellow and blue;

converting, by the controller, the digital RGB image from said step of obtaining to a Lab color space in order to generate at least one of an A plane image or a B plane image from the digital RGB image, the A plane image is generated at said step of converting if one of the plurality of optical fiducials is red or green and the B plane image is generated at said step of converting if one of the plurality of optical fiducials is yellow or blue;

calculating, by the controller, a normalized cross-correlation between a portion of the A or B plane images from said step of converting and a portion of a reference image, the door being at a reference position in the reference image, said step of calculating comprising calculating the normalized cross-correlation between a line of the A plane image from said step of converting and a line of the reference image if one of the plurality of optical fiducials is red or green and calculating the normalized cross-correlation between a line of the B plane image from said step of converting and the line of the reference image if one of the plurality of optical fiducials is yellow or blue; and

saving, by the controller, the digital RGB image from said step of obtaining when a normalized cross-correlation factor from said step of calculating is greater than a predetermined value.

2. The method of claim 1 , wherein each optical fiducial of the plurality of optical fiducials is colored one of red, green, yellow and blue.

3. The method of claim 1 , further comprising retrieving the digital RGB image after said step of saving and presenting the digital RGB image to a user of the appliance on a display.

4. The method of claim 1 , wherein the appliance is a refrigerator appliance having a cabinet that defines a freezer chamber and a fresh food chamber, the camera positioned on a fresh food door of the refrigerator appliance, the plurality of optical fiducials positioned on the cabinet of the refrigerator appliance adjacent the fresh food chamber.

5. A method for selecting an image of an appliance with a suitable position or orientation of a door of the appliance, comprising:

obtaining, by a controller, a plurality of digital RGB images from a camera of the appliance while the door of the appliance is opening, the camera positioned on the door of the appliance, at least one digital RGB image of plurality of digital RGB images including a plurality of optical fiducials positioned on the appliance, each optical fiducial of the plurality of optical fiducials colored one of red, green, yellow and blue;

converting, by the controller, each digital RGB image of the plurality of digital RGB images from said step of obtaining to a device independent color space in order to generate an first chromatic primary plane image or a second chromatic primary plane image from each digital RGB image of the plurality of digital RGB images, the device independent color space is a Lab color space, the first chromatic primary plane image is an A plane image, and the second chromatic primary plane image is a B plane image, the A plane image generated at said step of converting if one of the plurality of optical fiducials is red or green and the B plane image generated at said step of converting if one of the plurality of optical fiducials is yellow or blue;

calculating, the controller, a normalized cross-correlation between a portion of the first or second chromatic primary plane images from said step of converting and a portion of a reference image, the door being at a reference position in the reference image, said step of calculating comprising calculating the normalized cross-correlation between a line of the A plane image from said step of converting and a line of the reference image if one of the plurality of optical fiducials is red or green and calculating the normalized cross-correlation between a line of the B plane image from said step of converting and the line of the reference image if one of the plurality of optical fiducials is yellow or blue; and

selecting, by the controller, a particular one of the plurality of digital RGB images, the particular one of the plurality of digital RGB images having a normalized cross-correlation factor from said step of calculating that is greater than a predetermined value.

6. The method of claim 5 , wherein said step of calculating comprises calculating the normalized cross-correlation between a line of the first or second chromatic primary plane images from said step of converting and a line of the reference image.

7. The method of claim 5 , further comprising saving the particular one of the plurality of digital RGB images in a memory of the appliance.

8. The method of claim 7 , further comprising retrieving the digital RGB image after said step of saving and presenting the digital RGB image to a user of the appliance on a display.

9. The method of claim 5 , wherein the appliance is a refrigerator appliance having a cabinet that defines a freezer chamber and a fresh food chamber, the camera positioned on a fresh food door of the refrigerator appliance, the plurality of optical fiducials positioned on the cabinet of the refrigerator appliance adjacent the fresh food chamber.

10. The method of claim 9 , wherein each of the plurality of optical fiducials comprises a sticker adhered to the cabinet.

11. The method of claim 9 , wherein the optical fiducials are fixed at a top portion of the cabinet.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2016
From: GENERAL ELECTRIC COMPANY
To: HAIER US APPLIANCE SOLUTIONS, INC.
Reel/Frame 038964/0253 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2015
From: WAIT, KEITH WESLEY; GARDNER, WILLIAM EVERETTE
To: GENERAL ELECTRIC COMPANY
Reel/Frame 034733/0180 →
Continuity (1)
Related Publication 20160210510A1 · Jul 21, 2016