IP Library › Granted Patent US 12,293,027
Granted Patent B2
US 12,293,027 · App. 18/450,153 · Granted May 6, 2025

Method for operating an appliance using hand gestures

Inventors: Haitian Hu (Louisville, KY); Adam Hofmann (Louisville, KY)
Assignee: Haier US Appliance Solutions, Inc.
G06F3/017G06V10/82G06V40/28H04L12/282H04L12/2825
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,027
App. No.
18/450,153
Granted
May 6, 2025
Kind
B2
Abstract

A method of using a remote server to operate a first appliance of a plurality of appliances connected to an external network includes receiving one or more images from a second appliance of the plurality of appliances, analyzing the one or more images to detect a hand gesture, identifying a responsive action associated with the hand gesture, and instructing the first appliance to implement the responsive action.

Claims (33)

1. A method of using a remote server to operate a first appliance of a plurality of appliances, the method comprising:

receiving one or more images from a second appliance of the plurality of appliances;

analyzing the one or more images to detect a hand gesture, wherein the hand gesture is an ok symbol;

identifying a responsive action associated with the hand gesture, wherein the responsive action is leaving a clean indicator on; and

instructing the first appliance to implement the responsive action.

2. The method of claim 1 , wherein each of the plurality of appliances are connected to the remote server through an external network.

3. The method of claim 1 , wherein the one or more images are provided from at least two appliances of the plurality of appliances.

4. The method of claim 1 , wherein the first appliance is a dishwasher appliance.

5. The method of claim 1 , further comprising:

detecting user interaction with the first appliance; and

obtaining the one or more images within a predetermined time after detecting the user interaction.

6. The method of claim 5 , wherein the predetermined time is less than one minute.

7. The method of claim 5 , wherein the first appliance comprises a door and detecting the user interaction with the first appliance comprises determining that the door has been opened or closed.

8. The method of claim 1 , wherein analyzing the one or more images to detect the hand gesture comprises using a machine learning image recognition process comprising at least one of a convolution neural network (“CNN”), a region-based convolution neural network (“R-CNN”), a deep belief network (“DBN”), or a deep neural network (“DNN”) image recognition process.

9. The method of claim 1 , wherein the responsive action comprises:

adjusting a cycle type, a cycle setting, or other operating parameters.

10. The method of claim 1 , wherein the hand gesture is a thumbs up and the responsive action is commencing an operating cycle.

11. The method of claim 1 , wherein the hand gesture is an ok symbol and the responsive action is leaving a clean indicator on.

12. A method for operating an appliance, the method comprising:

obtaining one or more images using a camera assembly;

analyzing the one or more images to detect a hand gesture, wherein the hand gesture is an ok symbol;

identifying a responsive action associated with the hand gesture, wherein the responsive action is leaving a clean indicator on; and

implementing the responsive action using the appliance.

13. The method of claim 12 , wherein the camera assembly is mounted on an outside surface of a cabinet of the appliance for obtaining the one of more images.

14. The method of claim 12 , wherein the camera assembly comprises a fixed focus range of less than 2 feet.

15. The method of claim 14 , wherein the fixed focus range is between about 4 inches and 8 inches.

16. The method of claim 12 , wherein the appliance is a first appliance of a plurality of appliances connected to a local network, and wherein the camera assembly is mounted on a second appliance of the plurality of appliances for obtaining the one of more images.

17. The method of claim 16 , wherein the one or more images are provided from at least two appliances of the plurality of appliances.

18. The method of claim 12 , wherein the appliance is a dishwasher appliance.

19. The method of claim 12 , further comprising:

detecting user interaction with the appliance; and

obtaining the one or more images within a predetermined time after detecting the user interaction.

20. The method of claim 12 , wherein analyzing the one or more images to detect the hand gesture comprises using a machine learning image recognition process comprising at least one of a convolution neural network (“CNN”), a region-based convolution neural network (“R-CNN”), a deep belief network (“DBN”), or a deep neural network (“DNN”) image recognition process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2023
From: HU, HAITIAN; HOFMANN, ADAM
To: HAIER US APPLIANCE SOLUTIONS, INC.
Reel/Frame 064596/0228 →
Continuity (1)
Related Publication 20250060828A1 · Feb 20, 2025
References Cited (40)
US 8863040B2 · Queru · 2014 [cited by applicant]
US 10662571B2 · Strahle · 2020 [cited by applicant]
US 11093554B2 · Rexach et al. · 2021 [cited by applicant]
US 20080019569A1 · Rhoads · 2008 [cited by examiner]
US 20120235899A1 · Han · 2012 [cited by examiner]
US 20130088428A1 · Ting · 2013 [cited by examiner]
US 20130139071A1 · Hoff · 2013 [cited by examiner]
US 20130170699A1 · Bran · 2013 [cited by examiner]
US 20130229346A1 · Jungbauer · 2013 [cited by examiner]
US 20130307765A1 · Li · 2013 [cited by examiner]
US 20140157209A1 · Dalal · 2014 [cited by examiner]
US 20140310764A1 · Tippett · 2014 [cited by examiner]
US 20150000025A1 · clements · 2015 [cited by examiner]
US 20160364008A1 · Chun · 2016 [cited by examiner]
US 20170220128A1 · Karmon · 2017 [cited by examiner]
US 20180020350A1 · Vissa · 2018 [cited by examiner]
US 20180342151A1 · VanBlon · 2018 [cited by examiner]
US 20190384389A1 · Kim · 2019 [cited by examiner]
US 20190391666A1 · Kim · 2019 [cited by examiner]
US 20200050259A1 · Lam · 2020 [cited by examiner]
US 20200110928A1 · Al Jazaery · 2020 [cited by examiner]
US 20200134341A1 · Hu · 2020 [cited by examiner]
US 20210041956A1 · Hasburgh · 2021 [cited by examiner]
US 20210152389A1 · Park · 2021 [cited by examiner]
US 20210201661A1 · Al Jazaery · 2021 [cited by examiner]
US 20210262725A1 · Hong · 2021 [cited by examiner]
US 20210272362A1 · Park · 2021 [cited by examiner]
US 20210329073A1 · Sharma et al. · 2021 [cited by applicant]
US 20210348828A1 · Shin · 2021 [cited by examiner]
US 20220409005A1 · Gross · 2022 [cited by examiner]
US 20220412640A1 · Lee · 2022 [cited by examiner]
US 20230299997A1 · Hu · 2023 [cited by examiner]
US 20240015045A1 · King · 2024 [cited by examiner]
US 20240296697A1 · Xu · 2024 [cited by examiner]
CN 108542332A · 2018 [cited by applicant]
CN 108888224A · 2018 [cited by applicant]
CN 105095882B · 2019 [cited by applicant]
CN 108038452B · 2020 [cited by applicant]
DE 102014115460A1 · 2016 [cited by applicant]
EP 3884212B1 · 2023 [cited by applicant]