IP Library Granted Patent US 12,232,687
Granted Patent B2
US 12,232,687 · App. 17/735,660 · Granted Feb 25, 2025

Cleaning robot and method of performing task thereof

Inventors: Soonhyuk Hong (Suwon-si, KR); Minjeong Kang (Suwon-si, KR); Sejin Kwak (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
A47L9/2852A47L9/009A47L9/2826G05D1/0212G05D1/0231A47L2201/04A47L2201/06G05D1/0038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,232,687
App. No.
17/735,660
Granted
Feb 25, 2025
Kind
B2
Abstract

A method, performed by a cleaning robot, of performing a task, is provided. The method includes capturing an image of an object in a vicinity of the cleaning robot, determining a task to be performed by the cleaning robot, by applying the captured image to at least one trained artificial intelligence (AI) model, controlling a guard portion to descend from in front of an opened portion to a floor surface of the cleaning robot, according to the determined task, and driving towards the object so the object is moved by the descended guard portion.

Claims (51)

1. A method, performed by a cleaning robot, of performing a task, the method comprising:

capturing an image of an object in a vicinity of the cleaning robot;

determining a type of the object, by applying the captured image to at least one trained artificial intelligence (AI) model; and

determining driving path of the cleaning robot, according to the type of the object,

wherein the driving path includes:

performing moving in close contact with the object when the type of the object is determined to be a fixed object or a hard to move object,

performing moving away from the object by a certain distance when the type of the object is determined to be a fragile object, and

performing interaction toward the object when the type of the object is determined to be at least one of a person, a body part of a person, and animal.

2. The method of claim 1 ,

wherein the object is determined as a first object, and

wherein the driving path of the cleaning robot is determined as close avoidance driving in which a first distance is spaced apart from the first object.

3. The method of claim 2 ,

wherein the first object has a property of being fixed in the area or difficult to move, and

wherein the first distance is less than 1 cm.

4. The method of claim 2 , further comprising:

measuring distance information between the first object and the cleaning robot in real time,

wherein the driving path of the cleaning robot is determined such that the cleaning robot is separated from the first object by the first distance.

5. The method of claim 1 ,

wherein the object is determined as a second object, and

wherein the driving path of the cleaning robot is determined as complete avoidance driving in which a second distance is spaced apart from the second object.

6. The method of claim 5 ,

wherein the second object has a fragile property or a contamination possibility property, and

wherein the second distance is 1 cm or more and 15 cm or less.

7. The method of claim 5 , further comprising:

measuring distance information between the second object and the cleaning robot in real time,

wherein the driving path of the cleaning robot is determined such that the cleaning robot is separated from the second object by the second distance.

8. The method of claim 5 , further comprising:

measuring distance information between the second object and the cleaning robot in real time,

wherein a virtual wall is set in a second area separated from a second object by the second distance, and the cleaning robot drives in close contact with the virtual wall.

9. The method of claim 1 ,

wherein the object is determined as a second object, and

wherein the cleaning robot performs an interaction toward a third object.

10. The method of claim 9 , wherein the third object has a property of reacting to the interaction.

11. The method of claim 10 , further comprising:

measuring a position of the third object moved in response to the interaction and distance information between the third object and the cleaning robot in real time,

wherein the driving path of the cleaning robot is determined such that the cleaning robot is separated from the second object by a predetermined distance.

12. The method of claim 1 , wherein the determining of the task to be performed by the cleaning robot comprises:

obtaining identification information of the object by applying the captured image to a trained first AI model; and

determining the driving path of the cleaning robot by applying the obtained identification information of the object to a trained second AI model.

13. A cleaning robot comprising:

a camera;

a driver; and

at least one processor configured to:

control the camera to capture an image of an object in a vicinity of the cleaning robot,

determine a type of the object, by applying the captured image to at least one trained artificial intelligence (AI) model,

determine driving path of the cleaning robot, according to the type of the object, and

control the driver to drive the cleaning robot towards the object according to the driving path of the cleaning robot,

wherein the driving path includes:

performing moving in close contact with the object when the type of the object is determined to be a fixed object or a hard to move object,

performing moving away from the object by a certain distance when the type of the object is determined to be a fragile object, and

performing interaction toward the object when the type of the object is determined to be at least one of a person, a body part of a person, and animal.

Priority Claims (1)
KR 10-2018-0169914 · Dec 26, 2018 · national
Continuity (2)
Continuation 16727532 · Dec 26, 2019
Related Publication 20220257077A1 · Aug 18, 2022
References Cited (85)
US 5570285A · Asaka · 1996 [cited by examiner]
US 6169572B1 · Sogawa · 2001 [cited by examiner]
US 6173215B1 · Sarangapani · 2001 [cited by examiner]
US 6481515B1 · Kirkpatrick et al. · 2002 [cited by applicant]
US 6529806B1 · Licht · 2003 [cited by examiner]
US 7444214B2 · Cho · 2008 [cited by examiner]
US 7474941B2 · Kim et al. · 2009 [cited by applicant]
US 7532109B2 · Takahama · 2009 [cited by examiner]
US 7818090B2 · Okamoto · 2010 [cited by examiner]
US 7844398B2 · Sato · 2010 [cited by examiner]
US 8019475B2 · Kuroda · 2011 [cited by examiner]
US 8204679B2 · Nakamura · 2012 [cited by examiner]
US 8793069B2 · Kuroda · 2014 [cited by examiner]
US 8918241B2 · Chen · 2014 [cited by examiner]
US 8972057B1 · Freeman · 2015 [cited by examiner]
US 8972061B2 · Rosenstein · 2015 [cited by examiner]
US 9020637B2 · Schnittman · 2015 [cited by examiner]
US 9408515B2 · Rosenstein · 2016 [cited by examiner]
US 9434074B2 · Tanigawa · 2016 [cited by examiner]
US 10335003B2 · Dabrowski · 2019 [cited by applicant]
US 10492654B2 · Frey · 2019 [cited by applicant]
US 10676022B2 · Zevenbergen · 2020 [cited by examiner]
US 10908615B2 · Nishimura · 2021 [cited by examiner]
US 11292132B2 · Mao · 2022 [cited by examiner]
US 11637968B2 · Lyu · 2023 [cited by examiner]
US 20030174054A1 · Shimomura · 2003 [cited by examiner]
US 20040073368A1 · Gonzalez-Banos · 2004 [cited by examiner]
US 20050021181A1 · Kim et al. · 2005 [cited by applicant]
US 20050171637A1 · Tani · 2005 [cited by examiner]
US 20060058921A1 · Okamoto · 2006 [cited by examiner]
US 20060106496A1 · Okamoto · 2006 [cited by examiner]
US 20060115113A1 · Lages · 2006 [cited by examiner]
US 20080249662A1 · Nakamura · 2008 [cited by examiner]
US 20080269973A1 · Kuroda · 2008 [cited by examiner]
US 20090043440A1 · Matsukawa · 2009 [cited by examiner]
US 20090173561A1 · Moriguchi · 2009 [cited by examiner]
US 20090234527A1 · Ichinose · 2009 [cited by examiner]
US 20100082194A1 · Yabushita · 2010 [cited by examiner]
US 20100217528A1 · Sato · 2010 [cited by examiner]
US 20100222925A1 · Anezaki · 2010 [cited by examiner]
US 20100235033A1 · Yamamoto · 2010 [cited by examiner]
US 20130206177A1 · Burlutskiy · 2013 [cited by applicant]
US 20140124004A1 · Rosenstein · 2014 [cited by examiner]
US 20140129027A1 · Schnittman · 2014 [cited by examiner]
US 20150120128A1 · Rosenstein · 2015 [cited by examiner]
US 20170001309A1 · Passot et al. · 2017 [cited by applicant]
US 20170112345A1 · Frey · 2017 [cited by applicant]
US 20180210445A1 · Choi et al. · 2018 [cited by applicant]
US 20180288320A1 · Melick · 2018 [cited by examiner]
US 20180348374A1 · Laddha · 2018 [cited by examiner]
US 20180353042A1 · Gil · 2018 [cited by examiner]
US 20180354132A1 · Noh · 2018 [cited by examiner]
US 20190072985A1 · Taveira · 2019 [cited by examiner]
US 20190073912A1 · Mellinger, III · 2019 [cited by examiner]
US 20190187703A1 · Millard · 2019 [cited by examiner]
US 20190205609A1 · Taveira · 2019 [cited by examiner]
US 20190310651A1 · Vallespi-Gonzalez · 2019 [cited by examiner]
US 20190320867A1 · Noh et al. · 2019 [cited by applicant]
US 20190343354A1 · Hong · 2019 [cited by examiner]
US 20190365176A1 · Kim · 2019 [cited by examiner]
US 20190369628A1 · Kim · 2019 [cited by examiner]
US 20190370691A1 · Chae · 2019 [cited by examiner]
US 20190378283A1 · Boult · 2019 [cited by examiner]
US 20190389057A1 · Chae · 2019 [cited by examiner]
US 20190392254A1 · Oh · 2019 [cited by examiner]
US 20200089249A1 · Furuta et al. · 2020 [cited by applicant]
US 20200205629A1 · Hong et al. · 2020 [cited by applicant]
US 20230241783A1 · Zhang · 2023 [cited by examiner]
CN 106983460A · 2017 [cited by applicant]
CN 108247647A · 2018 [cited by applicant]
JP 2012231937A · 2012 [cited by applicant]
JP 2017143901A · 2017 [cited by applicant]
JP 2017144301A · 2017 [cited by applicant]
KR 1020180058511A · 2018 [cited by applicant]
KR 1020180134155A · 2018 [cited by applicant]
WO 2018097574A1 · 2018 [cited by applicant]
Chinese Office Action dated Oct. 11, 2023, issued in Chinese Patent Application No. 201980086406.7. [cited by applicant]
European Notice of Allowance dated Oct. 19, 2023, issued in European Patent Application No. 19904904.0. [cited by applicant]
Korean Office Action dated Oct. 20, 2023, issued in Korean Patent Application No. 10-2018-0169914. [cited by applicant]
International Search Report dated Apr. 6, 2020, issued in International Application No. PCT/KR2019/095053. [cited by applicant]
Chun et al., Floor detection based depth estimation from a single indoor scene, 2013 IEEE International Conference on Image Processing https://pdfs.semanticscholar.org/a2ae/b676397b1492eba7aeac7d51d23ffe685685.pdf. [cited by applicant]
European Search Report dated Nov. 17, 2021, issued in European Application No. 19904904.0. [cited by applicant]
Korean Office Action dated Jun. 24, 2024, issued in Korean Patent Application No. 10-2018-0169914. [cited by applicant]
Extended European Search Report dated Jul. 1, 2024, issued in European Patent Application No. 24163796.6. [cited by applicant]
Korean Notice of Allowance dated Sep. 30, 2024, issued in Korean Patent Application No. 10-2018-0169914. [cited by applicant]