IP Library › Granted Patent US 12,194,616
Granted Patent B2
US 12,194,616 · App. 16/973,354 · Granted Jan 14, 2025

Robot and control method therefor

Inventor: Soonhyuk Hong (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
B25J11/0085A47L9/2852A47L2201/04B25J9/1666B25J19/023G05D1/0246
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,194,616
App. No.
16/973,354
Granted
Jan 14, 2025
Kind
B2
Abstract

The present invention relates to a robot and a control method therefor and, more particularly, to a robot and a control method therefor, the robot detecting peripheral obstacles and structures by using an image in front of same, thereby providing an efficient and safe moving path. A robot control method according to one embodiment of the present invention comprises the steps of: capturing an image; acquiring a first image of which the bottom surface is separated in the image; recognizing obstacles included in the image by using a learned first artificial intelligence model; allowing a robot to acquire and store a second image in order to perform a task on the basis of the information about the first image and the region including the recognized obstacles; and allowing the robot to move on the basis of the second image.

Claims (48)

1. A control method of a robot, the method comprising:

capturing an image;

obtaining a first image which segments a floor surface from the image;

recognizing a type of obstacle included in the image using a trained first artificial intelligence model;

identifying an access forbidden region based on the type of the obstacle;

obtaining and storing a second image for the robot to perform a task by overlapping the access forbidden regions-region on the first image; and

moving the robot based on the second image,

wherein a size of the access forbidden region is identified based on the type of the obstacle and a size of the obstacle,

wherein identifying the access forbidden region comprises determining a boundary of the forbidden access region as a predetermined multiple of a dimension of the obstacle, wherein the predetermined multiple is based on the type of obstacle, and

wherein the moving the robot comprises, until a distance between the robot and the access forbidden region reaches within a predetermined first distance, moving at a first speed, and based on the distance between the robot and the access forbidden region being smaller than the predetermined first distance, moving at a second speed less than the first speed.

2. The method of claim 1 , further comprising:

obtaining moving state information and capturing direction information of the robot which captures an image,

wherein the storing further comprises storing the moving state information and the direction information together with the second image.

3. The method of claim 2 , further comprising:

identifying a distance between the robot and a wall using the second image and the moving state information.

4. The method of claim 3 , further comprising:

determining a moving speed of the robot based on the distance to the wall.

5. The method of claim 2 , further comprising:

generating a navigation map of a movable region of the robot using the second image stored together with the moving state information and the capturing direction information.

6. The method of claim 5 , further comprising:

identifying a position of a robot and establishing a moving plan using the navigation map and the second image stored together with the capturing direction information.

7. The method of claim 1 , wherein the obtaining the first image comprises obtaining the first image using a second artificial intelligence model trained to detect a floor surface region in the image.

8. The method of claim 1 , wherein a size of the region including the obstacle varies according to a type of an obstacle recognized by the first artificial intelligence model.

9. The method of claim 1 , further comprising:

obtaining a depth map image including depth information of the captured image;

obtaining and storing a third image for the robot to perform a task based on the depth map image and information about a region including the recognized obstacle; and

moving the robot based on the third image.

10. The method of claim 1 , wherein the forbidden access region is based on a space occupied by the obstacle as shown in the captured image.

11. A robot for cleaning, comprising:

a camera;

a driver;

a memory; and

a processor configured to:

control the camera to capture an image, obtain a first image which segments a floor surface from the image,

recognize a type of obstacle included in the image using a trained first artificial intelligence model and identifying an access forbidden region based on the type of obstacle,

obtain and store a second image for the robot to perform a task by overlapping the access forbidden region on the first image and, wherein a size of the access forbidden region is identified based on the type of obstacle and a size of the obstacle, and

control the driver to move the robot based on the second image,

wherein the processor determines a boundary of the forbidden access region as a predetermined multiple of a dimension of the obstacle, wherein the predetermined multiple is based on the type of obstacle, and

wherein the processor controls the driver to, until a distance between the robot and the access forbidden region reaches within a predetermined first distance, move at a first speed, and based on the distance between the robot and the access forbidden region being smaller than the predetermined first distance, move at a second speed less than the first speed.

12. The robot of claim 11 , wherein the robot further comprises:

a sensor,

wherein the processor is further configured to, based on obtaining moving state information and capturing direction information of the robot which captures an image through the sensor, store the moving state information and the direction information together with the second image in the memory.

13. The robot of claim 12 , wherein the processor is further configured to identify a distance between the robot and a wall using the second image and the moving state information.

14. The robot of claim 13 , wherein the processor is further configured to determine a moving speed of the robot based on the distance to the wall.

15. The robot of claim 12 , wherein the processor is further configured to generate a navigation map of a movable region of the robot using the second image stored together with the moving state information and the capturing direction information and store the same in the memory.

16. The robot of claim 15 , wherein the processor is further configured to identify a position of a robot and establish a moving plan using the navigation map and the second image stored together with the capturing direction information.

17. The robot of claim 11 , wherein the processor determines the type of obstacle from a plurality of categories.

18. The robot of claim 11 , wherein the processor determines the forbidden access region based on a space occupied by the obstacle as shown in the captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2020
From: HONG, SOONHYUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 054581/0887 →
Priority Claims (1)
KR 10-2018-0102689 · Aug 30, 2018 · national
Continuity (1)
Related Publication 20210213619A1 · Jul 15, 2021
References Cited (37)
US 7386163B2 · Sabe et al. · 2008 [cited by applicant]
US 8983130B2 · Yasugi et al. · 2015 [cited by applicant]
US 9504369B2 · So et al. · 2016 [cited by applicant]
US 9682483B1 · Romano · 2017 [cited by examiner]
US 9701016B1 · Urata · 2017 [cited by examiner]
US 10437252B1 · Liu · 2019 [cited by examiner]
US 11330948B2 · Noh et al. · 2022 [cited by applicant]
US 20150032260A1 · Yoon · 2015 [cited by examiner]
US 20150088310A1 · Pinter · 2015 [cited by examiner]
US 20160307070A1 · Jiang et al. · 2016 [cited by applicant]
US 20170364088A1 · Grufman · 2017 [cited by examiner]
US 20180114064A1 · Schnittman · 2018 [cited by examiner]
US 20180210445A1 · Choi · 2018 [cited by examiner]
US 20180242806A1 · Haegermarck · 2018 [cited by applicant]
US 20190061157A1 · Suvarna · 2019 [cited by examiner]
US 20190187703A1 · Millard · 2019 [cited by examiner]
US 20190196480A1 · Taylor · 2019 [cited by examiner]
US 20190202449A1 · Taveira · 2019 [cited by examiner]
US 20190320867A1 · Noh et al. · 2019 [cited by applicant]
US 20220265106A1 · Noh et al. · 2022 [cited by applicant]
EP 3367199B1 · 2018 [cited by applicant]
EP 3546139A1 · 2019 [cited by applicant]
JP 2008200770A · 2008 [cited by examiner]
JP 2011134226A · 2011 [cited by applicant]
KR 100825919B1 · 2008 [cited by examiner]
KR 1020140133369A · 2014 [cited by applicant]
KR 1020170061373A · 2017 [cited by applicant]
KR 1020180014535A · 2018 [cited by applicant]
KR 1020180048705A · 2018 [cited by applicant]
KR 1020180058511A · 2018 [cited by applicant]
WO WO2018097574A1 · 2018 [cited by examiner]
Office Action (issuance date: Nov. 18, 2022) issued by the Korean Patent Office for Korean Patent Application No. 10-2018-0102689. [cited by applicant]
Examination Report (issuance date: Jan. 20, 2023) issued by the European Patent Office for European Patent Application No. 19853500.7. [cited by applicant]
International Search Report (PCT/ISA/210) issued by the International Searching Authority in International Application No. PCT/KR2019/011133, issued on Dec. 17, 2019. [cited by applicant]
Written Opinion (PCT/ISA/237) issued by the International Searching Authority in International Application No. PCT/KR2019/011133, issued on Dec. 17, 2019. [cited by applicant]
KR Communication issued May 16, 2023 by the Korean Patent Office in Korean Patent Application No. 10-2018-0102689. [cited by applicant]
Communication dated May 25, 2021, issued by the European Patent Office in counterpart European Application No. 19853500.7. [cited by applicant]