IP Library Granted Patent US 11,599,114
Granted Patent B2
US 11,599,114 · App. 16/924,482 · Granted Mar 7, 2023

Electronic apparatus and controlling method thereof

Inventors: Dongnam Byun (Suwon-si, KR); Hyewon Kim (Seoul, KR); Haedong Yeo (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G05D1/0088G05D1/0238G05D1/0274G06K9/6215G06V20/10G06V20/58G05D2201/0203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,599,114
App. No.
16/924,482
Granted
Mar 7, 2023
Kind
B2
Abstract

Provided is an electronic apparatus, including: a sensor; a camera; a storage configured to store first and second artificial intelligence models; a first processor; and a second processor. The second processor is configured to: input an image obtained through the camera to the first artificial intelligence model and identify the object of the first type in the image, and input the image obtained through the camera to the second artificial intelligence model and identify the object of the second type, at least a part of which is not viewable in the image. The first processor is configured to: determine a distance between the object of the first type and the object of the second type based on sensing data received from the sensor; and control the electronic apparatus to travel based on the determined distance.

Claims (48)

1. An electronic apparatus, comprising:

a sensor;

a camera;

a driver;

a storage configured to store a first artificial intelligence model trained to identify an object of a first type included in an image and a second artificial intelligence model trained to identify an object of a second type, at least a part of which is not viewable in the image;

a first processor connected to the sensor, the driver, and the storage;

a second processor connected to the camera, the storage, and the first processor; and

wherein the second processor is configured to:

load the first artificial intelligence model and the second artificial intelligence model from the storage; and

input an image obtained through the camera to the first artificial intelligence model and identify the object of the first type in the image, input the image obtained through the camera to the second artificial intelligence model and identify the object of the second type, at least a part of which is not viewable in the image, and transmit information regarding the identified object of the first type and information regarding the identified object of the second type to the first processor, and

wherein the first processor is configured to:

determine a distance between the object of the first type and the object of the second type based on first sensing data received from the sensor; and

control the driver such that, based on a determination that the distance between the object of the first type and the object of the second type is equal to or greater than a predetermined value, the electronic apparatus is allowed to travel in a close proximity to the object of the first type.

2. The electronic apparatus according to claim 1 ,

wherein the first processor is further configured to control the driver such that, based on a determination that the distance between the object of the first type and the object of the second type is less than the predetermined value, the electronic apparatus travels in an area at a predetermined distance or greater away from the object of the second type.

3. The electronic apparatus according to claim 1 ,

wherein the first processor is further configured to, based on the object of the second type not being identified in the image, control the driver such that the electronic apparatus is allowed to travel in the close proximity to the object of the first type.

4. The electronic apparatus according to claim 1 , wherein the first processor is further configured to determine a first distance between the electronic apparatus and the object and a second distance between the electronic apparatus and the object of the second type based on the first sensing data received from the sensor, and determine the distance between the object of the first type and the object of the second type based on the first distance and the second distance.

5. The electronic apparatus according to claim 1 , wherein the storage is further configured to store information regarding a map including a plurality of sections, a plurality of first artificial intelligence models for identifying the object of the first type corresponding to the plurality of sections, and a plurality of second artificial intelligence models for identifying the object of the second type corresponding to the plurality of sections.

6. The electronic apparatus according to claim 5 , wherein the first processor is further configured to determine a section in which the electronic apparatus is located from among the plurality of sections based on second sensing data received from the sensor, and transmit information regarding the determined section to the second processor, and

wherein the second processor is further configured to:

identify the object of the first type by inputting the image to a first artificial intelligence model corresponding to the determined section from among the plurality of first artificial intelligence models; and

identify the object of the second type by inputting the image to a second artificial intelligence model corresponding to the determined section from among the plurality of second artificial intelligence models.

7. The electronic apparatus according to claim 1 , wherein the second artificial intelligence model is trained to identify the object of the second type of which a collision with the electronic apparatus is to be avoided.

8. A method of controlling an electronic apparatus, the method comprising:

obtaining an image through a camera;

inputting the image obtained through the camera to a first artificial intelligence model and identifying an object of a first type in the image;

inputting the image obtained through the camera to a second artificial intelligence model and identifying an object of a second type, at least a part of which is not viewable in the image;

determining a distance between the object of the first type and the object of the second type based on first sensing data received from a sensor; and

controlling the electronic apparatus such that, based on a determination that the distance between the object of the first type and the object of the second type is equal to or greater than a predetermined value, the electronic apparatus is allowed to travel in a close proximity to the object of the first type.

9. The method according to claim 8 , wherein the controlling comprises controlling the electronic apparatus such that, based on a determination that the distance between the object of the first type and the object of the second type is less than the predetermined value, the electronic apparatus travels in an area at a predetermined distance or greater away from the object of the second type.

10. The method according to claim 8 , wherein the controlling comprises, based on the object of the second type not being identified in the image, allowing the electronic apparatus to travel in the close proximity to the object of the first type.

11. The method according to claim 8 , wherein the determining the distance comprises determining a first distance between the electronic apparatus and the object of the first type and a second distance between the electronic apparatus and the object of the second type based on the first sensing data received from the sensor, and determining the distance between the object of the first type and the object of the second type based on the first distance and the second distance.

12. The method according to claim 8 , further comprising:

storing, in a storage of the electronic apparatus, information regarding a map including a plurality of sections, a plurality of first artificial intelligence models for identifying the object of the first type corresponding to the plurality of sections, and a plurality of second artificial intelligence models for identifying the object of the second type corresponding to the plurality of sections.

13. The method according to claim 12 , wherein the identifying comprises:

determining a section in which the electronic apparatus is located from among the plurality of sections based on second sensing data received from the sensor;

identifying the object of the first type by inputting the image to a first artificial intelligence model corresponding to the determined section from among the plurality of first artificial intelligence models; and

identifying the object of the second type by inputting the image to a second artificial intelligence model corresponding to the determined section from among the plurality of second artificial intelligence models.

14. The method according to claim 8 , wherein the second artificial intelligence model is trained to identify the object of the second type of which a collision with the electronic apparatus is to be avoided.

15. A non-transitory computer-readable storage medium, storing a computer program, which, when executed by at least one processor, causes the at least one processor to perform the method of claim 8 .

16. An apparatus for controlling an electronic apparatus, comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:

code configured to cause at least one of the at least one processor to load a first artificial intelligence model and a second artificial intelligence model;

code configured to cause at least one of the at least one processor to input an image obtained through a camera to the first artificial intelligence model and identify an object of a first type in the image, input the image obtained through the camera to the second artificial intelligence model and identify an object of a second type, at least a part of which is not viewable in the image;

code configured to cause at least one of the at least one processor to determine a distance between the object of the first type and the object of the second type based on first sensing data received from a sensor; and

code configured to cause at least one of the at least one processor to control the electronic apparatus such that, based on a determination that the distance between the object of the first type and the object of the second type is equal to or greater than a predetermined value, the electronic apparatus is allowed to travel in a close proximity to the object of the first type.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2020
From: BYUN, DONGNAM; KIM, HYEWON; YEO, HAEDONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053164/0620 →
Priority Claims (2)
KR 10-2019-0082781 · Jul 9, 2019 · national
KR 10-2019-0134855 · Oct 28, 2019 · national
Continuity (1)
Related Publication 20210011477A1 · Jan 14, 2021
Cited By (1)
US 12,736,964