IP Library › Granted Patent US 12,517,519
Granted Patent B2
US 12,517,519 · App. 18/380,509 · Granted Jan 6, 2026

Electronic apparatus and control method thereof

Inventors: Woomok Kim (Suwon-si, KR); Hyunmi Choi (Suwon-si, KR); Dongshin Song (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G05D1/0246B25J9/1676B25J19/023B25J19/06G05D1/0088G05D1/0214G05D1/0274G05D1/228G05D1/246G05D1/249G05D1/617G06N3/08G06T7/70G06V20/10G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,517,519
App. No.
18/380,509
Filed
Oct 16, 2023
Granted
Jan 6, 2026
Kind
B2
Art Unit
3657
USPC
700/255
Abstract

Disclosed is an electronic apparatus. The electronic apparatus includes: a camera; a memory configured to store attribute information and environment information; and a processor configured to identify a plurality of objects based on an image obtained by the camera, identify a first context of a first object, from among the plurality of objects, based on a relationship between attribute information of the plurality of objects and the environment information, and control a traveling state of the electronic apparatus based on the first context.

Claims (61)

1 . An electronic apparatus comprising:

a camera;

a memory storing attribute information of a plurality of objects and environment information; and

a processor configured to:

control the electronic apparatus to autonomously move along a traveling route,

identify a person based on an image obtained by the camera,

identify a relationship between attribute information of the person and the environment information, wherein the relationship indicates a state or an operation between the attribute information of the person and the environment information,

identify, while controlling the electronic apparatus to move along the traveling route, a first context based on the relationship between the attribute information of the person and the environment information, and

change the traveling route of the electronic apparatus based on the first context.

2 . The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to identify a first level of danger of the person based on the first context and change the traveling route of the electronic apparatus based on determining the first level of danger exceeds a threshold.

3 . The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to:

identify a first predicted context of the person based on the relationship between the attribute information of the person and the environment information, and

change the traveling route of the electronic apparatus based on the first predicted context.

4 . The electronic apparatus as claimed in claim 3 , wherein the person is a dynamic object having a dynamic attribute, and

wherein the processor is further configured to:

predict at least one of a moving direction or a moving distance of the person based on the relationship between the attribute information of the person and the environment information, and

change the traveling route of the electronic apparatus based on the at least one of the predicted moving direction or the predicted moving distance.

5 . The electronic apparatus as claimed in claim 4 , wherein the processor is further configured to:

identify a second context that the person is movable based on the dynamic attribute, and

change the traveling route of the electronic apparatus based on the second context.

6 . The electronic apparatus according to claim 1 , wherein the electronic apparatus is configured to operate in a protection mode, a low-noise mode, a monitoring mode, and a private mode,

wherein the processor is further configured to:

identify a current mode of the electronic apparatus, from among the protection mode, the low-noise mode, the monitoring mode, and the private mode, based on the first context, and

identify the current mode according to the traveling route of the electronic apparatus.

7 . The electronic apparatus as claimed in claim 6 , wherein the processor is further configured to control the current mode of the electronic apparatus to be at least one from among the private mode or the low-noise mode based on a relationship between the person and private space information indicating a space that is not open, and

wherein the private space information is included in the environment information.

8 . The electronic apparatus as claimed in claim 6 , wherein the processor is further configured to control the current mode of the electronic apparatus to be at least one from among the monitoring mode or the protection mode based on the first context that the person is dangerous for environment information.

9 . The electronic apparatus according to claim 1 , wherein the processor is further configured to:

identify a plurality of persons based on the image obtained by the camera, wherein each of the plurality of persons corresponds to one of a plurality of users,

identify a second context of the plurality of users based on a relationship between the plurality of users and the environment information, and

change the traveling route of the electronic apparatus based on the second context, and

wherein the attribute information comprises profile information of each of the plurality of users.

10 . The electronic apparatus as claimed in claim 9 , wherein the processor is further configured to identify the first context based on a relationship between the plurality of users.

11 . The electronic apparatus according to claim 1 , wherein the person is a predetermined user, and

wherein the processor is further configured to:

identify a second context of the predetermined user based on the relationship between the attribute information of the person and the environment information and a behavior history of the predetermined user, and

change the traveling route of the electronic apparatus based on the second context.

12 . The electronic apparatus according to claim 1 , wherein the environment information comprises at least one of space information, time information, or position information related to a current space.

13 . A control method of an electronic apparatus storing attribute information of a plurality of objects and environment information, the control method comprising:

controlling the electronic apparatus to autonomously move along a traveling route,

identifying a person based on an image obtained by a camera of the electronic apparatus,

identifying a relationship between attribute information of the person and the environment information, wherein the relationship indicates a state or an operation between the attribute information of the person and the environment information,

identifying, while controlling the electronic apparatus to move along the traveling route, a first context based on the relationship between the attribute information of the person and the environment information, and

changing the traveling route of the electronic apparatus based on the first context.

14 . The control method as claimed in claim 13 , further comprising identifying a first level of danger of the person based on the first context and changing the traveling route of the electronic apparatus based on determining the first level of danger exceeds a threshold.

15 . The control method as claimed in claim 13 , wherein the identifying the first context comprises identifying a first predicted context of the person based on the relationship between the attribute information of the person and the environment information, and

wherein the changing the traveling route comprises changing the traveling route of the electronic apparatus based on the first predicted context.

16 . The control method as claimed in claim 15 , wherein the person is a dynamic object having a dynamic attribute, and

wherein the changing the traveling route comprises:

predicting at least one of a moving direction or a moving distance of the person based on the relationship between the attribute information of the person and the environment information, and

changing the traveling route of the electronic apparatus based on the at least one of the predicted moving direction or the predicted moving distance.

17 . The control method as claimed in claim 16 , further comprising:

identifying a second context that the person is movable based on the dynamic attribute, and

changing the traveling route of the electronic apparatus based on the second context.

18 . The control method according to claim 13 , wherein the electronic apparatus is configured to operate in a protection mode, a low-noise mode, a monitoring mode, and a private mode, and

wherein the control method further comprises:

identifying a current mode of the electronic apparatus, from among the protection mode, the low-noise mode, the monitoring mode, and the private mode, based on the first context, and

identifying the current mode according to the traveling route of the electronic apparatus.

19 . The control method as claimed in claim 18 , wherein the changing the traveling route comprises controlling the current mode of the electronic apparatus to be at least one from among the private mode or the low-noise mode based on a relationship between the person and private space information indicating a space that is not open, and

wherein the private space information is included in the environment information.

20 . The control method as claimed in claim 18 , wherein the changing the traveling route comprises controlling the current mode of the electronic apparatus to be at least one from among the monitoring mode or the protection mode based on the first context that the person is dangerous for environment information.

Priority Claims (1)
KR 10-2019-0026189 · Mar 7, 2019 · national
Continuity (2)
Continuation 16807947 · Mar 3, 2020
Related Publication 20240045440A1 · Feb 8, 2024
References Cited (96)
US 6507773B2 · Parker et al. · 2003 [cited by applicant]
US 7468842B2 · Steenblik et al. · 2008 [cited by applicant]
US 8144399B2 · Steenblik et al. · 2012 [cited by applicant]
US 8355818B2 · Nielsen et al. · 2013 [cited by applicant]
US 8504202B2 · Ichinose et al. · 2013 [cited by applicant]
US 8583282B2 · Angle et al. · 2013 [cited by applicant]
US 8611321B2 · Herrala et al. · 2013 [cited by applicant]
US 9355368B2 · Djugash · 2016 [cited by applicant]
US 9373169B2 · Varekamp · 2016 [cited by examiner]
US 9375847B2 · Angle et al. · 2016 [cited by applicant]
US 9436185B2 · Schnittman · 2016 [cited by applicant]
US 9595115B1 · Cederlof · 2017 [cited by applicant]
US 9740207B2 · Storfer et al. · 2017 [cited by applicant]
US 9858496B2 · Sun et al. · 2018 [cited by applicant]
US 10282849B2 · Piekniewski et al. · 2019 [cited by applicant]
US 10478037B2 · Duenne et al. · 2019 [cited by applicant]
US 10909826B1 · Solh et al. · 2021 [cited by applicant]
US 11019972B2 · Lee et al. · 2021 [cited by applicant]
US 11161236B2 · Mallinson · 2021 [cited by applicant]
US 11353848B1 · Madden · 2022 [cited by applicant]
US 20050273967A1 · Taylor et al. · 2005 [cited by applicant]
US 20070058260A1 · Steenblik et al. · 2007 [cited by applicant]
US 20090122412A1 · Steenblik et al. · 2009 [cited by applicant]
US 20100185328A1 · Kim et al. · 2010 [cited by applicant]
US 20100217528A1 · Sato et al. · 2010 [cited by applicant]
US 20100222954A1 · Ichinose et al. · 2010 [cited by applicant]
US 20120185094A1 · Rosenstein et al. · 2012 [cited by applicant]
US 20130274924A1 · Chung et al. · 2013 [cited by applicant]
US 20140279733A1 · Djugash · 2014 [cited by applicant]
US 20140324271A1 · Oh et al. · 2014 [cited by applicant]
US 20150100167A1 · Sloo et al. · 2015 [cited by applicant]
US 20160303738A1 · Laurent et al. · 2016 [cited by applicant]
US 20170060150A1 · Stefanski et al. · 2017 [cited by applicant]
US 20170102710A1 · Hu et al. · 2017 [cited by applicant]
US 20170185085A1 · Storfer et al. · 2017 [cited by applicant]
US 20170225336A1 · Deyle et al. · 2017 [cited by applicant]
US 20170343966A1 · Schadow et al. · 2017 [cited by applicant]
US 20180039835A1 · Rajkumar et al. · 2018 [cited by applicant]
US 20180050634A1 · White et al. · 2018 [cited by applicant]
US 20180099412A1 · Pinter et al. · 2018 [cited by applicant]
US 20180224862A1 · Akazawa · 2018 [cited by applicant]
US 20180231981A1 · Storfer et al. · 2018 [cited by applicant]
US 20180239355A1 · Lee et al. · 2018 [cited by applicant]
US 20180317725A1 · Lee et al. · 2018 [cited by applicant]
US 20190077007A1 · Mallinson · 2019 [cited by applicant]
US 20190179333A1 · Noh et al. · 2019 [cited by applicant]
US 20190200872A1 · Matsuoka et al. · 2019 [cited by applicant]
US 20190236925A1 · Mosebach · 2019 [cited by examiner]
US 20190246075A1 · Khadloya et al. · 2019 [cited by applicant]
US 20190320867A1 · Noh et al. · 2019 [cited by applicant]
US 20200074175A1 · Zheng · 2020 [cited by examiner]
US 20200160034A1 · Choi et al. · 2020 [cited by applicant]
US 20200319640A1 · Vogel · 2020 [cited by examiner]
US 20200401144A1 · Storfer et al. · 2020 [cited by applicant]
US 20220331028A1 · Sternitzke et al. · 2022 [cited by applicant]
CN 102687174A · 2012 [cited by applicant]
CN 108290290A · 2018 [cited by applicant]
CN 108994839A · 2018 [cited by applicant]
CN 109015680A · 2018 [cited by applicant]
CN 111515946A · 2020 [cited by applicant]
EP 1469423A1 · 2004 [cited by applicant]
EP 3156872A1 · 2017 [cited by applicant]
EP 2993623B1 · 2017 [cited by applicant]
EP 3584043A1 · 2019 [cited by applicant]
JP 2003117866A · 2003 [cited by applicant]
JP 2014176963A · 2014 [cited by applicant]
KR 100656372B1 · 2006 [cited by applicant]
KR 1020080023302A · 2008 [cited by applicant]
KR 1020080073993A · 2008 [cited by applicant]
KR 100917377B1 · 2009 [cited by applicant]
KR 1020100086262A · 2010 [cited by applicant]
KR 101013384B1 · 2011 [cited by applicant]
KR 101105139B1 · 2012 [cited by applicant]
KR 101692688B1 · 2017 [cited by applicant]
KR 1020170048815A · 2017 [cited by applicant]
KR 1020170135195A · 2017 [cited by applicant]
KR 1020180040255A · 2018 [cited by applicant]
KR 1020180096078A · 2018 [cited by applicant]
KR 1020180134155A · 2018 [cited by applicant]
KR 20190027354A · 2019 [cited by applicant]
WO 2019031825A1 · 2019 [cited by applicant]
Office Action dated Nov. 8, 2023, issued by the Chinese Patent Office in Chinese Patent Application No. 202080018656.X. [cited by applicant]
Office Action dated Dec. 5, 2023, issued by the Korean Patent Office for Korean Patent Application No. 10-2019-0026189. [cited by applicant]
Communication dated Jun. 29, 2024, issued by the China National Intellectual Property Administration in Chinese Application No. 202080018656.X. [cited by applicant]
Communication dated Jul. 5, 2024, issued by the Korean International Patent Office in Korean Application No. 10-2019-0026189. [cited by applicant]
Written Opinion (PCT/ISA/237) issued by the International Searching Authority in corresponding International Application No. PCT/KR2020/002810, on Jun. 12, 2020. [cited by applicant]
Torralba, A., et al., “Context-based vision system for place and object recognition”, Proceedings Ninth IEEE International Conference on Computer Vision, Oct. 13-16, 2003, XP055535134, pp. 1-8. [cited by applicant]
International Search Report (PCT/ISA/210), issued by International Searching Authority in corresponding International Application No. PCT/KR2020/002810, on Jun. 12, 2020. [cited by applicant]
Communication dated Sep. 11, 2020, issued by the European Patent Office in counterpart European Application No. 20160582.1. [cited by applicant]
Communication dated Jun. 20, 2023, issued by the European Patent Office in counterpart European Application No. 22190448.5. [cited by applicant]
Communication issued Aug. 12, 2021 by the European Patent Office in counterpart European Patent Application No. 20160582.1. [cited by applicant]
Communication dated Nov. 18, 2022 issued by the European Patent Office in counterpart European Patent Application No. 22190448.5. [cited by applicant]
JP2003117866A.translate.English (Year: 2003). [cited by applicant]
KR20170135195.translate.English (Year: 2017). [cited by applicant]
KR20180040255.translate.English (Year: 2018). [cited by applicant]
KR20180134155.translate.English (Year: 2018). [cited by applicant]