IP Library › Granted Patent US 12,197,204
Granted Patent B2
US 12,197,204 · App. 17/406,727 · Granted Jan 14, 2025

User input processing method and electronic device supporting same

Inventors: Munsik Kim (Gyeonggi-do, KR); Kibeom Kim (Gyeonggi-do, KR); Jaeyung Yeo (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
G05D1/0016G05D1/0255G06N5/04G06V10/10G10L15/083G10L15/18G10L15/22G10L25/54G10L2015/223G10L2015/227
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,197,204
App. No.
17/406,727
Granted
Jan 14, 2025
Kind
B2
Abstract

An apparatus and method are provided for processing a user input in an electronic device. The method includes storing information associated with each of a plurality of users; receiving a user utterance associated with task execution of the electronic device; transmitting, to an external device, first data associated with the user utterance; receiving, from the external device, second data including information about at least one operation of the electronic device associated with the task execution, and at least one parameter for performing the at least one operation; identifying, as a target of the task execution, a first user from among the plurality of users based on the at least one parameter; inferring a location of the target based on information associated with the first user, which is included in the information associated with each of the plurality of users; moving the electronic device to a first location based on the inferred location; searching for the first user at the first location by comparing the information about the first user with information obtained at the first location; and in response to recognizing the first user at the first location, perform the at least one operation of the electronic device associated with the task execution.

Claims (44)

1. An electronic device, comprising:

a memory;

a microphone;

a driving module;

a sensor module; and

a processor operatively connected to the memory, the microphone, the driving module, and the sensor module,

wherein the processor is configured to:

store, in the memory, a database including information associated with each of a plurality of users,

receive, through the microphone, an utterance associated with executing a task,

based on first data associated with the utterance, obtain, second data including information about a sequence of operations associated with executing the task and at least one parameter for performing the sequence of operations,

based on the at least one parameter and the database, identify a target user associated with executing the task, from among the plurality of users and determine a space associated with the target user,

move, by controlling the driving module, the electronic device from a first location where the electronic device is located, to a second location associated with the determined space,

in response to determining that the electronic device has moved to the second location, identify at least one person positioned at the determined space by performing, using the sensor module, a search operation for the determined space,

in response to identifying the at least one person, determine whether the at least one person corresponds to the identified target user,

in response to determining that the at least one person corresponds to the identified target user, move, by controlling the driving module, the electronic device to a third location within a specified threshold distance range based on the at least one person corresponding to the target user, and execute the task based on the sequence of operations, and

in response to determining that the at least one person does not correspond to the identified target user, inquire about a location of the target user to the at least one person, move, by controlling the driving module, the electronic device to the first location, and provide a search result indicating that the target user is not present at the determined space.

2. The electronic device of claim 1 , wherein the processor is further configured to:

rotate, by controlling the driving module, the electronic device at a specified angle at the second location,

obtain information about a surrounding environment while the electronic device is rotated, and

perform the search operation for the determined space based on the obtained information.

3. The electronic device of claim 2 , wherein the obtained information about the surrounding environment includes image information associated with the determined space.

4. The electronic device of claim 1 , wherein the processor is further configured to request an additional utterance for identifying the target user, if the target user associated with executing the task is not identified.

5. The electronic device of claim 1 , further comprising a communication circuit configured to establish communication with an external device,

wherein the processor is further configured to:

transmit the first data to the external device, and

in response to the first data, receive the second data from the external device.

6. A method of an electronic device, the method comprising:

storing, in the electronic device, a database including information associated with each of a plurality of users;

receiving, through a microphone of the electronic device, an utterance associated with executing a task;

based on first data associated with the utterance, obtaining second data including information about a sequence of operations associated with executing the task and at least one parameter for performing the sequence of operations;

based on the at least one parameter and the database, identifying a target user associated with executing the task, from among the plurality of users and determining a space associated with the target user;

moving, by controlling a driving module of the electronic device, the electronic device from a first location where the electronic device is located, to a second location associated with the determined space;

in response to determining that the electronic device has moved to the second location, identify at least one person positioned at the determined space by performing a search operation for the determined space;

in response to identifying the at least one person, determining whether the at least one person corresponds to the identified target user;

in response to determining that the at least one person corresponds to the identified target user, moving, by controlling the driving module, the electronic device to a third location within a specified threshold distance range based on the at least one person corresponding to the target user, and executing the task based on the sequence of operations; and

in response to determining that the at least one person does not correspond to the identified target user, inquiring about a location of the target user to the at least one person, moving, by controlling the driving module, the electronic device to the first location, and providing a search result indicating that the target user is not present at the determined space.

7. The method of claim 6 , further comprising:

rotating, by controlling the driving module, the electronic device at a specified angle at the second location;

obtaining information about a surrounding environment while the electronic device is rotated; and

performing the search operation for the determined space based on the obtained information.

8. The method of claim 7 , wherein the obtained information includes image information associated with the determined space.

9. The operation method of claim 6 , further comprising:

transmitting the first data to an external device, and

in response to the first data, receiving the second data from the external device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2021
From: KIM, MUNSIK; KIM, KIBEOM; YEO, JAEYUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 057255/0266 →
Priority Claims (1)
KR 10-2019-0019546 · Feb 19, 2019 · national
Continuity (2)
Continuation PCTKR2020002327 · Feb 18, 2020
Related Publication 20210383806A1 · Dec 9, 2021
References Cited (65)
US 7447564B2 · Yasukawa · 2008 [cited by examiner]
US 9259842B2 · Fouillade et al. · 2016 [cited by applicant]
US 9471059B1 · Wilkins · 2016 [cited by examiner]
US 9557740B2 · Crawley · 2017 [cited by applicant]
US 9950431B2 · Fouillade et al. · 2018 [cited by applicant]
US 9983592B2 · Hong et al. · 2018 [cited by applicant]
US 10534366B2 · Choi et al. · 2020 [cited by applicant]
US 11433546B1 · Assaf · 2022 [cited by examiner]
US 20040066917A1 · Yasukawa et al. · 2004 [cited by applicant]
US 20040093219A1 · Shin · 2004 [cited by examiner]
US 20050131645A1 · Panopoulos · 2005 [cited by applicant]
US 20050216124A1 · Suzuki · 2005 [cited by examiner]
US 20060217837A1 · Koga · 2006 [cited by examiner]
US 20070027579A1 · Suzuki · 2007 [cited by examiner]
US 20090143910A1 · Seo et al. · 2009 [cited by applicant]
US 20120316676A1 · Fouillade et al. · 2012 [cited by applicant]
US 20140254896A1 · Zhou et al. · 2014 [cited by applicant]
US 20140316636A1 · Hong · 2014 [cited by examiner]
US 20150012163A1 · Crawley · 2015 [cited by applicant]
US 20160136817A1 · Fouillade et al. · 2016 [cited by applicant]
US 20170090456A1 · Mao · 2017 [cited by examiner]
US 20170300060A1 · Crawley · 2017 [cited by applicant]
US 20170361468A1 · Cheuvront · 2017 [cited by examiner]
US 20180143645A1 · Lee · 2018 [cited by examiner]
US 20180181137A1 · Choi et al. · 2018 [cited by applicant]
US 20180246520A1 · Martinson · 2018 [cited by examiner]
US 20180285070A1 · Yoon et al. · 2018 [cited by applicant]
US 20180288104A1 · Padilla et al. · 2018 [cited by applicant]
US 20190187703A1 · Millard · 2019 [cited by examiner]
US 20190258264A1 · Bash · 2019 [cited by examiner]
US 20190265692A1 · Miyazaki · 2019 [cited by examiner]
US 20190278294A1 · Shimada · 2019 [cited by examiner]
US 20190332105A1 · Sant · 2019 [cited by examiner]
US 20190342243A1 · Lee et al. · 2019 [cited by applicant]
US 20200050206A1 · Deyle · 2020 [cited by examiner]
US 20200072619A1 · Fukui · 2020 [cited by examiner]
US 20200110968A1 · Onodera · 2020 [cited by examiner]
US 20200148232A1 · Morrison · 2020 [cited by examiner]
US 20200164515A1 · Han · 2020 [cited by examiner]
US 20200201338A1 · Wang · 2020 [cited by examiner]
US 20200202114A1 · Yoon · 2020 [cited by examiner]
US 20200241486A1 · Hong · 2020 [cited by examiner]
US 20200380699A1 · Amo · 2020 [cited by examiner]
US 20210018912A1 · Dymesich · 2021 [cited by examiner]
US 20210076008A1 · Seyfi · 2021 [cited by examiner]
US 20210103281A1 · Takagi · 2021 [cited by examiner]
US 20210141381A1 · Maeda · 2021 [cited by examiner]
US 20210383806A1 · Kim · 2021 [cited by examiner]
US 20220017010A1 · Taniguchi · 2022 [cited by examiner]
US 20220019213A1 · Haghighat Kashani · 2022 [cited by examiner]
US 20230158683A1 · Carbune · 2023 [cited by examiner]
JP 2013061715 · 2013 [cited by applicant]
KR 1020140106891 · 2014 [cited by applicant]
KR 1020140126539 · 2014 [cited by applicant]
KR 1020180038871 · 2018 [cited by applicant]
KR 1020180074144 · 2018 [cited by applicant]
KR 1020180075875 · 2018 [cited by applicant]
KR 1020180109625 · 2018 [cited by applicant]
KR 101919354 · 2018 [cited by applicant]
KR 1020180134628 · 2018 [cited by applicant]
PCT/ISA/210 Search Report issued on PCT/KR2020/002327 pp. 3. [cited by applicant]
PCT/ISA/237 Written Opinion issued on PCT/KR2020/002327 pp. 5. [cited by applicant]
Korean Office Action dated Nov. 10, 2023 issued in counterpart application No. 10-2019-0019546, 15 pages. [cited by applicant]
KR Final Rejection dated Jul. 8, 2024 issued in counterpart application No. 10-2019-0019546, 8 pages. [cited by applicant]
Korean Office Action dated Oct. 16, 2024 Issued in counterpart application No. 10-2019-0019546, 10 pages. [cited by applicant]
Cited By (2)
US 12,514,419 US 12,725,306