IP Library › Granted Patent US 11,340,866
Granted Patent B2
US 11,340,866 · App. 16/168,408 · Granted May 24, 2022

Electronic apparatus and method for controlling thereof

Inventor: Joon-young Ahn (Seongnam-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/167G06F1/1605G10L15/08G10L15/22H04N21/4223H04N21/42201H04N21/43615H04N21/44218H04R1/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,340,866
App. No.
16/168,408
Granted
May 24, 2022
Kind
B2
Abstract

An electronic apparatus and a method for controlling thereof are provided. The electronic apparatus includes a microphone configured to receive a user voice, a communication interface, and a processor configured, based on a first voice being received through the microphone, to provide first response information corresponding to the first voice, and based on a user sensing signal being received from an external apparatus through the communication interface, to control the communication interface to send the first response information to the external apparatus.

Claims (38)

1. An electronic apparatus comprising:

a sensor;

a microphone configured to receive a user voice;

a communication interface; and

a processor configured to:

based on a first voice signal corresponding to a first voice of a user located in a first area around the electronic apparatus being received through the microphone, obtain a first keyword for executing an operation related to the first voice from the first voice signal, and obtain first response information based on the first keyword while the user located in the first area is sensed by the sensor,

based on a movement of the user moving outside the first area being sensed by the sensor and a user sensing signal being received from an external apparatus through the communication interface as the user moves to a second area around the external apparatus from the first area and the user located in the second area is sensed by the external apparatus, control the communication interface to transmit the first response information to the external apparatus,

based on a second voice signal corresponding to a second voice of the user being received from the external apparatus through the communication interface, obtain a second keyword related to the second voice from the second voice signal,

based on the second voice signal being received within a preset time from when the first voice is received, obtain second response information based on the first response information and the second keyword and control the communication interface to transmit the obtained second response information to the external apparatus, and

based on the second voice signal being received after the preset time from when the first voice is received, obtain third response information based om the second keyword and transmit the third response information to the external apparatus,

wherein the processor is configured to identify the user based on at least one of a channel number of a broadcast channel tuned in to by the electronic apparatus, a broadcast genre of the broadcast channel, and a channel zapping feature of the user, and transmit viewing history information of the identified user to the external apparatus.

2. The electronic apparatus as claimed in claim 1 , wherein the first area is a preset area from the electronic apparatus.

3. The electronic apparatus as claimed in claim 1 , further comprising:

a camera,

wherein the processor is configured to, based on a movement of the user moving outside of the first area from the first area being sensed through an image captured through the camera and the user sensing signal being received from the external apparatus, transmit the first response information to the external apparatus, and

wherein the first area is a preset area from the electronic apparatus.

4. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to, based on the user sensing signal being received from a plurality of external apparatuses and based on the received user sensing signal, identify an external apparatus sensing the user for more than a preset time among the plurality of external apparatuses and transmit the first response information to the identified external apparatus.

5. The electronic apparatus as claimed in claim 1 , wherein the user sensing signal is generated based on at least one of an image captured through a camera of the external apparatus, a voice received through a microphone of the external apparatus, and a movement of the user sensed through an infrared ray sensor of the external apparatus.

6. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to transmit the first response information and the second voice signal to a server, receive the second response information generated based on the first response information and the second voice signal from the server, and transmit the received second response information to the external apparatus.

7. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to, based on the second voice signal being received through the communication interface within the preset time from when the first voice is received, transmit the first response information and the second voice signal to a server, receive the second response information generated based on the first response information and the second voice signal from the server, and transmit the received second response information to the external apparatus, and based on the second voice signal being received through the communication interface after the preset time from when the first voice is received, transmit the second voice signal to the server, receive the third response information corresponding to the second voice signal from the server, and transmit the received third response information to the external apparatus.

8. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to, based on a third voice signal corresponding to a third voice received through a microphone of the external apparatus being received from the external apparatus, compare a feature of the first voice with a feature of the third voice, and based on users inputting the first voice and the third voice being a same person, transmit the first response information to the external apparatus.

9. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to identify the user based on a feature of the first voice and transmit viewing history information of the identified user to the external apparatus.

10. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to transmit, to the external apparatus, information about a content provided by the electronic apparatus, and

wherein the information about the content includes at least one of information about a broadcast channel tuned in to by the electronic apparatus, information about an application being executed in the electronic apparatus, and information about a multimedia content being reproduced in the electronic apparatus.

11. The electronic apparatus as claimed in claim 1 , wherein the processor is configured to perform communication with a user terminal and provide a content received from the user terminal, and based on a connection with the user terminal being released and a user terminal sensing signal being received from the external apparatus, transmit information related to the content to the external apparatus.

12. A method for controlling an electronic apparatus, the method comprising:

based on a first voice signal corresponding to a first voice of a user located in a first area around the electronic apparatus being received through a microphone, obtaining a first keyword for executing an operation related to the first voice from the first voice signal;

obtaining first response information based on the first keyword while the user located in the first area is sensed by a sensor of the electronic apparatus;

based on a movement of the user moving outside the first area being sensed by the sensor of the electronic apparatus and a user sensing signal being received from an external apparatus as the user moves to a second area around the external apparatus from the first area and the user located in the second area is sensed by the external apparatus, transmitting the first response information to the external apparatus;

based on a second voice signal corresponding to a second voice of the user being received from the external apparatus through a communication interface, obtaining a second keyword related to the second voice from the second voice signal;

based on the second voice signal being received within a preset time from when the first voice is received, obtaining second response information based on the first response information and the second keyword and transmitting the obtained second response information to the external apparatus;

based on the second voice signal being received from the external apparatus after the preset time from when the first voice is received, obtaining third response information based on the second keyword and transmitting the third response information to the external apparatus, and

identifying the user based on at least one of a channel number of a broadcast channel tuned in to by the electronic apparatus, a broadcast genre of the broadcast channel, and a channel zapping feature of the user, and transmitting viewing history information of the identified user to the external apparatus.

13. The method as claimed in claim 12 , wherein the first area is a preset area from the electronic apparatus.

14. The method as claimed in claim 12 , wherein the transmitting of the first response information comprises, based on a movement of the user moving outside the first area from the first area being sensed through an image captured through a camera and the user sensing signal being received from the external apparatus, transmitting the first response information to the external apparatus, and

wherein the first area is a preset area from the electronic apparatus.

15. The method as claimed in claim 12 , wherein the transmitting of the first response information comprises, based on the user sensing signal being received from a plurality of external apparatuses and based on the received user sensing signal, identifying an external apparatus sensing the user for more than a preset time among the plurality of external apparatuses and transmitting the first response information to the identified external apparatus.

16. The method as claimed in claim 12 , wherein the user sensing signal is generated based on at least one of an image captured through a camera of the external apparatus, a voice received through a microphone of the external apparatus, and a movement of the user sensed through an infrared ray sensor of the external apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2018
From: AHN, JOON-YOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 047719/0264 →
Priority Claims (1)
KR 10-2017-0146934 · Nov 6, 2017 · national
Continuity (1)
Related Publication 20190138272A1 · May 9, 2019