IP Library › Granted Patent US 11,189,284
Granted Patent B2
US 11,189,284 · App. 16/600,232 · Granted Nov 30, 2021

Apparatus for communicating with voice recognition device, apparatus with voice recognition capability and controlling method thereof

Inventor: Ji Chan Maeng (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G10L15/22E05F15/74G06N20/00E05Y2400/33E05Y2400/45E05Y2400/85E05Y2900/31
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,189,284
App. No.
16/600,232
Granted
Nov 30, 2021
Kind
B2
Abstract

The present disclosure relates to an apparatus which communicates with a voice recognition device, and a method for controlling an apparatus with a voice recognition capability which operates in the Internet of Things environment configured by a 5G communication network. According to an exemplary embodiment of the present disclosure, an apparatus with a voice recognition capability includes a container which has one open surface and accommodates objects therein, a door which opens/closes the container, a sensor which senses an open/closed state of the door, a microphone which receives an external voice, a voice recognizer which recognizes a voice command received from the microphone, and a controller which controls an active state and an inactive state of the voice recognizer, in which the controller may predict whether the voice recognizer needs to be activated using a deep neural network model learned through the machine learning.

Claims (37)

1. An apparatus with a voice recognition capability, the apparatus comprising:

a container having an opening at one side and configured to accommodate an object therein;

a door located at the one side and configured to open and close to cover the opening;

a sensor configured to sense an open or closed state of the door;

a microphone configured to receive audio;

a proximity sensor configured to detect a presence of a person; and

a controller configured to activate a voice recognizer of the apparatus in connection with a closed state of the door being changed to an open state or the open state of the door being changed to the closed state,

wherein the controller is further configured to:

activate the sensor to sense an open or close state of the door when the person is detected via the proximity sensor, and

activate the voice recognizer when the person is detected within a predetermined range for a predetermined length of time, via the proximity sensor, after the open state of the door is changed to the closed state.

2. The apparatus according to claim 1 , further comprising a camera configured to capture an image of an interior of the container, wherein the controller is further configured to activate the voice recognizer based on detecting a change in an arrangement of the object in the container based on the captured image after the closed state of the door is changed to the open state.

3. The apparatus according to claim 1 , further comprising a weight sensor configured to sense a weight of the object in the container, wherein the controller is further configured to activate the voice recognizer based on detecting a change in an arrangement of the object in the container based on weight information sensed via the weight sensor after the closed state of the door is changed to the open state.

4. The apparatus according to claim 1 , further comprising an indicator configured to indicate when the voice recognizer is activated.

5. An apparatus for use in a system capable of voice recognition, the apparatus comprising:

a container having an opening at one side and configured to accommodate an object therein;

a door located at the one side and configured to open and close to cover the opening;

a sensor configured to sense an open or closed state of the door;

a network interface configured to communicate with an external voice recognition device;

a proximity sensor configured to detect a presence of a person; and

a controller configured to:

transmit, via the network interface, a signal for activating a voice recognizer of the external voice recognition device in connection with a closed state of the door being changed to an open state or the open state of the door being changed to the closed state,

wherein the controller is further configured to:

activate the sensor to sense an open or close state of the door when the person is detected via the proximity sensor, and

transmit, via the network interface, a signal for activating the voice recognizer of the external voice recognition device when the person is detected within a predetermined range for a predetermined length of time, via the proximity sensor, after the open state of the door is changed to the closed state.

6. The apparatus according to claim 5 , further comprising a camera configured to capture an image of an interior of the container, wherein the controller is further configured to transmit, via the network interface, a signal for activating the voice recognizer of the external voice recognition device based on detecting a change in an arrangement of the object in the container based on the captured image after the closed state of the door is changed to the open state.

7. The apparatus according to claim 5 , further comprising a weight sensor configured to sense a weight of the object in the container, wherein the controller is further configured to transmit, via the network interface, a signal for activating the voice recognizer of the external voice recognition device based on detecting a change in an arrangement of the object in the container based on weight information sensed via the weight sensor after the closed state of the door is changed to the open state.

8. The apparatus according to claim 5 , wherein the external voice recognition device further comprises an indicator configured to indicate when the voice recognizer is activated, and wherein the transmitted signal causes the indicator to be operated.

9. A method for controlling an apparatus with a voice recognition capability, the method comprising:

detecting a presence of a person via a proximity sensor of the apparatus;

upon detection of a person, activating a sensor configured to sense an open or close state of the door;

sensing an open or closed state of a door of the apparatus;

activating a voice recognizer when an object is inserted into the apparatus or removed from the apparatus after a closed state of the door is changed to an open state;

performing a command when a voice command for the command is received within a predetermined time after activating the voice recognizer or inactivating the voice recognizer when a voice command is not received within a predetermined time after activating the voice recognizer; and

activating the voice recognizer when a presence of a person is detected within a predetermined range for a predetermined length of time, via the proximity sensor of the apparatus, after the open state of the door is changed to the closed state.

10. The method according to claim 9 , further comprising determining whether the object has been inserted or removed based on an image of an interior of the apparatus captured by a camera of the apparatus after the closed state of the door is changed to the open state.

11. The method according to claim 9 , further comprising determining whether the object has been inserted or removed based on weight information sensed by a weight sensor after the closed state of the door is changed to the open state.

12. The method according to claim 9 , further comprising indicating when the voice recognizer is activated via an indicator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2019
From: MAENG, JI CHAN
To: LG ELECTRONICS INC.
Reel/Frame 050693/0228 →
Priority Claims (1)
KR 10-2019-0087783 · Jul 19, 2019 · national
Continuity (1)
Related Publication 20200043494A1 · Feb 6, 2020
Cited By (32)
US 12,192,713 US 12,210,801 US 12,211,490 US 12,217,748 US 12,217,765 US 12,230,291 US 12,231,859 US 12,236,932 US 12,288,558 US 12,314,633 US 12,322,390 US 12,340,802 US 12,360,734 US 12,374,334 US 12,375,052 US 12,424,220 US 12,438,977 US 12,462,802 US 12,498,899 US 12,505,832 US 12,513,466 US 12,513,479 US 12,518,755 US 12,518,756 US 12,562,167 US 12,578,779 US 12,579,978 US 12,626,717 US 12,699,543 US 12,711,962 US 12,732,547 US 12,744,035