IP Library › Granted Patent US 11,425,339
Granted Patent B2
US 11,425,339 · App. 17/119,894 · Granted Aug 23, 2022

Artificial intelligence device and method thereof

Inventors: Hyongguk Kim (Seoul, KR); Sangyoun Shin (Seoul, KR); Darae Kim (Seoul, KR); Seokjun Yoon (Seoul, KR); Jihyun Song (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N7/185G05B13/027G06K9/6256G06N3/04G06V20/00G08B3/10G08C17/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,425,339
App. No.
17/119,894
Granted
Aug 23, 2022
Kind
B2
Abstract

Disclosed herein is an artificial intelligence device for providing connection between a plurality of home devices, including a communication interface configured to receive a visitor image from a door locking device including a door camera for photographing a visitor, and a processor configured to obtain visitor information output from a visitor recognition model by inputting the visitor image to the visitor recognition model and select a home device to receive the visitor image and the visitor information from among the plurality of home devices, wherein the communication interface transmits the visitor image and the visitor information to the selected home device.

Claims (58)

1. An artificial intelligence device comprising:

a communication interface configured to receive a visitor image captured via a camera associated with a door locking device; and

a processor configured to:

obtain visitor information from a visitor recognition model using the visitor image as input;

select a home device among a plurality of home devices for transmitting the visitor image and the visitor information; and

cause the communication interface to transmit the visitor image and the visitor information to the selected home device,

wherein the processor is further configured to determine one or more home devices among the plurality of home devices which are currently in use,

wherein the selected home device is selected from the one or more home devices currently in use based on a size of a display of each of the one or more home devices.

2. The artificial intelligence device of claim 1 ,

wherein the communication interface is further configured to receive a door control command for the door locking device from the selected home device, and

wherein the processor is further configured to cause the door locking device to be operated based on the door control command.

3. The artificial intelligence device of claim 1 , wherein the processor is further configured to cause the door locking device to output voice data received from the selected home device through a speaker associated with the door locking device.

4. The artificial intelligence device of claim 1 , wherein the processor is further configured to cause the door locking device to enter a safe mode for a predetermined time based on a failure to obtain visitor information using the visitor image.

5. The artificial intelligence device of claim 4 , wherein the processor is further configured to:

determine a length of time that an unidentified visitor remains while the door locking device is in the safe mode; and

cause a speaker associated with the door locking device to output a notification based on the determined length of time exceeding a preset length of time.

6. The artificial intelligence device of claim 4 ,

wherein the communication interface is further configured to receive audio data obtained by a microphone associated with the door locking device, and

wherein the processor is further configured to cause a speaker associated with the door locking device to output a notification based on detection of a sound having a decibel level that is greater than or equal to a preset decibel level while the door locking device is in the safe mode.

7. The artificial intelligence device of claim 1 , wherein the processor is further configured to cause the door locking device to enter a safe mode for a predetermined time when a visitor is not registered and a visit history includes a preset number of repeated visits by the visitor during a preset time.

8. The artificial intelligence device of claim 1 , wherein:

the communication interface is further configured to receive, from a first external door locking device, face information of a visitor who has been refused entry, and

the processor is further configured to:

cause the door locking device to enter a safe mode for a predetermined time when the visitor image matches face information of the visitor who has been refused entry; and

transmit, via the communication interface, the face information of the visitor who has been refused entry to a second external door locking device.

9. The artificial intelligence device of claim 1 ,

wherein the communication interface is further configured to receive a request for connection from a first home device to a second home device, and

wherein the processor is further configured to:

obtain a first communication protocol used by the first home device;

obtain a second communication protocol used by the second home device; and

transmit data received from the first home device to the second home device through the communication interface based on the first communication protocol and the second communication protocol.

10. The artificial intelligence device of claim 1 , wherein the processor is further configured to:

determine whether a visitor is a permitted member based on the visitor information;

update history information of the permitted member; and

obtain activity information of the permitted member based on the updated history information and operation information of the plurality of home devices.

11. The artificial intelligence device of claim 10 , wherein the processor is further configured to detect abnormal activity based on activity information of the permitted member.

12. A method comprising:

receiving a visitor image captured via camera associated with a door locking device;

obtaining visitor information output from a visitor recognition model using the visitor image as input;

selecting a home device among a plurality of home devices for transmitting the visitor image and the visitor information; and

transmitting the visitor image and the visitor information to the selected home device,

wherein the selecting of the home device comprises determining one or more home devices among the plurality of home devices which are currently in use, and wherein the selected home device is selected from the one or more home devices currently in use based on a size of the display of each of the one or more home devices.

13. The method of claim 12 , further comprising:

receiving a door control command for the door locking device from the selected home device; and

causing operation of the door locking device based on the door control command.

14. The method of claim 12 , further comprising causing the door locking device to enter a safe mode for a predetermined time based on a failure to obtain visitor information using the visitor image.

15. The method of claim 14 , further comprising:

determining a length of time that an unidentified visitor remains while the door locking device is in the safe mode; and

causing a speaker associated with the door locking device to output a notification based on the determined length of time exceeding a preset length of time.

16. The method of claim 14 , further comprising:

receiving audio data obtained by a microphone associated with the door locking device; and

causing a speaker associated with the door locking device to output a notification based on detection of a sound having a decibel level that is greater than or equal to a preset decibel level while the door locking device is in the safe mode.

17. The method of claim 12 , further comprising:

causing the door locking device to enter a safe mode for a predetermined time when a visitor is not registered and a visit history includes a preset number of repeated visits by the visitor during a preset time.

18. The method of claim 12 , further comprising:

receiving, from a first external door locking device, face information of a visitor who has been refused entry;

causing the door locking device to enter a safe mode for a predetermined time when the visitor image matches face information of the visitor who has been refused entry; and

transmitting, to a second external door locking device, the face information of the visitor who has been refused entry.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: KIM, HYONGGUK; SHIN, SANGYOUN; KIM, DARAE; YOON, SEOKJUN; SONG, JIHYUN
To: LG ELECTRONICS INC.
Reel/Frame 056343/0583 →
Priority Claims (2)
KR 10-2020-0067463 · Jun 4, 2020 · national
KR 10-2020-0146148 · Nov 4, 2020 · national
Continuity (2)
Provisional Application 62946906 · Dec 11, 2019
Related Publication 20210185283A1 · Jun 17, 2021