IP Library › Granted Patent US 11,212,132
Granted Patent B2
US 11,212,132 · App. 16/691,548 · Granted Dec 28, 2021

Method for providing IoT device information, apparatus and intelligent computing device thereof

Inventor: Jangkeun Jeong (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04L12/2812G06K9/00671G06N3/08G06T7/74H04L12/2809H04L12/2814H04L12/2821H04L12/2827H04W56/006H04W72/042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,212,132
App. No.
16/691,548
Granted
Dec 28, 2021
Kind
B2
Abstract

Provided are a method and device for providing IoT device information and an intelligent computing device. A method of providing information related to a control target device includes searching for the control target device and displaying a position of the control target device in a map of an area in which the control target device is positioned. Therefore, an intuitive interface can be provided to a user. One or more of the IoT devices, robots, and intelligent computing devices of the present disclosure may comprise artificial intelligence modules, drones (Unmanned Aerial Vehicles, UAVs), robots, Augmented Reality (AR) devices, virtual reality, VR) devices, devices related to 5G services, and the like.

Claims (63)

1. A method, comprising:

searching to find a control target device;

determining whether an object found during the searching is the control target device;

requesting an external device to provide first data associated with a position of the control target device, based on the object being determined to be the control target device;

obtaining, from the external device, the first data and second data associated with a map of an area which the control target device is positioned;

displaying the map of the area based on the second data; and

displaying the position of the control target device within the map based on the first data,

wherein the determining whether the object is the control target device comprises: transmitting a control signal to the object;

receiving, through the external device, information about a response of the object to the control signal; and

determining whether the object is the control target device based on the received information;

wherein the determining whether the object is the control target device comprises:

receiving a photographed image of the object from the external device;

determining whether the object is the control target device based on the photographed image of the object;

extracting a characteristic value from the photographed image of the object;

inputting the characteristic value to a previously learned artificial neural network; and

obtaining a probability that the object is the control target device from the previously learned artificial neural network; and

determining whether the object is the control target device based on the probability.

2. The method of claim 1 , wherein the control signal comprises an on/off control signal.

3. The method of claim 1 further comprising:

receiving, from a network, Downlink Control Information (DCI) used for scheduling reception of the first data associated with the position of the control target device; and

receiving the first data associated with the position of the control target device from the external device through the network based on the DCI.

4. The method of claim 3 , further comprising:

performing an initial access procedure to the network based on a synchronization signal block (SSB); and

receiving the first data associated with the position of the control target device from the external device through a Physical Uplink Shared Channel (PUSCH) of the network,

wherein a demodulation reference signal (DM-RS) of the PUSCH and the SSB is quasi co-located (QCL) for QCL type D.

5. The method of claim 3 , further comprising:

controlling a transceiver to transmit a photographed image of the object to an AI processor included in the network; and

controlling the transceiver to receive AI processed information from the AI processor,

wherein the AI processed information is a probability that the photographed object is the control target device.

6. The method of claim 1 , wherein the external device is a mobile robot which travels the area while obtaining the first and second data.

7. A device, comprising:

a display;

a transceiver; and

a processor coupled to the display and the transceiver, wherein the processor is configured to:

search, using the transceiver, to find a control target device;

determining whether an object found during the searching is the control target device;

request, using the transceiver, an external device to provide first data associated with a position of the control target device, based on the object being determined to be the control target device;

obtain, using the transceiver, from the external device, the first data and second data associated with a map of an area which the control target device is positioned;

cause the display to display the map of the area based on the second data; and

cause the display to display the position of the control target device within the map based on the first data,

wherein the processor is further configured to:

transmit, using the transceiver, a control signal to the object;

receive, using the transceiver, information about a response of the object to the control signal, through the external device;

determine whether the object is the control target device based on the received information;

wherein the determine whether the object is the control target device comprises:

receive, via the transceiver, a photographed image of the object from the external device;

determine whether the object is the control target device based on the photographed image of the object;

extract, using the transceiver, a characteristic value from the photographed image of the object;

input, using the transceiver, the characteristic value to a previously learned artificial neural network;

obtain, using the transceiver, a probability that the object is the control target device from the previously learned artificial neural network; and

determine whether the object is the control target device based on the probability.

8. The device of claim 7 , wherein the reference control signal comprises an on/off control signal.

9. The device of claim 7 , wherein the processor is further configured to:

receive, via the transceiver from a network, Downlink Control Information (DCI) used for scheduling reception of the first data associated with the position of the control target device; and

receive, via the transceiver, the first data associated with the position of the control target device from the external device through the network based on the DCI.

10. The device of claim 9 , wherein the processor is further configured to:

perform an initial access procedure to the network based on a synchronization signal block (SSB); and

receive, via the transceiver, the first data associated with the position of the control target device from the external device through a Physical Uplink Shared Channel (PUSCH) of the network,

wherein a demodulation reference signal (DM-RS) of the PUSCH and the SSB is quasi co-located (QCL) for QCL type D.

11. The device of claim 9 , wherein the processor is further configured to:

cause the transceiver to transmit a photographed image of the object to an AI processor included in the network; and

cause the transceiver to receive AI processed information from the AI processor, wherein the AI processed information is a probability that the photographed object is the control target device.

12. The device of claim 7 , wherein the external device is a mobile robot which travels the area while obtaining the first and second data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2019
From: JEONG, JANGKEUN
To: LG ELECTRONICS INC.
Reel/Frame 051091/0310 →
Priority Claims (1)
KR 10-2019-0088834 · Jul 23, 2019 · national
Continuity (1)
Related Publication 20200092124A1 · Mar 19, 2020
Cited By (1)
US 12,510,374