IP Library › Granted Patent US 11,350,264
Granted Patent B2
US 11,350,264 · App. 16/520,557 · Granted May 31, 2022

Method and apparatus for establishing device connection

Inventors: Xunmin Chen (Nanjing, CN); Peng Yin (Nanjing, CN); Jianrong Hu (Nanjing, CN)
Assignee: Samsung Electronics Co., Ltd.
H04W8/005G06F3/0482G06F3/0488G06K9/6217G06K9/6253H04L41/22H04L61/2038H04L67/125H04W76/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,350,264
App. No.
16/520,557
Filed
Jul 24, 2019
Granted
May 31, 2022
Kind
B2
Art Unit
2477
USPC
370/254
Abstract

A method and apparatus for establishing a device connection applied to a first device with a camera are provided. The method includes acquiring an image of a second device by the first device through the camera, recognizing the type of the second device through the acquired image of the second device, acquiring a device list corresponding to the type of the second device through an IoT server, and identifying the second device in the device list, acquiring a unique identifier of the second device in the current IoT environment, and using the unique identifier of the second device to initiate a connection request to the second device to establish a connection with the second device. The method may automatically establish a connection between devices with less operation of the devices.

Claims (97)

1. A method for establishing a device connection by a first device, the method comprising:

acquiring a first image of a second device using a camera of the first device;

recognizing a first type of the second device and first feature information associated with the second device based on the first image;

transmitting a first request for a first device list based on the first type of the second device from an internet of things (IoT) server;

in case that the first device list is stored by the IoT server, receiving the first device list;

identifying a first unique identifier of the second device in the first device list based on the first feature information associated with the second device;

transmitting a second request to establish a connection with the second device based on the first unique identifier of the second device;

acquiring a second image of a third device using the camera;

recognizing a second type of the third device and second feature information associated with the third device based on the second image;

receiving a second device list based on the second type of the third device from the IoT server;

identifying a second unique identifier of the third device in the second device list based on the second feature information associated with the third device;

determining whether the third device initiates a request for establishing connection with the second device;

in case that the third device is determined to initiate the request for establishing the connection, transmitting first device information of the second device to the third device for establishing the connection with the second device; and

in case that the third device is not determined to initiate the request for establishing the connection, transmitting second device information of the third device to the second device for establishing a second connection with the third device,

wherein the second device information of the third device includes the second unique identifier of the third device, and

wherein the first device information of the third device includes the first unique identifier of the second device.

2. The method of claim 1 , further comprising:

when the first device list is not stored by the IoT server, transmitting a third request for setting the first device list to the IoT server,

wherein the third request includes the first type of the second device and the first feature information associated with the second device.

3. The method of claim 1 , wherein the identifying of the first unique identifier of the second device comprises:

determining whether the first feature information associated with the second device is matched with a first item in the first device list; and

determining a unique identifier of the first item as the first unique identifier of the second device when the first feature information associated with the second device is matched with the first item in the first device list.

4. The method of claim 3 , further comprising:

when no item in the first device list matches with the first feature information of the second device, transmitting a fourth request for adding the second device into the first device list to the IoT server, wherein the fourth request includes the first feature information of the second device.

5. The method of claim 1 , further comprising:

displaying the first image on a screen of the first device;

determining a number of IoT devices in the first image; and

receiving a first input selecting the second device from among the number of the IoT devices.

6. The method of claim 1 , further comprising:

receiving a second input for acquiring a menu of commands for the second device;

in response to the second input, transmitting a fourth request to the second device for the menu of commands;

receiving and displaying the menu of commands in a floating window; and

when a third input of a command on the menu is received, transmitting a fifth request to the second device to perform the command.

7. The method of claim 1 , further comprising:

acquiring a fourth image of a fifth device using the camera;

displaying the fourth image, wherein the fifth device is displayed in a first region;

recognizing a fourth type of the fifth device and fourth feature information associated with the fifth device based on the fourth image;

receiving a fourth device list based on the fourth type of the fifth device from the IoT server;

identifying a fourth unique identifier of the fifth device in the fourth device list based on the fourth feature information associated with the fifth device;

receiving information including an IoT state of the fifth device from the IoT server; and

displaying the IoT state of the fifth device through a floating window.

8. The method of claim 7 , wherein the floating window is displayed in a second region that is different from the first region.

9. The method of claim 7 , further comprising:

when the IoT state corresponds to a connected state, requesting a list of devices connected to the fifth device from the IoT server; and

displaying a floating menu including the list of devices in a second region that is different from the first region.

10. A device comprising:

at least one camera;

a touch screen display;

a transceiver; and

at least one processor,

wherein the at least one processor is configured to:

acquire a first image of a second device through the at least one camera,

recognize a first type of the second device and first feature information associated with the second device based on the first image,

control the transceiver to transmit a first request for a first device list based on the first type of the second device from an internet of things (IoT) server,

in case that the first device list is stored by the IoT server, control the transceiver to receive the first device list,

identify a first unique identifier of the second device in the first device list based on the first feature information associated with the second device,

control the transceiver to transmit a second request to establish a connection with the second device based on the first unique identifier of the second device,

acquire a second image of a third device using the camera,

recognize a second type of the third device and second feature information associated with the third device based on the second image,

control the transceiver to receive a second device list based on the second type of the third device from the IoT server,

identify a second unique identifier of the third device in the second device list based on the second feature information associated with the third device,

determine whether the third device initiates a request for establishing connection with the second device,

in case that the third device is determined to initiate the request for establishing the connection, control the transceiver to transmit first device information of the second device to the third device for establishing the connection with the second device, and

in case that the third device is not determined to initiate the request for establishing the connection, control the transceiver to transmit second device information of the third device to the second device for establishing a second connection with the third device,

wherein the second device information of the third device includes the second unique identifier of the third device, and

wherein the first device information of the third device includes the first unique identifier of the second device.

11. The device of claim 10 ,

wherein the at least one processor is further configured to:

when the first device list is not stored by the IoT server, control the transceiver to transmit a third request for setting the first device list to the IoT server, and

wherein the third request includes the first type of the second device and the first feature information associated with the second device.

12. The device of claim 10 , wherein the at least one processor is further configured to:

determine whether the first feature information associated with the second device is matched with a first item in the first device list, and

determine a unique identifier of the first item as the first unique identifier of the second device when the first feature information associated with the second device is matched with the first item in the first device list.

13. The device of claim 12 , wherein, when no item in the first device list matches with the first feature information of the second device, the at least one processor is further configured to control the transceiver to transmit a fourth request for adding the second device into the first device list to the IoT server, and

wherein the fourth request includes the first feature information of the second device.

14. The device of claim 10 , wherein the at least one processor is further configured to:

display the first image on the touch screen display,

determine a number of IoT devices in the first image, and

receive a first input selecting the second device from among the number of the IoT devices.

15. The device of claim 10 , wherein the at least one processor is further configured to:

receive a second input for acquiring a menu of commands for the second device,

in response to the second input, control the transceiver to transmit a fourth request to the second device for the menu of commands,

control the transceiver to receive the menu of commands,

display the menu of commands in a floating window on the touch screen display, and

when a third input of a command on the menu is received, control the transceiver to transmit a fifth request to the second device to perform the command.

16. The device of claim 10 , wherein the at least one processor is further configured to:

acquire a fourth image of a fifth device using the at least one camera,

display the fourth image on the touch screen display, wherein the fifth device is displayed in a first region,

recognize a fourth type of the fifth device and fourth feature information associated with the fifth device based on the fourth image,

control the transceiver to receive a fourth device list based on the fourth type of the fifth device from the IoT server,

identify a fourth unique identifier of the fifth device in the fourth device list based on the fourth feature information associated with the fifth device,

control the transceiver to receive information including an IoT state of the fifth device from the IoT server, and

display the IoT state of the fifth device through a floating window on the touch screen display.

17. The device of claim 16 , wherein the floating window is displayed in a second region that is different from the first region.

18. The device of claim 16 , wherein the at least one processor is further configured to:

when the IoT state corresponds to a connected state, request a list of devices connected to the fifth device from the IoT server, and

display a floating menu including the list of devices in a second region that is different from the first region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: CHEN, XUNMIN; YIN, PENG; HU, JIANRONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 049844/0382 →
Priority Claims (2)
CN 201810824343.8 · Jul 25, 2018 · national
KR 10-2019-0077307 · Jun 27, 2019 · national
Continuity (1)
Related Publication 20200037144A1 · Jan 30, 2020
Cited By (2)
US 12,216,438 US 12,517,631