IP Library › Granted Patent US 9,894,260
Granted Patent B2
US 9,894,260 · App. 15/219,791 · Granted Feb 13, 2018

Method and device for controlling intelligent equipment

Inventors: Huayijun Liu (Beijing, CN); Ke Wu (Beijing, CN); Pengfei Zhang (Beijing, CN)
Assignee: Xiaomi Inc.
H04N5/23203A47C21/003A47C31/008G06K9/00597G06T7/004G06T7/70G06T7/74H04N1/00381H04N5/23219H04N7/188G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,894,260
App. No.
15/219,791
Granted
Feb 13, 2018
Kind
B2
Abstract

A method for controlling intelligent equipment includes receiving an image acquisition request sent from an intelligent mattress. The image acquisition request contains an identifier (ID) of the intelligent mattress and is triggered when a user uses the intelligent mattress. The method further includes sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress, receiving eyeball information of the user and device identification information, determining a target intelligent device based on the device identification information, and controlling the target intelligent device based on the eyeball information.

Claims (72)

1. A method for controlling intelligent equipment, comprising:

receiving an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receiving eyeball information of the user and device identification information;

determining a target intelligent device based on the device identification information; and

controlling the target intelligent device based on the eyeball information.

2. The method according to claim 1 , wherein:

the device identification information includes a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which a sight direction of the user points, and

determining the target intelligent device includes:

selecting, from a stored image library, a target image matching the sight position image; and

determining an intelligent device in the target image as the target intelligent device.

3. The method according to claim 1 , wherein controlling the target intelligent device based on the eyeball information includes:

acquiring a corresponding control operation from a stored corresponding relationship between eyeball information and control operations based on the eyeball information; and

controlling the target intelligent device based on the acquired corresponding control operation.

4. A method for controlling intelligent equipment, comprising:

receiving an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receiving a mattress position image and eyeball information of the user, the mattress position image being obtained by the intelligent photographing device by performing image acquisition on a position where the intelligent mattress is located;

determining a target intelligent device based on the mattress position image; and

controlling the target intelligent device based on the eyeball information.

5. The method according to claim 4 , wherein determining the target intelligent device includes:

determining a sight direction of the user according to the mattress position image; and

determining the target intelligent device based on the sight direction.

6. The method according to claim 5 , wherein determining the sight direction includes:

performing face recognition on the mattress position image to obtain an eye position of the user; and

performing sight recognition on an eye of the user to obtain the sight direction of the user based on the eye position.

7. The method according to claim 6 , wherein performing the sight recognition on the eye of the user includes:

determining an eye pupil offset angle of an eye pupil of the user relative to a normal sight direction based on the eye position; and

determining the sight direction of the user based on the eye pupil offset angle.

8. The method according to claim 5 , wherein determining the target intelligent device based on the sight direction includes:

determining a sight-horizontal angle between the sight direction and a horizontal direction and a sight-specified angle between the sight direction and a specified direction;

acquiring a corresponding intelligent device ID from a stored corresponding relationship among sight-horizontal angles, sight-specified angles, and intelligent device IDs based on the sight-horizontal angle and the sight-specified angle; and

determining an intelligent device corresponding to the acquired corresponding intelligent device ID as the target intelligent device.

9. The method according to claim 5 , wherein determining the target intelligent device based on the sight direction includes:

sending the sight direction to the intelligent photographing device;

receiving a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which the sight direction points; and

determining the target intelligent device based on the sight position image.

10. The method according to claim 9 , wherein determining the target intelligent device based on the sight position image includes:

selecting a target image matching the sight position image from a stored image library; and

determining an intelligent device in the target image as the target intelligent device.

11. The method according to claim 9 , wherein determining the target intelligent device based on the sight position image includes:

recognizing, from the sight position image, a device mark of an intelligent device in the sight position image;

acquiring a corresponding intelligent device ID from a stored corresponding relationship between device marks and intelligent device IDs based on the recognized device mark; and

determining an intelligent device corresponding to the acquired corresponding intelligent device ID as the target intelligent device.

12. The method according to claim 4 , wherein controlling the target intelligent device includes:

acquiring a corresponding control operation from a stored corresponding relationship between eyeball information and control operations based on the eyeball information; and

controlling the target intelligent device based on the acquired corresponding control operation.

13. A device for controlling intelligent equipment, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

receive an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

send the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receive eyeball information of the user and device identification information;

determine a target intelligent device based on the device identification information; and

control the target intelligent device based on the eyeball information.

14. The device according to claim 13 , wherein:

the device identification information includes a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which a sight direction of the user points, and

the instructions further cause the processor to:

select, from a stored image library, a target image matching the sight position image; and

determine an intelligent device in the target image as the target intelligent device.

15. A device for controlling intelligent equipment, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

receive an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

send the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receive a mattress position image and eyeball information of the user, the mattress position image being obtained by the intelligent photographing device by performing image acquisition on a position where the intelligent mattress is located;

determine a target intelligent device based on the mattress position image; and

control the target intelligent device based on the eyeball information.

16. The device according to claim 15 , wherein the instructions further cause the processor to:

determine a sight direction of the user according to the mattress position image;

determine the target intelligent device based on the sight direction; and

control the target intelligent device based on the eyeball information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2016
From: LIU, HUAYIJUN; WU, KE; ZHANG, PENGFEI
To: XIAOMI INC.
Reel/Frame 039260/0482 →
Priority Claims (1)
CN 2015 1 0792231 · Nov 17, 2015 · national
Continuity (1)
Related Publication 20170142317A1 · May 18, 2017