IP Library › Granted Patent US 12,126,864
Granted Patent B2
US 12,126,864 · App. 18/154,090 · Granted Oct 22, 2024

Screen interaction method and apparatus for electronic device

Inventors: Siwei Liu (Beijing, CN); Menghan Zhang (Beijing, CN); Ming Li (Beijing, CN); Haitao Wang (Beijing, CN); Peng Zhang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N21/44218H04N21/4516H04N21/4532H04N21/475
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,126,864
App. No.
18/154,090
Granted
Oct 22, 2024
Kind
B2
Abstract

A screen interaction method and apparatus for an electronic device are disclosed, to determine a target user from a plurality of users and control a picture displayed on a screen of the electronic device based on an action of the target user. The method includes: obtaining, by using a camera, an image including the plurality of users in front of a screen, recognizing respective actions of the plurality of users in the image based on the image including the plurality of users, comparing the actions of the plurality of users with a preset action, determining a user who performs an action matching the preset action as the target user, and controlling a picture displayed on the screen of the electronic device based on the action of the target user.

Claims (42)

1. A screen interaction method for an electronic device, comprising:

obtaining an image comprising N users, wherein N is an integer greater than or equal to 2;

recognizing respective actions of the N users based on the image comprising the N users;

determining M target users based on the respective actions of the N users, wherein an action of each of the M target users matches a preset action, wherein M is an integer, and 2≤M≤N; and

controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users,

wherein, upon determining that none of the M target users has control permission, the controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users comprises:

controlling the picture displayed on the screen of the electronic device based on an action of a user-specified target user indicated by a user.

2. The method according to claim 1 , wherein upon determining that the M target users include a target user having control permission, the controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users comprises:

controlling the picture displayed on the screen of the electronic device based on an action of the target user having control permission, wherein the target user having control permission is a target user that has interacted with the electronic device within a preset duration.

3. The method according to claim 1 , wherein before the controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users, the method further comprises:

transferring control permission from a user having control permission to the user-specified target user indicated by the user.

4. The method according to claim 1 , wherein before the controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users, the method further comprises:

assigning control permission to the user-specified target user indicated by the user.

5. The method according to claim 1 , wherein the preset action comprises one or more of swinging a forearm, forking a left arm, forking a right arm, forking two arms, nodding, or clenching a fist.

6. The method according to claim 5 , wherein the preset action is a menu selection action, the controlling a picture displayed on a screen of the electronic device based on the action of the target user comprises:

controlling, based on a swing angle of a forearm of the target user, a pointer displayed on the screen of the electronic device to point to an option on a menu.

7. The method according to claim 6 , wherein the menu displayed on the screen of the electronic device is a menu in a ring shape or in a roulette wheel shape.

8. A screen interaction method for an electronic device, comprising:

obtaining an image comprising N users, wherein N is an integer greater than or equal to 2;

determining, based on the image comprising the N users, whether the N users comprise a user having control permission;

upon determining that the N users comprise the user having control permission, determining the user having control permission as a target user having control permission, wherein an action of the target user having control permission matches a preset action;

upon determining that the N users do not comprise the user having control permission, and the N users comprise M target users, determining one target user as a target user having control permission, wherein an action of the target user matches a preset action, M is an integer, and 1≤M≤N; and

controlling a picture displayed on a screen of the electronic device based on the action of the target user having control permission,

wherein M≥2, and the determining one target user as a target user having control permission comprises:

assigning control permission to the one target user indicated by a user, and determining the one target user indicated by the user as the target user having control permission.

9. A screen interaction apparatus for an electronic device, comprising at least one processor configured to:

obtain an image comprising N users, wherein N is an integer greater than or equal to 2;

recognize respective actions of the N users based on the image comprising the N users;

determine M target users based on the respective actions of the N users, wherein an action of each of the M target users matches a preset action, wherein M is an integer, and 2≤M≤N; and

control a picture displayed on a screen of the electronic device based on the action of one of the M target users,

wherein, upon determining that none of the M target users has control permission, the controlling a picture displayed on a screen of the electronic device based on the action of one of the M target users comprises:

controlling the picture displayed on the screen of the electronic device based on an action of a user-specified target user indicated by a user.

10. The apparatus according to claim 9 , wherein upon determining that the M target users include a target user having control permission, the controlling a picture displayed on a screen of the electronic device based on the action of the one of the M target users comprises

controlling the picture displayed on the screen of the electronic device based on an action of the target user having control permission, wherein the target user having control permission is a target user that has interacted with the electronic device within a preset duration.

11. The apparatus according to claim 9 , wherein the at least one processor is further configured to:

transfer control permission from a user having control permission to the user-specified target user indicated by the user.

12. The apparatus according to claim 9 , wherein the at least one processor is further configured to:

assign control permission to the user-specified target user indicated by the user.

13. The apparatus according to claim 9 , wherein the preset action comprises one or more of swinging a forearm, forking a left arm, forking a right arm, forking two arms, nodding, or clenching a fist.

14. The apparatus according to claim 13 , wherein the preset action is a menu selection action, the at least one processor is further configured to:

control, based on a swing angle of a forearm of the target user, a pointer displayed on the screen of the electronic device to point to an option on a menu.

15. The apparatus according to claim 14 , wherein the menu displayed on the screen of the electronic device is a menu in a ring shape or in a roulette wheel shape.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2024
From: LIU, SIWEI; ZHANG, MENGHAN; LI, MING; WANG, HAITAO; ZHANG, PENG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 068050/0103 →
Priority Claims (1)
CN 202010696580.8 · Jul 17, 2020 · national
Continuity (2)
Continuation PCTCN2021106352 · Jul 14, 2021
Related Publication 20230171467A1 · Jun 1, 2023