IP Library › Granted Patent US 12,400,664
Granted Patent B2
US 12,400,664 · App. 17/639,004 · Granted Aug 26, 2025

Voice-controlled split-screen display method and electronic device

Inventor: Xiang Chen (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G10L17/22G06F3/0484G06F3/04842G06F3/04847G06F3/147G06F3/167G06V40/166G09G5/14G10L15/22G10L17/04G10L17/06G10L17/14H04N21/44218H04N21/4438G06F2203/04803G09G2354/00G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,664
App. No.
17/639,004
Granted
Aug 26, 2025
Kind
B2
Abstract

An electronic device displays, on a display in response to a first operation of a first user, an interface corresponding to a first task, where the display currently does not display an interface corresponding to another task; the electronic device collects first voice data when displaying the interface corresponding to the first task; the electronic device recognizes the first voice data in response to the first voice data including a wake-up word of the electronic device, where the first voice data is used to trigger the electronic device to execute a second task; and the electronic device displays, in a first display area of the display, the interface corresponding to the first task, and displays, in a second display area of the display, an interface corresponding to the second task, based on the first voice data being recognized as voice data of a second user.

Claims (96)

1. A voice-controlled split-screen display method, comprising:

displaying, in response to a first operation of a first user and on a display of an electronic device, a first interface corresponding to a first task while the display does not display an interface corresponding to another task;

collecting first voice data while displaying the first interface;

recognizing the first voice data in response to the first voice data comprising a wake-up word of the electronic device, wherein the first voice data is for triggering the electronic device to execute a second task;

displaying, based on the first voice data being recognized as voice data of a second user, the first interface in a first display area of the display and a second interface corresponding to the second task in a second display area of the display;

collecting a face image of the first user and a face image of the second user using a camera, wherein the electronic device further comprises the camera or is coupled to the camera;

displaying, when the electronic device detects the face image of the second user within a first preset time period and does not detect the face image of the first user, the second interface on the display and not displaying the first interface on the display; and

after the electronic device does not display the first interface, and when the electronic device re-detects the face image of the first user and the face image of the second user within a second preset time period after the first preset time period, either:

displaying, the first interface in the first display area and the second interface in the second display area; or

displaying the first interface in the second display area and the second interface in the first display area.

2. The voice-controlled split-screen display method of claim 1 , wherein the first display area is proximate to a first side of the display, wherein the second display area is proximate to a second side of the display, wherein the first side and the second side are left and right sides of the display, respectively, and wherein before displaying the first interface in the first display area and the second interface in the second display area, the voice-controlled split-screen display method further comprises determining, using at least one of the camera or a microphone of an electronic device, that the first user is close to the first side of the display and the second user is close to the second side of the display.

3. The voice-controlled split-screen display method of claim 2 , further comprising:

determining, using at least one of the camera or the microphone, that the first user is close to the second side of the display and the second user is close to the first side of the display; and

displaying the first interface in the second display area and the second interface in the first display area.

4. The voice-controlled split-screen display method of claim 1 , wherein displaying the first interface in the first display area and the second interface in the second display area comprises:

determining, based on the first voice data being recognized as the voice data of the second user, that there is no resource conflict between execution of the second task by the electronic device and execution of the first task by the electronic device; and

displaying, subsequent to determining that there is no conflict between the execution of the second task by the electronic device and the execution of the first task by the electronic device, the first interface in the first display area and the second interface in the second display area.

5. The voice-controlled split-screen display method of claim 4 , further comprising:

determining, based on the first voice data being recognized as the voice data of the second user, that there is the resource conflict between the execution of the second task by the electronic device and the execution of the first task by the electronic device;

displaying a third interface; and

either:

displaying, in response to a second operation on the third interface, the first interface on the display and not displaying the second interface on the display; or

displaying, in response to a third operation on the third interface, the second interface on the display and not displaying the first interface on the display.

6. The voice-controlled split-screen display method of claim 1 , wherein after the electronic device does not display the first interface and when the electronic device does not detect the face image of the first user within the second preset time period and re-detects the face image of the first user after the second preset time period, the voice-controlled split-screen display method further comprises:

displaying the second interface on the display; and

not displaying the first interface on the display.

7. The voice-controlled split-screen display method of claim 1 , further comprising:

collecting second voice data;

recognizing the second voice data in response to the second voice data comprising the wake-up word, wherein the second voice data is for triggering the electronic device to execute a third task, wherein the third task is different from the first task or is a subtask of the first task; and

displaying, based on the second voice data being recognized as voice data of the first user, a third interface corresponding to the third task in the first display area and the second interface in the second display area.

8. The voice-controlled split-screen display method of claim 7 , wherein the electronic device stores user identifiers of a plurality of users and a user level of each of the plurality of users, wherein a user level of the second user is higher than a user level of the first user, and wherein the voice-controlled split-screen display method further comprises:

determining, based on the second voice data being recognized as voice data of a third user, whether a user level of the third user is higher than the user level of the first user;

when the user level of the third user is higher than the user level of the first user:

determining whether there is a resource conflict between execution of the third task by the electronic device and execution of the second task by the electronic device; and

displaying, when there is no resource conflict between the execution of the third task by the electronic device and the execution of the second task by the electronic device, the third interface in the first display area and the second interface in the second display area; and

displaying, when the user level of the third user is lower than the user level of the first user, the first interface in the first display area and the second interface in the second display area.

9. The voice-controlled split-screen display method of claim 8 , further comprising:

when the user level of the third user is equal to the user level of the first user:

displaying, the first interface in the first display area and the second interface in the second display area;

displaying the third interface in the first display area and the second interface in the second display area; or

displaying a fourth interface; and

regardless of whether the first, third or fourth interface is displayed, either displaying, in response to a fourth operation on the fourth interface, the first interface in the first display area and the second interface in the second display area; or displaying, in response to a fifth operation on the fourth interface, the third interface in the first display area and the second interface in the second display area.

10. An electronic device, comprising:

a display;

a microphone; and

one or more processors coupled to the display and the microphone and configured to cause the electronic device to be configured to:

display, in response to a first operation of a first user an on the display, a first interface corresponding to a first task while the display does not display an interface corresponding to another task;

collect first voice data while displaying the first interface;

recognize the first voice data in response to the first voice data comprising a wake-up word of the electronic device, wherein the first voice data is for triggering the electronic device to execute a second task;

display, based on the first voice data being recognized as voice data of a second user, the first interface in a first display area of the display and a second interface corresponding to the second task in a second display area of the display;

collect a face image of the first user and a face image of the second user using a camera, wherein the electronic device further comprises the camera or is coupled to the camera;

display, when the electronic device detects the face image of the second user within a first preset time period and does not detect the face image of the first user, the second interface on the display and not display the first interface on the display; and

after not displaying the first interface on the display, and when the electronic device re-detects the face image of the first user and the face image of the second user within a second preset time period after the first preset time period, either:

display the first interface in the first display area and the second interface in the second display area; or

display the first interface in the second display area and the second interface in the first display area.

11. The electronic device of claim 10 , wherein the first display area is proximate to a first side of the display, wherein the second display area is proximate to a second side of the display, wherein the first side and the second side are left and right sides of the display, respectively, and wherein the one or more processors are further configured to cause the electronic device to be configured to determine, using at least one of the camera or the microphone, that the first user is close to the first side of the display and the second user is close to the second side of the display.

12. The electronic device of claim 11 , wherein one or more processors are further configured to cause the electronic device to be configured to:

determine, at least one of using the camera or the microphone, that the first user is close to the second side of the display and the second user is close to the first side of the display; and

display the first interface in the second display area and the second interface in the first display area.

13. The electronic device of claim 10 , wherein the one or more processors are further configured to cause the electronic device to be configured to:

determine, based on the first voice data being recognized as the voice data of the second user, that there is no resource conflict between execution of the second task by the electronic device and execution of the first task by the electronic device; and

display, subsequent to determining that there is not conflict between the execution of the second task by the electronic device and the execution of the first task by the electronic device, the first interface in the first display area and the second interface in the second display area.

14. The electronic device of claim 13 , wherein the one or more processors are further configured to cause the electronic device to be configured to:

determine, based on the first voice data being recognized as the voice data of the second user, that there is the resource conflict between the execution of the second task by the electronic device and the execution of the first task by the electronic device;

display a third interface; and

either:

display, in response to a second operation on the third interface, the first interface on the display and not displaying the second interface on the display; or

display, in response to a third operation on the first interface, the second interface on the display and not displaying the first interface on the display.

15. The electronic device of claim 10 , wherein the one or more processors are further configured to cause the electronic device to be configured to after not displaying the first interface, not detecting the face image of the first user within the second preset time period, and re-detecting the face image of the first user after the second preset time period, display the second interface on the display and not display the first interface on the display.

16. The electronic device of claim 10 , wherein the one or more processors are further configured to cause the electronic device to be configured to:

collect second voice data;

recognize the second voice data in response to the second voice data comprising the wake-up word, wherein the second voice data is for triggering the electronic device to execute a third task, wherein the third task is different from the first task, or the third task is a subtask of the first task; and

display, based on the second voice data being recognized as voice data of the first user, a third interface corresponding to the third task in the first display area and the second interface in the second display area.

17. The electronic device of claim 16 , wherein the memory stores user identifiers of a plurality of users and a user level of each of the plurality of users, wherein a user level of the second user is higher than a user level of the first user, and wherein the one or more processors are further configured to cause the electronic device to be configured to:

determine, based on the second voice data being recognized as the voice data of a third user, whether a user level of the third user is higher than the user level of the first user;

when the user level of the third user is higher than the user level of the first user:

determine whether there is a resource conflict between execution of the third task by the electronic device and execution of the second task by the electronic device; and

display, when there is no resource conflict between the execution of the third task by the electronic device and the execution of the second task by the electronic device, the third interface in the first display area and display the second interface in the second display area; and

display, when the user level of the third user is lower than the user level of the first user, the first interface in the first display area and the second interface in the second display area.

18. The electronic device of claim 17 , wherein the one or more processors are further configured to cause the electronic device to be configured to:

when the user level of the third user is equal to the user level of the first user:

display the first interface in the first display area and the second interface in the second display area;

display the third interface in the first display area and the second interface in the second display area; or

display a fourth interface; and

regardless of whether the first, third or fourth interface is displayed, either display, in response to a fourth operation on the fourth interface, the first interface in the first display area and the second interface in the second display area, or display, in response to a fifth operation on the fourth interface, the third interface in the first display area and the second interface in the second display area.

19. A computer program product comprising computer-executable instructions that are stored on a non-transitory computer-readable storage medium and that, when executed by one or more processors, cause an electronic device to:

display, in response to a first operation of a first user an on a display of the electronic device, a first interface corresponding to a first task while the display does not display an interface corresponding to another task;

collect first voice data while displaying the first interface;

recognize the first voice data in response to the first voice data comprising a wake-up word of the electronic device, wherein the first voice data is for triggering the electronic device to execute a second task;

display, based on the first voice data being recognized as voice data of a second user, the first interface in a first display area of the display and a second interface corresponding to the second task in a second display area of the display;

collect a face image of the first user and a face image of the second user using a camera, wherein the electronic device further comprises the camera or is coupled to the camera;

display, when the electronic device detects the face image of the second user within a first preset time period and does not detect the face image of the first user, the second interface on the display and not display the first interface on the display; and

after not displaying the first interface on the display, and when the electronic device re-detects the face image of the first user and the face image of the second user within a second preset time period after the first preset time period, either:

display the first interface in the first display area and the second interface in the second display area; or

display the first interface in the second display area and the second interface in the first display area.

20. The computer program product of claim 19 , wherein the first display area is proximate to a first side of the display, wherein the second display area is proximate to a second side of the display, wherein the first side and the second side are left and right sides of the display, respectively, and wherein the computer-executable instructions, when executed by the one or more processors, further cause the electronic device to determine, using at least one of the camera or a microphone of the electronic device, that the first user is close to the first side of the display and the second user is close to the second side of the display.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2024
From: XI'AN HUAWEI TECHNOLOGIES CO., LTD.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 069686/0558 →
EMPLOYMENT AGREEMENT Recorded Dec 27, 2024
From: CHEN, XIANG
To: XI'AN HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 069785/0366 →
Priority Claims (1)
CN 201910792694.X · Aug 26, 2019 · national
Continuity (1)
Related Publication 20220343919A1 · Oct 27, 2022
References Cited (39)
US 10310797B1 · Rayner · 2019 [cited by examiner]
US 10514949B1 · Korda · 2019 [cited by examiner]
US 20140049693A1 · Selim et al. · 2014 [cited by applicant]
US 20140125575A1 · Samanta Singhar · 2014 [cited by examiner]
US 20150355831A1 · Amendolagine · 2015 [cited by examiner]
US 20160092064A1 · Wu · 2016 [cited by applicant]
US 20160351168A1 · Yan et al. · 2016 [cited by applicant]
US 20170034469A1 · Lin · 2017 [cited by applicant]
US 20170083203A1 · Van Der Zaag · 2017 [cited by examiner]
US 20170105146A1 · Zeng · 2017 [cited by examiner]
US 20170186400A1 · Song et al. · 2017 [cited by applicant]
US 20180052595A1 · Parmar et al. · 2018 [cited by applicant]
US 20180285065A1 · Jeong · 2018 [cited by applicant]
US 20190228140A1 · Arroyo · 2019 [cited by examiner]
US 20190317606A1 · Jain · 2019 [cited by examiner]
US 20190392121A1 · VanBlon · 2019 [cited by examiner]
US 20220343919A1 · Chen · 2022 [cited by examiner]
CN 103279303A · 2013 [cited by applicant]
CN 103748585A · 2014 [cited by applicant]
CN 104123056A · 2014 [cited by applicant]
CN 104244105A · 2014 [cited by applicant]
CN 104850373A · 2015 [cited by applicant]
CN 105744368A · 2016 [cited by applicant]
CN 105812887A · 2016 [cited by applicant]
CN 107479815A · 2017 [cited by examiner]
CN 108549519A · 2018 [cited by examiner]
CN 108668153A · 2018 [cited by applicant]
CN 108717342A · 2018 [cited by examiner]
CN 108897508A · 2018 [cited by applicant]
CN 108958633A · 2018 [cited by applicant]
CN 108958810A · 2018 [cited by examiner]
CN 108962260A · 2018 [cited by examiner]
CN 109032554A · 2018 [cited by applicant]
CN 105404484B · 2019 [cited by applicant]
CN 109976645A · 2019 [cited by applicant]
CN 110060679A · 2019 [cited by applicant]
CN 110704004A · 2020 [cited by applicant]
EP 4284002A1 · 2023 [cited by examiner]
KR 20110110543A · 2011 [cited by examiner]