IP Library › Granted Patent US 11,503,208
Granted Patent B2
US 11,503,208 · App. 17/041,696 · Granted Nov 15, 2022

Intelligent assistant control method and terminal device for recommending a photographing mode to a user

Inventors: Lei Song (Shanghai, CN); Xin Guo (London, GB); Xiaomeng Chen (Shenzhen, CN); Yunchao Zhang (Beijing, CN); Xin Chen (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N5/23245H04N5/23203H04N5/23212H04N5/23222H04N5/23225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,503,208
App. No.
17/041,696
Granted
Nov 15, 2022
Kind
B2
Abstract

An intelligent assistant control method is provided: starting, by a terminal device, a lens; displaying, by the terminal device, a preview interface on a display screen, where the preview interface includes a to-be-photographed object; and if the terminal device determines that the preview interface has been stably displayed for preset duration, displaying, by the terminal device, first prompt information of a photographing mode in the preview interface, where the first prompt information is used to recommend a first photographing mode to a user, and the first photographing mode is determined by the terminal device based on scene information of the to-be-photographed object.

Claims (85)

1. A method of intelligent assistant control, wherein the method comprises:

starting, by a terminal device, a lens;

displaying, by the terminal device, a preview interface on a display screen, wherein the preview interface comprises a to-be-photographed object;

identifying, by the terminal device, at least two types of scene information comprised in the to-be-photographed object;

determining a first photographing mode from at least two photographing modes according to a priority policy and a first mapping relationship between the at least two types of scene information and the at least two photographing modes, wherein the priority policy comprises priorities of the at least two photographing modes, wherein the priorities of the at least two photographing modes are based on a quantity of times that each of the at least two photographing modes has been used by the terminal device; and

displaying, by the terminal device, a first prompt information of the first photographing mode in the preview interface when the terminal device determines that the to-be-photographed object in the preview interface has been stably displayed for preset duration, wherein the terminal device recommends the first photographing mode to a user based on the first prompt information.

2. The method according to claim 1 , wherein the identifying of the at least two types of scene information comprised in the to-be-photographed object and the determining of the first photographing mode according to the priority policy and the first mapping relationship between the at least two types of scene information and the photographing modes comprises:

collecting, by the terminal device, n frames of the preview interface, wherein n is an integer greater than or equal to 1;

identifying, by the terminal device, the at least two types of scene information of the to-be-photographed object comprised in each of the n frames of the preview interface; and

determining, by the terminal device based on the at least two types of scene information, a photographing mode matching each frame of the preview interface; and

determining the first photographing mode as a photographing mode matching a last frame of the preview interface in the n frames of the preview interface.

3. The method according to claim 1 , wherein the terminal device determines the preset duration in which the to-be-photographed object in the preview interface has been stably displayed comprises:

collecting, by the terminal device, at least two frames of the preview interface within the preset duration;

when a similarity between the at least two frames of the preview interface is higher than a preset similarity, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration; or

detecting, by the terminal device by using a motion sensor, whether the terminal device is in a still state within the preset duration; and

when the terminal device is in a still state within the preset duration, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration.

4. The method according to claim 1 , wherein the first prompt information comprises a first icon, the first icon identifies the first photographing mode, and the displaying, by the terminal device, of the first prompt information comprises:

displaying, by the terminal device, the first icon in a first display region in the preview interface, wherein the terminal device loads, in response to a first operation on the first icon, a first parameter set corresponding to the first photographing mode based on a second mapping relationship between the first photographing mode and the first parameter set.

5. The method according to claim 4 , wherein the method further comprises:

displaying, by the terminal device, the first parameter set in a second display region in the preview interface;

displaying, by the terminal device, a modified second parameter set in response to a second operation, wherein the modified second parameter set is obtained after a first parameter in the first parameter set is modified; and

loading, by the terminal device, the modified second parameter set.

6. The method according to claim 5 , wherein the method further comprises:

when the first parameter is modified more than a preset quantity of times, establishing, by the terminal device, a third mapping relationship between the modified second parameter set and the first photographing mode; and

adding, by the terminal device, the third mapping relationship to the second mapping relationship.

7. The method according to claim 4 , wherein the method further comprises:

displaying, by the terminal device, a first information in the preview interface in response to a second operation on the first icon, wherein the first information is text information describing the first photographing mode.

8. The method according to claim 4 , wherein the method further comprises:

displaying, by the terminal device, second prompt information in the preview interface, wherein the second prompt information is used to remind the user that the terminal device is currently in the first photographing mode.

9. The method according to claim 1 , wherein when the user selects another photographing mode other than the first photographing mode recommended by the terminal device, the method further comprises:

determining, by the terminal device, whether a quantity of times the user selects the another photographing mode exceeds a preset quantity of times; and when the quantity of times the user selects the another photographing mode exceeds the preset quantity of times,

setting, by the terminal device, a first priority of the another photographing mode to a second priority, wherein the second priority is greater than the first priority; and

updating, by the terminal device, the priority policy by using the second priority of the another photographing mode.

10. A terminal device, comprising:

a processor;

a lens;

a display screen; and

a memory;

wherein the processor executes instructions stored in the memory to perform operations comprising:

starting the lens;

instructing the display screen to display a preview interface that comprises a to-be-photographed object;

identifying at least two types of scene information comprised in the to-be-photographed object;

determining a first photographing mode from at least two photographing modes according to a priority policy and a first mapping relationship between the at least two types of scene information and the at least two photographing modes, wherein the priority policy comprises priorities of the at least two photographing modes, wherein the priorities of the at least two photographing modes are based on a quantity of times that each of the at least two photographing modes has been used by the terminal device; and

instructing the display screen to display a first prompt information of the first photographing mode in the preview interface when determining the to-be-photographed object in the preview interface has been stably displayed for a preset duration, wherein the terminal device recommends the first photographing mode to a user based on the first prompt information.

11. A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium comprises a computer program, and when the computer program is run on a terminal device, the terminal device is enabled to perform:

starting a lens;

displaying a preview interface on a display screen, wherein the preview interface comprises a to-be-photographed object;

identifying at least two types of scene information comprised in the to-be-photographed object;

determining a first photographing mode from at least two photographing modes according to a priority policy and a first mapping relationship between the at least two types of scene information and the at least two photographing modes, wherein the priority policy comprises priorities of the at least two photographing modes, wherein the priorities of the at least two photographing modes are based on a quantity of times that each of the at least two photographing modes has been used by the terminal device; and

displaying a first prompt information of the first photographing mode in the preview interface when the terminal device determines that the to-be-photographed object in the preview interface has been stably displayed for a preset duration, wherein the terminal device recommends the first photographing mode to a user based on the first prompt information.

12. The terminal device according to claim 10 , wherein the identifying of the at least two types of scene information comprised in the to-be-photographed object and the determining of the first photographing mode according to the priority policy and the first mapping relationship between the at least two types of scene information and the photographing modes comprises:

collecting n frames of the preview interface, wherein n is an integer greater than or equal to 1;

identifying the at least two types of scene information of the to-be-photographed object comprised in each of the n frames of the preview interface; and

determining, based on the at least two types of scene information, a photographing mode matching each frame of the preview interface; and

determining the first photographing mode as a photographing mode matching a last frame of the preview interface in the n frames of the preview interface.

13. The terminal device according to claim 10 , wherein the determining of the preset duration in which the to-be-photographed object in the preview interface has been stably displayed, comprises:

collecting at least two frames of the preview interface within the preset duration;

when a similarity between the at least two frames of the preview interface is higher than a preset similarity, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration; or

detecting whether the terminal device is in a still state within the preset duration by using a motion sensor; and

when the terminal device is in a still state within the preset duration, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration.

14. The terminal device according to claim 10 , wherein the first prompt information comprises a first icon that identifies the first photographing mode, and the displaying of the first prompt information comprises:

displaying the first icon in a first display region in the preview interface, wherein the terminal device loads, in response to a first operation on the first icon, a first parameter set corresponding to the first photographing mode based on a second mapping relationship between the first photographing mode and the first parameter set.

15. The terminal device according to claim 14 , the operations further comprising:

instructing the display screen to display a first parameter set in a second display region in the preview interface;

instructing the display screen to display a modified second parameter set in response to a second operation, wherein the modified second parameter set is obtained after a first parameter in the first parameter set is modified; and

loading the modified second parameter set.

16. The method terminal device according to claim 15 , the operations further comprising:

when the first parameter is modified more than a preset quantity of times, establishing a third mapping relationship between the modified second parameter set and the first photographing mode; and

adding the third mapping relationship to the second mapping relationship.

17. The terminal device according to claim 15 , the operations further comprising:

instructing the display screen to display a second prompt information in the preview interface, wherein the second prompt information is used to remind the user that the terminal device is currently in the first photographing mode.

18. The terminal device according to claim 15 , the operations further comprising:

when the user selects another photographing mode other than the first photographing mode recommended by the terminal device, determining whether a quantity of times that the user selects the another photographing mode exceeds a preset quantity of times; and

when the quantity of times that the user selects the another photographing mode exceeds the preset quantity of times, setting a first priority of the another photographing mode to a second priority, wherein the second priority is greater than the first priority; and

updating the priority policy by using the second priority of the another photographing mode.

19. The non-transitory computer readable storage medium according to claim 11 , wherein the identifying of the at least two types of scene information comprised in the to-be-photographed object and the determining of the first photographing mode according to the priority policy and the first mapping relationship between the two least two types of scene information and the at least two photographing modes comprises:

collecting n frames of the preview interface, wherein n is an integer greater than or equal to 1;

identifying the at least two types of scene information of the to-be-photographed object comprised in each of the n frames of preview interfaces; and

determining based on the at least two types of scene information, a photographing mode matching each frame of the preview interface; and

determining the first photographing mode as a photographing mode matching a last frame of the preview interface in the n frames of preview interfaces.

20. The non-transitory computer readable storage medium according to claim 11 , wherein determining the preset duration in which the to-be-photographed object in the preview interface has been stably displayed comprises:

collecting at least two frames of the preview interface within the preset duration;

when a similarity between the at least two frames of the preview interface is higher than a preset similarity, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration; or

detecting whether the terminal device is in a still state within the preset duration by using a motion sensor; and

when the terminal device is in a still state within the preset duration, determining that the to-be-photographed object in the preview interface has been stably displayed for the preset duration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2021
From: SONG, LEI; GUO, XIN; CHEN, XIAOMENG; ZHANG, YUNCHAO; CHEN, XIN
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 056560/0553 →
Continuity (1)
Related Publication 20210014420A1 · Jan 14, 2021
Cited By (2)
US 12,604,083 US 12,750,581