IP Library Granted Patent US 11,861,149
Granted Patent B2
US 11,861,149 · App. 18/296,074 · Granted Jan 2, 2024

Interface information processing method and apparatus, storage medium, and device

Inventors: Yan Liu (Shenzhen, CN); Ziqian Wang (Shenzhen, CN); Zuofeng Sun (Shenzhen, CN); Huihuang Huang (Shenzhen, CN); Wentao Zhong (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06F3/0484G06F40/58G06T11/001G06T13/80G06V10/56G06V30/1444G06V30/19G06T2200/24G06V2201/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,861,149
App. No.
18/296,074
Granted
Jan 2, 2024
Kind
B2
Abstract

An interface information processing method and apparatus, a storage medium, and a device are provided. The method includes: displaying, based on a trigger operation on a floating translation component in a first display interface, a trigger progress in the floating translation component, the first display interface including a character of a first language type, the trigger progress being associated with trigger duration, and the trigger duration being a duration of the trigger operation on the floating translation component; and switching the first display interface to a second display interface based on the trigger progress in the floating translation component satisfying a full-screen translation start progress, the second display interface including a character of a second language type, and the character of the second language type being obtained by translating the character of the first language type.

Claims (78)

1. An interface information processing method, performed by a computer device, comprising:

displaying, based on a trigger operation on a floating translation component in a first display interface, a trigger progress in the floating translation component, the first display interface comprising a character of a first language type, the trigger progress being associated with a trigger duration, and the trigger duration being a duration of the trigger operation on the floating translation component;

switching the first display interface to a second display interface based on the trigger progress in the floating translation component satisfying a full-screen translation start progress, the second display interface comprising a character of a second language type, and the character of the second language type being obtained by translating the character of the first language type;

displaying an authorization interface for the floating translation component;

enabling a configured permission of the floating translation component based on an enabling operation on a component authorization control in the authorization interface; and

displaying the floating translation component in the first display interface based on the configured permission based on the authorization interface being exited.

2. The interface information processing method according to claim 1 , wherein the second display interface comprises a second interface image, and

the switching comprises:

performing a screenshot taking processing operation on the first display interface to obtain a first interface image based on the trigger progress in the floating translation component satisfying the full-screen translation start progress;

translating the character of the first language type in the first interface image to obtain the second interface image, the second interface image comprising the character of the second language type; and

displaying the second interface image overlaying the first display interface.

3. The interface information processing method according to claim 2 , wherein the translating the character of the first language type in the first interface image comprises:

graying the first interface image to obtain a grayed first interface image;

performing character extraction on the grayed first interface image to obtain the character of the first language type in the first interface image; and

translating the character of the first language type into the character of the second language type, and generating the second interface image according to the character of the second language type.

4. The interface information processing method according to claim 3 , wherein the translating the character of the first language type into the character of the second language type and generating the second interface image according to the character of the second language type comprises:

performing semantic recognition on the character of the first language type to obtain character semantic information of the character of the first language type, and translating the character of the first language type into the character of the second language type according to the character semantic information; and

obtaining character position information of the character of the first language type in the first interface image, adding the character of the second language type to a transition interface image according to the character position information, and generating the second interface image comprising the character of the second language type according to the transition interface image, both the transition interface image and the second interface image having a same size as the first display interface.

5. The interface information processing method according to claim 4 , wherein the adding comprises:

determining, in the transition interface image, a region indicated by the character position information as an addition region;

adding the character of the second language type to the addition region in the transition interface image; and

generating the second interface image according to the transition interface image added with the character of the second language type.

6. The interface information processing method according to claim 5 , wherein the generating the second interface image according to the transition interface image added with the character of the second language type comprises:

performing pixel recognition on the first interface image to obtain a region color of a region in which the character of the first language type is located in the first interface image; and

setting a background color of the transition interface image added with the character of the second language type to the region color to obtain the second interface image.

7. The interface information processing method according to claim 2 , wherein the method further comprises:

detecting a screenshot taking permission of the floating translation component according to the configured permission to obtain a screenshot taking permission detection result; and

executing, based on the screenshot taking permission detection result indicating that the floating translation component has the screenshot taking permission, the screenshot taking processing operation on the first display interface.

8. The interface information processing method according to claim 2 , wherein a component authorization control further comprises a first floating authorization control, and the method further comprises:

detecting a floating permission of the floating translation component according to the configured permission to obtain a floating permission detection result; and

displaying the floating translation component in the first display interface based on the floating permission detection result indicating that the floating translation component has the floating permission; or

outputting a floating permission editing window for the floating translation component based on the floating permission detection result indicating that the floating translation component does not have the floating permission, and

displaying the floating translation component in the first display interface based on an enabling operation on the first floating authorization control in the floating permission editing window.

9. The interface information processing method according to claim 1 , wherein the component authorization control comprises a second floating authorization control and a first screenshot taking authorization control and the configured permission comprises a floating permission and a screenshot taking permission, and

the enabling the configured permission of the floating translation component comprises:

enabling the floating permission of the floating translation component based on a trigger operation on the second floating authorization control in the authorization interface, the floating permission indicating that the floating translation component has a permission to be displayed in the first display interface; and

enabling the screenshot taking permission of the floating translation component based on a trigger operation on the first screenshot taking authorization control in the authorization interface, the screenshot taking permission indicating that the floating translation component has a permission to take a screenshot of the first display interface.

10. The interface information processing method according to claim 1 , wherein the switching comprises:

displaying a full-screen scanning animation on the first display interface based on the trigger progress in the floating translation component satisfying the full-screen translation start progress, the full-screen scanning animation being used for indicating a state in which full-screen interface translation is currently being performed on the first display interface; and

switching the first display interface to the second display interface based on the full-screen scanning animation ending.

11. The interface information processing method according to claim 1 , wherein the method further comprises:

obtaining, based on a dragging operation on the floating translation component, movement position information determined by the dragging operation, and updating a display position of the floating translation component in the first display interface according to the movement position information;

obtaining current display position information of the floating translation component based on detecting that the dragging operation ends, and obtaining distances between the display position information and N interface boundaries of the first display interface respectively, N being a positive integer greater than or equal to 3; and

obtaining an interface boundary corresponding to a minimum distance as a target interface boundary, and displaying the floating translation component on the target interface boundary.

12. The interface information processing method according to claim 1 , wherein the method further comprises:

switching the second display interface to the first display interface based on a touch operation on the second display interface or a trigger operation on an exit control in the second display interface, and resuming display of the floating translation component in the first display interface.

13. An interface information processing apparatus comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprises:

trigger progress display code configured to cause the at least one processor to display, based on a trigger operation on a floating translation component in a first display interface, a trigger progress in the floating translation component, the first display interface comprising a character of a first language type, the trigger progress being associated with trigger duration, and the trigger duration being a duration of the trigger operation on the floating translation component;

interface switching code configured to cause the at least one processor to switch the first display interface to a second display interface based on the trigger progress in the floating translation component satisfying a full-screen translation start progress, the second display interface comprising a character of a second language type, and the character of the second language type being obtained by translating the character of the first language type;

first display code configured to cause the at least one processor to display an authorization interface for the floating translation component;

first enabling code configured to cause the at least one processor to enable a configured permission of the floating translation component based on an enabling operation on a component authorization control in the authorization interface; and

second display code configured to cause the at least one processor to display the floating translation component in the first display interface based on the configured permission based on the authorization interface being exited.

14. The interface information processing apparatus according to claim 13 , wherein the second display interface comprises a second interface image, and the interface switching code is further configured to cause the at least one processor to:

perform a screenshot taking processing operation on the first display interface to obtain a first interface image based om the trigger progress in the floating translation component satisfying the full-screen translation start progress;

translate the character of the first language type in the first interface image to obtain the second interface image, the second interface image comprising the character of the second language type; and

display the second interface image overlaying the first display interface.

15. The interface information processing apparatus according to claim 13 , wherein the interface switching code is further configured to cause the at least one processor to:

display a full-screen scanning animation on the first display interface based on the trigger progress in the floating translation component satisfying the full-screen translation start progress, the full-screen scanning animation being used for indicating a state in which full-screen interface translation is currently being performed on the first display interface; and

switch the first display interface to the second display interface based on the full-screen scanning animation ending.

16. The interface information processing apparatus according to claim 13 , wherein the program code further comprises:

update code configured to cause the at least one processor to obtain, based on a dragging operation on the floating translation component, movement position information determined by the dragging operation, and update a display position of the floating translation component in the first display interface according to the movement position information;

obtaining code configured to cause the at least one processor to obtain current display position information of the floating translation component based on detecting that the dragging operation ends, and obtain distances between the display position information and N interface boundaries of the first display interface respectively, N being a positive integer greater than or equal to 3; and

third component display code configured to cause the at least one processor to obtain an interface boundary corresponding to a minimum distance as a target interface boundary, and display the floating translation component on the target interface boundary.

17. The interface information processing apparatus according to claim 13 , wherein the program code further comprises:

display resuming code configured to cause the at least one processor to switch the second display interface to the first display interface based on a touch operation on the second display interface or a trigger operation on an exit control in the second display interface, and resume display of the floating translation component in the first display interface.

18. A non-transitory computer-readable storage medium storing computer code that when executed by at least one processor causes the at least one processor to:

display, based on a trigger operation on a floating translation component in a first display interface, a trigger progress in the floating translation component, the first display interface comprising a character of a first language type, the trigger progress being associated with a trigger duration, and the trigger duration being a duration of the trigger operation on the floating translation component;

switch the first display interface to a second display interface based on the trigger progress in the floating translation component satisfying a full-screen translation start progress, the second display interface comprising a character of a second language type, and the character of the second language type being obtained by translating the character of the first language type;

display an authorization interface for the floating translation component;

enable a configured permission of the floating translation component based on an enabling operation on a component authorization control in the authorization interface; and

display the floating translation component in the first display interface based on the configured permission based on the authorization interface being exited.

19. The non-transitory computer-readable storage medium according to claim 18 , wherein the second display interface comprises a second interface image, and

the computer code when executed by at least one processor causes the at least one processor to switch the first display interface to the second display interface by:

performing a screenshot taking processing operation on the first display interface to obtain a first interface image based on the trigger progress in the floating translation component satisfying the full-screen translation start progress;

translating the character of the first language type in the first interface image to obtain the second interface image, the second interface image comprising the character of the second language type; and

displaying the second interface image overlaying the first display interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2023
From: LIU, YAN; WANG, ZIQIAN; SUN, ZUOFENG; HUANG, HUIHUANG; ZHONG, WENTAO
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 063232/0196 →
Priority Claims (1)
CN 202110745185.9 · Jun 30, 2021 · national
Continuity (2)
Continuation PCTCN2022095194 · May 26, 2022
Related Publication 20230259256A1 · Aug 17, 2023