IP Library › Granted Patent US 10,765,947
Granted Patent B2
US 10,765,947 · App. 16/168,147 · Granted Sep 8, 2020

Visual display method for compensating sound information, computer readable storage medium and electronic device

Inventor: Xuemei Li (Hangzhou, CN)
Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
A63F13/5378A63F13/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,765,947
App. No.
16/168,147
Granted
Sep 8, 2020
Kind
B2
Abstract

The present disclosure provides a visual display method and apparatus for compensating sound information, a storage medium, and an electronic device, and relates to the field of human-computer interaction technology. The visual display method includes: providing a mini-map on a graphical user interface, and rendering a first graphic identifier on the mini-map, wherein the first graphic identifier is used to indicate a current position and orientation of a virtual object in a game scene; detecting a sound in a first preset range of the game scene, and when the sound in the first preset range of the game scene is detected, acquiring orientation information of a sound source of the sound; and generating a second graphic identifier corresponding to the sound at a corresponding position on the mini-map according to the orientation information of the sound source of the sound.

Claims (45)

1. A visual display method for compensating sound information, applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the method comprises:

providing a mini-map on the graphical user interface, and rendering a first graphic identifier on the mini-map, wherein the first graphic identifier is used to indicate a current position and orientation of the virtual object in the game scene;

detecting a sound in a first preset range of the game scene, and when the sound in the first preset range of the game scene is detected, acquiring orientation information of a sound source of the sound; and

generating a second graphic identifier corresponding to the sound at a corresponding position on the mini-map according to the orientation information of the sound source of the sound,

wherein the method further comprises: setting a timer for recording a duration of the sound from beginning, determining whether the duration exceeds a preset time threshold, and if not, displaying the second graphic identifier corresponding to the sound, and

wherein the method further comprises:

when a plurality of the sounds that are located at the same orientation and do not exceed the preset time threshold are detected, displaying the second graphic identifier corresponding to the sound that occurs at the latest.

2. The method according to claim 1 , wherein the generating the second graphic identifier corresponding to the sound at the corresponding position on the mini-map according to the orientation information of the sound source of the sound comprises:

determining relative orientation information of the sound source relative to the virtual object according to the orientation information; and

displaying the second graphic identifier at a relative orientation corresponding to the first graphic identifier according to the relative orientation information.

3. The method according to claim 2 , wherein the displaying the second graphic identifier at the relative orientation corresponding to the first graphic identifier according to the relative orientation information comprises:

setting an annular area centered on the first graphic identifier, and displaying the second graphic identifier at a position corresponding to the annular area according to the relative orientation information.

4. The method according to claim 1 , wherein the first preset range is an area range determined according to the current position of the virtual object in the game scene.

5. The method according to claim 1 , wherein the method further comprises: acquiring at least one of a state of the sound source of the sound and a distance between the sound source of the sound and the virtual object, and controlling a display form of the second graphic identifier according to the at least one of the state and the distance.

6. The method according to claim 5 , wherein the controlling the display form of the second graphic identifier according to the at least one of the state and the distance comprises: controlling at least one of a size, a color, a brightness, a transparency and a dynamic effect of the second graphic identifier according to the at least one of the state and the distance.

7. The method according to claim 1 , wherein the method further comprises: acquiring a type of the sound; and selecting a corresponding ideographic graph from preset ideographic graphs according to the type of the sound, as the second graphic identifier corresponding to the sound.

8. The method according to claim 1 , wherein the orientation information comprises: at least one of a relative orientation of the sound source relative to the virtual object and an orientation of the sound source in the game scene.

9. The method according to claim 1 , wherein the method further comprises: providing a third graphical identifier for indicating a visual field of the virtual object on the mini-map.

10. A non-transitory computer readable storage medium storing a computer program thereon, which is applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the computer program, when being executed by a processor, performs:

providing a mini-map on the graphical user interface, and rendering a first graphic identifier on the mini-map, wherein the first graphic identifier is used to indicate a current position and orientation of the virtual object in the game scene;

detecting a sound in a first preset range of the game scene, and when the sound in the first preset range of the game scene is detected, acquiring orientation information of a sound source of the sound; and

generating a second graphic identifier corresponding to the sound at a corresponding position on the mini-map according to the orientation information of the sound source of the sound,

wherein the computer program, when being executed by the processor, further performs: setting a timer for recording a duration of the sound from beginning, determining whether the duration exceeds a preset time threshold, and if not, displaying the second graphic identifier corresponding to the sound, and

wherein the computer program, when being executed by the processor, further performs:

when a plurality of the sounds that are located at the same orientation and do not exceed the preset time threshold are detected, displaying the second graphic identifier corresponding to the sound that occurs at the latest.

11. An electronic device for compensating sound information, which is applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the electronic device comprises:

a processor; and

a memory for storing executable instructions of the processor;

wherein, the processor is configured to perform the executable instructions to perform:

providing a mini-map on the graphical user interface, and rendering a first graphic identifier on the mini-map, wherein the first graphic identifier is used to indicate a current position and orientation of the virtual object in the game scene;

detecting a sound in a first preset range of the game scene, and when the sound in the first preset range of the game scene is detected, acquiring orientation information of a sound source of the sound; and

generating a second graphic identifier corresponding to the sound at a corresponding position on the mini-map according to the orientation information of the sound source of the sound,

wherein the processor is further configured to perform: setting a timer for recording a duration of the sound from beginning, determining whether the duration exceeds a preset time threshold, and if not, displaying the second graphic identifier corresponding to the sound, and

wherein the processor is further configured to perform;

when a plurality of the sounds that are located at the same orientation and do not exceed the preset time threshold are detected, displaying the second graphic identifier corresponding to the sound that occurs at the latest.

12. The electronic device according to claim 11 , wherein the processor is further configured to perform:

determining relative orientation information of the sound source relative to the virtual object according to the orientation information; and

displaying the second graphic identifier at a relative orientation corresponding to the first graphic identifier according to the relative orientation information.

13. The electronic device according to claim 12 , wherein the processor is further configured to perform:

setting an annular area centered on the first graphic identifier, and displaying the second graphic identifier at a position corresponding to the annular area according to the relative orientation information.

14. The electronic device according to claim 11 , wherein the first preset range is an area range determined according to the current position of the virtual object in the game scene.

15. The electronic device according to claim 11 , wherein the processor is further configured to perform: acquiring at least one of a state of the sound source of the sound and a distance between the sound source of the sound and the virtual object, and controlling a display form of the second graphic identifier according to the at least one of the state and the distance.

16. The electronic device according to claim 15 , wherein the processor is further configured to perform: controlling at least one of a size, a color, a brightness, a transparency and a dynamic effect of the second graphic identifier according to the at least one of the state and the distance.

17. The electronic device according to claim 11 , wherein the processor is further configured to perform: acquiring a type of the sound; and selecting a corresponding ideographic graph from preset ideographic graphs according to the type of the sound, as the second graphic identifier corresponding to the sound.

18. The electronic device according to claim 11 , wherein the orientation information comprises: at least one of a relative orientation of the sound source relative to the virtual object and an orientation of the sound source in the game scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2018
From: LI, XUEMEI
To: NETEASE (HANGZHOU) NETWORK CO.,LTD.
Reel/Frame 047279/0735 →
Priority Claims (1)
CN 2017 1 1029698 · Oct 27, 2017 · national
Continuity (1)
Related Publication 20190126151A1 · May 2, 2019
Cited By (2)
US 12,186,666 US 12,287,417