IP Library Granted Patent US 11,439,907
Granted Patent B2
US 11,439,907 · App. 16/899,889 · Granted Sep 13, 2022

Audio feedback that varies based on direction of input stroke

Inventors: Masami Yone (Kyoto, JP); Yuichi Ozaki (Kyoto, JP)
Assignee: NINTENDO CO., LTD.
A63F13/54A63F13/2145G06F3/041G06F3/04883G06F3/165G06T11/203A63F13/24A63F2300/1043A63F2300/1075A63F2300/6081G09B19/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,439,907
App. No.
16/899,889
Granted
Sep 13, 2022
Kind
B2
Abstract

A storage medium storing therein a program, an information processing apparatus, an information processing method, a game system and a mobile device are disclosed. For example, disclosed is a non-transitory storage medium storing therein a program that is readable by a computer of an information processing apparatus, the program being configured to cause the computer to: acquire input coordinates of input performed based on an operation performed by a user; generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus; determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed; generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and output the sound information of the virtual writing sound to a speaker.

Claims (147)

1. A non-transitory storage medium storing therein a program that is readable by a computer of an information processing apparatus, the program being configured to cause the computer to:

acquire input coordinates of input performed based on an operation by a user, the input coordinates are set in a coordinate plane of an orthogonal coordinate system;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, the direction of the reference line is inclined with respect to a coordinate axis of the coordinate plane; and

output the sound information of the virtual writing sound to a speaker.

2. The storage medium according to claim 1 , wherein the program is further configured to cause the computer to generate the sound information where a volume of the virtual writing sound is changed according to the movement direction with respect to the reference line.

3. The storage medium according to claim 2 , wherein the program is further configured to cause the computer to generate the sound information where when the movement direction is close to being perpendicular to the reference line, the volume is greater compared to a case where the movement direction is close to being parallel to the reference line.

4. The storage medium according to claim 1 , wherein the program is further configured to cause the computer to generate the sound information where a pitch of the virtual writing sound is changed according to the movement direction with respect to the reference line.

5. The storage medium according to claim 4 , wherein the program is further configured to cause the computer to generate the sound information where when the movement direction is close to being perpendicular to the reference line, the pitch is higher compared to a case where the movement direction is close to being parallel to the reference line.

6. The storage medium according to claim 1 , wherein the program is further configured to cause the computer to generate the sound information where a tone of the virtual writing sound is changed according to the movement direction with respect to the reference line.

7. The storage medium according to claim 6 , wherein the program is further configured to cause the computer to generate the sound information where the tone is changed depending on whether an angle formed by the movement direction with respect to the direction of the reference line is greater than or equal to 0 degrees and less than 180 degrees or greater than or equal to 180 degrees and less than 360 degrees.

8. The storage medium according to claim 1 , wherein the reference line is inclined by about 45 degrees with respect to the coordinate axis.

9. The storage medium according to claim 1 , wherein the program is further configured to cause the computer to determine an input velocity based on a change in the input coordinates and change the sound information of the virtual writing sound according to the determined input velocity.

10. The storage medium according to claim 9 , wherein the program is further configured to cause the computer to generate the sound information where the change in the sound information of the virtual writing sound is greater when the determined input velocity is faster.

11. The storage medium according to claim 9 , wherein the program is further configured to cause the computer to generate the sound information of the virtual writing sound where virtual writing sound has a higher pitch when the determined input velocity is faster.

12. An information processing apparatus comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user, the input coordinates are set in a coordinate plane of an orthogonal coordinate system;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, the direction of the reference line is inclined with respect to a coordinate axis of the coordinate plane ; and

output the sound information of the virtual writing sound to a speaker.

13. An information processing method comprising:

acquiring input coordinates of input performed based on an operation of a user, the input coordinates are set in a coordinate plane of an orthogonal coordinate system;

generating drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determining a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed; and

generating sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, the direction of the reference line is inclined with respect to a coordinate axis of the coordinate plane; and

outputting the sound information of the virtual writing sound to a speaker.

14. A game system comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user, the input coordinates are set in a coordinate plane of an orthogonal coordinate system;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, the direction of the reference line is inclined with respect to a coordinate axis of the coordinate plane; and

output the sound information of the virtual writing sound to a speaker.

15. A mobile device comprising:

a display comprising a touch panel;

at least one speaker; and

a processor configured to:

acquire input coordinates of input performed on the touch panel, the input coordinates are set in a coordinate plane of an orthogonal coordinate system;

generate drawing information for displaying a path corresponding to the input coordinates in the display;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, the direction of the reference line is inclined with respect to a coordinate axis of the coordinate plane; and

output the sound information of the virtual writing sound to the at least one speaker.

16. A non-transitory storage medium storing therein a program that is readable by a computer of an information processing apparatus, the program being configured to cause the computer to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, where a direction of the reference line is changed depending on whether the user is set as being right-handed or is set as being left-handed; and

output the sound information of the virtual writing sound to a speaker.

17. A non-transitory storage medium storing therein a program that is readable by a computer of an information processing apparatus, the program being configured to cause the computer to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and

output the sound information of the virtual writing sound to a speaker,

wherein the sound information includes a base sound that does not change according to the movement direction.

18. An information processing apparatus comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, where a direction of the reference line is changed depending on whether the user is set as being right-handed or is set as being left-handed; and

output the sound information of the virtual writing sound to a speaker.

19. An information processing apparatus comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, and

output the sound information of the virtual writing sound to a speaker,

wherein the sound information includes a base sound that does not change according to the movement direction.

20. An information processing method comprising:

acquiring input coordinates of input performed based on an operation of a user;

generating drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determining a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generating sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, where a direction of the reference line is changed depending on whether the user is set as being right-handed or is set as being left-handed; and

outputting the sound information of the virtual writing sound to a speaker.

21. An information processing method comprising:

acquiring input coordinates of input performed based on an operation of a user;

generating drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determining a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generating sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and

outputting the sound information of the virtual writing sound to a speaker, wherein the sound information includes a base sound that does not change according to the movement direction.

22. A game system comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, where a direction of the reference line is changed depending on whether the user is set as being right-handed or is set as being left-handed; and

output the sound information of the virtual writing sound to a speaker.

23. A game system comprising:

at least one processor;

at least one storage medium;

a program stored in the storage medium;

wherein the program is configured to cause the at least one processor to:

acquire input coordinates of input performed based on an operation by a user;

generate drawing information for displaying a path corresponding to the input coordinates on a display apparatus;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and

output the sound information of the virtual writing sound to a speaker,

wherein the sound information includes a base sound that does not change according to the movement direction.

24. A mobile device comprising:

a display comprising a touch panel;

at least one speaker; and

a processor configured to:

acquire input coordinates of input performed on the touch panel;

generate drawing information for displaying a path corresponding to the input coordinates in the display;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing, where the virtual writing sound is changed according to the movement direction with respect to a reference line, where a direction of the reference line is changed depending on whether the user is set as being right-handed or is set as being left-handed; and

output the sound information of the virtual writing sound to the at least one speaker.

25. A mobile device comprising:

a display comprising a touch panel;

at least one speaker; and

a processor configured to:

acquire input coordinates of input performed on the touch panel;

generate drawing information for displaying a path corresponding to the input coordinates in the display;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and

output the sound information of the virtual writing sound to the at least one speaker,

wherein the sound information includes a base sound that does not change according to the movement direction.

26. A mobile device comprising:

a display comprising a touch panel;

at least one speaker; and

a processor configured to:

acquire input coordinates of input performed on the touch panel;

generate drawing information for displaying a path corresponding to the input coordinates in the display;

determine a movement direction of the input based on a change in the input coordinates, which are acquired continuously while the input is performed;

generate sound information of a virtual writing sound that is changed based on the movement direction in response to the input coordinates changing; and

output the sound information of the virtual writing sound to the at least one speaker,

wherein the processor is configured to generate a first audio data and a third audio data and combine the first audio data and the third audio data to generate the sound information of the virtual writing sound when the determined direction is a first direction; and wherein the processor is configured to generate a second audio data and the third audio data and combine the second audio data and the third audio data to generate the sound information of the virtual writing sound when the determined direction is a second direction, the first audio data and the second audio data being different.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: YONE, MASAMI; OZAKI, YUICHI
To: NINTENDO CO., LTD.
Reel/Frame 052924/0243 →
Priority Claims (1)
JP JP2019-111003 · Jun 14, 2019 · national
Continuity (1)
Related Publication 20200391112A1 · Dec 17, 2020