IP Library › Granted Patent US 9,724,608

Granted Patent B2

US 9,724,608 · App. 13/425,780 · Granted Aug 8, 2017

Computer-readable storage medium storing information processing program, information processing device, information processing system, and information processing method

Inventor: Masato Mizuta (Kyoto, JP)

Assignee: NINTENDO CO., LTD.

A63F13/54 H04S7/302 H04S7/307 A63F2300/6081 A63F2300/6661 A63F2300/807 H04S2400/11

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,724,608
App. No.: 13/425,780
Granted: Aug 8, 2017
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

An example game device corrects a sound of a sound source located behind a virtual camera by applying a frequency filter to the sound. Specifically, an angle between an imaging direction of the virtual camera and a direction from the virtual camera toward the sound source is calculated. If the absolute value of the angle is 90 degrees or more, a filter value is calculated based on the angle. The game device also corrects the filter value based on a distance between the virtual camera and the sound source. The game device applies a low-pass filter corresponding to the filter value to the sound of the sound source.

Claims (98)

1. A non-transitory computer-readable storage medium storing an information processing program executable by a computer of an information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the program, when executed, causing the computer to perform:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

correcting the sound of the sound source by applying a predetermined filter to the sound when the calculated direction of the sound source corresponds to a predetermined direction as viewed from the virtual camera or the predetermined character provided in the virtual space; and

outputting the corrected sound,

wherein when the calculated angle is greater than a first threshold value, the sound is corrected.

2. A non-transitory computer-readable storage medium storing an information processing program executable by a computer of an information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the program, when executed, causing the computer to perform:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

outputting the corrected sound,

wherein a degree of correction of the sound is increased with an increase in the calculated angle.

3. The non-transitory computer-readable storage medium of claim 1 , wherein when the sound source is located behind the virtual camera or the predetermined character, the sound is corrected.

4. The non-transitory computer-readable storage medium of claim 1 , wherein the sound is also corrected based on a distance between the virtual camera or the predetermined character and the sound source.

5. The non-transitory computer-readable storage medium of claim 4 , wherein when the distance between the virtual camera or the predetermined character and the sound source is larger than a second threshold value, the sound is corrected.

6. The non-transitory computer-readable storage medium of claim 4 , wherein a degree of correction of the sound is increased with an increase in the distance.

7. The non-transitory computer-readable storage medium of claim 2 , wherein the degree of correction of the sound is increased by increasing a degree of attenuation of a volume of a predetermined frequency component of the sound.

8. The non-transitory computer-readable storage medium of claim 1 , wherein the sound is corrected by attenuating a predetermined frequency component of the sound.

9. The non-transitory computer-readable storage medium of claim 1 , wherein the program causes the computer to further execute:

determining whether or not to correct the sound, based on a type of the sound source or a type of the sound of the sound source, and

when it is determined that the sound is to be corrected, the sound is corrected.

10. The non-transitory computer-readable storage medium of claim 1 , wherein a degree of correction of the sound is set based on a type of the sound source or a type of the sound of the sound source, and the sound is corrected to the degree of correction.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the predetermined filter is a frequency filter.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the frequency filter is at least one of a low-pass filter and a band-pass filter.

13. A non-transitory computer-readable storage medium storing an information processing program executable by a computer of an information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the program, when executed, causing the computer to perform:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

outputting the corrected sound,

wherein an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source is calculated, a maximum value of a degree of correction is set based on the angle, the degree of correction is determined within the maximum value based on a distance between the virtual camera or the predetermined character and the sound source, and the sound is corrected based on the degree of correction.

14. An information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

correct the sound of the sound source by applying a predetermined filter to the sound when the calculated direction of the sound source corresponds to a predetermined direction as viewed from the virtual camera or the predetermined character provided in the virtual space; and

output the corrected sound,

wherein when the calculated angle is greater than a first threshold value, the sound is corrected.

15. An information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source; and

a sound output device configured to output the corrected sound,

wherein when the calculated angle is greater than a first threshold value, the sound is corrected.

16. An information processing method executed by a computer in an information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the method comprising:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

outputting the corrected sound,

wherein when the calculated angle is greater than a first threshold value, the sound is corrected.

17. A non-transitory computer-readable storage medium storing an information processing program executable by a computer of an information processing device, the program causing the computer to execute:

generating an image of a virtual space captured by a virtual camera, the virtual space including a sound source;

calculating a direction of the sound source as viewed from the virtual camera in the virtual space;

calculating an angle between an imaging direction of the virtual camera and the calculated direction of the sound source as viewed from the virtual camera in the virtual space;

correcting the sound of the sound source by applying a predetermined filter to the sound when the calculated direction of the sound source corresponds to a predetermined direction as viewed from the virtual camera in the virtual space, wherein a degree of correction of the sound is increased with an increase in the calculated angle; and

outputting the corrected sound.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the predetermined filter attenuates a predetermined frequency component of the sound.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the sound is corrected based on a distance between the sound source and a reference point which is different from the virtual camera.

20. An information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

output the corrected sound,

wherein a degree of correction of the sound is increased with an increase in the calculated angle.

21. An information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source; and

a sound output device configured to output the corrected sound,

wherein a degree of correction of the sound is increased with an increase in the calculated angle.

22. An information processing method executed by a computer in an information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the method comprising:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

outputting the corrected sound,

wherein a degree of correction of the sound is increased with an increase in the calculated angle.

23. An information processing device for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

output the corrected sound,

wherein a maximum value of a degree of correction is set based on the angle, the degree of correction is determined within the maximum value based on a distance between the virtual camera or the predetermined character and the sound source, and the sound is corrected based on the degree of correction.

24. An information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, comprising:

a computer processing system, including at least one computer processor, the computer processing system being configured to:

calculate a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculate an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source; and

a sound output device configured to output the corrected sound,

25. An information processing method executed by a computer in an information processing system for generating an image of a virtual space captured by a virtual camera and outputting a sound of a sound source provided in the virtual space, the method comprising:

calculating a direction of the sound source as viewed from the virtual camera or a predetermined character provided in the virtual space;

calculating an angle between an imaging direction of the virtual camera or a direction measured with reference to the predetermined character and the direction of the sound source;

outputting the corrected sound,

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2012

From: MIZUTA, MASATO

To: NINTENDO CO., LTD.

Reel/Frame 027901/0439 →

Priority Claims (1)

JP 2011-247127 · Nov 11, 2011 · national

Continuity (1)

Related Publication 20130123962A1 · May 16, 2013