IP Library Granted Patent US 12,002,485
Granted Patent B2
US 12,002,485 · App. 17/310,433 · Granted Jun 4, 2024

Information processing device and information processing method

Inventors: Weihsiang Liao (Tokyo, JP); Keiichi Osako (Tokyo, JP); Yuhki Mitsufuji (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G10L21/14G06F1/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,002,485
App. No.
17/310,433
Granted
Jun 4, 2024
Kind
B2
Abstract

The present technology relates to an information processing device, an information processing method, and a program that enable easier visualization of a sound field. The information processing device includes: a calculation unit configured to calculate, on the basis of positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval; an event detection unit configured to detect an event; and an adjustment unit configured to perform, in a case where the event is detected, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval. The present technology can be applied to a sound-field visualization system.

Claims (26)

1. An information processing device, comprising:

a calculation unit configured to calculate, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval;

an event detection unit configured to detect an event; and

an adjustment unit configured to perform, based on the detection of the event is detected, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval.

2. The information processing device according to claim 1 , wherein the calculation unit is further configured to transform the audio signal at each of the plurality of observation positions into a spatial-frequency domain signal based on the positional information and calculate the amplitude or the phase based on the spatial-frequency domain signal.

3. The information processing device according to claim 1 , wherein the adjustment unit is further configured to perform, based on a termination of the event, control such that the amplitude or the phase is calculated at a third time interval longer than the first time interval.

4. The information processing device according to claim 3 , further comprising:

a buffer configured to retain the amplitude or the phase calculated, wherein the adjustment unit is further configured to perform, based on occurrence of underflow of the amplitude or underflow of the phase in the buffer during calculation of the amplitude or the phase at the third time interval, control such that the amplitude or the phase is calculated at a fourth time interval that is longer than the second time interval and is shorter than the first time interval.

5. The information processing device according to claim 1 , wherein the event detection unit is further configured to determine, in response to an instruction from a user, that the event has been detected.

6. The information processing device according to claim 1 , wherein the event detection unit is further configured to determine, based on detection of a specific classification of sound, that the event has been detected.

7. The information processing device according to claim 6 , wherein the specific classification of sound has a signal level in a specific level range.

8. The information processing device according to claim 6 , wherein the specific classification of sound has a particular frequency at a level in a specific level range.

9. The information processing device according to claim 6 , wherein the specific classification of sound has a specific spectral shape.

10. The information processing device according to claim 1 , wherein the event detection unit is further configured to determine, at a specific timing, that the event has been detected.

11. The information processing device according to claim 1 , further comprising:

an image processing unit configured to generate an image of wavefronts of the sound in the space based on the amplitude or the phase calculated.

12. The information processing device according to claim 11 , wherein the adjustment unit is further configured to perform, based on calculation of the amplitude or the phase at the second time interval, control such that a display of the image is updated at a time interval longer than the second time interval.

13. An information processing method, comprising:

in an information processing device:

calculating, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval;

detecting an event; and

performing, based on the detection of the event, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval.

14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

calculating, based on positional information indicating a plurality of observation positions in a space and an audio signal of sound observed at each of the plurality of observation positions, an amplitude or phase of the sound at each of a plurality of positions in the space at a first time interval;

detecting an event; and

performing, based on the detection of the event, control such that the amplitude or the phase is calculated at a second time interval shorter than the first time interval.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2022
From: LIAO, WEIHSIANG; OSAKO, KEIICHI; MITSUFUJI, YUHKI
To: SONY GROUP CORPORATION
Reel/Frame 058668/0984 →
Priority Claims (1)
JP 2019-022615 · Feb 12, 2019 · national
Continuity (1)
Related Publication 20220208212A1 · Jun 30, 2022