IP Library Granted Patent US 11,216,242
Granted Patent B2
US 11,216,242 · App. 16/279,630 · Granted Jan 4, 2022

Audio output system, audio output method, and computer program product

Inventor: Yuki Yamada (Yokohama, JP)
Assignees: KABUSHIKI KAISHA TOSHIBA; TOSHIBA DIGITAL SOLUTIONS CORPORATION
G06F3/165G10L15/00G10L15/005G10L25/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,216,242
App. No.
16/279,630
Granted
Jan 4, 2022
Kind
B2
Abstract

An audio output system according to an embodiment has functions as: a receiving unit that receives voice data including a voice or sound data including a sound as output-data to be output; a content identification information generating unit that generates content identification information for identifying content that is determined from the output-data; a status identification information generating unit that generates status identification information for identifying a status from at least one of sensor data and input data; a parameter information generating unit that generates parameter information used for controlling output of the output-data from the content identification information and the status identification information; and an output control unit that controls audio output of the output-data by using the parameter information.

Claims (63)

1. An audio output system comprising:

a memory; and

one or more hardware processors electrically coupled to the memory and configured to function as:

a receiving unit that receives, as output-data to the output, voice data including a voice or sound data including a sound;

a content identification information generating unit that generates content identification information for identifying content that is determined from the output-data;

a status identification information generating unit that generates status identification information for identifying a status from at least one of sensor data and input data;

a parameter information generating unit that generates parameter information used for controlling output of the output-data from the content identification information and the status identification information; and

an output control unit that controls audio output of the output-data by using the parameter information, wherein

the parameter information generating unit establishes a link from the parameter information to the output-data,

the parameter information includes at least:

a content parameter indicating the content identification information,

a status parameter indicating the status identification information,

a first virtual sound image parameter that is linked to the content parameter, the first virtual sound image parameter indicating an output condition including a direction of a virtual sound image and a distance from a sound source of the virtual sound image, and

a second virtual sound image parameter indicating whether or not to output the virtual sound image that is linked to the status parameter and the content parameter; and

the output control unit controls the output-data expressed by the direction of the virtual sound image and the distance from the sound source of the virtual sound image based on the first virtual sound image parameter, and controls whether or not to output the virtual sound image based on the second virtual sound image parameter.

2. The system according to claim 1 , wherein, when the output-data is the sound data, the content identification information generating unit determines the kind of the sound included in the sound data and generates the content identification information based on a determination result of the sound.

3. The system according to claim 1 , wherein, when the output-data is the voice data, the content identification information generating unit determines a language of the speech included in the voice data, acquires a speech recognition result that is obtained by recognizing the speech with a speech recognition engine corresponding to the determined language, and generates the content identification information based on a meaning of the speech recognition result.

4. The system according to claim 2 , wherein, when the output-data is the voice data, the content identification information generating unit determines a language of the speech included in the voice data, acquires a speech recognition result that is obtained by recognizing the speech with a speech recognition engine corresponding to the determined language, and generates the content identification information based on a meaning of the speech recognition result.

5. The system according to claim 1 , wherein

the parameter information includes a parameter, a definition of the parameter, and a rule for calculating the parameter,

the audio output system further comprises a user I/F unit that receives an operation input indicating a change in at least one of the parameter, the definition, and the rule, and

the parameter information generating unit updates the parameter information based on the operation input.

6. The system according to claim 2 , wherein

the parameter information includes a parameter, a definition of the parameter, and a rule for calculating the parameter,

the audio output system further comprises a user I/F unit that receives an operation input indicating a change in at least one of the parameter, the definition, and the rule, and

the parameter information generating unit updates the parameter information based on the operation input.

7. The system according to claim 3 , wherein

the parameter information includes a parameter, a definition of the parameter, and a rule for calculating the parameter,

the audio output system further comprises a user I/F unit that receives an operation input indicating a change in at least one of the parameter, the definition, and the rule, and

the parameter information generating unit updates the parameter information based on the operation input.

8. The system according to claim 1 , wherein the rule includes at least a rule for calculating the second virtual sound image parameter.

9. The system according to claim 8 , wherein

the parameter information further includes a repetition control parameter for controlling whether or not to repeat outputting the virtual sound image, and

the rule further includes a rule for calculating the repetition control parameter.

10. The system according to claim 1 , wherein the parameter information generating unit groups pieces of the output-data as one data set, and sets a same value at least to the status parameters which are included in the parameter information.

11. The system according to claim 8 , wherein the parameter information generating unit groups pieces of the output-data as one data set, and sets a same value at least to the status parameters which are included in the parameter information.

12. The system according to claim 9 wherein the parameter information generating unit groups pieces of the output-data as one data set, and sets a same value at least to the status parameters which are included in the parameter information.

13. An audio output method comprising:

receiving voice data including a voice or sound data including a sound, as output-data to be output;

generating content identification information for identifying content that is determined from the output-data;

generating status identification information for identifying a status from at least one of sensor data and input data;

generating parameter information used for controlling output of the output-data from the content identification information and the status identification information; and

controlling audio output of the output-data by using the parameter information, wherein

the generating of the parameter information includes establishing a link from the parameter information to the output-data,

the parameter information includes at least:

a content parameter indicating the content identification information,

a status parameter indicating the status identification information,

a first virtual sound image parameter that is linked to the content parameter, the first virtual sound image parameter indicating an output condition including a direction of a virtual sound image and a distance from a sound source of the virtual sound image, and

a second virtual sound image parameter indicating whether or not to output the virtual sound image that is linked to the status parameter and the content parameter; and

the controlling of the audio output includes controlling the output-data expressed by the direction of the virtual sound image and the distance from the sound source of the virtual sound image based on the first virtual sound image parameter, and controlling whether or not to output the virtual sound image based on the second virtual sound image parameter.

14. A computer program product including a non-transitory computer readable medium in which programmed instructions are stored, the programmed instructions causing, when executed by a computer, the computer to perform:

receiving voice data including a voice or sound data including a sound, as output-data to be output;

generating content identification information for identifying content that is determined from the output-data;

generating status identification information for identifying a status from at least one of sensor data and input data;

generating parameter information used for controlling output of the output-data from the content identification information and the status identification information; and

controlling audio output of the output-data by using the parameter information, wherein

the generating of the parameter information includes establishing a link from the parameter information to the output-data,

the parameter information includes at least:

a content parameter indicating the content identification information,

a status parameter indicating the status identification information,

a first virtual sound image parameter that is linked to the content parameter, the first virtual sound image parameter indicating an output condition including a direction of a virtual sound image and a distance from a sound source of the virtual sound image, and

a second virtual sound image parameter indicating whether or not to output the virtual sound image that is linked to the status parameter and the content parameter; and

the controlling of the audio output includes controlling the output-data expressed by the direction of the virtual sound image and the distance from the sound source of the virtual sound image based on the first virtual sound image parameter, and controlling whether or not to output the virtual sound image based on the second virtual sound image parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2019
From: YAMADA, YUKI
To: KABUSHIKI KAISHA TOSHIBA; TOSHIBA DIGITAL SOLUTIONS CORPORATION
Reel/Frame 048727/0589 →
Priority Claims (1)
JP JP2018-026951 · Feb 19, 2018 · national
Continuity (1)
Related Publication 20190258452A1 · Aug 22, 2019