IP Library › Granted Patent US 11,755,653
Granted Patent B2
US 11,755,653 · App. 16/756,066 · Granted Sep 12, 2023

Real-time voice processing

Inventors: Thomas Girardier (Poisy, FR); Julien Goupy (Le Mesnil-Saint-Denis, FR); Etienne Ruffieux (Paris, FR)
Assignee: Google LLC
G06F16/90332G06F40/45G06F40/47G06F40/55G10L13/047G10L15/26G10L15/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,755,653
App. No.
16/756,066
Granted
Sep 12, 2023
Kind
B2
Abstract

A control device of voice distribution including: at least one voice processing module arranged to—receive as input an audio signal including a first vocal message, and—provide as output an audio signal including a second vocal message, the first and second vocal messages being different one from the other and the second vocal message resulting from a processing of the first vocal message; a communication module arranged to establish and simultaneously manage a wireless, bidirectional and audio link with each one of a plurality of auxiliary devices, each link being connected to the input and/or the output of at least one voice processing module.

Claims (52)

1. A control device of voice distribution, the device comprising:

at least one voice processing module arranged to:

receive as input a first audio signal including a first vocal message; and

provide as output a second audio signal including a second vocal message, the first and second vocal messages being different one from the other and the second vocal message resulting from a processing of the first vocal message;

a communication module arranged to establish and simultaneously manage a wireless, bidirectional Bluetooth audio link with each one of a plurality of auxiliary devices,

the communication module being arranged to establish and manage at least one link between the control device and a first auxiliary device that is coupled to an input of a first voice processing module and to an output of a second voice processing module, and

wherein the communication module is further arranged to establish and simultaneously manage at least one supplementary link with a supplementary auxiliary device that is connected to an input of the second voice processing module and to the output of the first voice processing module, and

the communication module arranged to receive, via bidirectional Bluetooth audio link, a third audio signal including a third vocal message different from the first and second vocal messages, the third audio signal being received simultaneously with receipt of the first audio signal;

where:

the first audio signal is buffered with a first input buffer of the control device while the third audio signal is buffered with a second input buffer of the control device,

the control device performs simultaneous bidirectional translation of the first vocal message and the third vocal message, and

the first input buffer is different from the second input buffer.

2. The device according to claim 1 , wherein the communication module includes a Bluetooth chip and wherein each wireless, bidirectional audio link is a Synchronous Connection-Oriented (SCO) or an enhanced Synchronous Connection-Oriented (eSCO) link according to the Hand-Free Profile (HFP) Bluetooth protocol.

3. The device according to claim 2 , wherein the at least one voice processing module includes a translation sub-module arranged to receive as input a first message in a first human language, and provide as output a second human language, the second message being a translation of the first message.

4. The device according to claim 2 , comprising at least one buffer disposed between said at least one voice processing module and the inputs and/or outputs of said auxiliary devices.

5. The device according to claim 2 , comprising at least a first voice processing module and a second voice processing module, the communication module being further arranged to establish and manage at least one link between:

an auxiliary device, and

the input of the first voice processing module and/or the output of the second voice processing module.

6. The device according to claim 2 , comprising at least two voice processing modules arranged to provide as output distinct audio signals, the device further comprising at least one mixing module, said mixing module being arranged to:

receive as inputs the at least two output audio signals from said at least two voice processing modules, and

provide as a single output audio signal a mixed audio signal constructed from the at least two audio signals.

7. The device according to claim 1 , wherein the first voice processing module includes a translation sub-module arranged to receive as input a first message in a first human language, and provide as output a second human language, the second message being a translation of the first message.

8. The device according to claim 7 , comprising at least one buffer disposed between said at least one voice processing module and the inputs and/or outputs of said auxiliary devices.

9. The device according to claim 7 , comprising at least a first voice processing module and a second voice processing module, the communication module being further arranged to establish and manage at least one link between:

an auxiliary device, and

the input of the first voice processing module and to the output of the second voice processing module.

10. The device according to claim 7 , comprising at least two voice processing modules arranged to provide as output distinct audio signals, the device further comprising at least one mixing module, said mixing module being arranged to:

receive as inputs the distinct audio signals from said at least two voice processing modules, and

provide as a single output audio signal a mixed audio signal constructed from the distinct audio signals.

11. The device according to claim 1 , comprising at least one buffer disposed between at least one of the first and second voice processing modules and the inputs and/or outputs of said auxiliary devices.

12. The device according to claim 11 , comprising at least a first voice processing module and a second voice processing module, the communication module being further arranged to establish and manage at least one link between:

an auxiliary device, and

the input of the first voice processing module and to the output of the second voice processing module.

13. The device according to claim 1 , comprising at least two voice processing modules arranged to provide as output distinct audio signals, the device further comprising at least one mixing module, said mixing module being arranged to:

receive as inputs the distinct audio signals from said at least two voice processing modules, and

provide as a single output audio signal a mixed audio signal constructed from the distinct audio signals.

14. The device according to claim 13 , further comprising at least one synchronizing module, said synchronizing module being interposed between the outputs of voice processing modules and a mixing module, said synchronizing module being arranged to delay at least one signal among the signals received by the mixing device in a manner to compensate a time shift resulting from different processing steps processed by at least one voice processing module and to enhance the conformity of a chronological order of second vocal messages with respect to a chronological order of first vocal messages.

15. A method of controlling voice processing system by a control device, said method comprising:

establishing a wireless, bidirectional audio link between a communication module of said control device and each one of a plurality of auxiliary devices, including establishing and managing a first Bluetooth link between the control device and a first auxiliary device that is coupled to an input of a first voice processing module and to an output of a second voice processing module, and establishing and simultaneously managing a second Bluetooth link between the control device and a second auxiliary device that is coupled to an input of the second voice processing module and to an output of the first voice processing module;

receiving, from at least one of the auxiliary devices, as input of at least one voice processing module of said control device, at least one first audio signal including a first vocal message;

providing as output of said at least one voice processing module a second audio signal including a second vocal message, the first and second vocal messages being different one from the other and the second vocal message resulting from a processing of the first vocal message;

transmitting from said communication module the said second vocal message to at least one of the auxiliary devices by using the respective said link;

receiving, from at least one of the auxiliary devices, as input a third audio signal including a third vocal message different from the first and second vocal messages, the third audio signal being received simultaneously with receipt of the first audio signal; and

performing simultaneous bidirectional translation of the first vocal message and the third vocal message;

where the first audio signal is buffered with a first input buffer of the control device while the third audio signal is buffered with a second input buffer of the control device, facilitating the simultaneous bidirectional translation of the first vocal message and the third vocal message, and where the first input buffer is different from the second input buffer.

16. A system of voice processing, the system comprising:

a control device arranged to implement a method according to claim 15 ; and

at least one auxiliary device, said auxiliary device being arranged to communicate by a wireless, bidirectional and audio link with the control device, said auxiliary device comprising at least one microphone arranged to feed the said audio link with an audio content and/or at least one speaker arranged to spread the audio content received on the said audio link.

17. A set to implement a system of voice processing, the set comprising:

a control device able to implement a method according to claim 15 ; and

at least one auxiliary device, said auxiliary device being able to communicate by a wireless, bidirectional and audio link with the control device, said auxiliary device comprising at least one microphone arranged to feed the said audio link with an audio content and/or at least one speaker arranged to spread the audio content received on the said audio link.

18. A non-transitory, computer-readable storage medium comprising a program product stored thereon and executable by a processor in the form of a software agent including at least one software module comprising instructions to implement 4 a method according to claim 15 .

Assignments (2)
CONFIRMATORY ASSIGNMENT Recorded Jul 30, 2021
From: TAP SOUND SYSTEM SAS
To: GOOGLE LLC
Reel/Frame 057038/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2020
From: GIRARDIER, THOMAS; GOUPY, JULIEN; RUFFIEUX, ETIENNE
To: TAP SOUND SYSTEM
Reel/Frame 052394/0735 →
Priority Claims (1)
EP 17306438 · Oct 20, 2017 · regional
Continuity (1)
Related Publication 20200301976A1 · Sep 24, 2020
Cited By (1)
US 12,455,925