IP Library › Granted Patent US 11,735,194
Granted Patent B2
US 11,735,194 · App. 16/629,432 · Granted Aug 22, 2023

Audio input and output device with streaming capabilities

Inventors: Giulio Cengarle (Barcelona, ES); Antonio Mateos Sole (Barcelona, ES); Davide Scaini (Barcelona, ES); Suraj Suhas Barkale (North Sydney, AU)
Assignees: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
G10L19/167G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,735,194
App. No.
16/629,432
Granted
Aug 22, 2023
Kind
B2
Abstract

Methods, systems, and computer program products that provide streaming capabilities to audio input and output devices are disclosed. An audio processing device connects an upstream device to a downstream device. The upstream device is plugged into an input port of the audio processing device. The audio processing device intercepts a signal from the upstream device to the downstream device. The audio processing device converts the signal to digital data and streams the digital data to a server. The digital data can include metadata, e.g., an input gain. The audio processing device can adjust the input gain in response to instructions from the server. The audio processing device feeds a pass-through copy of the audio signal to an output port. A user can connect the downstream device in a usual signal chain into the output port of the audio processing device. The streaming does not affect the user's workflow.

Claims (42)

1. A method comprising:

intercepting, by a first audio processing device coupled to a first upstream device, a first audio signal transmitted from the first upstream device in an audio signal path;

intercepting, by a second audio processing device coupled to a second upstream device, a second audio signal transmitted from the second upstream device in the audio signal path;

encoding, by the first or second audio processing device, the first or second audio signal into digital data, the digital data comprising digitally encoded audio signals and device type metadata indicating one or more attributes of the first or second upstream device, where at least one attribute indicates that a microphone of the first or second audio processing device is a multi-pattern microphone;

streaming, by the first or second audio processing device, the digital data to a server computer;

receiving, by at least one of the first or second audio processing devices from the server computer, one or more instructions for modifying a gain of at least one of the first or second audio processing devices and for changing a pattern of the multi-pattern microphone;

modifying the gain of the first or second audio processing device according to the one or more instructions, thereby adjusting a signal gain of the first or second audio signal according to the modified gain; and

providing, to a downstream device in the audio signal path, the adjusted first or second audio signal.

2. The method of claim 1 , wherein the first or second upstream device includes a microphone, a computer, or an instrument wired to the first or second audio processing device, the downstream device includes an audio recorder or an amplifier, and the first or second audio signal is an analog signal or a digital audio signal.

3. The method of claim 1 , wherein the gain to be modified includes at least one of a gain of a digital encoder of the first or second audio processing device or a post-encoding digital gain after the first or second audio signal has been encoded by the digital encoder.

4. The method of claim 1 , wherein encoding the first or second audio signal into digital data comprises performing joint lossy codec optimization on a plurality of channels of the first or second audio signal.

5. The method of claim 1 , comprising:

receiving, by the first or second audio processing device from the server computer, streamed audio signals, the streamed audio signals include a representation of the digital data provided by the server computer; and

providing the streamed audio signals to a monitor device.

6. A method, comprising:

receiving, by a server computer from a plurality of audio processing devices plugged into signal paths and configured to record audio in an audio recording session, streamed digital audio data, the streamed digital audio data comprising digitally encoded audio signals;

receiving, by the server computer from an audio processing device of the audio processing devices, device type metadata indicating one or more attributes of an upstream device,

determining, by the server computer based on the streamed digital audio data, a respective gain corresponding to each of the audio processing devices for achieving a sound effect for the audio recording session;

detecting, by the server computer based on the digital audio data, that a room sound level or a feedback level exceeds a threshold;

determining, by the server computer based on the device type metadata, that a microphone of a particular audio processing device is a multi-pattern microphone;

generating a particular instruction for the particular audio processing device, the particular instruction specifying a pattern for the multi-pattern microphone; and

providing that particular instruction to the particular audio processing device;

generating a respective instruction for each of the audio devices, each instruction operable to cause a corresponding audio processing device to adjust to the modified respective gain during recording; and

providing, by the server computer, each instruction to the corresponding audio processing device during the audio recording session to adjust a respective recording level.

7. The method of claim 6 , comprising:

determining, by the server computer based on device type metadata associated with the streamed digital audio data, a battery level of a particular audio processing device and a communication bandwidth between the particular audio processing device and the server computer;

determining a particular lossy compression scheme that balances needs to save battery and to minimize bandwidth consumption based on the battery level and the communication bandwidth;

generating a particular instruction for the particular audio processing device, the particular instruction specifying that the particular lossy compression scheme shall be used on the particular audio processing device; and

providing that particular instruction to the particular audio processing device.

8. The method of claim 6 ,

wherein the particular instruction specifies that a polar pattern of the multi-pattern microphone shall change between two of an omnidirectional mode, a bidirectional mode, and a cardioid mode.

9. The method of claim 6 , comprising:

registering the audio processing devices at the server computer using a mobile device; and

determining a respective identifier for each of the audio processing devices.

10. The method of claim 9 , comprising:

providing for display a list of the identifiers of the registered audio processing devices;

receiving a user selection of a particular audio processing device from the list; and

providing an instruction for generating a light signal or sound signal to the selected audio processing device, the light signal or sound signal operable to indicate the user selection.

11. A system comprising:

one or more processors; and

a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising operations of claim 1 .

12. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising operations of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2020
From: CENGARLE, GIULIO; MATEOS SOLE, ANTONIO; SCAINI, DAVIDE; BARKALE, SURAJ SUHAS
To: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
Reel/Frame 051613/0450 →
Priority Claims (2)
ES 201730933 · Jul 13, 2017 · national
EP 17192421 · Sep 21, 2017 · regional
Continuity (2)
Provisional Application 62558456 · Sep 14, 2017
Related Publication 20200184983A1 · Jun 11, 2020