IP Library Granted Patent US 11,206,504
Granted Patent B2
US 11,206,504 · App. 16/839,021 · Granted Dec 21, 2021

Systems and methods for spatial audio rendering

Inventors: Christopher John Stringer (Venice, CA); Matthew Brown (Brooklyn, NY); Bas Ording (San Francisco, CA); Robert Tilton (Los Angeles, CA); Jay Sterling Coggin (Brooklyn, NY); Afrooz Family (Los Angeles, CA); Lasse Vetter (Venice, CA); Marc Carino (Venice, CA); Christos Kyriakakis (Venice, CA); Matthew Robbetts (Venice, CA); Matthias Kronlachner (Venice, CA)
Assignee: SYNG, Inc.
H04S7/305H04S5/005H04S7/302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,206,504
App. No.
16/839,021
Granted
Dec 21, 2021
Kind
B2
Abstract

Systems and methods for rendering spatial audio in accordance with embodiments of the invention are illustrated. One embodiment includes a spatial audio system, including a primary network connected speaker, including a plurality of sets of drivers, where each set of drivers is oriented in a different direction, a processor system, memory containing an audio player application, wherein the audio player application configures the processor system to obtain an audio source stream from an audio source via the network interface, spatially encode the audio source, decode the spatially encoded audio source to obtain driver inputs for the individual drivers in the plurality of sets of drivers, where the driver inputs cause the drivers to generate directional audio.

Claims (29)

1. A spatial audio system, comprising:

a primary network connected speaker, comprising:

a plurality of sets of drivers, where each set of drivers is oriented in a different direction;

a processor system;

memory containing an audio player application;

wherein the audio player application configures the processor system to:

obtain a channel-based audio source stream from audio source via the network interface;

generate a plurality of spatial audio objects based upon the channel-based audio source stream, where each spatial audio object is assigned a location and has an associated audio signal; and

encode a spatial audio representation of the plurality of spatial audio objects;

decode the spatial audio representation of the plurality of spatial audio objects to obtain audio inputs for a plurality of virtual speakers;

encode a spatial audio representation of at least one of the plurality of virtual speakers based upon the location of the primary network connected speaker; and

decode the spatial audio representation of at least one of the plurality of virtual speakers to obtain driver inputs for the individual drivers in the plurality of sets of drivers, where the driver inputs cause the drivers to generate directional audio.

2. The spatial audio system of claim 1 , wherein the audio player application configures the processor system to decode an audio input for at least one of the plurality of virtual speakers to obtain driver inputs for the individual drivers in the plurality of sets of drivers using a filter for each set of drivers.

3. The spatial audio system of claim 1 , wherein the audio player application further configures the processor system to:

decode the spatial audio representation of the plurality of spatial audio objects to obtain a set of direct audio inputs for the plurality of virtual speakers; and

decode the spatial audio representation of the plurality of spatial audio objects to obtain a set of diffuse audio inputs for the plurality of virtual speakers.

4. The spatial audio system of claim 1 , wherein the plurality of virtual speakers comprises at least 8 virtual speakers arranged in a ring.

5. The spatial audio system of claim 1 , wherein the audio player application configures the processor system to spatially encode the channel-based audio source stream into at least one spatial representation selected from the group consisting of:

a first order ambisonic representation;

a higher order ambisonic representation;

Vector Based Amplitude Panning (VBAP) representation;

Distance Based Amplitude Panning (DBAP) representation; and

K Nearest Neighbors Panning representation.

6. The spatial audio system of claim 1 , wherein each of the plurality of spatial audio objects corresponds to a channel of the channel-based audio source stream.

7. The spatial audio system of claim 1 , wherein a number of spatial audio objects that is greater than the number of channels of the channel-based audio source stream is obtained using upmixing of the channel-based audio source stream.

8. The spatial audio system of claim 7 , wherein the plurality of spatial audio objects comprises direct spatial audio objects and diffuse spatial audio objects.

9. The spatial audio system of claim 1 , wherein the audio player application configures the processor system to assign predetermined locations to the plurality of spatial audio objects based upon a layout determined by the number of channels of the channel-based audio source stream.

10. The spatial audio system of claim 1 , wherein the audio player application configures the processor system to assign a location to a spatial audio object based upon user input.

11. The spatial audio system of claim 1 , wherein the audio player application configures the processor system to assign a location to a spatial audio object that changes over time programmatically.

Assignments (2)
CONFIRMATION OF ASSIGNMENT Recorded Jun 5, 2023
From: STRINGER, CHRISTOPHER JOHN; BROWN, MATTHEW; ORDING, BAS; TILTON, ROBERT; COGGIN, JAY STERLING; FAMILY, AFROOZ; VETTER, LASSE; CARINO, MARC; KYRIAKAKIS, CHRISTOS; ROBBETTS, MATTHEW; KRONLACHNER, MATTHIAS; FAN, YUAN-YI
To: SYNG, INC.
Reel/Frame 063861/0328 →
SECURITY INTEREST Recorded Oct 28, 2021
From: SYNG, INC.
To: SILICON VALLEY BANK
Reel/Frame 057946/0076 →
Continuity (4)
Provisional Application 62935034 · Nov 13, 2019
Provisional Application 62878696 · Jul 25, 2019
Provisional Application 62828357 · Apr 2, 2019
Related Publication 20200367009A1 · Nov 19, 2020
Cited By (3)
US 12,323,786 US 12,425,794 US 12,610,208