IP Library Granted Patent US 10,575,119
Granted Patent B2
US 10,575,119 · App. 16/218,207 · Granted Feb 25, 2020

Particle-based spatial audio visualization

Inventors: Stephen Joseph DiVerdi (Oakland, CA); Yaniv De Ridder (San Francisco, CA)
Assignee: Adobe Inc.
H04S7/40H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,575,119
App. No.
16/218,207
Granted
Feb 25, 2020
Kind
B2
Abstract

Methods and systems are provided for visualizing spatial audio using determined properties for time segments of the spatial audio. Such properties include the position sound is coming from, intensity of the sound, focus of the sound, and color of the sound at a time segment of the spatial audio. These properties can be determined by analyzing the time segment of the spatial audio. Upon determining these properties, the properties are used in rendering a visualization of the sound with attributes based on the properties of the sound(s) at the time segment of the spatial audio.

Claims (38)

1. A computer-implemented method, the method comprising:

receiving one or more attributes representing a set of properties associated with a time segment of spatial audio; and

rendering a first particle, at a position on a user interface corresponding to a location in a three-dimensional environment at which the spatial audio originates, with a first attribute representative of a focus indicating spatial concentration of the spatial audio at the location within the three-dimensional environment during the time segment of the spatial audio.

2. The computer-implemented method of claim 1 , wherein the first attribute of the particle is a size of the first particle.

3. The computer-implemented method of claim 1 , wherein the first particle is further rendered having a second attribute representative of a frequency associated with the time segment of the spatial audio, wherein the second attribute is a color of the first particle.

4. The computer-implemented method of claim 1 , wherein the first particle is further rendered having a third attribute of the particle representative of an intensity associated with the time segment of the spatial audio, wherein the third attribute is opacity of the first particle.

5. The computer-implemented method of claim 1 , further comprising:

receiving the position determined by incorporation of an omnidirectional audio component into a left/right audio component, an up/down audio component, and a forward/backward audio component.

6. The computer-implemented method of claim further comprising:

receiving the focus determined using an analysis of the location of the spatial audio within the three-dimensional environment indicative of the spatial concentration of the spatial audio during the time segment.

7. The computer-implemented method of claim 3 , further comprising:

receiving the frequency determined using color matching based on a frequency spectrum for the spatial audio during the time segment, the frequency spectrum mapped to a frequency bin, wherein the frequency bin is non-overlapping and corresponds to a Red-Green-Blue (RGB) color.

8. The computer-implemented method of claim 4 , further comprising:

receiving the intensity determined from analysis of an omnidirectional audio component indicative of an amount of energy that occurs during the time segment.

9. The computer-implemented method of claim 1 , wherein the position is rendered using a vector normalized indicative of coordinates on a unit sphere from which the spatial audio originates during the time segment.

10. One or more non-transitory computer-readable media having a plurality of executable instructions embodied thereon, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving a request to visualize spatial audio;

receiving one or more attributes representative of a set of properties associated with a first time segment of the spatial audio; and

rendering a first particle, at a position on a user interface corresponding to a location in a three-dimensional environment at which the spatial audio originates, with first attribute representative of a focus indicating spatial concentration of the spatial audio at the location within the three-dimensional environment during the time segment of the spatial audio.

11. The non-transitory media of claim 10 , wherein the first attribute of the particle representative of the focus is a size of the first particle.

12. The non-transitory media of claim 10 , wherein the first particle is further rendered having a second attribute representative of a frequency associated with the time segment of the spatial audio, wherein the second attribute is a color of the first particle.

13. The non-transitory media of claim 10 , wherein the first particle is further rendered having a third attribute of the particle representative of an intensity associated with the time segment of the spatial audio, wherein the third attribute is opacity of the first particle.

14. The non-transitory media of claim 10 , the operations further comprising:

receiving the position determined by incorporation of an omnidirectional audio component into a left/right audio component, an up/down audio component, and a forward/backward audio component.

15. The non-transitory media of claim 10 , the operations further comprising:

receiving the focus determined using an analysis of the location of the spatial audio within the three-dimensional environment to determine the spatial concentration of the spatial audio is during the time segment.

16. The non-transitory media of claim 10 , the operations further comprising:

receiving the frequency determined using color matching based on a frequency spectrum for the spatial audio during the time segment, the frequency spectrum mapped to a frequency bin, wherein the frequency bin is non-overlapping and corresponds to a Red-Green-Blue color.

17. The non-transitory media of claim 10 , the operations further comprising:

receiving the intensity determined from analysis of an omnidirectional audio component that indicates an amount of energy that occurs during the time segment.

18. A computing system comprising:

means for determining one or more properties of spatial audio; and

means for rendering the spatial audio using one or more particles with attributes associated with the one or more properties of the spatial audio, including a first particle rendered, at a position on a user interface corresponding to a location in a three-dimensional environment at which the spatial audio originates, with a first attribute of the first particle representative of a focus indicating spatial concentration of the spatial audio at the location within the three-dimensional environment during the time segment of the spatial audio.

19. The system of claim 18 , further comprising:

means for rendering the spatial audio using the one or more particles with the attributes associated with the one or more properties of the spatial audio, wherein a second attribute of the particle represents a frequency; and

means for rendering the spatial audio using the one or more particles with the attributes associated with the one or more properties of the spatial audio, wherein a third attribute of the particle represents an intensity.

20. The system of claim 18 , further comprising:

means for filtering the spatial audio to reduce noise level.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2019
From: DIVERDI, STEPHEN JOSEPH; DE RIDDER, YANIV
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 047934/0455 →
CHANGE OF NAME Recorded Jan 8, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048032/0709 →
Continuity (2)
Continuation 15814254 · Nov 15, 2017
Related Publication 20190149941A1 · May 16, 2019