IP Library Granted Patent US 10,203,839
Granted Patent B2
US 10,203,839 · App. 15/296,921 · Granted Feb 12, 2019

Three-dimensional generalized space

Inventors: Doree Duncan Seligmann (New York, NY); Ajita John (Holmdel, NJ); Michael J. Sammon (Watchung, NJ); David Skiba (Golden, CO)
Assignee: Avaya Inc.
G06F3/04815G06F3/167G06F17/3074G06F17/30752H04R27/00H04S3/002H04S7/302H04S7/40H04R2227/003H04R2227/005H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,203,839
App. No.
15/296,921
Filed
Oct 18, 2016
Granted
Feb 12, 2019
Kind
B2
Art Unit
2653
USPC
715/850
Abstract

According to one embodiment, audio and non-audio data can be represented as sound sources in a three-dimensional sound space adapted to also provide visual data. Non-audio data can be associated with audio sound sources presented in the sound space. Navigation within this combined three-dimensional audio/visual space can be based primarily on the audio aspects of the sound sources with the details of the non-audio data being presented on demand, for example, when the listener navigates through the combined three-dimensional audio/visual space to a particular sound source at which point the non-audio data associated with that sound source can be presented.

Claims (47)

1. A method comprising:

collecting, by a processor, information from one or more data sources, the collected information comprising at least in part non-audio data from at least one of the one or more data sources;

processing, by the processor, the collected information into a plurality of sound sources based on one or more attributes of the collected information;

presenting, by the processor, the plurality of sound sources in a combined three-dimensional audio/visual space comprising the plurality of sound sources playing at a same time in a three-dimensional sound space of the combined audio/visual space, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location; and

presenting, by the processor, at least one graphical presentation of the non-audio data in the combined three-dimensional audio/visual space based on navigation within the combined three-dimensional audio/visual space by the user.

2. The method of claim 1 , wherein processing the collected information into a plurality of sound sources further comprises converting at least some of the non-audio data to audio data.

3. The method of claim 2 , wherein processing the collected information into a plurality of sound sources further comprises grouping the selected sound sources based on the one or more attributes of the collected information and assigning the grouped sound sources to the respective location in the combined three-dimensional audio/visual space relative to one another based on the one or more attributes of the collected information.

4. The method of claim 2 , wherein the converted non-audio data comprises the attributes of the collected non-audio data.

5. The method of claim 4 , wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space comprises presenting the converted attributes for the sound source or a group of sound sources.

6. The method of claim 2 , wherein processing the collected information into the plurality of sound sources comprises associating the non-audio data with at least one sound source.

7. The method of claim 6 , wherein associating the non-audio data with at least one sound source further comprises generating the at least one sound source representing the non-audio data.

8. The method of claim 1 , wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space further comprises:

receiving an input from the user to navigate to a new location in the combined three-dimensional audio/visual space; and

based on the input, changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space.

9. The method of claim 8 , wherein presenting the at least one graphical representation of the non-audio data in the combined three-dimensional audio/visual space is further based on changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space.

10. The method of claim 1 , wherein the combined three-dimensional audio/visual space comprises one of a video conferencing environment, a social media environment, a virtual classroom environment, or a collaboration environment.

11. A system comprising:

a processor; and

a memory coupled with the processor and storing a set of instructions which, when executed by the processor, causes the processor to provide a combined three-dimensional audio/visual space by:

collecting information from one or more data sources, the collected information comprising at least in part non-audio data from at least one of the one or more data sources;

processing the collected information into a plurality of sound sources based on one or more attributes of the collected information;

presenting the plurality of sound sources in the combined three-dimensional audio/visual space comprising the plurality of sound sources playing at a same time in a three-dimensional sound space of the combined audio/visual space, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location; and

presenting at least one graphical presentation of the non-audio data in the combined three-dimensional audio/visual space based on navigation within the combined three-dimensional audio/visual space by the user.

12. The system of claim 11 , wherein processing the collected information into a plurality of sound sources further comprises:

converting at least some of the non-audio data to audio data;

grouping the selected sound sources based on the one or more attributes of the collected information; and

assigning the grouped sound sources to the respective location in the combined three-dimensional audio/visual space relative to one another based on the one or more attributes of the collected information.

13. The system of claim 12 , wherein the converted non-audio data comprises the attributes of the collected non-audio data and wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space comprises presenting the converted attributes for the sound source or a group of sound sources.

14. The system of claim 12 , wherein processing the collected information into the plurality of sound sources comprises associating the non-audio data with at least one sound source.

15. The system of claim 14 , wherein associating the non-audio data with at least one sound source further comprises generating the at least one sound source representing the non-audio data.

16. The system of claim 11 , wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space further comprises:

receiving an input from the user to navigate to a new location in the combined three-dimensional audio/visual space; and

based on the input, changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space, wherein presenting the at least one graphical representation of the non-audio data in the combined three-dimensional audio/visual space is further based on changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space.

17. A non-transitory computer-readable medium comprising a set of instructions stored therein which, when executed by a processor, causes the processor to:

collect information from one or more data sources, the collected information comprising at least in part non-audio data from at least one of the one or more data sources;

process the collected information into a plurality of sound sources based on one or more attributes of the collected information;

present the plurality of sound sources in the combined three-dimensional audio/visual space comprising the plurality of sound sources playing at a same time in a three-dimensional sound space of the combined audio/visual space, wherein each of the plurality of sound sources is assigned a respective location in the three-dimensional sound space relative to one another, and wherein a user is assigned a current location in the three-dimensional sound space relative to each respective location; and

present at least one graphical presentation of the non-audio data in the combined three-dimensional audio/visual space based on navigation within the combined three-dimensional audio/visual space by the user.

18. The non-transitory computer-readable medium of claim 17 , wherein processing the collected information into a plurality of sound sources further comprises:

converting at least some of the non-audio data to audio data;

grouping the selected sound sources based on the one or more attributes of the collected information; and

assigning the grouped sound sources to the respective location in the combined three-dimensional audio/visual space relative to one another based on the one or more attributes of the collected information.

19. The non-transitory computer-readable medium of claim 18 , wherein the converted non-audio data comprises the attributes of the collected non-audio data and wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space comprises presenting the converted attributes for the sound source or a group of sound sources.

20. The non-transitory computer-readable medium of claim 17 ,

wherein presenting the plurality of sound sources in the combined three-dimensional audio/visual space further comprises:

receiving an input from the user to navigate to a new location in the combined three-dimensional audio/visual space; and

based on the input, changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space, wherein presenting the at least one graphical representation of the non-audio data in the combined three-dimensional audio/visual space is further based on changing each respective location of the plurality of sound sources relative to the new location in the combined three-dimensional audio/visual space.

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: SKIBA, DAVID
To: AVAYA INC.
Reel/Frame 053855/0955 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2016
From: SELIGMANN, DOREE DUNCAN; JOHN, AJITA; SAMMON, MICHAEL J.
To: AVAYA INC.
Reel/Frame 040049/0071 →
Continuity (3)
Continuation In Part 15009950 · Jan 29, 2016
Continuation 13728467 · Dec 27, 2012
Related Publication 20170038943A1 · Feb 9, 2017
Cited By (1)
US 12,363,497