IP Library › Granted Patent US 11,418,440
Granted Patent B2
US 11,418,440 · App. 16/910,674 · Granted Aug 16, 2022

Routing virtual area based communications

Inventors: Robert J. Butler (Coralville, IA); Joseph Altmaier (Eugene, OR); David Van Wie (Eugene, OR)
Assignee: Sococo, Inc.
H04L45/54G06T11/60G06T13/40G06T15/205G06T17/05G06T19/006G06T19/20H04L65/4069H04L65/605H04L67/38G06T2200/04G06T2207/10012G06T2207/10016G06T2207/10072G06T2207/30196G06T2215/16G06T2219/024G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,440
App. No.
16/910,674
Granted
Aug 16, 2022
Kind
B2
Abstract

In association with a virtual area, a first network connection is established with a first network node present in the virtual area and a second network connection is established with a second network node present in the virtual area. Based on stream routing instructions, a stream router is created between the first network node and the second network node. The stream router includes a directed graph of processing elements operable to receive network data, process the received network data, and output the processed network data. On the first network connection, an input data stream derived from output data generated by the first network node is received in association with the virtual area. The input data stream is processed through the stream router to produce an output data stream. On the second network connection, the output data stream is sent to the second network node.

Claims (25)

1. A method comprising:

in association with a virtual area, an intermediate network node establishing a first network connection with a first network node present in the virtual area and establishing a second network connection with a second network node present in the virtual area;

based on stream routing instructions, the intermediate network node creating between the first network node and the second network node a stream router comprising a directed graph of processing elements operable to receive network data, process the received network data, and output the processed network data;

on the first network connection, the intermediate network node receiving an input data stream derived from output data generated by the first network node in association with the virtual area;

the intermediate network node processing the input data stream through the stream router to produce an output data stream;

on the second network connection, the intermediate network node sending the output data stream to the second network node, wherein sending the output data stream to the second network node comprises routing the output data stream of a first data stream type over a first type of network connection between client network nodes of users who are copresent in the virtual area;

responsive to an event that satisfies a switching predicate, ascertaining the second type of network connection between client network nodes of users who are copresent in the virtual area, wherein the first and second types of network connections are different, and the switching predicate is based on one or more of a count of client network nodes of users who are copresent in the virtual area, one or more types of data streams being communicated between client network nodes of the copresent users, bandwidth capabilities of client network nodes of the copresent users, attributes of the virtual area, and network latencies experienced by client network nodes of the copresent users;

responsive to a determination that a network connection of the second type currently exists, routing one or more data streams of the first data stream type over the second type of network connection between client network nodes of users who are copresent in the virtual area, and tearing down the one or more corresponding network connections of the first type; and responsive to a determination that the second type of network connection currently does not exist, establishing one or more network connections of the second type, and routing one or more data streams of the first data stream type over the established second type of network connection between client network nodes of users who are copresent in the virtual area.

2. A method of routing data streams between client network nodes in connection with a virtual area that supports establishment of communicant presence, the method comprising, by a computer system:

routing one or more data streams of a first data stream type over a first type of network connection between client network nodes of users who are copresent in the virtual area;

responsive to an event that satisfies a switching predicate, ascertaining a second type of network connection between client network nodes of users who are copresent in the virtual area, wherein the first and second types of network connection are different, and the switching predicate is based on one or more of a count of client network nodes of users who are copresent in the virtual area, one or more types of data streams being communicated between client network nodes of the copresent users, bandwidth capabilities of client network nodes of the copresent users, attributes of the virtual area, and network latencies experienced by client network nodes of the copresent users;

responsive to a determination that a network connection of the second type currently exists, routing one or more data streams of the first data stream type over the second type of network connection between client network nodes of users who are copresent in the virtual area, and tearing down the one or more corresponding network connections of the first type; and responsive to a determination that the second type of network connection currently does not exist, establishing one or more network connections of the second type, and routing one or more data streams of the first data stream type over the established second type of network connection between client network nodes of users who are copresent in the virtual area.

3. The method of claim 2 , wherein the virtual area is associated with a first switching rule that defines a first communication property of the virtual area in terms of connections of sources to sinks of the first data stream type between ones of the client network nodes of users who are copresent in the virtual area.

4. The method of claim 2 , wherein satisfaction of the switching predicate is based on a count of client network nodes of the copresent users who are communicating streams of the first data stream type in the virtual area exceeding a threshold number.

5. The method of claim 2 , wherein satisfaction of the switching predicate is based on respective bandwidth capabilities of client network nodes of the copresent users who are communicating streams of the first data stream type in the virtual area.

6. The method of claim 2 , wherein satisfaction of the switching predicate is based on respective current network latencies experienced by the client network nodes of the copresent users who are communicating streams of the first data stream type in the virtual area.

7. The method of claim 2 , wherein satisfaction of the switching predicate is based on respective packet losses experienced by the client network nodes of the copresent users who are communicating streams of the first data stream type in the virtual area.

8. The method of claim 2 , wherein satisfaction of the switching predicate is based on attribute values associated with positions in the virtual area in which the users are copresent.

9. The method of claim 2 , wherein the first data stream type is audio data.

10. The method of claim 9 , further comprising routing one or more data streams of the second data stream type, wherein the second data stream type is video data.

11. The method of claim 2 , further comprising, after the establishing, reconfiguring one or more network connections of the first type as one or more standby routes between the client network nodes of users who are copresent in the virtual area.

12. The method of claim 2 , wherein the first type of network connection corresponds to a peer-to-peer connection between client network nodes of users who are copresent in the virtual area, and the second type of network connection corresponds to connections between client network nodes of users who are copresent in the virtual area that are mediated at least in part by a server network node.

13. The method of claim 2 , wherein: before the event, one or more data streams of a second data stream type are routed over the second type of network connection between client network nodes of users who are copresent in the virtual area.

14. The method of claim 2 , wherein: after the event, one or more data streams of a second data stream type are routed over the second type of network connection.

15. The method of claim 2 , wherein the first type of network connection is peer-to-peer and the second type of network connection is mediated at least in part by a server network node.

Continuity (16)
Continuation 15696135 · Sep 5, 2017
Continuation 14810371 · Jul 27, 2015
Continuation In Part 14722156 · May 27, 2015
Continuation In Part 14251505 · Apr 11, 2014
Continuation 14045562 · Oct 3, 2013
Continuation 13763913 · Feb 11, 2013
Continuation 13422757 · Mar 16, 2012
Continuation In Part 13404453 · Feb 24, 2012
Continuation 12818517 · Jun 18, 2010
Division 12630973 · Dec 4, 2009
Continuation 12418243 · Apr 3, 2009
Continuation 11923629 · Oct 24, 2007
Provisional Application 61597757 · Feb 11, 2012
Provisional Application 61120372 · Dec 5, 2008
Provisional Application 61042714 · Apr 5, 2008
Related Publication 20200322269A1 · Oct 8, 2020