IP Library Granted Patent US 12,373,635
Granted Patent B2
US 12,373,635 · App. 17/964,294 · Granted Jul 29, 2025

System and methods of virtual world interaction

Inventors: Brian Shuster (Vancouver, CA); Aaron Burch (Vancouver, CA); Friso Kristiansen (Vancouver, CA); Ian Neufeld (Burnaby, CA); Dirk Herling (Vancouver, CA); Patrick Tyroler (Vancouver, CA); Gary Shuster (Vancouver, CA)
Assignee: PFAQUTRUMA RESEARCH LLC
G06F40/143G06F3/04815G06F3/04842G06F3/0487G06F40/14G06T19/003G06T19/20H04L63/08H04L63/101H04L65/4015H04L65/403H04L67/02H04L67/131A63F2300/5533A63F2300/5553A63F2300/5586A63F2300/64A63F2300/65A63F2300/807A63F2300/8082G06F3/011G06F16/444G06F16/954G06T2219/024G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,635
App. No.
17/964,294
Granted
Jul 29, 2025
Kind
B2
Abstract

Systems and methods of virtual world interaction, operation, implementation, instantiation, creation, and other functions related to virtual worlds (note that where the term “virtual world” is used herein, it is to be understood as referring to virtual world systems, virtual environments reflecting real, simulated, fantasy, or other structures, and includes information systems that utilize interaction within a 3D environment). Various embodiments facilitate interoperation between and within virtual worlds, and may provide consistent structures for operating virtual worlds. The disclosed embodiments may further enable individuals to build new virtual worlds within a framework, and allow third party users to better interact with those worlds.

Claims (33)

1. A method comprising:

transmitting, to a first client computer over a network, a three-dimensional representation of a three-dimensional environment enabling the first client computer to display a view of the three-dimensional environment, wherein the three-dimensional representation of the three-dimensional environment includes an avatar of a second client computer that is unable to change its position;

transmitting, to a second client computer over the network, a two-dimensional representation of the three-dimensional environment enabling a second client computer to interact with the three-dimensional environment without displaying a two-dimensional or three-dimensional view of the three-dimensional environment;

receiving, from the second client computer over the network, interaction with the three-dimensional environment; and

transmitting, to the first client computer over the network, an indication of the interaction.

2. The method of claim 1 , wherein the two-dimensional representation includes textual content describing the three-dimensional environment.

3. The method of claim 1 , wherein the two-dimensional representation includes information to facilitate access to a three-dimensional representation of the three-dimensional environment enabling the second client computer to display a view of the three-dimensional environment.

4. The method of claim 1 , wherein the interaction with the three-dimensional environment includes text entered into a chat function.

5. The method of claim 4 , wherein the indication of the interaction includes audio based on the text.

6. The method of claim 1 , wherein the interaction with the three-dimensional environment includes audio communication.

7. The method of claim 1 , wherein the three-dimensional representation of the three-dimensional environment includes an avatar of the second client computer.

8. The method of claim 7 , wherein the interaction with the three-dimensional environment includes moving the avatar of the second client computer in the three-dimensional environment.

9. The method of claim 7 , wherein the avatar of the second client computer indicates that the second client computer was transmitted the two-dimensional representation.

10. A server comprising:

a network interface;

non-transitory memory; and

one or more processes to:

transmit, to a first client computer over a network, a three-dimensional representation of a three-dimensional environment enabling the first client computer to display a view of the three-dimensional environment, wherein the three-dimensional representation of the three-dimensional environment includes an avatar of a second client computer that is unable to change its position;

transmit, to a second client computer over the network, a two-dimensional representation of the three-dimensional environment enabling a second client computer to interact with the three-dimensional environment without displaying a two-dimensional or three-dimensional view of the three-dimensional environment;

receive, from the second client computer over the network, interaction with the three-dimensional environment; and

transmit, to the first client computer over the network, an indication of the interaction.

11. The server of claim 10 , wherein the two-dimensional representation includes textual content describing the three-dimensional environment.

12. The server of claim 10 , wherein the interaction with the three-dimensional environment includes text entered into a chat function.

13. The server of claim 12 , wherein the indication of the interaction includes audio based on the text.

14. The server of claim 10 , wherein the interaction with the three-dimensional environment includes audio communication.

15. The server of claim 10 , wherein the interaction with the three-dimensional environment includes moving the avatar of the second client computer in the three-dimensional environment.

16. The server of claim 10 , wherein the avatar of the second client computer indicates that the second client computer was transmitted the two-dimensional representation.

17. The server of claim 10 , wherein the three-dimensional representation of the three-dimensional environment includes an avatar of the second client computer.

18. A non-transitory computer-readable medium having instructions encoded thereon which, when executed by one or more processors of a server, cause the server to perform operations comprising:

transmitting, to a first client computer over a network, a three-dimensional representation of a three-dimensional environment enabling the first client computer to display a view of the three-dimensional environment, wherein the three-dimensional representation of the three-dimensional environment includes an avatar of a second client computer that is unable to change its position;

transmitting, to a second client computer over the network, a two-dimensional representation of the three-dimensional environment enabling a second client computer to interact with the three-dimensional environment without displaying a two-dimensional or three-dimensional view of the three-dimensional environment;

receiving, from the second client computer over the network, interaction with the three-dimensional environment; and

transmitting, to the first client computer over the network, an indication of the interaction.

Continuity (6)
Continuation 16882497 · May 24, 2020
Continuation 15934858 · Mar 23, 2018
Continuation 14139397 · Dec 23, 2013
Continuation 13590187 · Aug 20, 2012
Provisional Application 61524956 · Aug 18, 2011
Related Publication 20230053055A1 · Feb 16, 2023
References Cited (127)
US 5461710A · Bloomfield et al. · 1995 [cited by applicant]
US 5802296A · Morse et al. · 1998 [cited by applicant]
US 5872575A · Segal · 1999 [cited by applicant]
US 5880731A · Liles et al. · 1999 [cited by applicant]
US 6031549A · Roth · 2000 [cited by applicant]
US 6285380B1 · Perlin et al. · 2001 [cited by applicant]
US 6681380B1 · Britton · 2004 [cited by examiner]
US 6801930B1 · Dionne et al. · 2004 [cited by applicant]
US 6912565B1 · Powers et al. · 2005 [cited by applicant]
US 7089278B1 · Churchill et al. · 2006 [cited by applicant]
US 7373377B2 · Altieri · 2008 [cited by applicant]
US 7593864B2 · Shuster · 2009 [cited by applicant]
US 7769895B1 · Williams et al. · 2010 [cited by applicant]
US 7859532B2 · Yoshida et al. · 2010 [cited by applicant]
US 8108774B2 · Finn et al. · 2012 [cited by applicant]
US 8113959B2 · De Judicibus · 2012 [cited by applicant]
US 8167724B2 · Shuster · 2012 [cited by applicant]
US 8245283B2 · Dawson et al. · 2012 [cited by applicant]
US 8274506B1 · Rees · 2012 [cited by applicant]
US 8290974B2 · Karlsson · 2012 [cited by examiner]
US 20010019337A1 · Kim · 2001 [cited by applicant]
US 20020140698A1 · Robertson et al. · 2002 [cited by applicant]
US 20030177187A1 · Levine et al. · 2003 [cited by applicant]
US 20030197737A1 · Kim · 2003 [cited by applicant]
US 20040143852A1 · Meyers · 2004 [cited by applicant]
US 20060066607A1 · Schmittler · 2006 [cited by examiner]
US 20060089938A1 · Leonard et al. · 2006 [cited by applicant]
US 20060140405A1 · Thommana et al. · 2006 [cited by applicant]
US 20060234795A1 · Dhunjishaw et al. · 2006 [cited by applicant]
US 20070013691A1 · Jung et al. · 2007 [cited by applicant]
US 20070118420A1 · Jung et al. · 2007 [cited by applicant]
US 20070168214A1 · Jung et al. · 2007 [cited by applicant]
US 20070198658A1 · Aggarwal et al. · 2007 [cited by applicant]
US 20080055306A1 · Kwok et al. · 2008 [cited by applicant]
US 20080081701A1 · Shuster · 2008 [cited by applicant]
US 20080092065A1 · Jung et al. · 2008 [cited by applicant]
US 20080120558A1 · Nathan et al. · 2008 [cited by applicant]
US 20080133392A1 · Jung et al. · 2008 [cited by applicant]
US 20080146338A1 · Bernard et al. · 2008 [cited by applicant]
US 20080201638A1 · Nair · 2008 [cited by applicant]
US 20080263460A1 · Altberg et al. · 2008 [cited by applicant]
US 20080320503A1 · Kruglick et al. · 2008 [cited by applicant]
US 20090037822A1 · Kandekar et al. · 2009 [cited by applicant]
US 20090037905A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20090043604A1 · Jung et al. · 2009 [cited by applicant]
US 20090094535A1 · Bromenshenkel et al. · 2009 [cited by applicant]
US 20090113066A1 · Van Wie et al. · 2009 [cited by applicant]
US 20090141023A1 · Shuster · 2009 [cited by applicant]
US 20090144282A1 · Uramoto · 2009 [cited by applicant]
US 20090158150A1 · Lyle et al. · 2009 [cited by applicant]
US 20090175559A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20090210812A1 · Cragun · 2009 [cited by examiner]
US 20090225074A1 · Bates et al. · 2009 [cited by applicant]
US 20090235183A1 · Hamilton et al. · 2009 [cited by applicant]
US 20090254968A1 · Bussani et al. · 2009 [cited by applicant]
US 20090265667A1 · Reisinger · 2009 [cited by applicant]
US 20090276718A1 · Dawson et al. · 2009 [cited by applicant]
US 20090287614A1 · Amsterdam et al. · 2009 [cited by applicant]
US 20090300493A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20090300525A1 · Jolliff et al. · 2009 [cited by applicant]
US 20090307226A1 · Koster et al. · 2009 [cited by applicant]
US 20090312080A1 · Hamilton, II et al. · 2009 [cited by applicant]
US 20090319609A1 · Ferraro · 2009 [cited by applicant]
US 20090325138A1 · Shuster · 2009 [cited by applicant]
US 20100001993A1 · Finn et al. · 2010 [cited by applicant]
US 20100005028A1 · Hartley et al. · 2010 [cited by applicant]
US 20100011359A1 · Shuster · 2010 [cited by applicant]
US 20100026681A1 · Dolbier et al. · 2010 [cited by applicant]
US 20100050004A1 · Hamilton, II et al. · 2010 [cited by applicant]
US 20100077313A1 · Draese et al. · 2010 [cited by applicant]
US 20100094890A1 · Bokor et al. · 2010 [cited by applicant]
US 20100115022A1 · Rapo · 2010 [cited by applicant]
US 20100121729A1 · Betzler et al. · 2010 [cited by applicant]
US 20100138455A1 · Alewine et al. · 2010 [cited by applicant]
US 20100138755A1 · Kulkarni et al. · 2010 [cited by applicant]
US 20100146409A1 · Yoshida et al. · 2010 [cited by applicant]
US 20100153858A1 · Gausman et al. · 2010 [cited by applicant]
US 20100169779A1 · Mason et al. · 2010 [cited by applicant]
US 20100184517A1 · Danieli · 2010 [cited by examiner]
US 20100185939A1 · Greene et al. · 2010 [cited by applicant]
US 20100229235A1 · Dawson et al. · 2010 [cited by applicant]
US 20100251337A1 · Amsterdam et al. · 2010 [cited by applicant]
US 20100275136A1 · Gower · 2010 [cited by applicant]
US 20100333031A1 · Castelli et al. · 2010 [cited by applicant]
US 20110010675A1 · Hamilton, II et al. · 2011 [cited by applicant]
US 20110054918A1 · Hamilton, II et al. · 2011 [cited by applicant]
US 20110055136A1 · Hamilton, II et al. · 2011 [cited by applicant]
US 20110055267A1 · Bolger et al. · 2011 [cited by applicant]
US 20110113065A1 · Cupka et al. · 2011 [cited by applicant]
US 20110126272A1 · Betzler et al. · 2011 [cited by applicant]
US 20110131509A1 · Brillhart et al. · 2011 [cited by applicant]
US 20110276477A1 · Shuster · 2011 [cited by applicant]
US 20110298618A1 · Stahl · 2011 [cited by examiner]
US 20110301760A1 · Shuster et al. · 2011 [cited by applicant]
US 20120021825A1 · Harp et al. · 2012 [cited by applicant]
US 20120030289A1 · Buford et al. · 2012 [cited by applicant]
US 20120179983A1 · Lemire · 2012 [cited by applicant]
US 20120188233A1 · Shuster et al. · 2012 [cited by applicant]
US 20120220369A1 · Shuster · 2012 [cited by applicant]
US 20120223940A1 · Dunstan et al. · 2012 [cited by applicant]
US 20120231891A1 · Watkins, Jr. et al. · 2012 [cited by applicant]
US 20120311463A1 · Hickman et al. · 2012 [cited by applicant]
US 20130021338A1 · Shuster et al. · 2013 [cited by applicant]
US 20130036371A1 · Cohen · 2013 [cited by applicant]
US 20130044106A1 · Shuster et al. · 2013 [cited by applicant]
US 20130044107A1 · Burch et al. · 2013 [cited by applicant]
US 20130046854A1 · Shuster et al. · 2013 [cited by applicant]
US 20130047098A1 · Shuster et al. · 2013 [cited by applicant]
US 20130047208A1 · Shuster et al. · 2013 [cited by applicant]
US 20130047217A1 · Shuster et al. · 2013 [cited by applicant]
US 20130217506A1 · Gault et al. · 2013 [cited by applicant]
EP 2184092A2 · 2010 [cited by applicant]
Extended European Search Report dated Apr. 20, 2015, European Patent Application No. 12823557.9, pp. 1-6. [cited by applicant]
Extended European Search Report dated Nov. 19, 2021, European Application No. 21190909.8, pp. 1-7. [cited by applicant]
Neil Coffey, “The user-agent header,” Retrieved on Mar. 5, 2022, from the Internet Archive, archived on Aug. 11, 2011, originally published at https://www.javamex.com/tutorials/servlets/headers_user_agent.shtml (Year: 2… [cited by applicant]
Nicholas Zakas, “History of the user-agent string,” Jan. 12, 2010 (reader mode), retrieved on Mar. 5, 2022, from https://humanwhocodes.com/blog/2010/01/12/history-of-the-user-agent-string/. [cited by applicant]
“The Virtual Reality Modeling Language Specification, Section 4,” Retrieved on Sep. 18, 2021, from http://tecfa.unige.ch/guides/vrml/vrml97/spec/part1/concepts.html (41 pages) (Year: 1997). [cited by applicant]
Rikk Carey, “The Virtual Reality Modeling Language Explained,” Standards, IEEE, Jul.-Aug. 1998, pp. 84-93. [cited by applicant]
Huang et al., “A Multiuser 3D Web Browsing System,” IEEE Internet Computing, Sep./Oct. 1998, pp. 70-79. [cited by applicant]
Huang et al., “GeoVR: a web-based tool for virtual reality presentation from 2D Gis data,” Computers & Geosciences 25, 1999, retrieved on Sep. 18, 2021 from http://homepages.cob.isu.edu/parkerkr/courses/CIS5591/Fall07/R… [cited by applicant]
Blais et al., Web-Based 3D Technology for Scenario Authoring and Visualization: the Savage Project, Institutional Archive of the Naval postgraduate School, Nov. 2001, retrieved on Sep. 18, 2021, from https://core.ac.uk/… [cited by applicant]
“Extensible 3D: XML Meets VRML,” Aug. 6, 2003, retrieved on Sep. 18, 2021, from https://www.XML.com/pub/a/2003/08/06/x3d.html (reader mode) (44 pgs.). [cited by applicant]
Untitled, retrieved on Sep. 18, 2021, from https://web.cs.wpi.edu/˜kal/elecdoc/java/vrml/html via the Internet Archive (archived Mar. 14, 2007). [cited by applicant]
Bruce Campbell, “VRML as a superset of HTML—An Approach to Consolidation,” retrieved on Sep. 18, 2021, from http://www.hitl.washington.edu/people/bdc/hgc2.htm via the Internet Archive (archived on Nov. 22, 2008) (16 pgs… [cited by applicant]
Glaab et al., “vrmlgen: An R package for 3D Data Visualization on the Web,” Journal of Statistical Software, vol. 36, Issue 8, Aug. 2010, retrieved on Sep. 18, 2021 from http://www.jtstatsoft.org/article/view/v036i08 (1… [cited by applicant]
“The Virtual World Web (VWW) Network Reaches 25,000 Independently Developed Worlds,” May 19, 2010, retrieved on Sep. 17, 2021, from https://www.prnewswire.com/news-releases/the-virtual-world-web-vww-network-reaches-2500… [cited by applicant]
“Virtual World Web Reaches 50,000 Virtual Worlds,” Mar. 31, 2011, retrieved on Sep. 17, 2021, from https://www.prweb.com/pdfdownload/8256005 (3 pgs). [cited by applicant]