IP Library Granted Patent US 11,809,679
Granted Patent B2
US 11,809,679 · App. 17/202,499 · Granted Nov 7, 2023

Personal digital assistance and virtual reality

Inventor: John Cronin (Williston, VT)
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
G06F3/04815G06F16/243G06F16/9537G06F16/9538H04L65/403H04L67/01H04L67/131H04N7/157H04N7/183A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,809,679
App. No.
17/202,499
Granted
Nov 7, 2023
Kind
B2
Abstract

A virtual reality network provides access to a number of virtual reality representations, each virtual reality representation representing a location in a virtual universe and defined by VR data stored on the network. The VR data can be in a simplified data format and include data from an intelligent personal assistant and knowledge navigator (IPAKN). A database stores the network address and the location in the universe of each virtual reality representation. A database server provides access to the database. The database server generates a list of locations in response to a location query from a visitor, and provides the network address of the virtual reality representation of a selected location. A visitor connects to the database server with a client host to visit the locations in the virtual universe.

Claims (46)

1. A method for modifying virtual reality (VR) representations, the method comprising:

receiving one or more questions at a natural language interface, wherein the questions are associated with one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation;

querying one or more web sources based on the questions associated with the user-generated content;

providing answers to the questions through the natural language interface based on query results from the web sources, wherein the query results include one or more images downloaded from the queried web sources associated with the location;

modifying, by a host server that communicates with a domain server, a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the VR data set and stored at one or more VR data servers;

generating a display of a map that includes an icon indicating that the one or more images downloaded from the queried web sources associated with the location are available;

receiving a selection from a visitor device specifying the location; and

allowing the visitor device to access the modified VR data set, wherein a new VR representation of the location is generated in accordance with the modified data set that includes the one or more images from the query results.

2. The method of claim 1 , wherein the generated VR representation of the location and the map corresponding to one or more real-world locations are displayed simultaneously by the visitor device.

3. The method of claim 1 , further comprising receiving a query via one or more widgets displayed with the VR representation, wherein querying the web sources is based on the received query.

4. The method of claim 3 , further comprising accessing information associated with the queried web sources via the one or more widgets.

5. The method of claim 1 , further comprising generating an icon in the VR representation that indicates one or more characteristics of the VR representation.

6. The method of claim 1 , further comprising updating the VR data servers based on the modified VR data set.

7. The method of claim 1 , wherein the map includes an icon indicating that the query results associated with the location is available.

8. The method of claim 1 , wherein modifying the VR data set includes adding an image data superimposed to the VR data set.

9. The method of claim 1 , wherein the user-generated content includes voice data, wherein querying the one or more web sources includes searching the web sources based on a question indicated by the voice data.

10. The method of claim 1 , further comprising organizing a plurality of user-generated content from one or more user devices, the user-generated content organized by the VR data servers to connect one or more VR representations.

11. A system for modifying virtual reality (VR) representations, the system comprising:

one or more VR data servers, wherein a VR data set is associated with any one of the one or more VR data servers;

a personal assistant server that provides a natural language interface, wherein the personal assistant server:

receives one or more questions at the natural language interface, the questions associated with one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation; and

queries one or more web sources based on the questions associated with the user-generated content

providing answers to the questions through the natural language interface based on query results from the web sources, wherein the query results include one or more images downloaded from the queried web sources associated with the location;

a domain server that transmits a network address of one of the VR data servers associated with the VR data set; and

a host server that communicates with the domain server to:

modify a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the VR data set and stored at one or more VR data servers;

generate a display of a map that includes an icon indicating that the one or more images downloaded from the queried web sources associated with the location are available;

receive a selection from a visitor device specifying the location; and

allow the visitor device to access the modified VR data set, wherein a new VR representation of the location is generated in accordance with the modified data set that includes the one or more images from the query results.

12. The system of claim 11 , wherein the visitor device displays the generated VR representation of the location and the map corresponding to one or more real-world locations simultaneously.

13. The system of claim 11 , wherein the personal assistant server receives a query via one or more widgets displayed with the VR representation, wherein querying the web sources is based on the received query.

14. The system of claim 13 , wherein the one or more widget allows access to information associated with the queried web sources.

15. The system of claim 11 , wherein the visitor device displays an icon in the VR representation that indicates one or more characteristics of the VR representation.

16. The system of claim 11 , wherein the VR data servers are updated based on the modified VR data set.

17. The system of claim 11 , wherein the map includes an icon indicating that the query results associated with location is available.

18. The system of claim 11 , wherein the host server modifies the VR data set by adding an image data superimposed to the VR data set.

19. The system of claim 11 , wherein the user generated content includes voice data, wherein querying the one or more web sources includes searching the web sources based on a question indicated by the voice data.

20. The system of claim 11 , wherein the VR server organizes a plurality of user-generated content from one or more user devices to connect one or more VR representations.

21. A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for modifying virtual reality (VR) representations, the method comprising:

receiving one or more questions at a natural language interface, wherein the questions are associated with one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation;

querying one or more web sources based on the questions associated with the user-generated content;

providing answers to the questions through the natural language interface based on query results from the web sources, wherein query results include one or more images from the web sources;

modifying, by a host server that communicates with a domain server, a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the VR data set and stored at the one or more VR data servers;

generating a display of a map that includes an icon indicating that the one or more images downloaded from the queried web sources associated with the location are available;

receiving a selection from a visitor device specifying the location; and

allowing the visitor device to access the modified VR data set, wherein the VR representation of the location is generated in accordance with the modified data set that includes the one or more images from the query results.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2023
From: CRONIN, JOHN
To: IPCREATE, INC.
Reel/Frame 064342/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2023
From: IPCREATE, INC.
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 064343/0141 →
MERGER Recorded Jul 21, 2023
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 064343/0656 →
CHANGE OF NAME Recorded Jul 21, 2023
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 064362/0236 →
Continuity (4)
Continuation 14460272 · Aug 14, 2014
Continuation 14147429 · Jan 3, 2014
Provisional Application 61786572 · Mar 15, 2013
Related Publication 20210344872A1 · Nov 4, 2021
Cited By (1)
US 12,353,680