IP Library › Granted Patent US 10,430,018
Granted Patent B2
US 10,430,018 · App. 15/603,292 · Granted Oct 1, 2019

Systems and methods for providing user tagging of content within a virtual scene

Inventors: Glenn Black (San Mateo, CA); Jeffrey Roger Stafford (Redwood City, CA); Javier Fernandez Rico (Pacifica, CA)
Assignee: Sony Interactive Entertainment Inc.
G06F3/04815A63F13/211A63F13/212A63F13/245A63F13/26A63F13/5255A63F13/69G02B27/0093G02B27/017G06F3/011G06F3/012G06F3/013G06F3/017G06F3/0304G06F3/04842G06F3/1454G06F16/5866G06Q30/0643G06T19/003G06T19/006G02B2027/014G02B2027/0138G02B2027/0141G02B2027/0187G06F2203/04804G06Q50/12G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,430,018
App. No.
15/603,292
Granted
Oct 1, 2019
Kind
B2
Abstract

Systems and methods for providing user tagging of content within a virtual scene are described. One of the methods includes sending data for display of a virtual environment on a head-mounted display. The virtual environment includes a virtual item. The method further includes receiving an indication of a selection associated with the virtual item. The method includes sending option data for allowing entry of content regarding the virtual item upon receiving the indication of the selection, receiving the content, associating the content with the virtual item, and sending tagged data for displaying a tag associated with the virtual item.

Claims (93)

1. A method comprising:

sending, via a computer network, virtual environment data for display of a shared virtual environment on a first head-mounted display, wherein the first head-mounted display is configured to be worn by a first user, wherein the shared virtual environment includes a three-dimensional view of a virtual item;

receiving, via the computer network and a first user account of the first user, an indication of a selection associated with the virtual item;

sending, via the computer network, option data for allowing entry of content regarding the virtual item upon receiving the indication of the selection;

receiving, via the computer network, the content;

associating the content with the virtual item and the first user account;

sending, via the computer network, tagged data for displaying a tag associated with the virtual item, wherein the tag indicates that the content is associated with the virtual item;

analyzing a number of interactions with the virtual item including the selection of the virtual item to determine a rating for the virtual item, wherein the interactions include three-dimensional movement of the virtual item in the shared virtual environment;

sending, via the computer network, data for display of the virtual item within the shared virtual environment to a second head-mounted display based on the rating and an interest profile associated with a second user account of a second user.

2. The method of claim 1 , wherein said associating the content with the virtual item and the first user account includes generating an entry in a database for storing data regarding the virtual item and providing a link between the data regarding the virtual item and a user identifier of the first user account, the link further related to an entry that includes an identifier of the content.

3. The method of claim 2 , wherein the database is accessible to a plurality of other user accounts to enable an access to the virtual item and retrieval of the content.

4. The method of claim 2 , wherein the database links the first user account and the content to a model of the virtual item that enables the three-dimensional view of the virtual item in the first virtual environment, wherein the first virtual environment is a virtual online store.

5. The method of claim 4 , wherein the model has graphics data associated with geometry, shape, shading, and texture of the virtual item.

6. The method of claim 5 , wherein the texture is defined by lighting, a number of polygonal pieces forming the virtual item, and color.

7. The method of claim 1 , wherein the virtual item is viewable at different perspectives based on gestures made by the first user.

8. The method of claim 1 , wherein the virtual item is displayed at different perspectives based on an orientation of the first head-mounted display, wherein the different perspectives are displayed when the first head-mounted display is moved by the first user.

9. The method of claim 1 , wherein the content is audio content, or video content, or text, or graphics, or a combination thereof, wherein the content is associated with an identity of the first user account accessed to create the content.

10. The method of claim 1 , further comprising:

receiving, via the computer network and the second user account, a search request to search for the virtual item, wherein the second user account is assigned to the second user;

determining whether the second user account has permission to access the virtual item and the content in response to the search request; and

sending, via the computer network, the content for display within the shared virtual environment on the second head-mounted display configured to be worn by the second user, wherein said sending the data for display of the virtual item and said sending the content for display within the shared virtual environment are performed upon determining that the second user account has permission to access the virtual item and the content.

11. The method of claim 1 , further comprising:

sending, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display configured to be worn by the second user, wherein the shared virtual environment includes the tag;

receiving, via the computer network and the second user account of the second user, an indication of a selection of the tag;

determining whether the second user account has permission to access the content upon receiving the indication of the selection of the tag; and

sending, via the computer network and the second user account, content data for displaying the content via the second user account upon determining that the second user account has the permission.

12. The method of claim 11 , wherein the first user account is not accessed via the computer network to display the shared virtual environment on the first head-mounted display when the second user account is used to access the shared virtual environment on the second head-mounted display.

13. The method of claim 1 , further comprising:

sending, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display configured to be worn by the second user;

receiving, via the computer network and the second user account of the second user, an indication of a selection of the virtual item;

determining whether the second user account has permission to access the content upon receiving the indication of the selection of the virtual item;

sending, via the computer network, content data for displaying the content via the second user account upon determining that the second user account has the permission.

14. The method of claim 1 , further comprising:

determining whether the virtual item will be accessed via the second user account;

determining whether the rating exceeds a predetermined rating, wherein said sending the data for display of the virtual item includes sending; the data for display of the virtual item in a more prominent manner compared to a manner in which other virtual items are displayed within the shared virtual environment in response to determining that the virtual item will be accessed via the second user account.

15. The method of claim 1 , further comprising:

sending, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display, wherein the second head-mounted display is configured to be worn by the second user;

receiving, via the computer network and the second user account of the second user, an indication of a selection of the tag;

sending, via the computer network, option data for allowing entry of additional content regarding the virtual item upon receiving the indication of the selection of the tag;

receiving, via the computer network, the additional content;

associating the additional content with the virtual item and the tag.

16. The method of claim 1 , further comprising:

sending, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display, wherein the second head-mounted display is configured to be worn by the second user;

receiving, via the computer network and the second user account of the second user, an indication of a selection of the virtual item;

sending, via the computer network, option data for allowing entry of additional content regarding the virtual item upon receiving the indication of the selection of the virtual item;

receiving, via the computer network, the additional content;

associating the additional content with the virtual item and the tag.

17. The method of claim 1 , further comprising:

counting an amount of content associated with the virtual item;

determining whether the amount of content exceeds a pre-determined threshold;

determining whether access to the virtual environment data for display of the shared virtual environment is requested from the second user account assigned to the second user;

sending, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display configured to be worn by the second user upon determining that the access to the virtual environment for display of the shared virtual environment is requested from the second user account, wherein the shared virtual environment displays the virtual item in a more prominent location compared to a location of display of the virtual item in the shared virtual environment displayed on the first head-mounted display.

18. The method of claim 1 , wherein the first virtual environment includes a virtual user using the virtual item.

19. The method of claim 1 , wherein the virtual item is displayed at a first location within the shared virtual environment displayed on the first head-mounted display and at a second location within the shared virtual environment displayed on the second head-mounted display, wherein the second location is different from the first location.

20. A system comprising:

a first head-mounted display, wherein the first head-mounted display is configured to be worn by a first user; and

one or more servers coupled to the first head-mounted display via a computer network, wherein the one or more servers are configured to send, via the computer network, virtual environment data for display of a shared virtual environment on the first head-mounted display, wherein the shared virtual environment includes a three-dimensional view of a virtual item,

wherein the first head-mounted display is configured to display the shared virtual environment,

wherein the one or more servers are configured to receive, via the computer network and a first user account of the first user, an indication of a selection associated with the virtual item displayed on the first head-mounted display;

wherein the one or more servers are configured to send, via the computer network, option data for allowing entry of content regarding the virtual item upon receiving the indication of the selection,

wherein the first head-mounted display is configured to display the option data for the entry of the content,

wherein the one or more servers are configured to receive, via the computer network, the content;

wherein the one or more servers are configured to associate the content with the virtual item; and

wherein the one or more servers are configured to send, via the computer network, tagged data for displaying a tag associated with the virtual item, wherein the tag indicates that the content is associated with the virtual item,

wherein the first head-mounted display is configured to display the tag,

wherein the one or more servers are configured to analyze a number of interactions with the virtual item including the selection of the virtual item to determine a rating for the virtual item, wherein the interactions include three-dimensional movement of the virtual item in the shared virtual environment,

wherein the one or more servers are coupled to a second head-mounted display via the computer network, wherein the one or more servers are configured to send, via the computer network, data for display of the virtual item within the shared virtual environment to the second head-mounted display based on the rating and an interest profile associated with a second user account of a second user.

21. The system of claim 20 , wherein the content is audio content, or video content, or text, or a combination thereof, wherein the content is associated with an identity of the first user account accessed to create the content.

22. The system of claim 20 ,

wherein the second head-mounted display is configured to be worn by the second user,

wherein the second head-mounted display is configured to display a field for receiving a search request for the virtual item via the second user account assigned to the second user,

wherein the one or more servers are configured to receive, via the computer network and the second user account, the search request to search for the virtual item,

wherein the one or more servers are configured to determine whether the second user account has permission to access the virtual item and the content in response to the search request,

wherein the one or more servers are configured to send, via the computer network, the virtual environment data for display of the shared virtual environment upon determining that the second user account has permission to access the virtual item and the content,

wherein the second head-mounted display is configured to display the shared virtual environment, wherein the shared virtual environment includes the content.

23. The system of claim 20 ,

wherein the second head-mounted display is configured to be worn by the second user,

wherein the one or more servers are configured to send, via the computer network, the virtual environment data for display of the shared virtual environment on the second head-mounted display, wherein the shared virtual environment includes the tag,

wherein the one or more servers are configured to receive, via the computer network and the second user account of the second user, an indication of a selection of the tag;

wherein the one or more servers are configured to determine whether the second user account has permission to access the content upon receiving the indication of the selection of the tag, and

wherein the one or more servers are configured to send, via the computer network, content data for displaying the content via the second user account upon determining that the second user account has the permission,

wherein the second head-mounted display is configured to display the content within the shared virtual environment.

24. The system of claim 23 , wherein the first user account is not accessed via the computer network to display the shared virtual environment on the first head-mounted display when the second user account is used to access the shared virtual environment on the second head-mounted display.

25. A system comprising:

a first head-mounted display configured to display a shared virtual environment, wherein the first head-mounted display is configured to be worn by a first user, wherein the shared virtual environment includes a three-dimensional view of a virtual item; and

a communication device coupled to the first head-mounted display for sending, via a computer network and a first user account of the first user, an indication of a selection associated with the virtual item,

wherein the communication device is configured to receive, via the computer network, option data for allowing entry of content regarding the virtual item after the indication of the selection is sent,

wherein the first head-mounted display is configured to display the content,

wherein the communication device is configured to send the content via the computer network to a server for associating of the content with the virtual item,

wherein the communication device is configured to receive tag data for displaying a tag associated with the virtual item, wherein the tag indicates that the content is associated with the virtual item,

a second head-mounted display coupled to the computer network, wherein the second head-mounted display is configured to receive, via the computer network, data for display of the virtual item within the shared virtual environment based on a rating and an interest profile associated with a second user account associated with a second user,

wherein the rating is determined from an analysis of a number of interactions with the virtual item including the selection of the virtual item, wherein the interactions include three-dimensional movement of the virtual item in the shared virtual environment.

26. The system of claim 25 , wherein the content is audio content, or video content, or text, or a combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2017
From: BLACK, GLENN; STAFFORD, JEFFREY ROGER; RICO, JAVIER FERNANDEZ
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 042490/0751 →
Continuity (6)
Continuation In Part 14206219 · Mar 12, 2014
Continuation In Part 14658123 · Mar 13, 2015
Provisional Application 62357342 · Jun 30, 2016
Provisional Application 61953730 · Mar 14, 2014
Provisional Application 61832758 · Jun 7, 2013
Related Publication 20170262154A1 · Sep 14, 2017
Cited By (12)
US 12,189,422 US 12,236,008 US 12,265,655 US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,669,848