IP Library Granted Patent US 10,691,202
Granted Patent B2
US 10,691,202 · App. 15/803,599 · Granted Jun 23, 2020

Virtual reality system including social graph

Inventors: Arthur van Hoff (Palo Alto, CA); Thomas M. Annau (Palo Alto, CA); Jens Christensen (Palo Alto, CA)
Assignee: Verizon Patent and Licensing Inc.
G06F3/013G06F3/011G06F3/016G06F3/04815G06F3/04842G06K9/2081G06K9/628G06Q30/0261G06Q30/0263G06Q30/0273G06T3/4038G06T11/206G06T19/006H04N5/23238H04N13/106H04N13/111H04N13/243H04N13/271H04N21/2668H04N21/4223H04N21/44218H04N21/4788H04N21/812H04N21/816H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,691,202
App. No.
15/803,599
Granted
Jun 23, 2020
Kind
B2
Abstract

The disclosure includes a system and method for receiving viewing data that describes a location of a first user's gaze while viewing virtual reality content. The method also determining an object of interest in the virtual reality content based on the location of the first user's gaze. The method also includes generating a social network that includes the first user as a member of the social network. The method also includes performing an action in the social network related to the object of interest.

Claims (71)

1. A method comprising:

recording a compressed stream of video data describing an environment using a camera array, the camera array including a set of camera modules that are configured to provide at least a 3× field of view overlap such that each pixel included in the environment is described by at least three camera modules included in the set of camera modules;

generating three-dimensional content based on the compressed stream of video data, wherein the three-dimensional content depicts the environment;

receiving viewing data that describes a location of a gaze of a user;

providing the three-dimensional content to the user based on the viewing data;

receiving sensor data that describes behavior of the user while the user is viewing the three-dimensional content, wherein the sensor data includes words spoken by the user;

determining locations of the gaze of the user with respect to the three-dimensional content;

generating, based on the locations of the gaze of the user, a gaze map that determines areas of interest of the three-dimensional content based on a number of user gazes for each location included in the determined locations;

determining, based on the words spoken by the user and the gaze map, that the user is interested in a first object in the three-dimensional content; and

providing the user with a first advertisement that is related to the first object.

2. The method of claim 1 , wherein the sensor data further includes at least one of an indication that eyes of the user were darting, a pupil dilation of the eyes of the user, a heart rate of the user, and a level of perspiration of the user during viewing of the three-dimensional content.

3. The method of claim 1 , wherein the first advertisement is provided as a graphical object and further comprising:

receiving a selection of the graphical object from the user; and

responsive to receiving the selection, providing the user with a third-party website.

4. The method of claim 2 , further comprising:

receiving a voice input from the user; and

determining, based on the voice input, that the user is searching for the three-dimensional content.

5. The method of claim 1 , further comprising:

determining that the user views a second object in the three-dimensional content for a threshold amount of time; and

responsive to the user viewing the second object for the threshold amount of time, providing the user with a second advertisement associated with the second object.

6. The method of claim 1 , wherein the three-dimensional content is displayed on a first device and further comprising:

determining a location within the three-dimensional content when the user stops viewing the three-dimensional content;

determining that the user is viewing the three-dimensional content on a second device; and

providing the user with the three-dimensional content in a substantially same location.

7. The method of claim 1 , further comprising determining a fee for displaying a second advertisement to the user at each area of interest represented in the gaze map.

8. A method comprising:

recording a compressed stream of video data describing an environment using a camera array, the camera array including a set of camera modules that are configured to provide at least a 3× field of view overlap such that each pixel included in the environment is described by at least three camera modules included in the set of camera modules;

generating three-dimensional content based on the compressed stream of video data, wherein the three-dimensional content depicts the environment;

receiving viewing data that describes a location of a gaze of a user;

providing the three-dimensional content to a first user based on the viewing data;

determining that the first user is interested in an object in the three-dimensional content;

providing the first user with an advertisement that is related to the object;

generating a social graph that includes the first user and associates the first user with information about the three-dimensional content;

receiving information from a social network that indicates one or more geographic locations that the first user visited;

providing the first user with the three-dimensional content, wherein the three-dimensional content includes the one or more geographic locations;

determining that a second user from the social graph visited the one or more geographic locations that the first user visited; and

providing the second user with a synchronized three-dimensional experience that includes the one or more geographic locations and that is synchronized with the three-dimensional content viewed by the first user.

9. The method of claim 8 , further comprising:

determining a type of three-dimensional content viewed by the first user; and

associating the first user with the type of three-dimensional content and the social graph.

10. The method of claim 9 , further comprising:

identifying the second user from the social graph as being associated with the type of three-dimensional content; and

providing a recommendation to the first user to connect with the second user within the social network.

11. The method of claim 9 , further comprising:

identifying the second user from the social graph as being associated with the type of three-dimensional content; and

providing a recommendation to the first user to view other three-dimensional content that was viewed by the second user.

12. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

recording a compressed stream of video data describing an environment using a camera array, the camera array including a set of camera modules that are configured to provide at least a 3× field of view overlap such that each pixel included in the environment is described by at least three camera modules included in the set of camera modules;

generating three-dimensional content based on the compressed stream of video data, wherein the three-dimensional content depicts the environment;

receiving viewing data that describes a location of a gaze of a user;

providing the three-dimensional content to a user based on the viewing data;

receiving sensor data that describes behavior of the user while the user is viewing the three-dimensional content, wherein the sensor data includes words spoken by the user;

determining locations of the gaze of the user with respect to the three-dimensional content;

generating, based on the locations of the gaze of the user, a gaze map that determines areas of interest of the three-dimensional content based on a number of user gazes for each location included in the determined locations;

determining, based on the words spoken by the user and the gaze map, that the user is interested in a first object in the three-dimensional content; and

providing the user with a first advertisement that is related to the first object.

13. The computer storage medium of claim 12 , wherein the sensor data further includes at least one of an indication that eyes of the user were darting, a pupil dilation of the eyes of the user, a heart rate of the user, and a level of perspiration of the user during viewing of the three-dimensional content.

14. The computer storage medium of claim 13 , wherein the first advertisement is provided as a graphical object and the instructions are further operable to perform operations comprising:

receiving a selection of the graphical object from the user; and

responsive to receiving the selection, providing the user with a third-party website.

15. The computer storage medium of claim 13 , wherein the instructions are further operable to perform operations comprising:

receiving a voice input from the user; and

determining, based on the voice input, that the user is searching for the three-dimensional content.

16. The computer storage medium of claim 12 , wherein the instructions are further operable to perform operations comprising:

determining that the user views a second object in the three-dimensional content for a threshold amount of time; and

responsive to the user viewing the second object for the threshold amount of time, providing the user with an advertisement associated with the object.

17. The computer storage medium of claim 12 , wherein the three-dimensional content is displayed on a first device and the instructions are further operable to perform operations comprising:

determining a location within the three-dimensional content when the user stops viewing the three-dimensional content;

determining that the user is viewing the three-dimensional content on a second device; and

providing the user with the three-dimensional content in a substantially same location.

18. The computer storage medium of claim 12 , wherein the first advertisement is a pop-up window that appears above the first object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2019
From: VAN HOFF, ARTHUR; ANNAU, THOMAS M.; CHRISTENSEN, JENS
To: JAUNT INC.
Reel/Frame 050676/0715 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: JAUNT, INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 050602/0853 →
Continuity (8)
Continuation 15146774 · May 4, 2016
Continuation 14845137 · Sep 3, 2015
Continuation In Part 14842465 · Sep 1, 2015
Continuation In Part 14726118 · May 29, 2015
Continuation In Part 14444938 · Jul 28, 2014
Provisional Application 62142909 · Apr 3, 2015
Provisional Application 62055259 · Sep 25, 2014
Related Publication 20180059783A1 · Mar 1, 2018
Cited By (1)
US 12,244,605