IP Library Granted Patent US 9,955,120
Granted Patent B2
US 9,955,120 · App. 15/290,989 · Granted Apr 24, 2018

Multiuser telepresence interaction

Inventors: Allison Marlene Chaney (San Francisco, CA); Megan Moyer (Oakland, CA); Chris David Oliver (Glendora, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
H04N7/157H04N7/142H04N13/0459H04N13/0484
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,955,120
App. No.
15/290,989
Granted
Apr 24, 2018
Kind
B2
Abstract

Implementations generally relate to virtual reality telepresence. In some implementations, a method includes positioning a first user in a virtual environment, and determining a first point of view associated with the first user. The method further includes positioning a second user in the virtual environment, and determining a second point of view associated with the second user. The method further includes projecting one or more of the first user and the second user in the virtual environment based on a first positioning of the first user and a second positioning of the second user and based on the first point of view and the second point of view.

Claims (49)

1. A computer-implemented method comprising:

positioning a first user in a virtual environment, wherein the first user is a local user;

determining a first point of view associated with the first user;

positioning a second user in the virtual environment, wherein the second user is a remote user;

determining a second point of view associated with the second user; and

projecting the first user and the second user in the virtual environment on at least one same display screen based on a first positioning of the first user and a second positioning of the second user and based on the first point of view and the second point of view; and

detecting movement information of the first user using a local depth sensor, wherein the movement information includes skeletal tracking information of the first user;

projecting the information of the first user in the virtual environment, wherein the information includes a movement indication and text information.

2. The method of claim 1 , wherein the first positioning of the first user and the second positioning of the second user are based on one or more of respective red-green-blue video data and depth data.

3. The method of claim 1 , wherein the first positioning of the first user and the second positioning of the second user are based on respective poses of the first user and the second user.

4. The method of claim 1 , wherein the first positioning of the first user and the second positioning of the second user are based on respective skeletal tracking information associated with the first user and the second user.

5. The method of claim 1 , wherein the method further comprises:

determining the first point of view based on head tracking of the first user; and

determining the second point of view based on head tracking of the second user.

6. The method of claim 1 , wherein the method further comprises projecting information in the virtual environment based on movement of one or more of the first user and the second user.

7. The method of claim 1 , wherein the method further comprises simulating eye contact between the first user and the second user in the virtual environment.

8. A non-transitory computer-readable storage medium carrying program instructions thereon, the instructions when executed by one or more processors are operable to perform operations comprising:

positioning a first user in a virtual environment, wherein the first user is a local user;

determining a first point of view associated with the first user;

positioning a second user in the virtual environment, wherein the second user is a remote user;

determining a second point of view associated with the second user; and

projecting the first user and the second user in the virtual environment on at least one same display screen based on a first positioning of the first user and a second positioning of the second user and based on the first point of view and the second point of view; and

detecting movement information of the first user using a local depth sensor, wherein the movement information includes skeletal tracking information of the first user;

projecting the information of the first user in the virtual environment, wherein the information includes a movement indication and text information.

9. The computer-readable storage medium of claim 8 , wherein the first positioning of the first user and the second positioning of the second user are based on one or more of respective red-green-blue video data and depth data.

10. The computer-readable storage medium of claim 8 , wherein the first positioning of the first user and the second positioning of the second user are based on respective poses of the first user and the second user.

11. The computer-readable storage medium of claim 8 , wherein the first positioning of the first user and the second positioning of the second user are based on respective skeletal tracking information associated with the first user and the second user.

12. The computer-readable storage medium of claim 8 , wherein the instructions when executed are further operable to perform operations comprising:

determining the first point of view based on head tracking of the first user; and

determining the second point of view based on head tracking of the second user.

13. The computer-readable storage medium of claim 8 , wherein the instructions when executed are further operable to perform operations comprising projecting information in the virtual environment based on movement of one or more of the first user and the second user.

14. The computer-readable storage medium of claim 8 , wherein the instructions when executed are further operable to perform operations comprising simulating eye contact between the first user and the second user in the virtual environment.

15. A system comprising:

one or more processors; and

logic encoded in one or more non-transitory computer-readable storage media for execution by the one or more processors and when executed operable to perform operations comprising:

positioning a first user in a virtual environment, wherein the first user is a local user;

determining a first point of view associated with the first user;

positioning a second user in the virtual environment, wherein the second user is a remote user;

determining a second point of view associated with the second user; and

projecting the first user and the second user in the virtual environment on at least one same display screen based on a first positioning of the first user and a second positioning of the second user and based on the first point of view and the second point of view; and

detecting movement information of the first user using a local depth sensor, wherein the movement information includes skeletal tracking information of the first user;

projecting the information of the first user in the virtual environment, wherein the information includes a movement indication and text information.

16. The system of claim 15 , wherein the first positioning of the first user and the second positioning of the second user are based on one or more of respective red-green-blue video data and depth data.

17. The system of claim 15 , wherein the first positioning of the first user and the second positioning of the second user are based on respective poses of the first user and the second user.

18. The system of claim 15 , wherein the first positioning of the first user and the second positioning of the second user are based on respective skeletal tracking information associated with the first user and the second user.

19. The system of claim 15 , wherein the logic when executed is further operable to perform operations comprising:

determining the first point of view based on head tracking of the first user; and

determining the second point of view based on head tracking of the second user.

20. The system of claim 15 , wherein the logic when executed is further operable to perform operations comprising projecting information in the virtual environment based on movement of one or more of the first user and the second user.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Feb 21, 2018
From: SONY INTERACTIVE ENTERTAINMENT NETWORK AMERICA LLC; SONY INTERACTIVE ENTERTAINMENT LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 044988/0512 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2017
From: CHANEY, ALLISON MARLENE; MOYER, MEGAN
To: SONY INTERACTIVE ENTERTAINMENT NETWORK AMERICA LLC
Reel/Frame 041671/0589 →
Continuity (2)
Provisional Application 62294681 · Feb 12, 2016
Related Publication 20170237940A1 · Aug 17, 2017