IP Library › Granted Patent US 10,484,508
Granted Patent B2
US 10,484,508 · App. 16/274,898 · Granted Nov 19, 2019

Sharing in an augmented and/or virtual reality environment

Inventors: Manuel Christian Clement (Felton, CA); Stefan Welker (Mountain View, CA)
Assignee: Google LLC
H04L67/38A63F13/428A63F13/573G06F3/011G06F3/017G06F3/048A63F2300/8082G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,484,508
App. No.
16/274,898
Granted
Nov 19, 2019
Kind
B2
Abstract

In a system and method for sharing items in an augmented and/or virtual reality environment, selected virtual items may be virtually propelled using, for example, a tossing or throwing motion, to a target recipient, so that the selected item may be shared with the target recipient without direct physical and/or virtual contact with the target recipient. Movement of a user's hand may be detected and tracked, so that the intended target recipient for the shared item may be identified based on a projected trajectory of a throwing motion of the user's hand. Associations between the user and different target recipients may cause different possible target recipients to exhibit different attractive forces, or different levels of magnetism, for particular items being tossed or thrown by a user for sharing, to further differentiate between the possible target recipients, and resolve recipient ambiguity.

Claims (73)

1. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared virtual environment by a selection device in virtual contact with the selected virtual item;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user interacting in the shared virtual environment;

identifying a target recipient for the selected virtual item in the ambient environment, the target recipient corresponding to a second user in the ambient environment and interacting in the shared virtual environment, the identifying the target recipient including:

detecting at least one possible recipient in the ambient environment;

detecting an attractive force associated with each of the at least one possible recipient in the ambient environment; and

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and the detected attractive force associated with each of the at least one possible recipient; and

sharing the selected virtual item, selected from the shared virtual environment, with the identified target recipient in the ambient environment.

2. The method of claim 1 , wherein sharing the selected virtual item includes:

superimposing a virtual image of the selected virtual item on the identified target recipient; and

displaying an image of the selected virtual item superimposed on the identified target recipient for viewing by the first user and the second user.

3. The method of claim 1 , wherein sharing the selected virtual item includes suggesting the selected virtual item to the identified target recipient for consideration by the identified target recipient.

4. The method of claim 1 , wherein sharing the selected virtual item includes sharing purchase information for the selected virtual item with the identified target recipient.

5. The method of claim 1 , wherein

receiving the selection of the virtual item includes receiving a selection of a virtual event, and

sharing the selected virtual item includes sharing access to the selected virtual event with the identified target recipient.

6. The method of claim 1 , wherein

detecting at least one possible recipient includes detecting a plurality of possible recipients, and

detecting the attractive force includes detecting the attractive force associated with each of the plurality of possible recipients.

7. The method of claim 6 , further comprising tracking movement of the selection device in virtual contact with the selected virtual item, including:

tracking a six degree of freedom movement of a hand of the first user through a throwing movement of the hand of the user;

projecting the virtual trajectory for the selected virtual item based on the tracked throwing movement of the hand of the first user; and

identifying the intended target recipient based on an extension of the projected virtual trajectory to one of a plurality of possible recipients.

8. The method of claim 7 , wherein detecting the attractive force includes detecting the attractive force based on a commonality between a characteristic of the selected virtual item and a characteristic of each of the plurality of possible recipients including detecting at least one of:

an existing association with one or more of the plurality of possible recipients;

an existing share request from one or more of the plurality of possible recipients;

a sharing history with one or more of the plurality of possible recipients; or

a common format type with one or more of the plurality of possible recipients.

9. The method of claim 7 , wherein

identifying the target recipient from the plurality of possible recipients in the shared virtual environment includes identifying the target recipient from a plurality of additional users in the shared virtual environment; and

detecting the attractive force associated with each of the plurality of possible recipients in the shared virtual environment includes detecting the attractive force associated with each possible recipient based on at least one of:

an established association between the user and the possible recipient; or

a request for sharing of the content of the virtual item by the possible recipient.

10. The method of claim 1 , wherein identifying the target recipient includes identifying the target recipient from a plurality of virtual display areas in the shared virtual environment, each of the plurality of virtual display areas being configured to receive a virtual item for display, the method further comprising:

detecting the attractive force associated with each of the plurality of display areas based on a comparison of at least one characteristic of the selected virtual item and at least one characteristic of the respective virtual display area, the at least one characteristic of the respective virtual display area including at least one of a virtual size of the virtual display area, a virtual orientation of the virtual display area, or a virtual texture of the of the virtual display area;

identifying a target display area of the plurality of virtual display areas as the target recipient for display of the selected virtual item based on the projected virtual trajectory for the selected virtual item and the attractive force associated with each of the plurality of virtual display areas; and

displaying content of the selected virtual item at the target display area identified as the target recipient.

11. The method of claim 10 , wherein displaying the content of the selected virtual item at the target display area identified as the target recipient includes at least one of:

re-sizing a virtual item previously displayed at the target display area identified as the target recipient to accommodate display of the selected virtual item at the target display area identified as the target recipient; or

eliminating a virtual item previously displayed at the target display area identified as the target recipient to accommodate display of the selected virtual item at the target display area identified as the target recipient.

12. The method of claim 1 , wherein identifying the target recipient includes identifying the target recipient from a plurality of virtual storage areas in the shared virtual environment, each of the plurality of virtual storage areas being configured to receive a virtual item for storage, the method further comprising:

detecting the respective attractive force associated with each of the plurality of virtual storage areas based on a comparison of at least one characteristic of the selected virtual item and at least one characteristic of the respective virtual storage area, the at least one characteristic of the respective virtual storage area including at least one of an item classification type, a share setting, or a designated destination;

identifying a target storage area of the plurality of virtual storage areas to receive the selected virtual item based on the projected virtual trajectory for the selected virtual item and the respective attractive force associated with each of the plurality of virtual storage areas; and

sharing the content of the selected virtual item in the target storage area identified as the target recipient.

13. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared augmented reality environment by a selection device in virtual contact with the selected virtual item, the selected virtual item representing a virtual event;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user in the ambient environment, interacting in the shared augmented reality environment;

identifying a target recipient for the selected virtual item in the shared augmented reality environment, the target recipient corresponding to a second user in the ambient environment, interacting in the shared augmented reality environment, the identifying the target recipient including:

detecting at least one possible recipient in the shared augmented reality environment;

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and an attractive force associated with the at least one possible recipient; and

sharing access to the selected virtual event represented by the selected virtual item with the identified target recipient.

14. The method of claim 13 , wherein

detecting the at least one possible recipient includes detecting the at least one possible recipient from a plurality of possible recipients in the shared augmented reality environment, and

identifying the target recipient includes identifying the target recipient based on the projected virtual trajectory and the respective attractive forces associated with each of the plurality of possible recipients in the shared augmented reality environment.

15. The method of claim 14 , wherein identifying the target recipient includes detecting the attractive forces associated with each of the plurality of possible recipients based on at least one of:

an established association between the first user and each of the plurality of possible recipients;

a request for sharing of the content of the virtual item received by the first user from one or more of the plurality of possible recipients; or

a sharing history of the first user with one or more of the plurality of possible recipients.

16. The method of claim 14 , further comprising tracking movement of the selection device in virtual contact with the selected virtual item, including:

tracking a six degree of freedom movement of a hand of the first user through a throwing movement of the hand of the user;

projecting the virtual trajectory for the selected virtual item based on the tracked throwing movement of the hand of the first user; and

identifying the intended target recipient based on an extension of the projected virtual trajectory to one of a plurality of possible recipients.

17. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared augmented reality environment by a selection device in virtual contact with the selected virtual item;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user in the ambient environment, interacting in the shared augmented reality environment;

identifying a target recipient for the selected virtual item in the shared augmented reality environment, the target recipient corresponding to a second user interacting in the shared augmented reality environment, the identifying the target recipient including:

detecting at least one possible recipient in the shared environment;

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and an attractive force associated with the at least one possible recipient; and

sharing the selected virtual item, selected from the shared augmented reality environment, with the identified target recipient, including sharing content associated with the selected virtual item for further action by the identified target recipient.

18. The method of claim 17 , wherein sharing the content associated with the selected virtual item includes at least one of:

superimposing a virtual image of the selected virtual item on the identified target recipient;

suggesting the selected virtual item to the identified target recipient for consideration by the identified target recipient; or

sharing purchase information for the selected virtual item with the identified target recipient.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2019
From: CLEMENT, MANUEL CHRISTIAN; WELKER, STEFAN
To: GOOGLE INC.
Reel/Frame 048376/0855 →
Continuity (3)
Continuation 15386614 · Dec 21, 2016
Provisional Application 62332314 · May 5, 2016
Related Publication 20190182355A1 · Jun 13, 2019
Cited By (5)
US 12,283,121 US 12,354,031 US 12,373,160 US 12,654,326 US 12,670,461