IP Library Granted Patent US 10,747,331
Granted Patent B2
US 10,747,331 · App. 16/521,999 · Granted Aug 18, 2020

Virtual reality platform with haptic interface for interfacing with media items having metadata

Inventors: Simon Tarr (Columbia, SC); Evan Meaney (Columbia, SC)
Assignee: UNIVERSITY OF SOUTH CAROLINA
G06F3/017G06F3/014G06F3/016G06F3/0482G06F16/43
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,747,331
App. No.
16/521,999
Granted
Aug 18, 2020
Kind
B2
Abstract

Apparatuses, systems, and methods for interacting with media items in a virtual reality environment are provided. An apparatus is provided that includes processing circuitry configured to control a display of a virtual reality interface to render representations of media items returned from a query in the virtual reality environment. The processing circuitry is further configured to control the display to render metadata links between the selected metadata attribute and the representations of the media items that have the selected metadata attribute, detect, from a haptic interface, a haptic gesture to bundle and pull the metadata links to a foreground, and control the display to render representations of the media items having the selected metadata attribute in the foreground for selection.

Claims (45)

1. A system for interacting with media items in a virtual reality environment, the system comprising:

processing circuitry;

a virtual reality interface operably coupled to the processing circuitry and comprising a display and a motion sensor, wherein the display is configured to render a virtual reality environment and wherein the motion sensor is configured to detect motion of a user to modify a viewpoint into the virtual reality environment rendered by the display; and

a haptic interface device operably coupled to the processing circuitry;

wherein the processing circuitry is configured to:

control the display to render representations of media items returned from a query, the media items being associated with respective metadata attributes;

detect the motion of the user via the motion sensor and modify the viewpoint into the virtual reality environment such that a representation of a desired media item is within view;

detect, from the haptic interface, a first haptic gesture to select a metadata attribute associated with the desired media item;

control the display to render metadata links between the selected metadata attribute and the representations of the media items that have the selected metadata attribute;

detect, from the haptic interface, a second haptic gesture to bundle and pull selected metadata links to a foreground;

control the display to render representations of the media items having the selected metadata link in the foreground for selection; and

receive, at the processing circuitry, a selection of the media items that have the selected metadata links in response to detecting the second haptic gesture to bundle and pull the selected metadata links the foreground.

2. The system of claim 1 , wherein the processing circuitry is configured to control the display to render the metadata links as connecting lines between the selected metadata attribute and the representations of the media items that have the selected metadata attribute.

3. The system of claim 1 , wherein the processing circuitry is configured to detect the second haptic gesture to bundle the metadata links as comprising a detection of a hand moving from an open position to a closed position.

4. The system of claim 1 , wherein the virtual reality interface comprises a head-mounted display and the haptic interface device comprises a glove.

5. The system of claim 1 , wherein the processing circuitry is further configured to detect, from the haptic interface, a third haptic gesture to select the representation of the desired media item.

6. The system of claim 5 , wherein the processing circuitry is further configured to control the display to render the desired media item on a palette device hand display within the virtual reality environment.

7. The system of claim 6 , wherein the processing circuitry is further configured to control the display to render a plurality of metadata attributes associated with the desired media item on the palette device hand display within the virtual reality environment.

8. An apparatus for interacting with media items in a virtual reality environment, the apparatus comprising processing circuitry configured to:

control a display of a virtual reality interface to render representations of media items returned from a query in the virtual reality environment, the media items being associated with respective metadata attributes;

detect motion of a user via a motion sensor and modify the viewpoint into the virtual reality environment such that a representation of a desired media item is within view;

detect, from a haptic interface, a first haptic gesture to select a metadata attribute associated with the desired media item;

control the display to render metadata links between the selected metadata attribute and the representations of the media items that have the selected metadata attribute;

detect, from the haptic interface, a second haptic gesture to bundle and pull selected metadata links to a foreground;

control the display to render representations of the media items having the selected metadata links in the foreground for selection; and

receive, at the processing circuitry, a selection of the media items that have the selected metadata links in response to detecting the second haptic gesture to bundle and pull the selected metadata links the foreground.

9. The apparatus of claim 8 , wherein the processing circuitry is configured to control the display to render the metadata links as connecting lines between the selected metadata attribute and the representations of the media items that have the selected metadata attribute.

10. The apparatus of claim 8 , wherein the processing circuitry is configured to detect the second haptic gesture to bundle the metadata links as comprising a detection of a hand moving from an open position to a closed position.

11. The apparatus of claim 8 , wherein the virtual reality interface comprises a head-mounted display and the haptic interface device comprises a glove.

12. The apparatus of claim 8 , wherein the processing circuitry is further configured to detect, from the haptic interface, a third haptic gesture to select the representation of the desired media item.

13. The system of claim 12 , wherein the processing circuitry is further configured to control the display to render the desired media item on a palette device hand display within the virtual reality environment.

14. The system of claim 13 , wherein the processing circuitry is further configured to control the display to render a plurality of metadata attributes associated with the desired media item on the palette device hand display within the virtual reality environment.

15. A method comprising:

controlling a display of a virtual reality interface to render representations of media items returned from a query in the virtual reality environment, the media items being associated with respective metadata attributes;

detecting motion of a user via a motion sensor and modify the viewpoint into the virtual reality environment such that a representation of a desired media item is within view;

detecting, from a haptic interface, a first haptic gesture to select a metadata attribute associated with the desired media item;

controlling the display to render metadata links between the selected metadata attribute and the representations of the media items that have the selected metadata attribute;

detecting, from the haptic interface, a second haptic gesture to bundle and pull selected metadata links to a foreground;

controlling the display to render representations of the media items having the selected metadata links in the foreground for selection; and

receiving, at the processing circuitry, a selection of the media items that have the selected metadata links in response to detecting the second haptic gesture to bundle and pull the selected metadata links the foreground.

16. The method of claim 15 , further comprising controlling the display to render the metadata links as connecting lines between the selected metadata attribute and the representations of the media items that have the selected metadata attribute.

17. The method of claim 15 , further comprising detecting the second haptic gesture to bundle the metadata links as comprising a detection of a hand moving from an open position to a closed position.

18. The method of claim 15 , wherein the virtual reality interface comprises a head-mounted display and the haptic interface device comprises a glove.

19. The method of claim 15 , further comprising detecting, from the haptic interface, a third haptic gesture to select the representation of the desired media item.

20. The method of claim 19 , further comprising controlling the display to render the desired media item on a palette device hand display within the virtual reality environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2019
From: TARR, SIMON; MEANEY, EVAN
To: SOUTH CAROLINA UNIVERSITY
Reel/Frame 050064/0732 →
Continuity (2)
Provisional Application 62711161 · Jul 27, 2018
Related Publication 20200033950A1 · Jan 30, 2020