IP Library Patent Application 14144370
Patent Application
App. No. 14/144,370

ASSIGNING A VIRTUAL USER INTERFACE TO A PHYSICAL OBJECT

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/144,370
Abstract

A system and method for assigning a virtual user interface to a physical object is described. A virtual user interface for a physical object is created at a machine. The machine is trained to associate the virtual user interface with identifiers of the physical object and tracking data related to the physical object. The virtual user interface is displayed in relation to the image of the physical object.

Claims (72)

1 . A machine comprising:

a processor comprising an augmented reality application, the augmented reality application having:

a virtual user interface creation module configured to create a virtual user interface; and

a virtual user interface assigning module configured to associate the virtual user interface with identifiers of a physical object and tracking data related to the physical object, the virtual user interface displayed in relation to an image of the physical object.

2 . The machine of claim 1 , wherein the virtual user interface comprises a menu of information identifying the physical object.

3 . The machine of claim 1 , wherein the virtual user interface comprises interactive virtual functions associated with functions of the physical object.

4 . The machine of claim 1 , wherein the virtual user interface creation module is configured to create the virtual user interface from a selection of templates of virtual interfaces of similar physical objects.

5 . The machine of claim 1 , wherein the virtual user interface creation module is configured to create a custom virtual user interface.

6 . The machine of claim 1 , wherein the machine is a viewing device comprising:

a physical object identifier module configured to generate identifiers of the physical object comprising feature points of the physical object,

wherein the tracking data comprise a location of the physical object, a location of the viewing device viewing the physical object, an orientation of the viewing device, and a distance between the location of the viewing device and the location of the physical object.

7 . The machine of claim 6 , wherein the viewing device comprises:

an optical device configured to capture the image of the physical object;

a virtual user interface displaying module configured to:

determine the identifiers of the physical object and tracking data using the image of the physical object,

identify the physical object based on the identifiers of the physical object and tracking data, and

retrieve the virtual user interface associated with the physical object; and

a display configured to display the retrieved virtual user interface in relation to the image of the physical object.

8 . The machine of claim 7 , wherein the viewing device comprises:

a display in a mobile communication device hand held by a user or a transparent display mounted to a head of the user;

a plurality of sensors configured to determine a location and an orientation of the viewing device relative to the physical object in a physical environment local to the viewing device,

wherein the location includes a geographic location determined based on wireless data generated by the viewing device or triangulated from predefined references of the physical environment,

wherein the orientation is determined based on gyroscope data from the viewing device or is externally determined using a three-dimensional camera sensor.

9 . The machine of claim 1 , wherein the machine is a server comprising:

a storage device configured to store a database of virtual user interfaces and corresponding identifiers of physical objects and tracking data related to physical objects; and

a physical object detector module configured to:

receive the identifiers of the physical object and tracking data from a viewing device,

identify the physical object based on the identifiers of the physical object and tracking data and the database of identifiers of physical objects and tracking data related to the physical objects, and

retrieve the virtual user interface associated with the identified physical object.

10 . The machine of claim 1 , wherein the machine is a server comprising:

a storage device configured to store a database of virtual user interfaces and corresponding identifiers of physical objects and tracking data related to physical objects; and

a physical object detector module configured to:

receive the image of the physical object and tracking data from a viewing device,

generate feature points in the image of the physical object and tracking data from the viewing device;

identify the physical object based on the generated feature points of the image of the physical object and tracking data and the database of identifiers of physical objects and tracking data related to physical objects, and

retrieve the virtual user interface associated with the identified physical object.

11 . A method comprising:

creating a virtual user interface for a physical object with a viewing device; and

training the viewing device to associate the virtual user interface with identifiers of the physical object and tracking data related to the physical object, the virtual user interface displayed in relation to an image of the physical object.

12 . The method of claim 11 , wherein the virtual user interface comprises a menu of information identifying the physical object.

13 . The method of claim 11 , wherein the virtual user interface comprises interactive virtual functions associated with functions of the physical object.

14 . The method of claim 11 , further comprising:

creating the virtual user interface from a selection of templates of virtual interfaces of similar physical objects.

15 . The method of claim 11 , further comprising:

creating a custom virtual user interface.

16 . The method of claim 11 , further comprising:

generating identifiers of the physical object comprising feature points of the physical object,

wherein the tracking data comprise a location of the physical object, a location of the viewing device viewing the physical object, an orientation of the viewing device, and a distance between the location of the viewing device and the location of the physical object.

17 . The method of claim 16 , further comprising:

capturing the image of the physical object;

determining a location and an orientation of the viewing device relative to the physical object in a physical environment local to the viewing device;

determining the identifiers of the physical object and tracking data using the image of the physical object;

identifying the physical object based on the identifiers of the physical object and tracking data;

retrieving the virtual user interface associated with the physical object; and

generating, in a display of the viewing device, the retrieved virtual user interface in relation to the image of the physical object,

wherein the location includes a geographic location determined based on wireless data generated by the viewing device or triangulated from predefined references of the physical environment,

wherein the orientation is determined based on gyroscope data from the viewing device or is externally determined using a three-dimensional camera sensor,

wherein the display comprises a transparent display mounted to a head of a user.

18 . The method of claim 11 , further comprising:

storing a database of virtual user interfaces and corresponding identifiers of physical objects and tracking data related to physical objects;

receiving the identifiers of the physical object and tracking data from the viewing device at a server;

identifying, at the server, the physical object based on the identifiers of the physical object and tracking data and the database of identifiers of physical objects and tracking data related to the physical objects; and

retrieving, from the server, the virtual user interface associated with the identified physical object.

19 . The method of claim 11 , further comprising:

storing a database of virtual user interfaces and corresponding identifiers of physical objects and tracking data related to physical objects;

receiving the image of the physical object and tracking data from the viewing device;

generating feature points in the image of the physical object and tracking data from the viewing device at a server;

identifying, at the server, the physical object based on the identifiers of the physical object and tracking data and the database of identifiers of physical objects and tracking data related to the physical objects; and

retrieving, from the server, the virtual user interface associated with the identified physical object.

20 . A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

creating a virtual user interface for a physical object at a viewing device; and

training the viewing device to associate the virtual user interface with identifiers of the physical object and tracking data related to the physical object, the virtual user interface displayed in the viewing device in relation to an image of the physical object.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2014
From: MULLINS, BRIAN
To: DAQRI, LLC
Reel/Frame 034305/0932 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2014
From: MULLINS, BRIAN
To: DAQRI, LLC
Reel/Frame 033546/0733 →