IP Library Granted Patent US 9,753,687
Granted Patent B1
US 9,753,687 · App. 14/460,282 · Granted Sep 5, 2017

Wearable computer using programmed local tag

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,753,687
App. No.
14/460,282
Granted
Sep 5, 2017
Kind
B1
Abstract

A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device from a programmed local tag. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

Claims (52)

1. A method for using a wearable computing device within an environment, the method comprising:

locating a programmed local tag of a target device within the environment of the wearable computing device, wherein the wearable computing device comprises a head-mounted display (HMD), wherein the HMD provides a field of view in which at least a portion of the environment is viewable, and wherein the HMD displays images superimposed over the field of view;

augmenting the field of view based on target device information from the programmed local tag of the target device, wherein augmenting the field of view based on the target device information comprises controlling how the target device information from the programmed local tag is displayed by the HMD, wherein controlling how the target device information from the programmed local tag is displayed by the HMD comprises:

identifying a defined area of the target device viewable within the field of view,

displaying the target device information from the programmed local tag within the identified defined area, and

superimposing a virtual control interface as an image over at least part of the identified defined area of the target device in the field of view;

receiving user input relative to the virtual control interface;

generating instructions for the target device to perform one or more action based on the received user input; and

transmitting the generated instructions from the wearable computing device to the target device.

2. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of a wearable computing device comprises:

receiving a point-of-view image captured by a camera; and

identifying that the point-of-view image is associated with the programmed local tag of the target device.

3. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of the wearable computing device comprises receiving a beacon from the target device.

4. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of the wearable computing device comprises recognizing a radio frequency identification (RFID) tag on the target device.

5. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of the wearable computing device comprises recognizing an optical identification on the target device.

6. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of the wearable computing device comprises:

detecting environment information regarding the environment of the wearable computing device; and

identifying a presence of the programmed local tag of a target device based on the environment information.

7. The method of claim 1 , wherein locating a programmed local tag of a target device within the environment of the wearable computing device comprises:

detecting environment information regarding the environment of the wearable computing device;

transmitting the environment information to a server network; and

receiving an identification of the target device or the programmed local tag of the target device from the server network based on association with the environment information.

8. The method of claim 1 , further comprising retrieving the target device information from a target device database.

9. The method of claim 1 , further comprising receiving the target device information from a server network based on the located programmed local tag of the target device.

10. The method of claim 1 , further comprising recognizing the received user input relative to the virtual control interface as a control instruction for the target device.

11. The method of claim 10 , wherein transmitting the generated instructions to the target device comprises transmitting the control instruction to the target device via a wireless computing device.

12. The method of claim 10 , wherein transmitting the generated instructions to the target device comprises transmitting the control instruction to a server network for transmission to the target device.

13. A non-transitory computer-readable storage medium having embodied thereon a program executable by a processor to perform a method for using a wearable computing device within an environment, the method comprising:

locating a programmed local tag of a target device within the environment of the wearable computing device, wherein the wearable computing device comprises a head-mounted display (HMD), wherein the HMD provides a field of view in which at least a portion of the environment is viewable, and wherein the HMD displays images superimposed over the field of view;

augmenting the field of view based on target device information from the programmed local tag of the target device, wherein augmenting the field of view based on the target device information comprises controlling how the target device information from the programmed local tag is displayed by the HMD, wherein controlling how the target device information from the programmed local tag is displayed by the HMD comprises:

identifying a defined area of the target device viewable within the field of view,

displaying the target device information from the programmed local tag within the identified defined area, and

superimposing a virtual control interface as an image over at least part of the identified defined area of the target device in the field of view,

receiving user input relative to the virtual control interface;

generating instructions for the target device to perform one or more actions based on the received user input; and

transmitting the generated instructions from the wearable computing device to the target device.

14. A wearable computing device comprising:

a head-mounted display (HMD), wherein the HMD provides a field of view in which at least a portion of an environment of the wearable computing device, and wherein the HMD displays images superimposed over the field of view; and

a controller associated with the HMD, wherein the controller executes instructions stored in memory to:

locate a programmed local tag of a target device within the environment of the wearable computing device,

augment the field of view based on target device information from the programmed local tag of the target device, wherein augmenting the field of view based on the target device information comprises controlling how the target device information from the programmed local tag is displayed by the HMD, wherein controlling how the target device information from the programmed local tag is displayed by the HMD comprises:

identifying a defined area of the target device viewable within the field of view,

displaying the target device information from the programmed local tag within the identified defined area; and

superimposing a virtual control interface as an image over at least part of the identified defined area of the target device in the field of view;

receive user input relative to the virtual control interface;

generate instructions for the target device to perform one or more action based on the received user input; and

transmit the generated instructions from the wearable computing device to the target device.

15. The wearable computing device of claim 14 , further comprising a camera that captures one or more images of a portion of the environment located in front of the HMD, wherein the controller identifies that the captured images is associated with the programmed local tag of the target device.

16. The wearable computing device of 14 , further comprising a target device database, wherein the controller retrieves the target device information via the target device database.

17. The wearable computing device of claim 14 , further comprising a communication interface, wherein the controller retrieves the target device information by communicating with a server network via the communication interface.

18. The wearable computing device of claim 14 , wherein the controller further recognizes the received user input relative to the virtual control interface as a control instruction for the target device.

19. The wearable computing device of claim 18 , further comprising a communication interface, wherein the controller transmits the control instruction to the target device via the communication interface.

Assignments (6)
MERGER Recorded Mar 30, 2020
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 053323/0567 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE/RECEIVING PARTY ADDRESS PREVIOUSLY RECORDED AT REEL: 038794 FRAME: 0300. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 13, 2016
From: IPCREATE, INC.
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 039349/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2016
From: IPCREATE, INC.
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 038794/0300 →
CHANGE OF NAME Recorded May 5, 2016
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 038630/0154 →
SECURITY INTEREST Recorded Sep 25, 2015
From: IPCREATE INC.
To: EAGLE VENTURE CAPITAL, LLC
Reel/Frame 036688/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2014
From: CRONIN, JOHN
To: IPCREATE, INC.
Reel/Frame 033548/0911 →