IP Library Granted Patent US 10,416,946
Granted Patent B1
US 10,416,946 · App. 16/425,786 · Granted Sep 17, 2019

Wearable computer using programmed local tag

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,416,946
App. No.
16/425,786
Granted
Sep 17, 2019
Kind
B1
Abstract

A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device from a programmed local tag. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

Claims (36)

1. A method for displaying user interfaces via a head-mounted display (HMD), the method comprising:

capturing images of a location within a real-world environment via a camera, the captured images corresponding to a field of view of the HMD;

identifying a predefined target area at the location within the real-world environment based on an analysis of the captured images, wherein the identified target area is associated with preprogrammed data;

generating a mixed display on the HMD in accordance with the preprogrammed data, wherein at least one virtual interface image is superimposed over the field of view of the real-world environment at the location of the identified target area;

detecting movement of the HMD, wherein the detected movement moves the field of view of the HMD relative to the real-world environment; and

updating the mixed display on the HMD based on the detected movement, wherein the at least one virtual interface image appears affixed to the location of the identified target area within the real-world environment.

2. The method of claim 1 , wherein the identified target area corresponds to an object located in the real-world environment.

3. The method of claim 1 , further comprising directing the mixed display to a single eye of a user.

4. The method of claim 1 , wherein a size of the at least one virtual interface image is based on a distance between the HMD and the predefined target area.

5. The method of claim 1 , wherein at least one other virtual interface image remains within a field of view of the HMD when the HMD is moved.

6. The method of claim 1 , wherein the at least one virtual interface image includes one or more interface elements each corresponding to a different action executable by the HMD.

7. The method of claim 6 , further comprising receiving user input indicating a selection of at least one of the interface elements.

8. The method of claim 7 , wherein receiving the user input includes capturing a gesture by the camera.

9. The method of claim 7 , wherein receiving the user input includes capturing a voice command by a microphone.

10. A wearable computing device for displaying user interfaces via a head-mounted display (HMD), the device comprising:

a camera that captures images of a location within a real-world environment, the captured images corresponding to a field of view of the HMD;

a controller that executes instructions stored in memory to:

identify a predefined target area at the location within the real-world environment based on an analysis of the captured images, wherein the identified target area is associated with preprogrammed data,

generate a mixed display on the HMD in accordance with the preprogrammed data, wherein at least one virtual interface image is superimposed over the field of view of the real-world environment at the location of the identified target area,

detect movement of the HMD, wherein the detected movement moves the field of view of the HMD relative to the real-world environment, and

update the mixed display on the HMD based on the detected movement, wherein the at least one virtual interface image appears affixed to the location of the identified target area within the real-world environment; and

the HMD that includes a display panel that displays the mixed display.

11. The device of claim 10 , wherein the predefined target area corresponds to an object located within the real-world environment.

12. The device of claim 10 , wherein the HMD directs the mixed display to a single eye of a user.

13. The device of claim 11 , wherein a size of the at least one virtual interface image is based on a distance between the HMD and the predefined target area.

14. The device of claim 10 , wherein at least one other virtual interface image remains within a field of view of the HMD when the HMD is moved.

15. The device of claim 10 , wherein the at least one virtual interface image includes one or more interface elements each corresponding to a different actions executable by the HMD.

16. The device of claim 15 wherein the controller further receives user input indicating a selection of at least one of the interface elements.

17. The device of claim 16 , further comprising a camera that captures the user input as a gesture.

18. The device of claim 16 , further comprising a microphone that captures the user input as a voice command.

19. A non-transitory computer-readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for displaying user interfaces via a head-mounted display (HMD), the method comprising:

capturing images of a location within a real-world environment via a camera, the captured images corresponding to a field of view of a head-mounted display HMD;

identifying a predefined target area at the location within the real-world environment based on an analysis of the captured images, wherein the identified target area is associated with preprogrammed data;

generating a mixed display on the HMD in accordance with the preprogrammed data, wherein at least one virtual interface image is superimposed over the field of view of the real-world environment at the location of the identified target area;

detecting movement of the HMD, wherein the detected movement moves the field of view of the HMD relative to the real-world environment; and

updating the mixed display on the HMD based on the detected movement, wherein the at least one virtual interface image appears affixed to the location of the identified target area within the real-world environment.

Assignments (4)
MERGER Recorded Mar 30, 2020
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 053323/0567 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2019
From: CRONIN, JOHN
To: IPCREATE, INC.
Reel/Frame 049930/0925 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2019
From: IPCREATE, INC.
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 049931/0268 →
CHANGE OF NAME Recorded Aug 1, 2019
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 049933/0607 →