IP Library Granted Patent US 10,636,197
Granted Patent B2
US 10,636,197 · App. 16/135,214 · Granted Apr 28, 2020

Dynamic display of hidden information

Inventor: Anthony Mark Jones (Hillsboro, OR)
G06T15/20G06T7/73G06T19/006G06F3/017G06T15/30G06T19/20G06T2200/24G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,636,197
App. No.
16/135,214
Granted
Apr 28, 2020
Kind
B2
Abstract

Information obscured to a user is provided through a display of a hybrid-reality system (DHR), such as a head-mounted display (HMD). A view position relative to a real-world object is established, the real-world object at least partially occluding a view of an occluded object. First data providing information about a first position, at a first time, of at least a moveable portion of an occluded object is received and a first image of at least the moveable portion of the occluded object in the first position is then rendered on the display. Second data providing information about a second position, at a second time, of the moveable portion of the occluded object is then received, and a second image of at least the moveable portion of the occluded object in the second position is rendered on the display to replace the first image.

Claims (50)

1. A method to provide information obscured to a user through a display of a hybrid-reality system (DHR), the method comprising:

establishing a view position for the DHR relative to a first real-world object;

receiving first data associated with an occluded object at the hybrid-reality system from a separate device over a computer network, the first data providing information about a first position, at a first time, of at least a moveable portion of the occluded object that is hidden from the view position by a surface of the first real-world object at the first time, wherein the occluded object is a second real-world object or a part of the first real-world object;

presenting a first image of at least the moveable portion of the occluded object in the first position on the display using the first data;

receiving second data associated with the occluded object at the hybrid-reality system from the separate device over the computer network, the second data providing information about a second position, at a second time, of the moveable portion of the occluded object; and

presenting a second image of at least the moveable portion of the occluded object in the second position on the display to replace the first image using the second data.

2. The method of claim 1 , wherein the second data indicates that the moveable portion of the occluded object is hidden from the view position by the surface of the real world object at the second time.

3. The method of claim 1 , wherein the second data indicates that the moveable portion of the occluded object is visible from the view position at the second time.

4. The method of claim 1 , further comprising:

creating a window on the display positioned to at least partially occlude a view of the real-world object, the window smaller than the display; and

rendering the second image into the window consistent with a real-world position of the occluded object relative to the view position.

5. The method of claim 1 , further comprising:

receiving first sensor data from a sensor included in the occluded object, the first data comprising the first sensor data;

determining the first position of the moveable portion of the occluded object based on the first sensor data;

receiving second sensor data from the sensor, the second data comprising the second sensor data; and

determining the second position of the moveable portion of the occluded object based on the second sensor data.

6. The method of claim 1 , further comprising:

receiving first sensor data from a sensor separate from the occluded object and the hybrid-reality system, the first data comprising the first sensor data;

determining the first position of the moveable portion of the occluded object based on the first sensor data;

receiving second sensor data from the sensor, the second data comprising the second sensor data; and

determining the second position of the moveable portion of the occluded object based on the second sensor data.

7. The method of claim 1 , wherein the moveable portion of the occluded object is under control of a user of the hybrid-reality system.

8. The method of claim 7 , further comprising providing guidance to the user on where to move the moveable portion of the occluded object.

9. The method of claim 1 , wherein the occluded object is associated with a body part of a user of the hybrid-reality system.

10. The method of claim 1 , further comprising:

receiving sensor data from a sensor, the sensor data providing information about a third position of a second object; and

determining the second position of the moveable portion of the occluded object based, at least in part, on the third position of the second object.

11. The method of claim 10 , wherein the second object is separate from the occluded object.

12. The method of claim 10 , wherein the second object is coupled to the occluded object.

13. The method of claim 10 , wherein the second object, at least in part, moves the moveable portion of the occluded object.

14. The method of claim 10 , further comprising:

storing the sensor data; and

computing the second position based, at least in part, on previously stored sensor data.

15. The method of claim 1 , wherein the first data comprises first image data and the first image is created using the first image data, and the second data comprises second image data and the second image is created using the second image data.

16. An article of manufacture comprising a tangible medium, that is not a transitory propagating signal, encoding computer-readable instructions that, when applied to a computer system, instruct the computer system to perform a method comprising:

establishing a view position for a display of a hybrid-reality system relative to a first real-world object;

receiving first data associated with an occluded object at the hybrid-reality system from a separate device over a computer network, the first data providing information about a first position, at a first time, of at least a moveable portion of the occluded object that is hidden from the view position by a surface of the first real-world object at the first time, wherein the occluded object is a second real-world object or a part of the first real-world object;

presenting a first image of at least the moveable portion of the occluded object in the first position on the display using the received data;

receiving second data associated with the occluded object at the hybrid-reality system from the separate device over the computer network, the second data providing information about a second position, at a second time, of the moveable portion of the occluded object; and

presenting a second image of at least the moveable portion of the occluded object in the second position on the display to replace the first image.

17. A hybrid-reality system comprising:

a display;

a structure, coupled to the display and adapted to position the display in a field-of-view (FOV) of the user;

a network interface; and

a processor, coupled to the display and the network interface, the processor configured to:

establish a view position for the display relative to a real-world object;

receive first data associated with an occluded object at the hybrid-reality system from a separate device over a computer network, the first data providing information about a first position, at a first time, of at least a moveable portion of the occluded object that is hidden from the view position by a surface of the first real-world object at the first time, wherein the occluded object is a second real-world object or a part of the first real-world object;

present a first image of at least the moveable portion of the occluded object in the first position on the display using the first data;

receive second data associated with the occluded object at the hybrid-reality system from the separate device through the network interface, the second data providing information about a second position, at a second time, of the moveable portion of the occluded object; and

present a second image of at least the moveable portion of the occluded object in the second position on the display to replace the first image using the second data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2018
From: JONES, JESSICA AF; JONES, ANTHONY MARK; YOUNG, BRUCE A
To: CURIOUS COMPANY, LLC
Reel/Frame 047150/0934 →
Continuity (2)
Continuation 16123543 · Sep 6, 2018
Related Publication 20200082602A1 · Mar 12, 2020