IP Library › Granted Patent US 9,210,401
Granted Patent B2
US 9,210,401 · App. 13/463,585 · Granted Dec 8, 2015

Projected visual cues for guiding physical movement

Inventors: Andrew Wilson (Seattle, WA); Hrvoje Benko (Seattle, WA); Rajinder Sodhi (Champaign, IL)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
H04N13/004G06F3/017G06F19/3481G06K9/00355G09B19/003H04N9/3147H04N9/3185A63B69/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,210,401
App. No.
13/463,585
Granted
Dec 8, 2015
Kind
B2
Abstract

Physical movement of a human subject may be guided by a visual cue. A physical environment may be observed to identify a current position of a body portion of the human subject. A model path of travel may be obtained for the body portion of the human subject. The visual cue may be projected onto the human subject and/or into a field of view of the human subject. The visual cue may indicate the model path of travel for the body portion of the human subject.

Claims (42)

1. A method of guiding physical movement of a human subject, the method comprising:

observing, via one or more cameras, a physical environment;

identifying, with a computing device configured to process image data from the camera, a current three-dimensional position of a body portion of a human subject within the physical environment;

obtaining, with the computing device, a model path of future travel for the body portion of the human subject; and

projecting, via an image projector, a visual cue onto the human subject at the current three-dimensional position of the body portion, the visual cue indicating the model path of future travel for the body portion of the human subject.

2. The method of claim 1 , wherein the visual cue further indicates how the human subject's previous physical movements tracked a model path of travel.

3. The method of claim 1 , wherein the visual cue indicates the model path of future travel by showing how the human subject's future physical movements can mimic the model path of travel.

4. The method of claim 1 , wherein the visual cue indicates the model path of future travel by showing a deviation between the current position of the body portion and a model position along the model path of future travel.

5. The method of claim 4 , further comprising:

determining one or both of a magnitude and a direction of the deviation between the current position of the body portion and the model position along the model path of future travel;

wherein the visual cue indicates one or both of the magnitude and the direction of the deviation.

6. The method of claim 1 , wherein projecting the visual cue onto the human subject includes projecting the visual cue onto the body portion of the human subject.

7. The method of claim 1 , wherein the model path of future travel is a multi-dimensional model path of travel.

8. The method of claim 1 , wherein the visual cue includes a visual representation of a multi-dimensional directional indicator.

9. The method of claim 1 , wherein the visual cue includes a directional indicator that guides the body portion of the human subject toward or along the model path of future travel.

10. The method of claim 1 , wherein the visual cue includes one or more colors that indicate the current position of the body portion relative to the model path of future travel.

11. The method of claim 1 , wherein the visual cue directs the body portion of the human subject toward the model path of future travel by:

directing the body portion toward a future model position of the model path of travel; or

directing the body portion along a parallel model path of travel offset from the model path of future travel.

12. The method of claim 1 , wherein the visual cue indicates the model path of future travel by following the model path of future travel.

13. The method of claim 1 further comprising:

updating the current position of the body portion of the human subject over time as the body portion moves within the physical environment; and

varying a spatial parameter of projection of the visual cue as the body portion moves within the physical environment to maintain projection of the visual cue within a boundary of the body portion.

14. A computer comprising:

a depth-camera input to receive depth-camera information from a depth camera;

an image-projector output to send projector information to an image projector;

a processor operatively connected to the depth-camera input and to the image-projector output;

a storage device holding instructions executable by the processor to:

identify, from the depth-camera information, a current three-dimensional position of a body portion of a human subject imaged by the depth camera;

obtain a model path of future travel for the body portion of the human subject; and

project a visual cue via the image projector onto the human subject at the current three-dimensional position, the visual cue indicating the model path of future travel for the body portion of the human subject.

15. The storage device of claim 14 , wherein the visual cue further indicates how the human subject's previous physical movements tracked the model path of travel.

16. The storage device of claim 14 , wherein the visual cue indicates the model path of future travel by showing how the human subject's future physical movements can mimic the model path of future travel.

17. The storage device of claim 14 , wherein the visual cue includes a visual representation of the model path of future travel.

18. The storage device of claim 14 , wherein the visual cue includes one or more of a directional indicator indicating a deviation between the current position of the body portion and a model position along the model path of future travel.

19. The storage device of claim 14 , wherein the visual cue includes one or more colors indicating a deviation between the current position of the body portion and a model position along the model path of future travel.

20. A method of guiding physical movement of a human subject, the method comprising:

identifying, with a computing device configured to process image data from a camera, a current three-dimensional position of a body portion of a human subject within a physical environment;

obtaining a multi-dimensional model path of future travel for the body portion of the human subject; and

projecting a visual cue onto the body portion at the current three-dimensional position via one or more image projectors, the visual cue including:

a visible light portion that indicates a first direction of movement for the body portion toward or along the model path of future travel in a first plane, and

a directional indicator that indicates a second direction of movement for the body portion toward or along the model path of future travel perpendicular to the first plane.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2012
From: WILSON, ANDREW; BENKO, HRVOJE; SODHI, RAJINDER
To: MICROSOFT CORPORATION
Reel/Frame 028153/0972 →
Continuity (1)
Related Publication 20130295539A1 · Nov 7, 2013