IP Library Granted Patent US 10,019,839
Granted Patent B2
US 10,019,839 · App. 15/199,480 · Granted Jul 10, 2018

Three-dimensional object scanning feedback

Inventors: Jeffrey Kohler (Redmond, WA); Shawn Crispin Wright (Sammamish, WA); Jason Bradley Scott (Bellevue, WA); John Copic (Redmond, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T17/00G02B27/017G05B19/4207G06T19/006G06T19/20G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,839
App. No.
15/199,480
Filed
Jun 30, 2016
Granted
Jul 10, 2018
Kind
B2
Art Unit
2612
USPC
345/419
Abstract

Examples of providing feedback regarding a scan of a three-dimensional object are described. In one example, a method of computer modeling a three-dimensional object includes computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning devices changes to measure different contours of the three-dimensional object from different vantage points, and assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device. The example method further includes providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

Claims (32)

1. A method of computer modeling a three-dimensional object, the method comprising:

computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device; and

providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

2. The method of claim 1 , wherein providing haptic feedback comprises decreasing one or more of an intensity and a frequency of haptic output provided by the haptic output device as the sufficiency of contour measurements increases.

3. The method of claim 1 , wherein providing haptic feedback comprises individually controlling each of a plurality of haptic actuators to provide directional haptic feedback to a user in contact with the haptic output device.

4. The method of claim 1 , wherein the haptic feedback is provided to the user directly via the scanning device.

5. The method of claim 1 , wherein the haptic feedback indicates a speed of the scanning device.

6. The method of claim 1 , wherein the haptic feedback indicates a distance of the scanning device from the three-dimensional object.

7. The method of claim 1 , further comprising providing visual feedback, via an augmented reality display, indicating the sufficiency of contour measurements.

8. The method of claim 1 , further comprising providing visual feedback, via an augmented reality display, indicating a field of view of the scanning device.

9. A method of computer modeling a three-dimensional object, the method comprising:

computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

mapping the three-dimensional pose of the scanning device to a coordinate space shared by an augmented reality display; and

displaying, via the augmented reality display, an augmented scene including an augmentation indicating a current field of view of the scanning device from a current vantage point of the scanning device.

10. The method of claim 9 , wherein the augmentation includes a frustum shape extending from the scanning device as the scanning device is viewed through a head-mounted display device.

11. The method of claim 10 , wherein the frustum shape includes two or more differently-displayed segments, each of the two or more segments extending from either the scanning device or an adjacent segment of the two or more segments and terminating at a different distance from the scanning device.

12. The method of claim 10 , wherein the augmented scene further includes a model of the three-dimensional object, the method further comprising forming and displaying portions of the model for which sufficient contour measurements are acquired.

13. The method of claim 12 , wherein one or more visual properties of the model is based at least on the sufficiency of contour measurements of associated surfaces of the three-dimensional object.

14. The method of claim 12 , wherein displaying the augmented scene comprises displaying the model of the three-dimensional object in a position that is offset from the three-dimensional object.

15. The method of claim 12 , wherein displaying the augmented scene comprises displaying the model as an overlay on the three-dimensional object.

16. The method of claim 9 , wherein the display device is a head-mounted display device.

17. A device for computer modeling a three-dimensional object, the device comprising:

an interface communicatively connected to a scanning device and an augmented reality display;

a logic machine; and

a storage machine holding instructions executable by the logic machine to:

computer-track a three-dimensional pose of the scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

map the three-dimensional pose of the scanning device to a coordinate space shared by the augmented reality display; and

display, via the augmented reality display, an augmented scene including the three-dimensional object, the scanning device, and an augmentation indicating a current field of view from a current vantage point of the scanning device.

18. The device of claim 17 , wherein the augmented reality display includes a head-mounted display (HMD) device, and wherein the augmentation is displayed as extending from the scanning device and intersecting the three-dimensional object as the scanning device and three-dimensional object are viewed through the HMD device.

19. The device of claim 18 , wherein the augmented scene further includes a model of the three-dimensional object, and wherein the instructions are further executable to form and display portions of the model based at least on a sufficiency of contour measurements of surfaces of the three-dimensional object that are scanned by the scanning device from the different vantage points.

20. The device of claim 19 , wherein the scanning device includes one or more haptic actuators, and wherein the instructions are further executable to output haptic feedback controls to the one or more haptic actuators indicating the sufficiency of contour measurements of the three-dimensional object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2018
From: KOHLER, JEFFREY; WRIGHT, SHAWN CRISPIN; SCOTT, JASON BRADLEY; COPIC, JOHN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 045907/0573 →
Continuity (1)
Related Publication 20180005433A1 · Jan 4, 2018
Cited By (1)
US 12,305,975