IP Library Granted Patent US 10,176,641
Granted Patent B2
US 10,176,641 · App. 15/299,247 · Granted Jan 8, 2019

Displaying three-dimensional virtual objects based on field of view

Inventors: Megan Ann Lindsay (Kirkland, WA); Michael Scavezze (Bellevue, WA); Aaron Daniel Krauss (Snoqualmie, WA); Michael Thomas (Redmond, WA); Richard Wifall (Sammamish, WA); Jeffrey David Smith (Duvall, WA); Cameron Brown (Bellevue, WA); Charlene Jeune (Redmond, WA); Cheyne Rory Quin Mathey-Owens (Seattle, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06T19/006G06F3/011G06F3/0482G06K9/6201G06T7/004G06T7/0085G06T7/20G06T7/60G06T19/20G06T2207/10028G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,176,641
App. No.
15/299,247
Granted
Jan 8, 2019
Kind
B2
Abstract

Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Claims (39)

1. On a display device comprising a camera and a display, a method comprising:

acquiring, via the camera, image data imaging an environment;

receiving a user input requesting display of a three-dimensional virtual object;

comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device by rotating the three-dimensional virtual object around an axis and comparing aspect ratios at multiple axial positions;

modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object; and

displaying the modified three-dimensional virtual object via the display.

2. The method of claim 1 , wherein the three-dimensional virtual object is a first three-dimensional virtual object, and further comprising receiving a user input requesting display of a second three-dimensional virtual object, determining that the second three-dimensional virtual object is not to be modified and displaying the second three-dimensional virtual object without modifying the second three-dimensional virtual object.

3. The method of claim 2 , wherein determining that the second three-dimensional virtual object is not to be modified comprises checking a status of a flag associated with the second three-dimensional virtual object.

4. The method of claim 2 , wherein determining that the second three-dimensional virtual object is not to be modified comprises receiving a user input requesting the second three-dimensional virtual object to not be modified.

5. The method of claim 2 , further comprising not permitting the second three-dimensional virtual model to be moved or rotated based upon determining that the second three-dimensional virtual object is not to be modified.

6. The method of claim 1 , wherein comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view comprises comparing an aspect ratio of a bounding box defined around the three-dimensional virtual object to an aspect ratio of the field of view.

7. The method of claim 1 , wherein comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view further comprises positioning the three-dimensional virtual object at a preselected virtual distance from the display device and comparing based upon the preselected virtual distance.

8. The method of claim 7 , wherein positioning the three-dimensional virtual object comprises positioning a nearest location of the three-dimensional virtual object at the preselected virtual distance from the display device.

9. The method of claim 1 , wherein comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view further comprises receiving a user input positioning the three-dimensional virtual object at a virtual distance from the display device, and comparing based upon the virtual distance.

10. The method of claim 1 , wherein modifying further comprises modifying the three-dimensional virtual object based upon a greatest aspect ratio of the aspect ratios at the multiple axial positions.

11. The method of claim 1 , further comprising obtaining the dimensional information from metadata for the three-dimensional virtual object.

12. The method of claim 1 , further comprising obtaining the dimensional information from one or more of a data table and a database.

13. A display device comprising

a camera;

a display;

a logic subsystem; and

a storage subsystem comprising instructions that are executable by the logic subsystem to:

acquire, via the camera, image data imaging an environment;

receive a user input requesting display of a three-dimensional virtual object;

compare dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device by rotating the three-dimensional virtual object around an axis and comparing aspect ratios at multiple axial positions;

modify the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object; and

display the modified three-dimensional virtual object via the display.

14. The display device of claim 13 , wherein the three-dimensional virtual object is a first three-dimensional virtual object, and wherein the instructions are further executable to receive a user input requesting display of a second three-dimensional virtual object, determining that the second three-dimensional virtual object is not to be modified and displaying the second three-dimensional virtual object without modifying the second three-dimensional virtual object.

15. The display device of claim 13 , wherein the instructions are executable to compare the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view by positioning the three-dimensional virtual object at a preselected virtual distance from the display device and comparing based upon the preselected virtual distance.

16. The display device of claim 13 , wherein the instructions are executable to compare the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view by comparing an aspect ratio of a bounding box defined around the three-dimensional virtual object to an aspect ratio of the field of view.

17. The display device of claim 13 , wherein the instructions are executable to modify the three-dimensional virtual object the three-dimensional virtual object based upon a greatest aspect ratio of the aspect ratios at the multiple axial positions.

18. A computer-readable memory device comprising instructions that are executable by a computing device comprising a camera and a display to:

acquire, via the camera, image data imaging an environment;

receive a user input requesting display of a three-dimensional virtual object;

compare dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device by rotating the three-dimensional virtual object around an axis and comparing aspect ratios at multiple axial positions;

modify the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object; and

display the modified three-dimensional virtual object via the display.

19. The computer-readable memory device of claim 18 , wherein the instructions are executable to compare the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view by comparing an aspect ratio of a bounding box defined around the three-dimensional virtual object to an aspect ratio of the field of view.

20. The computer-readable memory device of claim 18 , wherein the instructions are executable to modify the three-dimensional virtual object the three-dimensional virtual object based upon a greatest aspect ratio of the aspect ratios at the multiple axial positions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2018
From: LINDSAY, MEGAN ANN; SCAVEZZE, MICHAEL; KRAUSS, AARON DANIEL; THOMAS, MICHAEL; WIFALL, RICHARD; SMITH, JEFFREY DAVID; BROWN, CAMERON; JEUNE, CHARLENE; MATHEY-OWENS, CHEYNE RORY QUIN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 047460/0322 →
Continuity (2)
Provisional Application 62311324 · Mar 21, 2016
Related Publication 20170270715A1 · Sep 21, 2017
Cited By (2)
US 12,609,119 US 12,705,841