IP Library › Granted Patent US 8,487,927
Granted Patent B2
US 8,487,927 · App. 12/122,731 · Granted Jul 16, 2013

Validating user generated three-dimensional models

Inventors: Eyal Ofek (Redmond, WA); Pragyana Mishra (Kirkland, WA)
Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,487,927
App. No.
12/122,731
Granted
Jul 16, 2013
Kind
B2
Abstract

Three-dimensional model validation. As a part of the model validation, one or more three-dimensional models of a structure and at least one real world image of the structure is accessed. Features of the one or more three-dimensional models of the structure are combined with features of the at least one real world image of the structure to create a composite model of the structure. The composite model is projected into an imaging plane. The composite model of the structure is compared with at least one of the at least one real world images. Based on the results of the comparing, the accuracy of the one or more three-dimensional models of the structure is determined.

Claims (46)

1. A method for validating the accuracy of three-dimensional models, comprising:

accessing one or more three-dimensional models of a structure;

accessing at least one real world image of said structure wherein said at least one real world image has an imaging plane;

combining features of said one or more three-dimensional models of said structure with features of said at least one real world image of said structure to create a composite model of said structure wherein said composite model comprises features of a three-dimensional model of said structure and features of a real world image of said structure;

projecting said composite model into said imaging plane of said at least one real world image;

comparing said composite model of said structure that is projected into said imaging plane of said at least one real world image with at least one of said at least one real world images; and

based on said comparing, determining the accuracy of said one or more three-dimensional models of said structure.

2. The method of claim 1 further comprising:

selecting a three-dimensional model of said one or more three-dimensional models that is most accurate; and

providing access to said three-dimensional model that is most accurate for presentation on a display.

3. The method of claim 2 wherein said selecting a three-dimensional model of said one or more three-dimensional models that is most accurate is based on image-coherence metrics.

4. The method of claim 2 further comprising verifying and selecting user-generated data for publishing on three-dimensional platforms and databases using image-coherent metrics.

5. The method of claim 2 further comprising:

providing cues and quality metrics to a three-dimensional model generating system for use in a modeling process that are based on said determining of the accuracy of said one or more three-dimensional model.

6. The method of claim 5 wherein said modeling process uses image-based metrics to contribute to the accuracy and quality of three-dimensional models.

7. The method of claim 1 wherein the geometric accuracy of said three-dimensional model is quantified base on texture-based metrics.

8. A method for three-dimensional model validation, comprising:

accessing one or more three-dimensional models of a structure and at least one real world image of said structure;

mapping features of said at least one real world image of said structure onto features of said one or more three-dimensional models of said structure to create a feature mapped model of said structure wherein said feature mapped model comprises features of a three-dimensional model of said structure and features of a real world image of said structure;

placing said feature mapped model into an imaging plane of one of said at least one real world image;

comparing said feature mapped model of said structure that is placed into the imaging plane of said at least one real world image with said one of said at least one real world image; and

based on said comparing, determining the accuracy of said one or more three-dimensional models of said structure, wherein a score is associated with said one or more three-dimensional models.

9. The method of claim 8 further comprising:

selecting a three-dimensional model of said one or more three-dimensional models based on said score; and

providing access to the selected three-dimensional model for presentation on a display.

10. The method of claim 9 wherein said selecting a three-dimensional model of said one or more three-dimensional models that is most accurate is based on image-coherence metrics.

11. The method of claim 9 further comprising:

providing cues and quality metrics to a three-dimensional model generating system for use in a modeling process that are based on said determining of the accuracy of said one or more three-dimensional model.

12. The method of claim 11 wherein said modeling process uses image-based metrics to contribute to the accuracy and quality of three-dimensional models.

13. The method of claim 8 further comprising verifying and selecting user-generated data for publishing on three-dimensional platforms and databases using image-coherent metrics.

14. The method of claim 8 wherein the geometric accuracy of said three-dimensional model is quantified base on texture-based metrics.

15. A tangible computer-readable medium having computer-executable components, comprising:

a model accessing component for accessing one or more three-dimensional models of a structure;

an image accessing component for accessing at least one real world image of said structure wherein said at least one real world image has an imaging plane;

a feature combining component for combining features of said one or more three-dimensional models of said structure with features of said at least one real world image of said structure to create a composite model of said structure wherein said composite model comprises features of a three-dimensional model of said structure and features of a real world image of said structure;

a model projecting component for projecting said composite model into said imaging plane of said at least one real world image;

a comparing component for comparing said composite model of said structure that is projected into said imaging plane of said at least one real world image with at least one of said at least one real world images; and

an accuracy determining component for determining the accuracy of said one or more three-dimensional models of said structure based on said comparing.

16. The medium of claim 15 further comprising:

a model selecting component for selecting a three-dimensional model of said one or more three-dimensional models that is most accurate.

17. The medium of claim 16 wherein said selecting a three-dimensional model of said one or more three-dimensional models that is most accurate is based on image-coherence metrics.

18. The medium of claim 16 further comprising:

an access providing component for providing access to said three-dimensional model that is most accurate to a three-dimensional model publishing platform.

19. The medium of claim 16 further comprising:

a cue providing component for providing cues and quality metrics to a three-dimensional model generating system for use in a modeling process that are based on said determining of the accuracy of said one or more three-dimensional model.

20. The medium of claim 15 wherein said determining said accuracy of said one or more three-dimensional models is based on image-coherence metrics.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034564/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2008
From: OFEK, EYAL, DR.; MISHRA, PRAGYANA, DR.
To: MICROSOFT CORPORATION
Reel/Frame 021319/0272 →
Continuity (1)
Related Publication 20090284527A1 · Nov 19, 2009