IP Library Granted Patent US 10,169,384
Granted Patent B2
US 10,169,384 · App. 15/253,944 · Granted Jan 1, 2019

Augmented reality model comparison and deviation detection

Inventors: Eli M. Dow (Wappingers Falls, NY); Erin M. Farr (Fishkill, NY); Michael E. Gildein, II (Wappingers Falls, NY); Moses J. Vaughan (Mahwah, NJ)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F17/30321G06F17/30256G06F17/30294G06F17/30477G06K9/00671G06T19/006G06T7/408G06T7/602
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,169,384
App. No.
15/253,944
Granted
Jan 1, 2019
Kind
B2
Abstract

An aspect of providing augmented reality model comparison and deviation detection includes receiving a three-dimensional (3D) model of an object that is associated with a domain, determining a set of characteristics of the object from the 3D model, and searching a domain-specific database for data matching the set of characteristics. The domain-specific database corresponds to the domain associated with the object. An aspect also includes determining an identification of the object from data in the domain-specific database that matches the set of characteristics. For each characteristic in the set of characteristics, and aspect further includes comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database, and calculating any variation between the corresponding value of the characteristic and the value of the matching data. Another aspect includes creating a searchable index of the matching data and corresponding variations.

Claims (79)

1. A method, comprising:

detecting, using at least one electronic sensor, an object associated with a domain;

receiving a three-dimensional (3D) model of the object;

determining, by a computer processor, a set of characteristics of the object from the 3D model;

searching a domain-specific database for data matching the set of characteristics, the domain-specific database corresponding to the domain associated with the object;

determining an identification of the object from data in the domain-specific database that matches the set of characteristics, the identification determined using an image detection technique;

for each characteristic in the set of characteristics:

comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database; and

calculating any variation between the corresponding value of the characteristic and the value of the matching data;

creating, by the computer processor, a searchable index of the matching data and corresponding variations;

receiving a request as to how the variations affect at least one of a monetary value of the object, a safety of the object, and a compliance regulation corresponding to the object;

mapping the variations stored in the searchable index to at least one of the monetary value of the object, the safety of the object, and the compliance regulation corresponding to the object;

generating an indicator that indicates a degree of the variation with respect to at least one of the monetary value, the safety, and the compliance regulation; and

displaying, on a display device, the indicator in relation to the object so as to generate an augmented image showing the degree of the variation with respect to the object,

wherein receiving the request comprises:

receiving a request for a monetary value corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristics and corresponding variation; and

submitting a query to a data source, the query including the characteristics and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object;

wherein the monetary value reflects one of an increase in value of the object and a decrease in value of the object based on a type and the degree of the variation.

2. The method of claim 1 , wherein the domain-specific database is a product specification database, and the object is a product created by a manufacturer.

3. The method of claim 1 , wherein the set of characteristics includes conditioning.

4. The method of claim 1 , wherein the object is a building structure, the method further comprising:

receiving a request for compliance data corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristic and corresponding variation; and

submitting a query to a data source, the query including the characteristic and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object, the data source storing building regulation codes;

wherein the compliance data includes an indicator of compliance of the variation based on the building regulation codes.

5. The method of claim 1 , wherein the set of characteristics includes at least one of dimensions and colors.

6. The method of claim 1 , wherein the values include at least one of size, shape, proportion, and gradient.

7. A system, comprising:

a memory having computer readable instructions; and

a processor for executing the computer readable instructions, the computer readable instructions including:

an electronic sensor configured to detect an object associated with a domain;

receiving a three-dimensional (3D) model of the object;

determining a set of characteristics of the object from the 3D model;

searching a domain-specific database for data matching the set of characteristics, the domain-specific database corresponding to the domain associated with the object;

determining an identification of the object from data in the domain-specific database that matches the set of characteristics, the identification determined using an image detection technique;

for each characteristic in the set of characteristics:

comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database;

calculating any variation between the corresponding value of the characteristic and the value of the matching data; and

creating a searchable index of the matching data and corresponding variations;

receiving a request as to how the variations affect at least one of a monetary value of the object, a safety of the object, and a compliance regulation corresponding to the object;

mapping the variations stored in the searchable index to at least one of the monetary value of the object, the safety of the object, and the compliance regulation corresponding to the object; and

generating an indicator that indicates a degree of the variation with respect to at least one of the monetary value, the safety, and the compliance regulation; and

displaying, on a display device, the indicator in relation to the object so as to generate an augmented image showing the degree of the variation with respect to the object,

wherein the receiving request further comprises:

receiving a request for a monetary value corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristics and corresponding variation; and

submitting a query to a data source, the query including the characteristics and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object;

wherein the monetary value reflects one of an increase in value of the object and a decrease in value of the object based on a type and the degree of the variation.

8. The system of claim 7 , wherein the domain-specific database is a product specification database, and the object is a product created by a manufacturer.

9. The system of claim 7 , wherein the set of characteristics includes conditioning.

10. The system of claim 7 , wherein the object is a building structure, the computer readable instructions further comprise:

receiving a request for compliance data corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristic and corresponding variation; and

submitting a query to a data source, the query including the characteristic and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object, the data source storing building regulation codes;

wherein the compliance data includes an indicator of compliance of the variation based on the building regulation codes.

11. The system of claim 7 , wherein the set of characteristics includes at least one of dimensions and colors.

12. The system of claim 7 , wherein the values include at least one of size, shape, proportion, and gradient.

13. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a computer processor to cause the computer processor to perform a method comprising:

detecting, via at least one electronic sensor, an object associated with a domain;

receiving a three-dimensional (3D) model of the object;

determining a set of characteristics of the object from the 3D model;

searching a domain-specific database for data matching the set of characteristics, the domain-specific database corresponding to the domain associated with the object;

determining an identification of the object from data in the domain-specific database that matches the set of characteristics, the identification determined using an image detection technique;

for each characteristic in the set of characteristics:

comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database;

calculating any variation between the corresponding value of the characteristic and the value of the matching data;

creating a searchable index of the matching data and corresponding variations;

receiving a request as to how the variations affect at least one of a monetary value of the object, a safety of the object, and a compliance regulation corresponding to the object;

mapping the variations stored in the searchable index to at least one of the monetary value of the object, the safety of the object, and the compliance regulation corresponding to the object; and

generating an indicator that indicates a degree of the variation with respect to at least one of the monetary value, the safety, and the compliance regulation; and

displaying, on a display device, the indicator in relation to the object so as to generate an augmented image showing the degree of the variation with respect to the object,

wherein the receiving the request comprises:

receiving a request for a monetary value corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristics and corresponding variation; and

submitting a query to a data source, the query including the characteristics and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object;

wherein the monetary value reflects one of an increase in value of the object and a decrease in value of the object based on a type and the degree of the variation.

14. The computer program product of claim 13 , wherein the domain-specific database is a product specification database, and the object is a product created by a manufacturer.

15. The computer program product of claim 13 , wherein the set of characteristics includes conditioning.

16. The computer program product of claim 13 , wherein the object is a building structure, the program instructions are further executable to implement:

receiving a request for compliance data corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristic and corresponding variation; and

submitting a query to a data source, the query including the characteristic and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object, the data source storing building regulation codes;

wherein the compliance data includes an indicator of compliance of the variation based on the building regulation codes.

17. The computer program product of claim 13 , wherein the set of characteristics includes at least one of dimensions and colors.

Assignments (7)
SECURITY AGREEMENT Recorded May 20, 2026
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 075591/0399 →
SECURITY INTEREST Recorded Nov 10, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 073514/0326 →
SECURITY AGREEMENT Recorded Mar 13, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 070513/0542 →
SECURITY AGREEMENT Recorded Oct 10, 2024
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 069143/0399 →
SECURITY AGREEMENT Recorded Mar 24, 2021
From: WAYFAIR LLC
To: CITIBANK, N.A.
Reel/Frame 055708/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: WAYFAIR LLC
Reel/Frame 050867/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2016
From: DOW, ELI M.; FARR, ERIN M.; GILDEIN, MICHAEL E., II; VAUGHAN, MOSES J.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039610/0676 →
Continuity (2)
Continuation 14950152 · Nov 24, 2015
Related Publication 20170147619A1 · May 25, 2017