IP Library Granted Patent US 11,226,785
Granted Patent B2
US 11,226,785 · App. 16/396,549 · Granted Jan 18, 2022

Scale determination service

Inventors: Paul G. Allen (Mercer Island, WA); Alan Caplan (Seattle, WA); Keith Rosema (Seattle, WA); Jeffrey Alex Kramer (Redmond, WA); Richard Earl Simpkinson (Issaquah, WA)
Assignee: Vulcan Inc.
G06F3/1454G06F3/017G09G5/373G09G5/38G09G2340/045G09G2340/0464G09G2340/0492G09G2340/12G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,226,785
App. No.
16/396,549
Granted
Jan 18, 2022
Kind
B2
Abstract

An augmented reality system obtains sensor data depicting a first object in a scene. The identity of the first object is determined. The system estimates a size of the first object based on the determined identity. Based on the estimated size, the system estimates a scale of other objects depicted in the obtained sensor data. An augmented reality display is generated based at least in part on the size of a second object determined using the estimated scale.

Claims (43)

1. A system comprising:

at least one processor; and

a memory having stored thereon computer-executable instructions that, when executed by the at least one processor, cause the system to:

obtain sensor data comprising information indicative of a first object observed in a scene;

obtain information indicative of an identity of the first object, the information obtained based, at least in part, on the sensor data and a database comprising information indicative of dimensions of a plurality of objects;

obtain, from the database, a first size based at least in part on the identity of the first object; and

generate an augmented reality visualization based, at least in part, on a determination of a distance to a second object in the scene, the distance to the second object determined based, at least in part, on the first size.

2. The system of claim 1 , wherein the memory has stored thereon computer-executable instructions that, when executed by the at least one processor, cause the system to:

recognize an environmental code in the sensor data; and

obtain the identity of the first object, the identity determined based at least in part on the environmental code.

3. The system of claim 1 , wherein the first size is determined based at least in part on a size statistics for objects of the same class as the first object.

4. The system of claim 1 , wherein the memory has stored thereon computer-executable instructions that, when executed by the at least one processor, cause the system to:

obtain an estimate of importance of the second object, the estimate based at least in part on the distance to the second object.

5. The system of claim 1 , wherein the database comprises information indicative of a range of sizes associated with the first object.

6. The system of claim 1 , wherein an identity of the second object is determined based at least in part on scale information derived from the first size.

7. A computer-implemented method, comprising:

obtaining sensor data comprising information indicative of a first object in a scene;

determining an identity of the first object based, at least in part, on a database comprising information indicative of sizes of a plurality of objects;

determining a first size of the first object, the first size based at least in part on the identity of the first object;

determining, based at least in part on the first size, a distance to a second object in the scene; and

generating an augmented reality visualization based, at least in part, on the distance to the second object in the scene.

8. The computer-implemented method of claim 7 , further comprising:

determining the first size based at least in part on one or more statistics of sizes of objects sharing an identity with the first object.

9. The computer-implemented method of claim 7 , further comprising:

determining, based at least in part on the distance to the second object, an estimate of importance of the second object.

10. The computer-implemented method of claim 7 , further comprising:

determining an identity of the first object based at least in part on an environmental code recognized in the sensor data.

11. The computer-implemented method of claim 10 , wherein the environmental code is affixed to the first object.

12. The computer-implemented method of claim 7 , further comprising:

determining a scale of objects depicted in the scene, based at least in part on the first size.

13. The computer-implemented method of claim 7 , wherein the database comprises information indicative of sizes of objects falling within a class of objects.

14. The computer-implemented method of claim 7 , further comprising determining an identity of the second object, based at least in part on the second size.

15. A non-transitory computer-readable storage medium having stored thereon executable instructions that, in response to being executed by one or more processors of an augmented reality device, cause the augmented reality device to at least:

obtain sensor data comprising information indicative of a first object in a scene;

obtain information indicative of an identity of the first object based, at least in part, on a database comprising information indicative of sizes of a plurality of objects;

obtain a first size based at least in part on the identity of the first object;

obtain a distance to a second object in a scene, the distance determined based at least in part on the first size; and

generate an augmented reality visualization of the second object, based at least in part on a distance to the second object.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the first size is determined based at least in part on one or more statistics of sizes of objects sharing an identity with the first object.

17. The non-transitory computer-readable storage medium of claim 15 , wherein an estimate of importance of the second object is determined based at least in part on the second size.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the identity of the first object is determined based at least in part on an environmental code recognized in the sensor data.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the first size is determined based, at least in part, on a category of objects in which the first object belongs.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the first object comprises an environmental code.

Assignments (3)
CHANGE OF NAME Recorded Jan 27, 2025
From: VULCAN INC.
To: VULCAN LLC
Reel/Frame 070014/0049 →
CHANGE OF NAME Recorded Jan 27, 2025
From: VULCAN LLC
To: VALE GROUP LLC
Reel/Frame 070015/0137 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2020
From: ALLEN, PAUL G.; CAPLAN, ALAN; ROSEMA, KEITH; KRAMER, JEFFREY ALEX; SIMPKINSON, RICHARD EARL
To: VULCAN INC.
Reel/Frame 052135/0516 →
Continuity (2)
Provisional Application 62663995 · Apr 27, 2018
Related Publication 20200027427A1 · Jan 23, 2020