IP Library › Granted Patent US 11,821,730
Granted Patent B2
US 11,821,730 · App. 17/987,277 · Granted Nov 21, 2023

Construction layout using augmented reality

Inventors: Kent Kahle (Hayward, CA); David Hyland (Westminster, CO); Benedict JG Atkins (Broomfield, CO); Eliot Jones (Denver, CO); Marc Howell (Albany, OR); Steven Ostrowski (Columbus, OH)
Assignee: Trimble Inc.
G01C15/002A42B3/042A42B3/0433A42B3/30G01C1/04G06F3/012G06F3/013G06T7/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,821,730
App. No.
17/987,277
Granted
Nov 21, 2023
Kind
B2
Abstract

An augmented-reality system is combined with a surveying system to make measurement and/or layout at a construction site more efficient. A reflector can be mounted to a wearable device having an augmented-reality system. A total station can be used to track a reflector, and truth can be transferred to the wearable device while an obstruction is between the total station and the reflector. Further, a target can be used to orient a local map of a wearable device to an environment based on a distance between the target and the wearable device.

Claims (59)

1. A system comprising:

a light source;

a base station;

a wearable device separate from the light source, wherein the wearable device comprises one or more cameras;

one or more memory devices comprising instructions that, when executed, cause one or more processors to perform the following steps:

projecting a target into an environment using the light source;

ascertaining a field of view of a user of the wearable device;

receiving data of the field of view of the user at the base station;

moving the target, using the light source, to project on a surface of the environment within the field of view of the user, based on data of the field of view transmitted to the base station;

acquiring one or more images of the target using the one or more cameras of the wearable device; and

generating a local map based on the one or more images acquired by the one or more cameras of the wearable device.

2. The system of claim 1 , wherein the light source comprises a laser.

3. The system of claim 1 , wherein the light source is a projector.

4. The system of claim 1 , wherein the target is a spot.

5. The system of claim 1 , wherein the instructions, when executed, cause the one or more processors to perform the following steps:

measuring a relative location of the target to the base station;

measuring a relative location of the target to the wearable device, using the local map;

orienting the local map to the environment of the base station based on the relative location of the target to the base station, the relative location of the target to the wearable device, and a relative location of the base station to the environment; and

presenting, on a display of the wearable device, a virtual object in relation to the environment and/or measure one or more coordinates of a physical object, based on orienting the local map of the wearable device with the environment.

6. The system of claim 1 , wherein the light source is part of the base station.

7. A method comprising:

projecting a target into an environment using a light source;

ascertaining a field of view of a user of a wearable device, wherein:

the wearable device comprises one or more cameras; and

the wearable device is separate from the light source;

receiving data of the field of view of the user at a base station;

moving the target, using the light source, to project on a surface of the environment within the field of view of the user, based on data of the field of view transmitted to the base station; and

acquiring one or more images of the target using the one or more cameras of the wearable device; and

generating a local map based on the one or more images acquired by the one or more cameras of the wearable device.

8. The method of claim 7 , further comprising:

measuring a relative location of the target to the base station;

measuring a relative location of the target to the wearable device, using the local map;

orienting the local map to the environment of the base station based on the relative location of the target to the base station, the relative location of the target to the wearable device, and a relative location of the base station to the environment; and

presenting, on a display of the wearable device, a virtual object in relation to the environment and/or measure one or more coordinates of a physical object, based on orienting the local map of the wearable device with the environment.

9. The method of claim 7 , further comprising presenting a graphic on a display of the wearable device to indicate to the user to turn to find an item in the environment.

10. The method of claim 9 , wherein the graphic is an arrow.

11. The method of claim 9 , further comprising logging a location of the item in the environment before presenting the graphic on the display to indicate to the user to turn to fine the item.

12. The method of claim 9 , wherein the item is a tool.

13. The method of claim 7 , further comprising:

ascertaining the field of view of the user moved;

ascertaining that the target cannot be projected to be within the field of view of the user; and

transferring truth for measurements from the target to the wearable device.

14. The method of claim 7 , further comprising receiving an input from the user to lock the target in place, so that the target no longer moves as the field of view of the user moves.

15. The method of claim 14 , further comprising moving a location of the target based on a command from the user.

16. The method of claim 14 , wherein the input is a gesture identified by the wearable device.

17. The method of claim 7 , wherein data of the field of view is eye-tracking data obtained using the wearable device.

18. A memory device comprising instructions that, when executed, cause one or more processors to perform the following steps:

projecting a target into an environment using a light source;

receiving, at a base station, data of a field of view of a user of a wearable device, wherein:

the wearable device comprises one or more cameras; and

the wearable device is separate from the light source;

moving the target, using the light source, to project on a surface of the environment within the field of view of the user, based on data of the field of view received;

measuring a distance from the base station to the target using a laser of the base station; and

generating a local map based on the one or more images acquired by the one or more cameras of the wearable device.

19. The memory device of claim 18 , wherein the instructions, when executed, cause the one or more processors to perform the following steps:

ascertaining the field of view of the user moved;

ascertaining that the target cannot be projected to be within the field of view of the user; and

transferring truth for measurements from the target to the wearable device.

20. The memory device of claim 18 , wherein the instructions, when executed, cause the one or more processors to perform the following step: receiving an input from the user to lock the target in place, so that the target no longer moves as the field of view of the user moves.

Continuity (2)
Continuation 16924651 · Jul 9, 2020
Related Publication 20230152093A1 · May 18, 2023
Cited By (1)
US 12,379,496