IP Library › Granted Patent US 9,684,055
Granted Patent B2
US 9,684,055 · App. 15/375,786 · Granted Jun 20, 2017

Method and apparatus for using gestures to control a laser tracker

Inventors: Robert E. Bridges (Kennett Square, PA); David H. Parker (Earlysville, VA); Kelley Fletcher (Costa Mesa, CA)
Assignee: FARO TECHNOLOGIES, INC.
G01S3/786G01B11/002G01S17/66G06F3/017G06K9/00355G06T7/194G06T7/254G06T2207/10016G06T2207/20224G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,684,055
App. No.
15/375,786
Granted
Jun 20, 2017
Kind
B2
Abstract

A method and system are provided for controlling a measurement device remotely through gestures performed by a user. The method includes providing a relationship between each of a plurality of commands and each of a plurality of user gestures. A gesture is performed by the user with the user's body that corresponds to one of the plurality of user gestures. The gesture performed by the user is detected. A first command is determined from one of the plurality of commands based at least in part on the detected gesture. Then the first command is executed with the laser tracker.

Claims (44)

1. A method for a user to control operation of a measurement device, the method comprising:

providing a relationship between each of a plurality of commands and each of a plurality of gestures, each gesture of the plurality of gestures corresponding to a body position of the user;

providing the measurement device, the measurement device measuring three-dimensional coordinates of a point based at least in part on light from a first light projected from a first light source of the measurement device;

providing a processor operably coupled to the measurement device;

projecting a second light beam from a second light source and acquiring a first image of a user;

generating with the processor a skeletal model of the user from the first image;

positioning the user into a first body position, the first body position corresponding to a first gesture from among the plurality of gestures;

identifying with the processor from the skeletal model the performing by the user of the first gesture;

determining a first command with the processor based at least in part on the identifying of the first gesture;

executing the first command with the measurement device;

positioning the user into a second body position, the second body position corresponding to a second gesture corresponding to a second body position;

identifying with the processor from the skeletal model the performing by the user of the second gesture;

determining with the processor the second command based at least in part on identifying the second gesture; and

executing the second command with the measurement device.

2. The method of claim 1 wherein the first command is to acquire a retroreflector.

3. The method of claim 1 wherein the second light beam includes a structured light pattern, and the image includes at least a portion of the structured light pattern.

4. The method of claim 1 wherein the generating the skeletal model includes determining with the processor three dimensional coordinates of the user's body.

5. The method of claim 1 further comprising:

providing a plurality of gesture filters, each gesture filter including information of a gesture performed by the user as interpreted through the skeletal model,

wherein the identifying of the first gesture is based at least in part on one of the plurality of gesture filters.

6. The method of claim 5 wherein each of the plurality of gesture filters include a plurality of inputs and a plurality of outputs.

7. The method of claim 6 wherein the plurality of inputs includes at least one of joint data, RGB color data and a rate of change of an aspect of the user.

8. The method of claim 6 wherein the plurality of outputs includes at least one of confidence level and a speed of motion of the gesture.

9. A method of claim 1 wherein the second command further comprises:

identifying with the processor an area containing the retroreflector from the second image; and

reorienting the measurement device to acquire the retroreflector based at least in part on the identifying of the area.

10. A method of claim 1 wherein the first command is to acquire a retroreflector by performing with the measurement device a spiral search pattern to acquire the retroreflector.

11. The method of claim 10 wherein the first body position includes a pointing of a finger by the user at an object.

12. The method of claim 11 , further comprising

identifying with the processor based at least in part on the skeletal model the object in the first image the user is pointing at; and

repositioning the measurement device to project the first light beam toward the object.

13. The method of claim 12 , wherein the object is a first retroreflector.

14. The method of claim 13 further comprising a plurality of retroreflectors, wherein the plurality of retroreflectors includes the first retroreflector.

15. The method of claim 12 , further comprising:

identifying with the processor based at least in part on the skeletal model a point on the object the user is pointing at; and

determining with the processor three-dimensional coordinates of the point.

16. The method of claim 1 , further comprising:

determining with the processor that the user is in the first image;

acquiring with the camera a second image;

aligning with the processor the second image with the first image; and

identifying with the processor foreground shapes.

17. The method of claim 16 , wherein at least one of the foreground shapes is the user.

18. The method of claim 17 , further comprising subtracting with the processor the first image from the second image to identify foreground shapes.

19. The method of claim 18 , further comprising tracking with the processor a movement of the user from the first image to the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2016
From: BRIDGES, ROBERT E.; PARKER, DAVID H.; FLETCHER, KELLEY
To: FARO TECHNOLOGIES, INC.
Reel/Frame 040709/0820 →
Continuity (5)
Continuation 15165068 · May 26, 2016
Continuation 14803575 · Jul 20, 2015
Division 14264420 · Apr 29, 2014
Provisional Application 61818208 · May 1, 2013
Related Publication 20170090005A1 · Mar 30, 2017