IP Library Granted Patent US 10,281,553
Granted Patent B2
US 10,281,553 · App. 14/094,645 · Granted May 7, 2019

Determining the orientation of objects in space

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,281,553
App. No.
14/094,645
Granted
May 7, 2019
Kind
B2
Abstract

A method and system determines object orientation using a light source to create a shadow line extending from the light source. A camera captures an image including the shadow line on an object surface. An orientation module determines the surface orientation from the shadow line. In some examples a transparency imperfection in a window through which a camera receives light can be detected and a message sent to a user as to the presence of a light-blocking or light-distorting substance or particle. A system can control illumination while imaging an object in space using a light source mounted to a support structure so a camera captures an image of the illuminated object. Direct illumination of the camera by light from the light source can be prevented such as by blocking the light or using a light-transmissive window adjacent the camera to reject light transmitted directly from the light source.

Claims (49)

1. A method for determining an orientation of an object in space, the method comprising:

operating a light source including an opaque structure portion that is formed to protrude from a surface of a structure housing the light source and protruding substantially in a direction of the object, wherein the opaque structure portion is formed to be disposed within a path of light emanating from the light source housed thereby creating a shadow line that is generated by the opaque structure portion, the shadow line extending from the opaque structure portion such that light from the light source partially illuminates the object while simultaneously casting the shadow line onto the object that is being illuminated;

capturing, using a camera, an image comprising an object intersecting the shadow line;

analyzing the image to determine a position of the shadow line on the object;

using the position of the shadow line, determining an orientation of the object;

detecting a light-blocking or light-distorting substance or particle on a transparent window through which the camera receives light; and

wherein the detecting the light-blocking or light-distorting substance or particle comprises comparing the image with a second image.

2. The method of claim 1 , wherein the shadow line is created by blocking a portion of light emitted by the light source with a light blocking structure at least partially opaque to the light, the orientation of the light blocking structure being based also on a configuration and position of the light blocking structure relative to the light source.

3. The method of claim 1 , wherein the light source is a light-emitting diode.

4. The method of claim 1 , wherein the structure housing the light source comprises a protrusion acting as the light blocking structure.

5. The method of claim 1 , wherein the structure housing the light source comprises a recess in a wall acting as the light blocking structure.

6. The method of claim 1 , wherein analyzing the image comprises analyzing rows of the image to detect increases or decreases in luminescence therein.

7. The method of claim 2 , further comprising moving the shadow line by moving the light source or the light blocking structure.

8. The method of claim 1 , wherein the comparing the image comprises comparing the image with a second image taken with a second said camera.

9. The method of claim 1 , wherein the comparing the image comprises comparing the image with a second image taken with the camera while the light source is not projecting light.

10. The method of claim 1 , further comprising sending a message to a user informing the user of a presence of said light-blocking or light-distorting substance or particle.

11. The method of claim 1 , further comprising preventing direct illumination of the camera by light from the light source.

12. The method of claim 11 , wherein the direct illumination preventing step comprises creating, during the light source operating step, an un-illuminated region to one side of the shadow line, the camera being located within the un-illuminated region.

13. The method of claim 11 , wherein the direct illumination preventing step comprises shielding the camera with a window configured to reject light transmitted directly from the light source to the window.

14. The method of claim 1 , wherein the shadow line is a straight line.

15. The method of claim 1 , wherein the image analyzing step further comprises:

determining a first position of a shadow line;

determining a second position of the shadow line;

comparing the first position and the second position of the shadow line to detect a difference in shadow line position; and

determining that the orientation of the object has changed based at least in part upon detecting the difference between the first position of the shadow line and the second position of the shadow line.

16. A light blocking/distorting detection method, for use with a system using at least one camera to image an object in space, comprising:

illuminating an object in space by operating a light source including an opaque structure a portion that is formed to protrude from a surface of a structure housing the light source and protruding substantially in a direction of the object, wherein the opaque structure portion is formed to be disposed within a path of light emanating from the light source housed thereby creating a shadow line extending from the light source such that light from the light source to partially illuminates the object while simultaneously casting the shadow line of the opaque structure onto the object that is being illuminated;

capturing, using a camera, an image of at least a portion of the object;

detecting a light-blocking or light-distorting substance or particle on a transparent window through which the camera receives light;

wherein the detecting the light-blocking or light-distorting substance or particle comprises comparing the image with a second image; and

sending a message to a user to inform the user of a presence of said light-blocking or light-distorting substance or particle.

17. The method of claim 16 , wherein comparing the image comprises comparing the image with a second image taken with a second said camera.

18. The method of claim 16 , wherein:

illuminating the object comprises operating a light source which projects light towards the object; and

comparing the image comprises comparing the image with a second image taken with the camera while the light source is not projecting light.

19. The method of claim 16 , further including detecting a transparency imperfection in a window through which a camera receives light, comprising:

capturing a first image with the camera;

capturing a second image with a second camera;

comparing the first image to the second image to detect a blurry region in the first image corresponding to transparency imperfection in a window through which the camera receives light; and

alerting a user to presence of the transparency imperfection.

20. The method of claim 19 , wherein the transparency imperfection is a light-blocking or light-distorting substance or particle.

21. A method for detecting a transparency imperfection in a window through which a camera receives light, the method comprising:

capturing a first image with the camera while a light source near the camera is emitting light; wherein light source includes an opaque structure portion that is formed to protrude from a surface of a structure housing the light source, wherein protrusion is substantially in direction of an object being illuminated, and is disposed within a path of light emanating from the light source to create a shadow line extending from the light source to partially illuminate an object with the shadow line of the opaque structure comprising a portion of a structure housing the light source on the object;

capturing a second image with the camera while the light source is not emitting light;

comparing the first image to the second image to detect an illumination of a transparency imperfection in a window through which the camera receives light; and

alerting a user to presence of the transparency imperfection.

22. The method of claim 21 , wherein the transparency imperfection is a light-blocking or light-distorting substance or particle.

23. The method claim 8 , further comprising sending a message to a user informing the user of a presence of said light-blocking or light-distorting substance or particle.

24. The method claim 9 , further comprising sending a message to a user informing the user of a presence of said light-blocking or light-distorting substance or particle.

Assignments (15)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2026
From: TRIPLEPOINT CAPITAL LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 075295/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0545 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0664 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
TERMINATION OF SECURITY AGREEMENT Recorded Nov 7, 2018
From: THE FOUNDERS FUND IV, LP, AS COLLATERAL AGENT
To: LEAP MOTION, INC.
Reel/Frame 047444/0567 →
SECURITY INTEREST Recorded Oct 6, 2015
From: LEAP MOTION, INC.
To: THE FOUNDERS FUND IV, LP
Reel/Frame 036796/0151 →
SECURITY INTEREST Recorded Sep 21, 2015
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 036644/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2013
From: HOLZ, DAVID
To: LEAP MOTION, INC.
Reel/Frame 031701/0398 →