IP Library Granted Patent US 8,845,107
Granted Patent B1
US 8,845,107 · App. 12/977,924 · Granted Sep 30, 2014

Characterization of a scene with structured light

Inventors: Christopher Coley (Morgan Hill, CA); Jonathan Betts-LaCroix (Belmont, CA); William Spencer Worley, III (Half Moon Bay, CA)
Assignee: Rawles LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,845,107
App. No.
12/977,924
Granted
Sep 30, 2014
Kind
B1
Abstract

Objects and their placement within a particular scene may be characterized using structured light with no or minimal manual intervention or calibration to the scene. The structured light pattern may be rendered with visible light, yet imperceptible to users, by generating a set of opposing excursions in one or more image properties for durations which are shorter than the integration time of the human eye. A set of assumptions and ongoing testing of those assumptions against physical objects identified within the environment allows characterization of the scene and the objects therein.

Claims (58)

1. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:

determining a topology of a scene;

identifying one or more objects within the scene;

determining a dimension of objects within the scene based at least in part upon testing one or more assumptions of a preliminary dimension of the one or more identified objects within the scene; and

generating a model of the scene based at least in part upon the determined topology, the identified objects, and the determined dimension.

2. The one or more non-transitory computer-readable storage media of claim 1 , wherein the determining the topology of the scene comprises scanning the scene with a structured light pattern.

3. The one or more non-transitory computer-readable storage media of claim 2 , wherein the structured light pattern comprises a pseudorandom noise pattern modulating a plurality of visible light sub-frames with a set of opposing excursions in one or more image properties.

4. The one or more non-transitory computer-readable storage media of claim 3 , wherein the excursions in one or more image properties vary dynamically between pluralities of visible light sub-frames.

5. The one or more non-transitory computer-readable storage media of claim 3 , wherein the pseudorandom noise pattern comprises dynamic pixel blocks.

6. The one or more non-transitory computer-readable storage media of claim 1 , wherein the testing the one or more assumptions comprises:

applying the preliminary dimension to the one or more identified objects within the scene based at least in part upon their identification;

applying a tentative dimension to the one or more unidentified objects based at least in part upon the preliminary dimension of the one or more identified object and a relative displacement of the one or more unidentified objects compared to the one or more identified objects;

testing the tentative dimension of the object and discarding contradictory dimensional results; and

confirming the preliminary dimension and the tentative dimension as actual dimensions when error associated with the preliminary dimension, tentative dimension, or both is reduced below a pre-determined error threshold.

7. The one or more non-transitory computer-readable storage media of claim 2 , further comprising retrieving from an object datastore dimensional data about the one or more identified objects and using the dimensional data to determine the preliminary dimension.

8. The one or more non-transitory computer-readable storage media of claim 1 , wherein the preliminary dimension is based at least in part upon one or more system parameters and one or more object parameters.

9. The one or more non-transitory computer-readable storage media of claim 8 , wherein the system parameters comprise state information about one or more components within a system determining the topology of the scene.

10. The one or more non-transitory computer-readable storage media of claim 8 , wherein the object parameters comprise state information about the one or more objects within the scene.

11. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:

determining a topology of a scene;

locating one or more objects within the scene;

determining a dimension of objects within the scene based at least in part upon testing one or more assumptions of preliminary dimension of the one or more objects within the scene; and

generating a model of the scene based at least in part upon the determined topology and the determined dimension.

12. The one or more non-transitory computer-readable storage media of claim 1 , wherein the testing the one or more assumptions comprises:

applying the preliminary dimension to the one or more dimensioned objects within the scene based at least in part upon the determined topology of the scene;

applying a tentative dimension to one or more undimensioned objects based at least in part upon the preliminary dimension of the one or more dimensioned objects and a relative displacement of the undimensioned objects compared to the one or more dimensioned objects;

testing the preliminary dimension of the one or more dimensioned objects and the tentative dimension of the one or more undimensioned objects and discarding contradictory dimensional results; and

confirming the preliminary dimension and the tentative dimension as actual dimensions when error associated with the preliminary dimension, tentative dimension, or both is reduced below a pre-determined error threshold.

13. The one or more non-transitory computer-readable storage media of claim 11 , wherein the preliminary dimension is based at least in part upon the comparison of two or more images acquired with differing system parameters.

14. A method comprising:

determining a topology of a scene;

identifying one or more objects within the scene;

determining a dimension of objects within the scene based at least in part upon testing one or more assumptions of a preliminary dimension of the one or more identified objects within the scene; and

generating a model of the scene based at least in part upon the determined topology, the identified objects, and the determined dimension.

15. The method of claim 14 , wherein the determining the topology of the scene comprises scanning the scene with a structured light pattern.

16. The method of claim 15 , wherein the structured light pattern comprises a pseudorandom noise pattern modulating a plurality of visible light sub-frames with a set of opposing excursions in one or more image properties.

17. The method of claim 16 , wherein the excursions in one or more image properties vary dynamically between pluralities of visible light sub-frames.

18. The method of claim 16 , wherein the pseudorandom noise pattern comprises dynamic pixel blocks.

19. The method of claim 14 , wherein the testing the one or more assumptions comprises:

applying the preliminary dimension to the one or more identified objects within the scene based at least in part upon their identification;

applying a tentative dimension to the one or more unidentified objects based at least in part upon the preliminary dimension of the one or more identified object and a relative displacement of the one or more unidentified objects compared to the one or more identified objects;

testing the tentative dimension of the object and discarding contradictory dimensional results; and

confirming the preliminary dimension and the tentative dimension as actual dimensions when error associated with the preliminary dimension, tentative dimension, or both is reduced below a pre-determined error threshold.

20. The method of claim 15 , further comprising retrieving from an object datastore dimensional data about the one or more identified objects and using the dimensional data to determine the preliminary dimension.

21. The method of claim 14 , wherein the preliminary dimension is based at least in part upon one or more system parameters and one or more object parameters.

22. The method of claim 21 , wherein the system parameters comprise state information about one or more components within a system determining the topology of the scene.

23. The method of claim 21 , wherein the object parameters comprise state information about the one or more objects within the scene.

24. A method comprising:

determining a topology of a scene;

locating one or more objects within the scene;

determining a dimension of objects within the scene based at least in part upon testing one or more assumptions of preliminary dimension of the one or more objects within the scene; and

generating a model of the scene based at least in part upon the determined topology and the determined dimension.

25. The method of claim 24 , wherein the testing the one or more assumptions comprises:

applying the preliminary dimension to the one or more dimensioned objects within the scene based at least in part upon the determined topology of the scene;

applying a tentative dimension to one or more undimensioned objects based at least in part upon the preliminary dimension of the one or more dimensioned objects and a relative displacement of the undimensioned objects compared to the one or more dimensioned objects;

testing the preliminary dimension of the one or more dimensioned objects and the tentative dimension of the one or more undimensioned objects and discarding contradictory dimensional results; and

confirming the preliminary dimension and the tentative dimension as actual dimensions when error associated with the preliminary dimension, tentative dimension, or both is reduced below a pre-determined error threshold.

26. The method of claim 24 , wherein the preliminary dimension is based at least in part upon the comparison of two or more images acquired with differing system parameters.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2011
From: COLEY, CHRISTOPHER; BETTS-LACROIX, JONATHAN; WORLEY III, WILLIAM SPENCER
To: RAWLES LLC
Reel/Frame 026433/0891 →