Granted Patent B1

US 9,207,680 · App. 14/510,290 · Granted Dec 8, 2015

Abstract

Claims (56)

1. A method comprising:

receiving, at a computing device, a first three-dimensional (3D) point cloud depicting a first view of an object in an environment of a vehicle;

determining a reference point on the object in the first 3D point cloud;

receiving a second 3D point cloud depicting a second view of the object, wherein the second 3D point cloud is captured a given period of time after the first 3D point cloud is captured;

estimating, by the computing device, a projection of the reference point relative to the second view so as to trace the reference point from the first view to the second view;

determining, by the computing device, one or more motion characteristics of the object based on the projection of the reference point, the given time period, and one or more motion characteristics of the vehicle; and

controlling, by the computing device, the vehicle based on the one or more motion characteristics of the object.

2. The method of claim 1 , wherein the motion characteristics of the vehicle include a speed and a direction of motion of the vehicle, and wherein the motion characteristics of the object include whether the object is moving or stationary, a respective speed, and a respective direction of motion of the object.

3. The method of claim 1 , wherein receiving the second 3D point cloud comprises:

receiving the second 3D point cloud depicting the second view of the object as the vehicle moves relative to the object.

4. The method of claim 1 , wherein the reference point on the object is occluded by another object in the second 3D point cloud.

5. The method of claim 1 , further comprising:

identifying multiple reference points on the object;

tracing the multiple reference points from the first view to the second view; and

determining one or more geometric characteristics of the object based on tracing the multiple points, wherein determining the one or more motion characteristics of the object is further based on the one or more geometric characteristics of the object.

6. The method of claim 5 , further comprising:

estimating a shape of the object based on tracing the multiple reference points.

7. The method of claim 1 , wherein determining the one or more motion characteristics of the object comprises determining the one or more motion characteristics in real-time.

8. The method of claim 1 , wherein controlling, by the computing device, the vehicle comprises controlling the vehicle in an autonomous operation mode.

9. The method of claim 1 , wherein the second view includes at least a portion of the first view, the method further comprising:

determining a transformation between the first view and the second view based on matching the portion of the object depicted in the first view to a corresponding portion depicted in the second view, wherein estimating the projection of the reference point is based on the transformation.

10. A non-transitory computer readable medium having stored thereon instructions that, when executed by a computing device, cause the computing device to perform functions comprising:

receiving a first three-dimensional (3D) point cloud depicting a first view of an object in an environment of a vehicle;

determining a reference point on the object in the first 3D point cloud;

receiving a second 3D point cloud depicting a second view of the object, wherein the second 3D point cloud is captured a given period of time after the first 3D point cloud is captured;

estimating a projection of the reference point relative to the second view so as to trace the reference point from the first view to the second view;

determining one or more motion characteristics of the object based on the projection of the reference point, the given time period, and one or more motion characteristics of the vehicle; and

controlling the vehicle based on the one or more motion characteristics of the object.

11. The non-transitory computer readable medium of claim 10 , wherein the motion characteristics of the vehicle include a speed and a direction of motion of the vehicle, and wherein the motion characteristics of the object include whether the object is moving or stationary, a respective speed, and a respective direction of motion of the object.

12. The non-transitory computer readable medium of claim 10 , wherein receiving the second 3D point cloud comprises:

receiving the second 3D point cloud depicting the second view of the object as the vehicle moves relative to the object.

13. The non-transitory computer readable medium of claim 10 , wherein the reference point on the object is occluded by another object in the second 3D point cloud.

14. The non-transitory computer readable medium of claim 10 , wherein the functions further comprise:

identifying multiple reference points on the object;

tracing the multiple reference points from the first view to the second view; and

determining one or more geometric characteristics of the object based on tracing the multiple points, wherein determining the one or more motion characteristics of the object is further based on the one or more geometric characteristics of the object.

15. The non-transitory computer readable medium of claim 14 , further comprising:

estimating a shape of the object based on tracing the multiple reference points.

16. A system, comprising:

at least one processor; and

data storage comprising instructions that, when executed by the at least one processor, cause the system to perform functions comprising:

receiving a first three-dimensional (3D) point cloud depicting a first view of an object in an environment of a vehicle;

determining a reference point on the object in the first 3D point cloud;

receiving a second 3D point cloud depicting a second view of the object, wherein the second 3D point cloud is captured a given period of time after the first 3D point cloud is captured;

estimating a projection of the reference point relative to the second view so as to trace the reference point from the first view to the second view;

determining one or more motion characteristics of the object based on the projection of the reference point, the given time period, and one or more motion characteristics of the vehicle; and

controlling the vehicle based on the one or more motion characteristics of the object.

17. The system of claim 16 , wherein the functions further comprise:

identifying multiple reference points on the object;

tracing the multiple reference points from the first view to the second view; and

determining one or more geometric characteristics of the object based on tracing the multiple points, wherein determining the one or more motion characteristics of the object is further based on the one or more geometric characteristics of the object.

18. The system of claim 17 , wherein the functions further comprise:

estimating a shape of the object based on tracing the multiple reference points, wherein determining the one or more motion characteristics of the object is further based on the estimated shape of the object.

19. The system of claim 16 , wherein the function of controlling the vehicle comprises controlling the vehicle in an autonomous operation mode.

20. The system of claim 16 , wherein the second view includes at least a portion of the first view, and wherein the functions further comprise:

determining a transformation between the first view and the second view based on matching the portion of the object depicted in the first view to a corresponding portion depicted in the second view, wherein estimating the projection of the reference point is based on the transformation.

Assignments (6)