Vehicle using spatial information acquired using sensor, sensing device using spatial information acquired using sensor, and server
A method of sensing a three-dimensional (3D) space using at least one sensor is proposed. The method can include acquiring spatial information over time for the sensed 3D space, applying a neural network based object classification model to the acquired spatial information over time to identify at least one object in the sensed 3D space. The method can also include tracking the sensed 3D space including the identified at least one object, and using information related to the tracked 3D space.
1. A vehicle comprising:
a sensor unit configured to sense a three-dimensional (3D) space;
a memory storing one or more instructions; and
a processor configured to execute the one or more instructions to:
acquire point cloud data for the sensed 3D space,
distinguish individual object areas from the acquired point cloud data,
acquire object information of an object identified by using an object classification model,
track the sensed 3D space using the object information and information related to an object acquired from the individual object areas, and
control driving of the vehicle based on information related to the tracked 3D space.
2. The vehicle of claim 1 , wherein the processor is further configured to execute the one or more instructions, in response to an object not being identified through the object classification model, to track the sensed 3D space using the information related to the object acquired from the individual object areas.
3. The vehicle of claim 1 , wherein the processor is further configured to execute the one or more instructions to track the sensed 3D space by correcting the object information using the information related to the object.
4. The vehicle of claim 1 , wherein the processor is further configured to execute the one or more instructions to track the sensed 3D space by correcting a bounding box corresponding to the object information using the information related to the object.
5. The vehicle of claim 1 , wherein the processor is further configured to execute the one or more instructions to predict information related to the tracked 3D space by analyzing a movement pattern of an object from accumulated information related to the tracked 3D space.
6. The vehicle of claim 1 , wherein the processor is further configured to execute the one or more instructions to:
extract an object area from the acquired point cloud data and distinguish the individual object areas by clustering the object area, and
identify the object in the 3D space from the acquired point cloud data using the object classification model and estimate the object information of the identified object.
7. The vehicle of claim 1 , wherein the information related to the object is information related to a location, shape, and number of an object acquired based on point cloud data corresponding to the individual object areas.
8. A sensing device comprising:
a sensor unit configured to sense a three-dimensional (3D) space;
a memory storing one or more instructions; and
a processor configured to execute the one or more instructions to:
acquire point cloud data for the sensed 3D space,
distinguish individual object areas from the acquired point cloud data,
acquire object information of an object identified by using an object classification model, and
track the sensed 3D space using the object information and information related to an object acquired from the individual object areas.
9. The sensing device of claim 8 , wherein the processor is further configured to execute the one or more instructions, in response to an object not being identified through the object classification model, to track the sensed 3D space using the information related to the object acquired from the individual object areas.
10. The sensing device of claim 8 , wherein the processor is further configured to execute the one or more instructions to track the sensed 3D space by correcting the object information using the information related to the object.
11. The sensing device of claim 8 , wherein the processor is further configured to execute the one or more instructions to track the sensed 3D space by correcting a bounding box corresponding to the object information using the information related to the object.
12. The sensing device of claim 8 , wherein the processor is further configured to execute the one or more instructions to predict information related to the tracked 3D space by analyzing a movement pattern of an object from accumulated information related to the tracked 3D space.
13. The sensing device of claim 8 , wherein the processor is further configured to execute the one or more instructions to:
extract an object area from the acquired point cloud data and distinguish the individual object areas by clustering the object area, and
identify the object in the 3D space from the acquired point cloud data using the object classification model and estimate the object information of the identified object.
14. The sensing device of claim 8 , further comprising a communication interface, and wherein the processor is further configured to execute the one or more instructions to transmit information related to the tracked 3D space to outside through the communication interface.
15. A non-transitory computer-readable storage medium storing instructions, when executed by one or more processors, configured to perform a method, the method comprising:
acquiring point cloud data for a sensed 3D space;
distinguishing individual object areas from the acquired point cloud data;
acquiring object information of an object identified by using an object classification model; and
tracking the sensed 3D space using the object information and information related to an object acquired from the individual object areas.