Physical object boundary detection techniques and systems
Physical object boundary detection techniques and systems are described. In one example, an augmented reality module generates three dimensional point cloud data. This data describes depths at respective points within a physical environment that includes the physical object. A physical object boundary detection module is then employed to filter the point cloud data by removing points that correspond to a ground plane. The module then performs a nearest neighbor search to locate a subset of the points within the filtered point cloud data that correspond to the physical object. Based on this subset, the module projects the subset of points onto the ground plane to generate a two-dimensional boundary. The two-dimensional boundary is then extruded based on a height determined from a point having a maximum distance from the ground plane from the filtered cloud point data.
1. A method implemented by at least one computing device, the method comprising:
receiving, by the at least one computing device, motion sensing data and digital images corresponding to a physical environment including a physical object;
generating, by the at least one computing device, point cloud data based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating, by the at least one computing device, a three-dimensional boundary of the physical object based on the point cloud data generated based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating, by the at least one computing device, digital content based on the three-dimensional boundary, the digital content indicating an availability of the physical object; and
displaying, by the at least one computing device, the digital content generated in a user interface.
2. The method as described in claim 1 , wherein the user interface includes a display of a digital image of a physical environment as part of a live camera feed that includes the physical object and corresponds to the motion sensing data and the digital images corresponding to the physical environment including the physical object.
3. The method as described in claim 1 , wherein the digital content is a webpage.
4. The method as described in claim 1 , wherein the digital content includes one or more of the digital images.
5. The method as described in claim 1 , wherein the digital content is a user interface screen for output in a mobile application.
6. The method as described in claim 1 , wherein the point cloud data is down sampled.
7. The method as described in claim 1 , further comprising generating, by the at least one computing device, shipping data for the physical object as part of the generating of the digital content, and wherein the digital content includes the shipping data.
8. The method as described in claim 7 , wherein the shipping data includes an amount of packing to be used in packaging the physical object.
9. The method as described in claim 7 , wherein the shipping data is an estimated cost of shipping the physical object.
10. The method as described in claim 7 , wherein the shipping data describes an estimated shipping cost based on dimensions of the three-dimensional boundary.
11. The method of claim 7 , wherein the digital content includes a listing of the physical object, the listing including the shipping data generated.
12. A system comprising:
at least one hardware processor; and
a non-transitory computer-readable storage medium storing executable instructions that, when executed, cause the at least one hardware processor to perform operations comprising:
receiving motion sensing data and digital images corresponding to a physical environment including a physical object;
generating point cloud data based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating a three-dimensional boundary of the physical object based on the point cloud data generated based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating digital content based on the three-dimensional boundary, the digital content indicating an availability of the physical object; and
displaying the digital content generated in a user interface.
13. The system as described in claim 12 , wherein the digital content includes one or more of the digital images.
14. The system as described in claim 12 , further comprising generating shipping data for the physical object as part of the generating of the digital content, and wherein the digital content includes the shipping data.
15. The system as described in claim 12 , wherein the digital content includes a listing of the physical object.
16. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:
receiving motion sensing data and digital images corresponding to a physical environment including a physical object;
generating point cloud data based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating a three-dimensional boundary of the physical object based on the point cloud data generated based on the motion sensing data and the digital images corresponding to the physical environment including the physical object;
generating digital content based on the three-dimensional boundary, the digital content indicating an availability of the physical object; and
displaying the digital content generated in a user interface.
17. The non-transitory computer-readable storage medium as described in claim 16 , further comprising generating shipping data for the physical object based on the three-dimensional boundary as part of the generating of the digital content, and wherein the digital content includes the shipping data.
18. The non-transitory computer-readable storage medium as described in claim 16 , wherein the generating of the three-dimensional boundary further comprises:
computing a plurality of two-dimensional boundaries, in which each two-dimensional boundary of the plurality of two-dimensional boundaries corresponds to a respective one of a plurality of perspectives captured by the data;
selecting a two-dimensional boundary from the plurality of two-dimensional boundaries; and
generating the three-dimensional boundary having dimensions based on the selected two-dimensional boundary and a height of the physical object from the data.
19. The non-transitory computer-readable storage medium as described in claim 16 , wherein the generating of the three-dimensional boundary further comprises:
filtering the point cloud data by removing points from the point cloud data that correspond to a ground plane;
receiving, via the user interface, a user input specifying a location of the physical object;
locating a subset of points within the filtered point cloud data that correspond to the physical object, the locating performed using a proximity search based on the location of the user input;
generating a two-dimensional boundary based on the located subset; and
extruding the two-dimensional boundary into the three-dimensional boundary.
20. The non-transitory computer-readable storage medium as described in claim 16 , wherein the generating of the three-dimensional boundary further comprises:
computing a plurality of two-dimensional boundaries, in which each two-dimensional boundary corresponds to a respective one of a plurality of perspectives captured by the point cloud data;
selecting a two-dimensional boundary from the plurality of two-dimensional boundaries; and
generating the three-dimensional boundary having dimensions based on the selected boundary and a height of the physical object from the point cloud data.