Topometric map based autonomous navigation for inventory drone
A topometric map that enables autonomous navigation of an inventory robot. The topometric map is generated using the layout of a storage site and is made up of vertices and edges. The vertices are generated at pallet locations and other structural locations, and edges are generated between neighboring vertices. Vertices and edges have associated metrics that aid in the routing of the robot. The metrics of the vertices and edges may be updated as the robot navigates through the storage site by using a perception engine and state estimator. The metrics of the edges can be used to calculate an energy cost. The robot determines a shortest path between a source and destination vertex based on the energy cost associated with each edge.
1 . A method for autonomously navigating an inventory robot in a storage site, the method comprising:
generating a topometric map which contains layout information of the storage site, the topometric map comprising vertices representing locations of the storage site and edges that connect the vertices, wherein the topometric map is a three-dimensional map, a subset of the vertices represent pallet locations in the storage site, each vertex in the subset is associated with location coordinates as metrices of the vertex, and an edge is associated with one or more metrics that define a cost between two vertices connected by the edge;
updating a value of a metric of the topometric map through the inventory robot moving in the storage site in capturing an updated value of the metric, wherein updating the value of the metric of the topometric map through the inventory robot moving in the storage site in capturing the updated value of the metric comprises:
measuring a relative pose of the inventory robot at a parent vertex and at a child vertex, wherein the parent vertex represents a starting location along a path and the child vertex represents a subsequent location connected to the parent vertex via an edge, and wherein the relative pose is with respect to a reference structure in the storage site,
calculating a cost associated with the edge connecting the parent vertex and the child vertex based on the measured relative pose, wherein the cost comprises one or more of a planar distance, a vertical displacement, or an angular rotation between the vertices, and
updating one or more metrics in the topometric map based on the calculated cost, the updated metrics being associated with the edge connecting the parent vertex and the child vertex;
determining a path to a target pallet location by calculating a total cost of traversing one or more edges in the topometric map along the path; and
directing the inventory robot to navigate in the storage site according to the path.
2 . The method of claim 1 , wherein generating the topometric map further comprises:
generating a layout of storage racks in the storage site, based on a default numbering system of the storage site;
translating the default numbering system into a locally used unified numbering system;
generating vertices for pallet locations and structural locations;
generating edges between neighboring vertices; and
assigning predefined metrics for vertices and edges.
3 . The method of claim 2 , wherein the storage racks comprise rows and columns.
4 . The method of claim 1 , wherein one of the vertices of the topometric map is represented as a combination of location values, which indicate a position of one of the vertices in context of the storage site, and wherein one of the edges of the topometric map is represented as a combination of metric values, which includes a cost for traversing an edge.
5 . The method of claim 4 , wherein one of the edges connecting to a ground station is predefined, and the metric values of a plurality of remaining edges of the topometric map are captured through the inventory robot moving in the storage site.
6 . The method of claim 1 , wherein an instruction for updating the value of a metric of an edge of the topometric map comprises instructions for:
detecting, with a camera, a feature of a structural location associated with a source vertex;
measuring, with the camera, a relative pose of the source vertex with respect to the structural location associated with the source vertex;
moving the inventory robot in a predefined direction until a structural location associated with a destination vertex is detected by the camera;
measuring, with the camera, a relative pose of the destination vertex with respect to the structural location associated with the destination vertex;
calculating, using a state estimator, the relative pose between source and destination vertices; and
updating the metric of the edge with the relative pose between the source and destination vertices.
7 . The method of claim 4 , wherein the cost associated with an edge that connects a parent and child vertex is calculated using translational and rotational differences between the parent and child vertex.
8 . The method of claim 1 , wherein determining the path to the target pallet location further comprises:
generating a list of vertices that make up the path; and
determining a sequence of actions performed by the inventory robot to navigate from source vertex to destination vertex, based in part on vertex metrics and corresponding edge metrics.
9 . An inventory robot, comprising:
a sensor configured to perform measurement of a storage site;
one or more computer processors; and
memory coupled to one or more computer processors, the memory storing one or more sets of instruction, the one or more sets of instructions, when executed by the one or more computer processors, cause the one or more computer processors to:
receive a topometric map which contains layout information of the storage site, the topometric map comprising vertices representing locations of the storage site and edges that connect the vertices, wherein the topometric map is a three-dimensional map, a subset of the vertices represent pallet locations in the storage site, each vertex in the subset is associated with location coordinates as metrices of the vertex, and an edge is associated with one or more metrics that define a cost between two vertices connected by the edge;
provide an updated value of a metric of the topometric map through performing measurement using the sensor capturing an updated value of the metric, wherein updating the value of the metric of the topometric map through the inventory robot moving in the storage site in capturing the updated value of the metric comprises:
measuring a relative pose of the inventory robot at a parent vertex and at a child vertex, wherein the parent vertex represents a starting location along a path and the child vertex represents a subsequent location connected to the parent vertex via an edge, and wherein the relative pose is with respect to a reference structure in the storage site,
calculating a cost associated with the edge connecting the parent vertex and the child vertex based on the measured relative pose, wherein the cost comprises one or more of a planar distance, a vertical displacement, or an angular rotation between the vertices, and
updating one or more metrics in the topometric map based on the calculated cost, the updated metrics being associated with the edge connecting the parent vertex and the child vertex;
determine a path to a target pallet location through calculating a total cost of traversing one or more edges in the topometric map along the path; and
direct the inventory robot to navigate in the storage site according to the path.
10 . The inventory robot of claim 9 , wherein an instruction for generating the topometric map comprises instructions for:
generating a layout of storage racks in the storage site, based on a default numbering system of the storage site;
translating the default numbering system into a locally used unified numbering system;
generating vertices for pallet locations and structural locations;
generating edges between neighboring vertices; and
assigning predefined metrics for vertices and edges.
11 . The inventory robot of claim 10 , wherein the storage racks comprise rows and columns.
12 . The inventory robot of claim 9 , wherein one of the vertices of the topometric map is represented as a combination of location values, which indicate a position of one of the vertices in context of the storage site, and wherein one of the edges of the topometric map is represented as a combination of metric values, which includes a cost for traversing an edge.
13 . The inventory robot of claim 12 , wherein one of the edges connecting to a ground station is predefined, and the metric values of a plurality of remaining edges of the topometric map are captured through the inventory robot moving in the storage site.
14 . The inventory robot of claim 9 , wherein an instruction for updating the value of a metric of an edge of the topometric map comprises instructions for:
detecting, with a camera, a feature of a structural location associated with a source vertex;
measuring, with the camera, a relative pose of the source vertex with respect to the structural location associated with the source vertex;
moving the inventory robot in a predefined direction until a structural location associated with a destination vertex is detected by the camera;
measuring, with the camera, a relative pose of the destination vertex with respect to the structural location associated with the destination vertex;
calculating, using a state estimator, the relative pose between source and destination vertices; and
updating the metric of the edge with the relative pose between the source and destination vertices.
15 . The inventory robot of claim 12 , wherein the cost associated with an edge that connects a parent and child vertex is calculated using translational and rotational differences between the parent and child vertex.
16 . The inventory robot of claim 9 , wherein determining the path to the target pallet location further comprises:
generating a list of vertices that make up the path; and
determining a sequence of actions performed by the inventory robot to navigate from source vertex to destination vertex, based in part on vertex metrics and corresponding edge metrics.
17 . A system comprising:
a computing server configured to generate a topometric map which contains layout information of a storage site, the topometric map comprising vertices representing locations of the storage site and edges that connect the vertices, wherein the topometric map is a three-dimensional map, a subset of the vertices represent pallet locations in the storage site, each vertex in the subset is associated with location coordinates as metrices of the vertex, and an edge is associated with one or more metrics that define a cost between two vertices connected by the edge; and
an inventory robot in communication with the computing server, the inventory robot configured to:
update a value of a metric of an edge of the topometric map through the inventory robot moving in the storage site in capturing an updated value of the metric, wherein updating the value of metric of the topometric map through the inventory robot moving in the storage site in capturing the updated value of the metric comprises:
measuring a relative pose of the inventory robot at a parent vertex and at a child vertex, wherein the parent vertex represents a starting location along a path and the child vertex represents a subsequent location connected to the parent vertex via an edge, and wherein the relative pose is with respect to a reference structure in the storage site,
calculating a cost associated with the edge connecting the parent vertex and the child vertex based on the measured relative pose, wherein the cost comprises one or more of a planar distance, a vertical displacement, or an angular rotation between the vertices, and
updating one or more metrics in the topometric map based on the calculated cost, the updated metrics being associated with the edge connecting the parent vertex and the child vertex;
determine a path to a target pallet location by calculating a total cost of traversing one or more edges in the topometric map along the path; and
navigate in the storage site according to the path.
18 . The system of claim 17 , wherein an instruction for generating the topometric map comprises instructions for:
generating a layout of storage racks in the storage site, based on a default numbering system of the storage site;
translating the default numbering system into a locally used unified numbering system;
generating vertices for pallet locations and structural locations;
generating edges between neighboring vertices; and
assigning predefined metrics for vertices and edges.
19 . The system of claim 17 , wherein an instruction for updating the value of a metric of an edge of the topometric map comprises instructions for:
detecting, with a camera, a feature of a structural location associated with a source vertex;
measuring, with the camera, a relative pose of the source vertex with respect to the structural location associated with the source vertex;
moving the inventory robot in a predefined direction until a structural location associated with a destination vertex is detected by the camera;
measuring, with the camera, a relative pose of the destination vertex with respect to the structural location associated with the destination vertex;
calculating, using a state estimator, the relative pose between source and destination vertices; and
updating the metric of the edge with the relative pose between the source and destination vertices.
20 . The system of claim 17 , wherein an instruction for determining the path to the target pallet location further comprises instructions for:
generating a list of vertices that make up the path; and
determining a sequence of actions performed by the inventory robot to navigate from source vertex to destination vertex, based in part on vertex metrics and corresponding edge metrics.