IP Library › Granted Patent US 11,376,735
Granted Patent B2
US 11,376,735 · App. 17/603,931 · Granted Jul 5, 2022

Method for rapidly determining warehousing map, device, storage medium and robot

Inventors: Junbin Liu (Shenzhen, CN); Zhiqin Yang (Shenzhen, CN)
Assignee: SYRIUS ROBOTICS CO., LTD.
B25J9/1664B25J9/1684B25J9/1694B65G1/1378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,376,735
App. No.
17/603,931
Granted
Jul 5, 2022
Kind
B2
Abstract

Provided are a method for rapidly determining a warehousing map, a device, a storage medium and a robot. The method includes: generating a warehouse map of a warehouse; acquiring a motion position and pose of the robot, and acquiring information of a mark on a rack collected by an image collection sensor on the robot; determining a mark position of the mark; determining a rack position of the rack and a depositary place position of each depositary place on the rack; and determining a warehousing map of the warehouse. The method can rapidly create the warehousing map in the warehouse, and position accuracy of the depositary place in the warehousing map is high.

Claims (77)

1. A method for determining a warehousing map, comprising:

generating, according to induction data collected when a robot moves in a warehouse, a warehouse map of the warehouse;

acquiring a motion position and pose of the robot in real time, and acquiring information of a mark on a rack collected by an image collection sensor on the robot, wherein at least one rack is arranged in the warehouse, each rack is provided with at least one group of marks, and an outer outline surface of the rack is provided with at least one mark;

determining a mark position of the mark in the warehouse map based on the motion position and pose and the information of the mark;

determining a rack position of the rack and a depositary place position of each depositary place on the rack in the warehouse map according to preset depositary place information of the rack and the mark position; and

determining a warehousing map of the warehouse according to the warehouse map, the rack position and the depositary place position.

2. The method according to claim 1 , further comprising:

determining an origin in the warehouse; and

creating a warehouse coordinate system of the warehouse based on the origin, wherein the warehouse map, the motion position and pose, the mark position, the rack position and the depositary place position are all in the warehouse coordinate system.

3. The method according to claim 2 , wherein the generating, according to the induction data collected when the robot moves in the warehouse, the warehouse map of the warehouse comprises:

acquiring data of an outline of each object in the warehouse scanned by a radar on the robot;

drawing data of a shape of the object in the warehouse according to the data of the outline; and

creating the warehouse map of the warehouse in the warehouse coordinate system according to the data of the shape.

4. The method according to claim 2 , wherein the mark comprises a mark code, the information of the mark comprises information on an image of the mark code, the motion position and pose comprises a first motion position and pose and a second motion position and pose, the information of the mark comprises information on a first image, collected in the first motion position and pose, of the mark code, and information on a second image, collected in the second motion position and pose, of the mark code; and

the determining the mark position of the mark in the warehouse map based on the motion position and pose and the information of the mark comprises:

determining, in the warehouse coordinate system, first referential three-dimensional coordinates of a vertex in the mark code according to the first motion position and pose, the information on the first image and a focal length of the image collection sensor;

determining, in the warehouse coordinate system, second referential three-dimensional coordinates of the vertex in the mark code according to the second motion position and pose, the information on the second image and the focal length of the image collection sensor;

calculating three-dimensional coordinates of the vertex in the mark code in the warehouse coordinate system based on the first referential three-dimensional coordinates and the second referential three-dimensional coordinates by using triangulation; and

calculating, according to target three-dimensional coordinates of the vertex in the mark code in the warehouse coordinate system, horizontal coordinates of the mark code in the warehouse coordinate system, and determining the horizontal coordinates as the mark position.

5. The method according to claim 2 , wherein the mark comprises a mark code, and the information of the mark comprises information on an image of the mark code, and the determining a mark position of the mark in the warehouse map based on the motion position and pose and the information of the mark comprises:

calculating referential three-dimensional coordinates of a vertex in the mark code in a coordinate system of the image collection sensor by using depth information of the image collection sensor and the information on the image;

converting the referential three-dimensional coordinates of the vertex into target three-dimensional coordinates in the warehouse coordinate system according to the motion position and pose; and

calculating horizontal coordinates of the mark code in the warehouse coordinate system according to the target three-dimensional coordinates, and determining the horizontal coordinates as the mark position.

6. The method according to claim 2 , wherein the determining the depositary place position of each depositary place on the rack in the warehouse map according to the preset depositary place information of the rack and the mark position comprises:

determining a position area, corresponding to the same group of marks, of the rack according to mark positions of the same group of marks;

dividing the position area according to the number of single-layer depositary places in the preset depositary place information, so as to acquire horizontal coordinates of depositary places of each layer; and

determining the horizontal coordinates of the depositary place as the depositary place position.

7. The method according to claim 1 , further comprising:

creating a corresponding relation between a preset depositary place mark of each depositary place on the rack and a corresponding depositary place position of the depositary place.

8. The method according to claim 1 , further comprising:

collecting a positioned position of the robot moving in the warehouse by using a robot positioning system when the robot picks goods according to the warehousing map;

acquiring information of a mark on a rack collected by the robot at the positioned position, and calculating a calculated position of the robot according to a mark position corresponding to the information of the mark;

calculating a positional deviation between the calculated position and the positioned position; and

calibrating the positioned position by using the positional deviation.

9. A non-transitory computer readable storage medium storing one or more programs, wherein the one or more programs are able to be executed by one or more processors, so as to implement the method according to claim 1 .

10. An electronic device, comprising: a memory, a processor, and a computer program which is stored on the memory and is runnable on the processor, wherein when executing the program, the processor is configured to:

generate, according to induction data collected when a robot moves in a warehouse, a warehouse map of the warehouse;

acquire a motion position and pose of the robot in real time, and acquire information of a mark on a rack collected by an image collection sensor on the robot, wherein at least one rack is arranged in the warehouse, each rack is provided with at least one group of marks, and an outer outline surface of the rack is provided with at least one mark;

determine a mark position of the mark in the warehouse map based on the motion position and pose and the information of the mark;

determine a rack position of the rack and a depositary place position of each depositary place on the rack in the warehouse map according to preset depositary place information of the rack and the mark position; and

determine a warehousing map of the warehouse according to the warehouse map, the rack position and the depositary place position.

11. The electronic device according to claim 10 , wherein the processor is further configured to:

create a corresponding relation between a preset depositary place mark of each depositary place on the rack and a corresponding depositary place position of the depositary place.

12. A robot, comprising:

an inductive sensor configured to collect induction data in a warehouse;

an image collection sensor configured to collect information of a mark on a rack of the warehouse;

a position and pose sensor configured to collect a motion position and pose of the robot; and

a processor configured to determine a mark position of the mark in a warehouse map based on the motion position and pose and the information of the mark; determine a depositary place position of each depositary place on the rack in the warehouse map according to preset depositary place information of the rack and the mark position; and create a corresponding relation between a preset depositary place mark of each depositary place on the rack and a corresponding depositary place position of the depositary place.

13. The robot according to claim 12 , wherein the processor is further configured to:

determine an origin in the warehouse; and

create a warehouse coordinate system of the warehouse based on the origin, wherein the warehouse map, the motion position and pose, the mark position, the rack position and the depositary place position are all in the warehouse coordinate system.

14. The robot according to claim 13 , wherein the processor is further configured to generate, according to the induction data collected when the robot moves in the warehouse, the warehouse map of the warehouse.

15. The robot according to claim 14 , wherein the processor is configured to:

acquire data of an outline of each object in the warehouse scanned by a radar on the robot;

draw data of a shape of the object in the warehouse according to the data of the outline; and

create the warehouse map of the warehouse in the warehouse coordinate system according to the data of the shape.

16. The robot according to claim 13 , wherein the mark comprises a mark code, the information of the mark comprises information on an image of the mark code, the motion position and pose comprises a first motion position and pose and a second motion position and pose, the information of the mark comprises information on a first image, collected in the first motion position and pose, of the mark code, and information on a second image, collected in the second motion position and pose, of the mark code; and

the processor is configured to:

determine, in the warehouse coordinate system, first referential three-dimensional coordinates of a vertex in the mark code according to the first motion position and pose, the information on the first image and a focal length of the image collection sensor;

determine, in the warehouse coordinate system, second referential three-dimensional coordinates of the vertex in the mark code according to the second motion position and pose, the information on the second image and the focal length of the image collection sensor;

calculate three-dimensional coordinates of the vertex in the mark code in the warehouse coordinate system based on the first referential three-dimensional coordinates and the second referential three-dimensional coordinates by using triangulation; and

calculate, according to target three-dimensional coordinates of the vertex in the mark code in the warehouse coordinate system, horizontal coordinates of the mark code in the warehouse coordinate system, and determining the horizontal coordinates as the mark position.

17. The robot according to claim 13 , wherein the mark comprises a mark code, and the information of the mark comprises information on an image of the mark code, and the processor is configured to:

calculate referential three-dimensional coordinates of a vertex in the mark code in a coordinate system of the image collection sensor by using depth information of the image collection sensor and the information on the image;

convert the referential three-dimensional coordinates of the vertex into target three-dimensional coordinates in the warehouse coordinate system according to the motion position and pose; and

calculate horizontal coordinates of the mark code in the warehouse coordinate system according to the target three-dimensional coordinates, and determining the horizontal coordinates as the mark position.

18. The robot according to claim 13 , wherein the processor is configured to:

determine a position area, corresponding to the same group of marks, of the rack according to mark positions of the same group of marks;

divide the position area according to the number of single-layer depositary places in the preset depositary place information, so as to acquire horizontal coordinates of depositary places of each layer; and

determine the horizontal coordinates of the depositary place as the depositary place position.

19. The robot according to claim 12 , wherein the processor is further configured to:

create a corresponding relation between a preset depositary place mark of each depositary place on the rack and a corresponding depositary place position of the depositary place.

20. The robot according to claim 12 , wherein the processor is further configured to:

collect a positioned position of the robot moving in the warehouse by using a robot positioning system when the robot picks goods according to the warehousing map;

acquire information of a mark on a rack collected by the robot at the positioned position, and calculating a calculated position of the robot according to a mark position corresponding to the information of the mark;

calculate a positional deviation between the calculated position and the positioned position; and

calibrate the positioned position by using the positional deviation.

Priority Claims (1)
CN 201910296683.2 · Apr 14, 2019 · national
Continuity (1)
Related Publication 20220088782A1 · Mar 24, 2022