Localization method and apparatus for control apparatus, device, storage medium and computer program product

1 . A localization method for a control apparatus, wherein the method is applied to a first control apparatus, a camera is installed on the first control apparatus, and the method comprises:

collecting, by the camera and at a moment T 1 , an external environment where the first control apparatus is located, thereby obtaining first point cloud data;

acquiring inertial measurement unit data of the first control apparatus at the moment T 1 and a first point cloud map of the external environment; and

determining six-degrees-of-freedom data of the first control apparatus according to the first point cloud data, the inertial measurement unit data and the first point cloud map,

wherein the first point cloud map comprises historical point cloud data that is collected by the first control apparatus and a second control apparatus from the external environment relative to the moment T 1 ;

wherein the method further comprises:

comparing whether there is a difference between the first point cloud data and the first point cloud map; and

in a case where there is a difference between the first point cloud data and the first point cloud map, updating a difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

2 . The method according to claim 1 , wherein updating the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus comprises:

when a target condition is satisfied, updating the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

3 . The method according to claim 2 , wherein the target condition comprises at least one of the following that:

a preset duration after the moment T 1 is reached; or

a cumulative size of the difference part between the first point cloud data and the first point cloud map and a difference part between point cloud data, which is collected by the camera from the external environment after the moment T 1 , and the first point cloud map reaches a preset size.

4 . The method according to claim 3 , further comprising:

receiving a difference part, which is sent by the second control apparatus, between second point cloud data and the first point cloud map; and

updating a difference part between the second point cloud data and the first point cloud map into the first point cloud map,

wherein the second point cloud data is point cloud data obtained by the second control apparatus by collecting the external environment at the moment T 1 by a camera of the second control apparatus.

5 . The method according to claim 1 , further comprising: before collecting, by the camera and at the moment T 1 , the external environment where the first control apparatus is located, thereby obtaining first point cloud data,

switching a mode of the first control apparatus from an initial mode to a self-tracking mode,

wherein the initial mode is a mode in which the first control apparatus is operated by an arm model.

6 . The method according to claim 5 , further comprising:

when the mode of the first control apparatus is the initial mode, receiving historical point cloud data that is collected by the second control apparatus from the external environment relative to a moment T 2 ; and

determining a second point cloud map according to the historical point cloud data that is collected by the second control apparatus from the external environment relative to the moment T 2 .

7 . The method according to claim 1 , wherein the first point cloud map is stored in a target database; and

the target database is a database shared by the first control apparatus and the second control apparatus.

8 . A control apparatus, comprising:

a processor; and

a memory, configured to store an executable instruction of the processor,

wherein the processor is configured to, via executing the executable instruction:

collect, by a camera and at a moment T 1 , an external environment where a first control apparatus is located, thereby obtaining first point cloud data;

acquire inertial measurement unit data of the first control apparatus at the moment T 1 and a first point cloud map of the external environment; and

determine six-degrees-of-freedom data of the first control apparatus according to the first point cloud data, the inertial measurement unit data and the first point cloud map,

wherein the first point cloud map comprises historical point cloud data that is collected by the first control apparatus and a second control apparatus from the external environment relative to the moment T 1 ;

wherein the processor is further configured to:

compare whether there is a difference between the first point cloud data and the first point cloud map; and

in a case where there is a difference between the first point cloud data and the first point cloud map, update a difference part between the first point cloud data and the first point cloud map into the first point cloud map, and send the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

9 . A non-volatile computer-readable storage medium, storing a computer program thereon, wherein the computer program, when executed by a processor, implements:

collecting, by a camera and at a moment T 1 , an external environment where a first control apparatus is located, thereby obtaining first point cloud data;

acquiring inertial measurement unit data of the first control apparatus at the moment T 1 and a first point cloud map of the external environment; and

determining six-degrees-of-freedom data of the first control apparatus according to the first point cloud data, the inertial measurement unit data and the first point cloud map,

wherein the first point cloud map comprises historical point cloud data that is collected by the first control apparatus and a second control apparatus from the external environment relative to the moment T 1 ;

wherein the computer program further implements:

comparing whether there is a difference between the first point cloud data and the first point cloud map; and

in a case where there is a difference between the first point cloud data and the first point cloud map, updating a difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

10 . The control apparatus according to claim 8 , wherein the processor is configured to update the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and send the difference part between the first point cloud data and the first point cloud map to the second control apparatus by being configured to:

when a target condition is satisfied, update the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and send the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

11 . The control apparatus according to claim 10 , wherein the target condition comprises at least one of the following that:

a preset duration after the moment T 1 is reached; or

a cumulative size of the difference part between the first point cloud data and the first point cloud map and a difference part between point cloud data, which is collected by the camera from the external environment after the moment T 1 , and the first point cloud map reaches a preset size.

12 . The control apparatus according to claim 11 , wherein the processor is further configured to:

receive a difference part, which is sent by the second control apparatus, between second point cloud data and the first point cloud map, which is sent by the second control apparatus; and

update a difference part between the second point cloud data and the first point cloud map into the first point cloud map,

wherein the second point cloud data is point cloud data obtained by the second control apparatus by collecting the external environment at the moment T 1 by a camera of the second control apparatus.

13 . The control apparatus according to claim 8 , wherein the processor is further configured to: before collecting, by the camera and at the moment T 1 , the external environment where the first control apparatus is located, thereby obtaining first point cloud data,

switch a mode of the first control apparatus from an initial mode to a self-tracking mode,

wherein the initial mode is a mode in which the first control apparatus is operated by an arm model.

14 . The control apparatus according to claim 13 , wherein the processor is further configured to:

when the mode of the first control apparatus is the initial mode, receive historical point cloud data that is collected by the second control apparatus from the external environment relative to a moment T 2 ; and

determine a second point cloud map according to the historical point cloud data that is collected by the second control apparatus from the external environment relative to the moment T 2 .

15 . The control apparatus according to claim 8 , wherein the first point cloud map is stored in a target database; and

the target database is a database shared by the first control apparatus and the second control apparatus.

16 . The non-volatile computer-readable storage medium according to claim 9 , wherein updating the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus comprises:

when a target condition is satisfied, updating the difference part between the first point cloud data and the first point cloud map into the first point cloud map, and sending the difference part between the first point cloud data and the first point cloud map to the second control apparatus.

17 . The non-volatile computer-readable storage medium according to claim 16 , wherein the target condition comprises at least one of the following that:

a preset duration after the moment T 1 is reached; or

a cumulative size of the difference part between the first point cloud data and the first point cloud map and a difference part between point cloud data, which is collected by the camera from the external environment after the moment T 1 , and the first point cloud map reaches a preset size.