IP Library › Granted Patent US 11,270,456
Granted Patent B2
US 11,270,456 · App. 16/620,680 · Granted Mar 8, 2022

Spatial positioning method, spatial positioning device, spatial positioning system and computer readable medium

Inventors: Zehua Dong (Beijing, CN); Hao Zhang (Beijing, CN); Lili Chen (Beijing, CN); Minglei Chu (Beijing, CN); Jiankang Sun (Beijing, CN); Ziqiang Guo (Beijing, CN); Zhanshan Ma (Beijing, CN); Bingxin Liu (Beijing, CN)
Assignees: Beijing BOE Optoelectronics Technology Co., Ltd.; BOE Technology Group Co., Ltd.
G06T7/73G06T7/13G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,270,456
App. No.
16/620,680
Granted
Mar 8, 2022
Kind
B2
Abstract

The present disclosure discloses a spatial positioning method, a spatial positioning device, a spatial positioning system and a computer readable medium. The spatial positioning method includes: capturing a feature image containing multiple feature markers of a to-be-positioned object; determining coordinate positions of respective feature markers in the feature image in an image coordinate system; traversing the respective feature markers in the image coordinate system according to preset multiple standard vector relations, and arbitrarily selecting at least three of the feature markers to calculate vector relations corresponding to the standard vector relations; determining position information of at least three feature markers according to position information corresponding to the standard vector relations in the image coordinate system when it is determined that the calculated vector relations satisfy any standard vector relation.

Claims (70)

1. A spatial positioning method, applied to an infrared image capturing device, wherein the method comprises:

capturing a feature image containing multiple feature markers of an object that needs to be positioned; wherein at least one surface of the object that needs to be positioned has multiple feature markers, and geometric shapes formed by the feature markers on respective surfaces are different; wherein the feature markers are luminous bodies or reflectors, and when the reflectors are used as the feature markers, the object that needs to be positioned is illuminated by specific light sources;

determining coordinate positions of respective feature markers in the feature image in an image coordinate system;

traversing the respective feature markers in the image coordinate system according to preset multiple standard vector relations, and arbitrarily selecting at least three of the feature markers to calculate vector relations corresponding to the standard vector relations;

determining position information of the at least three feature markers according to position information corresponding to the standard vector relations in the image coordinate system when it is determined that the calculated vector relations satisfy any standard vector relation, and

determining a relative position relationship between the object that needs to be positioned and an image capturing component, according to the position information of the feature markers and position information of the image capturing component.

2. The spatial positioning method according to claim 1 , wherein each surface of the object that needs to be positioned has multiple feature markers, the geometric shapes formed by the feature markers on respective surfaces are different, and each feature marker has unique position information relative to the object that needs to be positioned.

3. The spatial positioning method according to claim 1 , wherein, the determining the coordinate positions of the respective feature markers in the feature image in the image coordinate system further comprises:

performing binarization processing on the captured feature image;

extracting contours of the respective feature markers in the feature image subjected to the binarization processing; and

determining contour moments of respective feature markers, and taking center-of-mass coordinates of the contour moments of respective feature markers as coordinate positions of respective feature markers in the image coordinate system.

4. The spatial positioning method according to claim 1 , wherein, the arbitrarily selecting the at least three of the feature markers to calculate the vector relations corresponding to the standard vector relations further comprises:

arbitrarily selecting at least four of the feature markers, and normalizing coordinates of the selected at least four feature markers to determine the normalized coordinates;

calculating vectors of other feature markers to one of the at least four feature markers according to the normalized coordinates, and summing the vectors; and

determining a first included angle between the vector sum and a set coordinate axis of a coordinate system corresponding to the normalized coordinates; and

determining whether the calculated vector relations satisfy any standard vector relation, further comprises:

determining whether the first included angle is within a range of a first threshold value.

5. The spatial positioning method according to claim 4 , wherein, the normalizing the coordinates of the selected at least four feature markers to determine the normalized coordinates further comprises:

selecting one of the feature markers as an origin of the coordinate system corresponding to the normalized coordinates;

calculating distances from other feature markers to the origin; and

selecting a longest distance among the distances as a standard, and normalizing coordinates of other feature markers to obtain normalized coordinates of the other feature markers.

6. The spatial positioning method according to claim 1 , wherein, the arbitrarily selecting the at least three of the feature markers to calculate the vector relations corresponding to the standard vector relations further comprises:

arbitrarily selecting at least four and even number of the feature markers, and normalizing coordinates of the selected at least four feature markers to determine the normalized coordinates;

calculating vector between every two feature markers according to the normalized coordinates; and

determining second included angles between any two vectors with no intersection; and

determining whether the calculated vector relations satisfy any standard vector relation, further comprises:

determining whether the respective second included angles are within a range of a second threshold value.

7. The spatial positioning method according to claim 1 , wherein, the determining the position information of the at least three feature markers according to the position information corresponding to the standard vector relations in the image coordinate system further comprises:

determining a geometric shape to which the at least three feature markers belong according to the standard vector relations; and

determining the position information of the respective feature markers in the geometric shape according to distance information and relative position relations among the at least three feature markers.

8. The spatial positioning method according to claim 1 , wherein, there are multiple standard vector relations corresponding to a geometric shape; and

determining whether the calculated vector relations satisfy any standard vector relation, further comprises:

determining whether the calculated vector relations satisfy all standard vector relations corresponding to the geometric shape.

9. A non-transitory computer readable medium, comprising program codes configured for enabling a computing device to perform the spatial positioning method according to claim 1 when the program codes run on the computing device.

10. An infrared image capturing device, comprising: at least one processor and a memory, wherein the at least one processor is configured to read and execute programs stored in the memory to:

capture a feature image containing multiple feature markers of an object that needs to be positioned; wherein at least one surface of the object that needs to be positioned has multiple feature markers, and geometric shapes formed by the feature markers on respective surfaces are different; determine coordinate positions of respective feature markers in the feature image in an image coordinate system; wherein the feature markers are luminous bodies or reflectors, and when the reflectors are used as the feature markers, the object that needs to be positioned is illuminated by specific light sources;

traverse the respective feature markers in the image coordinate system according to preset multiple standard vector relations, arbitrarily select at least three of feature markers to calculate vector relations corresponding to the standard vector relations, and determine whether the calculated vector relations satisfy any standard vector relation;

determine position information of the at least three feature markers according to position information corresponding to the standard vector relations in the image coordinate system when it is determined that the calculated vector relations satisfy any standard vector relation; and

determine a relative position relationship between the object that needs to be positioned and an image capturing component, according to the position information of the feature markers and position information of the image capturing component.

11. The infrared image capturing device according to claim 10 , wherein the at least one processor is further configured to read and execute programs stored in the memory to:

perform binarization processing on the captured feature image;

extract contours of the respective feature markers in the feature image subjected to the binarization processing; and

determine contour moments of respective feature markers, and take center-of-mass coordinates of the contour moments of respective feature markers as coordinate positions of respective feature markers in the image coordinate system.

12. The infrared image capturing device according to claim 10 , wherein the at least one processor is further configured to read and execute programs stored in the memory to:

arbitrarily select at least four of the feature markers, and normalize coordinates of the selected at least four feature markers to determine the normalized coordinates;

calculate vectors of other feature markers to one of the at least four feature markers according to the normalized coordinates, and sum the vectors;

determine a first included angle between the vector sum and a set coordinate axis of a coordinate system corresponding to the normalized coordinates; and

determine whether the first included angle is within a range of a first threshold value.

13. The infrared image capturing device according to claim 12 , wherein the at least one processor is further configured to read and execute programs stored in the memory to:

select one of the feature markers as an origin of the coordinate system corresponding to the normalized coordinates;

calculate distances from other feature markers to the origin; and

select a longest distance among the distances as a standard, and normalize coordinates of other feature markers to obtain normalized coordinates of the other feature markers.

14. The infrared image capturing device according to claim 10 , wherein the at least one processor is further configured to read and execute programs stored in the memory to:

arbitrarily select at least four of the feature markers, and normalize coordinates of the selected at least four and even number of feature markers to determine the normalized coordinates;

calculate vectors between every two feature markers according to the normalized coordinates;

determine second included angles between any two vectors with no intersection; and

determine whether the respective second included angles are within a range of a second threshold value.

15. The infrared image capturing device according to claim 10 , wherein the at least one processor is further configured to read and execute programs stored in the memory to:

determine a geometric shape to which the at least three feature markers belong according to the standard vector relations; and

determine the position information of the respective feature markers in the geometric shape according to distance information and relative position relations among the at least three feature markers.

16. The infrared image capturing device according to claim 10 , wherein there are multiple standard vector relations corresponding to a geometric shape; and

the at least one processor is further configured to read and execute programs stored in the memory to: determine whether the calculated vector relations satisfy all standard vector relations corresponding to any geometric shape.

17. A spatial positioning system, comprising: infrared image capturing device, and an object that needs to be positioned; wherein

the infrared image capturing device comprises: at least one processor and a memory, wherein the at least one processor is configured to read and execute programs stored in the memory to:

capture a feature image containing multiple feature markers of the object that needs to be positioned; wherein at least one surface of the object that needs to be positioned has multiple feature markers, and geometric shapes formed by the feature markers on respective surfaces are different wherein the feature markers are luminous bodies or reflectors, and when the reflectors are used as the feature markers, the object that needs to be positioned is illuminated by specific light sources;

determine coordinate positions of respective feature markers in the feature image in an image coordinate system;

traverse the respective feature markers in the image coordinate system according to preset multiple standard vector relations, arbitrarily select at least three of feature markers to calculate vector relations corresponding to the standard vector relations, and determine whether the calculated vector relations satisfy any standard vector relation;

determine position information of the at least three feature markers according to position information corresponding to the standard vector relations in the image coordinate system when it is determined that the calculated vector relations satisfy any standard vector relation; and

determine a relative position relationship between the object that needs to be positioned and an image capturing component, according to the position information of the feature markers and position information of the image capturing component;

wherein at least one surface of the object that needs to be positioned is provided with multiple feature markers, and geometric shapes formed by the feature markers on respective surfaces are different.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE TO ADD THE EIGHTH INVENTOR OMITTED PREVIOUSLY RECORDED AT REEL: 051218 FRAME: 0032. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 24, 2020
From: DONG, ZEHUA; ZHANG, HAO; CHEN, LILI; CHU, MINGLEI; SUN, JIANKANG; GUO, ZIQIANG; MA, ZHANSHAN; LIU, BINGXIN
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 054452/0702 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2019
From: DONG, ZEHUA; ZHANG, HAO; CHEN, LILI; CHU, MINGLEI; SUN, JIANKANG; GUO, ZIQIANG; MA, ZHANSHAN; LIU BINGXIN
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 051218/0032 →
Priority Claims (1)
CN 201810552221.8 · May 31, 2018 · national
Continuity (1)
Related Publication 20210142507A1 · May 13, 2021