IP Library Granted Patent US 12,270,906
Granted Patent B2
US 12,270,906 · App. 18/483,416 · Granted Apr 8, 2025

Method, apparatus, and system for vibration measurement for sensor bracket and movable device

Inventors: Jian Lu (Beijing, CN); Pingyuan Ji (Beijing, CN); Haiquan Li (Beijing, CN); Jianan Hao (Beijing, CN)
Assignee: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
G01S17/50G01S17/88H04N23/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,270,906
App. No.
18/483,416
Granted
Apr 8, 2025
Kind
B2
Abstract

The present disclosure relates to sensor technology, and provides a method, an apparatus, and a system for vibration measurement for a sensor bracket as well as a movable device. The method is applied in a system for vibration measurement for the sensor bracket. The system includes the sensor bracket to be measured that is mounted on a movable device, and a marker on the sensor bracket to be measured, and a first sensor provided on the sensor bracket to be measured for collecting marker information. The method includes: collecting the marker information of the marker on the sensor bracket to be measured using the first sensor; determining a vibration measurement reference point based on the marker information, and obtaining vibration condition data of the vibration measurement reference point; and determining a vibration evaluation result for the sensor bracket based on the vibration condition data of the vibration measurement reference point.

Claims (57)

1. A method for vibration measurement for a sensor bracket, applied in a system for vibration measurement for the sensor bracket, the system comprising the sensor bracket that is mounted on a movable device, and a marker on the sensor bracket, and a sensor provided on the sensor bracket, wherein the marker has one or more sets of marks to be measured, each set of marks to be measured comprising two marks to be measured, with an initial position of a line connecting respective centers of the two marks to be measured being parallel to a plane on which the movable device is movable, wherein the marker has a plate-shaped structure with a front surface and a rear surface, and the front surface has the one or more sets of marks to be measured; the line connecting respective centers of the two marks to be measured is perpendicular to a direction in which the sensor bracket extends; the sensor is a first sensor mounted at an end of the sensor bracket; and a second sensor is mounted at another end of the sensor bracket, and the rear surface is fixedly connected to the second sensor, wherein the method comprises:

collecting marker information of the marker using the sensor;

determining a vibration measurement reference point based on the marker information; and

determining a vibration evaluation result for the sensor bracket based on a vibration condition of the vibration measurement reference point.

2. The method of claim 1 , wherein the sensor bracket is configured to have a binocular camera set mounted thereon, the binocular camera set comprising two cameras; the sensor bracket has camera mounting positions on both sides where the two cameras are to be mounted, respectively; and the marker is provided at one of the camera mounting positions, and the sensor is provided at the other of the camera mounting positions.

3. The method of claim 1 , wherein said collecting the marker information of the marker using the sensor comprises:

collecting each set of marks to be measured on the marker using the first sensor, and determining edge information of the two marks to be measured in each set of marks to be measured.

4. The method of claim 3 , wherein said determining the vibration measurement reference point based on the marker information comprises:

determining respective mark center points of the two marks to be measured in each set of marks to be measured based on the edge information of the two marks to be measured in the set of marks to be measured; and

determining the vibration measurement reference point based on the respective mark center points of the two marks to be measured in each set of marks to be measured,

wherein said determining the vibration evaluation result for the sensor bracket based on the vibration condition of the vibration measurement reference point comprises:

obtaining offset positions of the vibration measurement reference point at respective time points and pitches of the sensor bracket.

5. The method of claim 4 , wherein said determining the vibration evaluation result for the sensor bracket based on the vibration condition of the vibration measurement reference point further comprises:

determining the vibration evaluation result for the sensor bracket based on the offset positions of the vibration measurement reference point at the respective time points, the pitches of the sensor bracket, a predetermined offset position range, and a predetermined pitch threshold, wherein the vibration evaluation result for the sensor bracket is determined as passing an evaluation when each of the offset positions at the respective time points is within the predetermined offset position range, and each of the pitches at the respective time points is smaller than or equal to the predetermined pitch threshold, or the vibration evaluation result for the sensor bracket is determined as failing the evaluation when any of the offset positions at the respective time points is outside the predetermined offset position range, or any of the pitches at the respective time points is larger than the predetermined pitch threshold.

6. The method of claim 4 , wherein each mark to be measured is a square ArUco code, and the first sensor is a vehicle-mounted camera, and said collecting each set of marks to be measured on the marker using the first sensor, and determining the edge information of the two marks to be measured in each set of marks to be measured comprises:

collecting each set of square ArUco codes on the marker using the vehicle-mounted camera, and determining edge point positions of four corners of each square ArUco code in each set of square ArUco codes.

7. The method of claim 6 , wherein said determining the respective mark center points of the two marks to be measured in each set of marks to be measured based on the edge information of the two marks to be measured in the set of marks to be measured comprises:

determining the mark center point of each square ArUco code in each set of square ArUco codes based on the edge point positions of the four corners of the square ArUco code.

8. The method of claim 7 , wherein said determining the vibration measurement reference point based on the respective mark center points of the two marks to be measured in each set of marks to be measured comprises:

obtaining a midpoint between the respective mark center points of the two square ArUco codes in each set of square ArUco codes, and determining a vibration measurement reference point based on the midpoint corresponding to each set of square ArUco codes,

wherein said obtaining the offset positions of the vibration measurement reference point at the respective time points and the pitches of the sensor bracket comprises:

determining, in real time, the offset positions of the vibration measurement reference point at the respective time points based on positions of the midpoint between the respective mark center points of the two square ArUco codes in each set of square ArUco codes at the respective time points; and

obtaining a deflection angle between a line connecting the respective mark center points of the two square ArUco codes in each set of square ArUco codes and the plane on which the movable device is movable, and determining the pitches of the sensor bracket based on the deflection angle corresponding to each set of square ArUco codes.

9. The method of claim 4 , wherein a material of the plate-shaped structure has a laser reflection intensity different from that of a material of the mark to be measured, each mark to be measured is a square sheet, and the first sensor is a vehicle-mounted laser radar, and said collecting each set of marks to be measured on the marker using the first sensor, and determining the edge information of the two marks to be measured in each set of marks to be measured comprises:

collecting point cloud data of each set of square sheets on the marker using the vehicle-mounted laser radar, and determining edge point positions of four corners of each square sheet in each set of square sheets based on the point cloud data of the set of square sheets.

10. The method of claim 9 , wherein said determining the respective mark center points of the two marks to be measured in each set of marks to be measured based on the edge information of the two marks to be measured in the set of marks to be measured comprises:

determining the mark center point of each square sheet in each sets of square sheets based on the edge point positions of the four corners of the square sheet.

11. The method of claim 10 , wherein said determining the vibration measurement reference point based on the respective mark center points of the two marks to be measured in each set of marks to be measured comprises:

obtaining a midpoint between the respective mark center points of the two square sheets in each set of square sheets, and determining a vibration measurement reference point based on the midpoint corresponding to each set of square sheets,

wherein, said obtaining the offset positions of the vibration measurement reference point at the respective time points and the pitches of the sensor bracket comprises:

determining, in real time, the offset positions of the vibration measurement reference point at the respective time points based on positions of the midpoint between the respective mark center points of the two square sheets in each set of square sheets at the respective time points; and

obtaining a deflection angle between a line connecting the respective center points of the two square sheets in each set of square sheets and the plane on which the movable device is movable, and determining the pitches of the sensor bracket to be measured based on the deflection angle corresponding to each set of square sheets.

12. An apparatus for vibration measurement for a sensor bracket, comprising:

a memory; and

one or more processors communicatively coupled to the memory, wherein

the memory stores instructions that, when executed by the one or more processors, causing the apparatus to perform the method of claim 1 .

13. A system for vibration measurement for a sensor bracket, comprising:

an apparatus for vibration measurement for the sensor bracket;

the sensor bracket that is mounted on a movable device, and

a marker on the sensor bracket, and a sensor provided on the sensor bracket, the sensor being communicatively connected to the apparatus for vibration measurement for the sensor bracket, wherein the marker has one or more sets of marks to be measured, each set of marks to be measured comprising two marks to be measured, with an initial position of a line connecting respective centers of the two marks to be measured being parallel to a plane on which the movable device is movable,

wherein the marker has a plate-shaped structure with a front surface and a rear surface, and the front surface has the one or more sets of marks to be measured; the line connecting respective centers of the two marks to be measured is perpendicular to a direction in which the sensor bracket extends; the sensor is a first sensor mounted at an end of the sensor bracket; and a second sensor is mounted at another end of the sensor bracket, and the rear surface is fixedly connected to the second sensor; and wherein

the apparatus for vibration measurement for the sensor bracket is configured to:

collect marker information of the marker using the sensor;

determine a vibration measurement reference point based on the marker information; and

determine a vibration evaluation result for the sensor bracket based on a vibration condition of the vibration measurement reference point.

14. The system of claim 13 , wherein the sensor bracket is configured to have a binocular camera set mounted thereon, the binocular camera set comprising two cameras; the sensor bracket has camera mounting positions on both sides where the two cameras are to be mounted, respectively; and the marker is provided at one of the camera mounting positions, and the sensor is provided at the other of the camera mounting positions.

15. The system of claim 13 , wherein the marker has a plate-shaped structure with a front surface and a rear surface, and the front surface has the one or more sets of marks to be measured; and the line connecting respective centers of the two marks to be measured is perpendicular to a direction in which the sensor bracket extends; the sensor is a first sensor mounted at an end of the sensor bracket; and a second sensor is mounted at another end of the sensor bracket, and the rear surface is fixedly connected to the second sensor.

16. The system of claim 15 , wherein the apparatus for vibration measurement for the sensor bracket is configured to:

collect each set of marks to be measured on the marker using the first sensor, and determine edge information of the two marks to be measured in each set of marks to be measured.

17. The system of claim 16 , wherein the apparatus for vibration measurement for the sensor bracket is configured to:

determine respective mark center points of the two marks to be measured in each set of marks to be measured based on the edge information of the two marks to be measured in the set of marks to be measured; and

determine the vibration measurement reference point based on the respective mark center points of the two marks to be measured in each set of marks to be measured, and obtain offset positions of the vibration measurement reference point at respective time points and pitches of the sensor bracket.

18. A movable device, comprising the system for vibration measurement for a sensor bracket according to claim 13 .

19. A non-transitory computer readable storage medium, comprising program instructions which, when executed by a processor of a computing device, cause the device to:

collecting marker information of a marker on a sensor bracket mounted on a movable device using a sensor provided on the sensor bracket, wherein the marker has one or more sets of marks to be measured, each set of marks to be measured comprising two marks to be measured, with an initial position of a line connecting respective centers of the two marks to be measured being parallel to a plane on which the movable device is movable, wherein the marker has a plate-shaped structure with a front surface and a rear surface, and the front surface has the one or more sets of marks to be measured; the line connecting respective centers of the two marks to be measured is perpendicular to a direction in which the sensor bracket extends; the sensor is a first sensor mounted at an end of the sensor bracket; and a second sensor is mounted at another end of the sensor bracket, and the rear surface is fixedly connected to the second sensor;

determining a vibration measurement reference point based on the marker information; and

determining a vibration evaluation result for the sensor bracket based on a vibration condition of the vibration measurement reference point.

Assignments (2)
CHANGE OF NAME Recorded Dec 9, 2025
From: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
To: BEIJING OCGEN TECHNOLOGY CO., LTD.
Reel/Frame 073916/0416 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2023
From: LU, JIAN; JI, PINGYUAN; LI, HAIQUAN; HAO, JIANAN
To: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
Reel/Frame 065461/0102 →
Priority Claims (1)
CN 201911011742.3 · Oct 23, 2019 · national
Continuity (2)
Continuation 17079113 · Oct 23, 2020
Related Publication 20240053475A1 · Feb 15, 2024
References Cited (26)
US 11828828B2 · Lu · 2023 [cited by examiner]
US 20190033147A1 · Zerwekh et al. · 2019 [cited by applicant]
US 20200074675A1 · Cejka et al. · 2020 [cited by applicant]
US 20200342627A1 · Wang et al. · 2020 [cited by applicant]
US 20210124051A1 · Lu et al. · 2021 [cited by applicant]
CN 101387546A · 2009 [cited by examiner]
CN 102322938A · 2012 [cited by applicant]
CN 106017839A · 2016 [cited by applicant]
CN 106780609A · 2017 [cited by applicant]
CN 107168398A · 2017 [cited by applicant]
CN 107449578A · 2017 [cited by applicant]
CN 109204160A · 2019 [cited by examiner]
CN 109313811B · 2019 [cited by applicant]
KR 20160096000A · 2016 [cited by applicant]
Lei Jing-fa, et al. “A Measurement Method of Plane Angle Based on Machine Vision,” Journal of South China University of Technology, Natural Science Edition, vol. 39, No. 8, Aug. 2022, pp. 1-6. [cited by applicant]
Zhu, Fang-wen, et al. “An AR Tracker Based on Planar Marker,” Journal of Shanghai University, Natural Science, vol. 10, No. 5, Oct. 2004, pp. 1-5. [cited by applicant]
Yuanwen, Wang. et al. “Influence of sensor vibration on torsional vibration measurement and its elimination method,” Journal of Vibration, Measurement & Diagnosis, Vibration Testing and Diagnosis, vol. 37, No. 5, Oct. 2… [cited by applicant]
Xu Chao, et al. “Machine Vision Based Vibration Displacement Measurement of Large Flexible Structures,” Journal of Vibration, Measurement & Diagnosis, vol. 37, No. Aug. 4, 2017, pp. 1-7. [cited by applicant]
Zhang, Wei, et al. “Marker of Monocular Vision Based on Surgical Navigation System,” China Digital Medicine, vol. 11, No. 10, pp. 57-59 (Nov. 10, 2016). [cited by applicant]
No Author. “Research on low frequency vibration of large structures based on video tracking,” China Academic Journal Electronic Publishing House. 2018. pp. 1-7. [cited by applicant]
Shu, Xinwei, et al. “The measurement of low frequency vibration based on stereo vision,” Optical Instruments, vol. 38, No. 2, Apr. 2016, pp. 1-6. [cited by applicant]
Ma, Tianbing, et al. “Vibration displacement measurement of flexible manipulator using machine vision,” vol. 36 (13) 2018, pp. 1-6. [cited by applicant]
Xu Xiuxiu et al. “Vibration measurement of Flexible beam based on machine vision,” J. Huazhong University of Science & Technology, Natural Science Edition, vol. 41, Sup. I, Oct. 2013, pp. 1-4. [cited by applicant]
No Author. Chinese Application No. 201911011742.3 First Office Action, Mailed Nov. 2, 2022, pp. 1-25. [cited by applicant]
Chinese Patent Office, Notice of Rejection for CN Appl. 201911011742.3, mailed Sep. 28, 2023, 19 pages with English translation. [cited by applicant]
English translation of Chinese Office Action from corresponding Chinese Patent Application No. 201911011742.3, dated May 16, 2023, (34 pages). [cited by applicant]