IP Library Granted Patent US 12,548,601
Granted Patent B2
US 12,548,601 · App. 18/516,982 · Granted Feb 10, 2026

Time synchronization method of video information and bus packet formation and electronic device

Inventors: Chu Liu (Shanghai, CN); Yueyin Xie (Shanghai, CN); Mang Mo (Shanghai, CN)
Assignee: SHANGHAI TOSUN TECHNOLOGY LTD.
G11B27/34H04N5/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,548,601
App. No.
18/516,982
Granted
Feb 10, 2026
Kind
B2
Abstract

A time synchronization method of video information and bus packet information includes: defining a timestamp of the video information as a basic timestamp; upon starting recording, obtaining a first-frame timestamp T0 of the video information, and aligning a first-frame timestamp of the bus packets with the first-frame timestamp T0 of the video information and recording each frame timestamp Ty of the aligned bus packets; upon stopping recording, obtaining a tail-frame timestamp T1 of the video information and a tail-frame timestamp T2 of the bus packets; setting a ratio coefficient k=(T1−T0)/(T2−T0); traversing all recorded bus packets and modifying and storing each frame timestamp Ty of these bus packets as Tx, wherein Tx=T0+(Ty−T0)*k; and each frame timestamp Tx of the bus packets is recorded with a clock of the video information as basis.

Claims (62)

1 . A time synchronization method of video information and bus packet information, comprising:

defining a timestamp of the video information as a basic timestamp;

upon starting recording, obtaining a first-frame timestamp T0 of the video information, and aligning a first-frame timestamp of bus packets with the first-frame timestamp T0 of the video information to obtain aligned bus packets and recording each frame timestamp Ty of the aligned bus packets;

upon stopping recording, obtaining a tail-frame timestamp T1 of the video information and a tail-frame timestamp T2 of the bus packets;

setting a ratio coefficient k=(T1−T0)/(T2−T0);

traversing all recorded bus packets and modifying and storing each frame timestamp Ty of the bus packets as Tx, wherein Tx=T0+(Ty−T0)*k; and each frame timestamp Tx of the bus packets is recorded with a clock of the video information as basis;

wherein the time synchronization method is applied in a vehicle advanced driving assistance system (ADAS).

2 . The time synchronization method according to claim 1 , wherein

a method of aligning the first-frame timestamp collected for the bus packets with the first-frame timestamp T0 of the video information to obtain the aligned bus packets and recording each frame timestamp Ty collected for the aligned bus packets comprises:

defining the first-frame timestamp collected for the bus packets as T3;

defining a timestamp collected for any bus packet in a recording process as T, and obtaining each frame timestamp Ty collected for the aligned bus packets as Ty=T−T3+T0.

3 . The time synchronization method according to claim 1 , wherein

the video information is transmitted in real time to a computer; and,

the bus packets are transmitted to the computer via a bus adapter.

4 . The time synchronization method according to claim 1 , wherein

a transmission frame rate of the bus packets is greater than or equal to 1000 frames/second.

5 . A computer readable storage medium, storing computer readable instructions, wherein the computer readable instructions are executed by at least one processor to perform the time synchronization method according to claim 1 .

6 . The computer readable storage medium according to claim 5 , wherein

a method of aligning the first-frame timestamp collected for the bus packets with the first-frame timestamp T0 of the video information to obtain the aligned bus packets and recording each frame timestamp Ty collected for the aligned bus packets comprises:

defining the first-frame timestamp collected for the bus packets as T3;

defining a timestamp collected for any bus packet in a recording process as T, and obtaining each frame timestamp Ty collected for the aligned bus packets as Ty=T−T3+T0.

7 . The computer readable storage medium according to claim 5 , wherein

a transmission frame rate of the bus packets is greater than or equal to 1000 frames/second.

8 . An apparatus, comprising:

at least one readable storage medium, storing instructions;

at least one processor, configured to execute the instructions to perform the operations of:

defining a timestamp of video information as a basic timestamp;

upon starting recording, obtaining a first-frame timestamp T0 of the video information, and aligning a first-frame timestamp of bus packets with the first-frame timestamp T0 of the video information to obtain aligned bus packets and recording each frame timestamp Ty of the aligned bus packets;

upon stopping recording, obtaining a tail-frame timestamp T1 of the video information and a tail-frame timestamp T2 of the bus packets;

setting a ratio coefficient k=(T1−T0)/(T2−T0);

traversing all recorded bus packets and modifying and storing each frame timestamp Ty of the bus packets as Tx, wherein Tx=T0+(Ty−T0)*k; and

each frame timestamp Tx of the bus packets is recorded with a clock of the video information as basis;

wherein the operations are performed for a time synchronization of video information and bus packet information in a vehicle ADAS.

9 . The apparatus according to claim 8 , wherein

a method of aligning the first-frame timestamp collected for the bus packets with the first-frame timestamp T0 of the video information to obtain the aligned bus packets and recording each frame timestamp Ty collected for the aligned bus packets comprises:

defining the first-frame timestamp collected for the bus packets as T3;

defining a timestamp collected for any bus packet in a recording process as T, and obtaining each frame timestamp Ty collected for the aligned bus packets as Ty=T−T3+T0.

10 . The apparatus according to claim 8 , wherein

the video information is transmitted in real time; and,

the bus packets are transmitted via a bus adapter.

11 . The apparatus according to claim 10 , wherein

a transmission frame rate of the bus packets is greater than or equal to 1000 frames/second.

12 . An electronic device, comprising a processor, a display communicating with the processor to present a graphic interface, and a readable storage medium, wherein

the readable storage medium is configured to store an instruction program;

the processor is configured to execute the instruction program to perform the operations of:

defining a timestamp of video information as a basic timestamp;

upon starting recording, obtaining a first-frame timestamp T0 of the video information, and aligning a first-frame timestamp of bus packets with the first-frame timestamp T0 of the video information to obtain aligned bus packets and recording each frame timestamp Ty of the aligned bus packets;

upon stopping recording, obtaining a tail-frame timestamp T1 of the video information and a tail-frame timestamp T2 of the bus packets;

setting a ratio coefficient k=(T1−T0)/(T2−T0);

traversing all recorded bus packets and modifying and storing each frame timestamp Ty of the bus packets as Tx, wherein Tx=T0+(Ty−T0)*k; and

each frame timestamp Tx of the bus packets is recorded with a clock of the video information as basis;

the display is configured to display the time-synchronized bus packets and video information via the graphic interface;

wherein the operations are performed for a time synchronization of video information and bus packet information in a vehicle ADAS.

13 . The electronic device according to claim 12 , wherein

a method of aligning the first-frame timestamp collected for the bus packets with the first-frame timestamp T0 of the video information to obtain the aligned bus packets and recording each frame timestamp Ty collected for the aligned bus packets comprises:

defining the first-frame timestamp collected for the bus packets as T3;

defining a timestamp collected for any bus packet in a recording process as T, and obtaining each frame timestamp Ty collected for the aligned bus packets as Ty=T−T3+T0.

14 . The electronic device according to claim 12 , wherein

the video information is transmitted in real time; and,

the bus packets are transmitted via a bus adapter.

15 . The electronic device according to claim 12 , wherein

a transmission frame rate of the bus packets is greater than or equal to 1000 frames/second.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2023
From: LIU, CHU; XIE, YUEYIN; MO, MANG
To: SHANGHAI TOSUN TECHNOLOGY LTD.
Reel/Frame 065642/0226 →
Continuity (1)
Related Publication 20250166668A1 · May 22, 2025
References Cited (20)
US 6236694B1 · Blatter et al. · 2001 [cited by applicant]
US 10742955B2 · Karivaradaswamy · 2020 [cited by applicant]
US 11108485B2 · He · 2021 [cited by examiner]
US 11316912B2 · Lapointe · 2022 [cited by examiner]
US 20080201580A1 · Savitzky et al. · 2008 [cited by applicant]
US 20130003757A1 · Boatright et al. · 2013 [cited by applicant]
US 20170064154A1 · Tseng · 2017 [cited by examiner]
US 20170208220A1 · Stankoski et al. · 2017 [cited by applicant]
US 20210377331A1 · Lapointe · 2021 [cited by examiner]
US 20220377407A1 · Marchuk et al. · 2022 [cited by applicant]
US 20230305138A1 · Zhou et al. · 2023 [cited by applicant]
CN 111464772A · 2020 [cited by applicant]
CN 111554004A · 2020 [cited by applicant]
CN 111984580A · 2020 [cited by applicant]
CN 112600739A · 2021 [cited by applicant]
CN 113395561A · 2021 [cited by applicant]
CN 113639764A · 2021 [cited by applicant]
CN 113839732A · 2021 [cited by applicant]
RU 2115261C1 · 1998 [cited by applicant]
Huijuan Han, et al., Study of Vehicle Video and CAN-Bus Data Synchronous Acquisition System, ICTIS 2013: Improving Multimodal Transportation Systems-Information, Safety, and Integration, 2013, pp. 1658-1663. [cited by applicant]