Granted Patent B1

US 12,219,332 · App. 18/922,808 · Granted Feb 4, 2025

Inventors: Huaijing Wang (Newark, CA); Lifeng Zhao (Newark, CA)

Assignee: Linkplay Technology Inc.

H04R3/12G11B27/34H04R29/002

Abstract

Claims (53)

1. An audio synchronization playback method, applied to an audio synchronization playback system comprising a primary playback device and a preset quantity of secondary playback devices, the method comprising:

obtaining, by the primary playback device, target audio data in response to receiving a synchronization playback command;

sending, by the primary playback device, the target audio data to at least one secondary playback device for playback;

determining, by the primary playback device, a reference clock device;

in response to receiving a target audio synchronization signal, synchronizing, by the primary playback device, local time of the primary playback device with local time of the reference clock device based on the target audio synchronization signal and a delay calibration value of the primary playback device, and obtaining, by the primary playback device, a reference playback timestamp of the target audio synchronization signal; wherein the target audio synchronization signal is a periodic signal sent by the reference clock device; the reference clock device is a playback device with a smallest clock error calibration value among the primary playback device and at least one secondary playback device; and the delay calibration value is a transmission time value of a signal between a sound card and a speaker; and

starting, by the primary playback device, playback from a target audio data frame corresponding to the reference playback timestamp;

wherein starting by the primary playback device playback from the target audio data frame corresponding to the reference playback timestamp comprises:

calculating, by the primary playback device, a time difference between the primary playback device and the reference clock device in each period at a first preset period to obtain a system time difference of the primary playback device;

determining, by the primary playback device, an output sampling rate of the primary playback device according to the system time difference of the primary playback device;

moving, by the primary playback device, to the target audio data frame corresponding to the reference playback timestamp for decoding; and

starting, by the primary playback device, sampling and playback from the decoded target audio data frame based on the output sampling rate of the primary playback device.

2. The audio synchronization playback method according to claim 1 , wherein obtaining by the primary playback device the target audio data in response to receiving the synchronization playback command comprises:

obtaining, by the primary playback device, original audio data indicated by the synchronization playback command in response to receiving the synchronization playback command;

obtaining, by the primary playback device, scenario information and determining, by the primary playback device, a target encoding compression algorithm according to the scenario information;

performing, by the primary playback device, encoding and compression on the original audio data according to the target encoding compression algorithm; and

adding, by the primary playback device, a timestamp to each compressed audio data frame to obtain the target audio data.

3. The audio synchronization playback method according to claim 2 , wherein obtaining by the primary playback device the scenario information and determining by the primary playback device the target encoding compression algorithm according to the scenario information comprises:

obtaining, by the primary playback device, the scenario information, wherein the scenario information comprises an audio type and network bandwidth information of the original audio data;

performing, by the primary playback device, selection on preset encoding compression algorithms according to the audio type to obtain a set of encoding compression algorithms; and

selecting, by the primary playback device, an algorithm from the set of encoding compression algorithms that matches the network bandwidth information to obtain the target encoding compression algorithm.

4. The audio synchronization playback method according to claim 1 , further comprising:

prior to synchronizing by the primary playback device the local time of the primary playback device with reference local time of the reference clock device based on the target audio synchronization signal in response to receiving the target audio synchronization signal and obtaining by the primary playback device the reference playback timestamp of the target audio synchronization signal,

determining, by the primary playback device, whether the received synchronization signal is the periodic signal sent by the reference clock device in response to receiving the target audio synchronization signal;

determining, by the primary playback device, that the target audio synchronization signal is received in response to that the received synchronization signal is the periodic signal; and

determining, by the primary playback device, that the target audio synchronization signal is not detected in response to that the received synchronization signal is not the periodic signal.

5. The audio synchronization playback method according to claim 1 , wherein

synchronizing by the primary playback device the local time of the primary playback device with reference local time of the reference clock device based on the target audio synchronization signal in response to receiving the target audio synchronization signal and obtaining by the primary playback device the reference playback timestamp of the target audio synchronization signal comprises:

analyzing, by the primary playback device, the target audio synchronization signal to obtain the reference local time and the reference playback timestamp of the reference clock device in response to receiving the target audio synchronization signal; wherein the reference playback timestamp indicates a position of the audio data frame currently being played by the reference clock device; and

performing, by the primary playback device, time synchronization based on the reference local time of the reference clock device.

6. The audio synchronization playback method according to claim 5 , wherein performing by the primary playback device time synchronization based on the reference local time of the reference clock device comprises:

determining, by the primary playback device, current local time of the primary playback device based on the reference local time of the reference clock device and the delay calibration value of the primary playback device.

7. An audio synchronization playback system, comprising a primary playback device and a preset quantity of secondary playback devices, wherein the audio synchronization playback system is configured to perform the audio synchronization playback method according to claim 1 .

8. A non-transitory computer-readable storage medium having stored thereon instructions, wherein the instructions, when executed by a processor, cause the processor to perform the audio synchronization playback method according to claim 1 .

9. An audio synchronization playback method, applied to an audio synchronization playback system comprising a primary playback device and a preset quantity of secondary playback devices, the method comprising:

playing, by a secondary playback device, target audio data in response to receiving the target audio data from the primary playback device;

in response to receiving a target audio synchronization signal, synchronizing, by the secondary playback device, local time of the secondary playback device with local time of the reference clock device based on the target audio synchronization signal and a delay calibration value of the secondary playback device, and obtaining, by the secondary playback device, a reference playback timestamp of the target audio synchronization signal; wherein the target audio synchronization signal is a periodic signal sent by the reference clock device; the reference clock device is a playback device with a smallest clock error calibration value among the primary playback device and at least one secondary playback device; the delay calibration value is a transmission time value of a signal between a sound card and a speaker; and the reference clock device is determined by the primary playback device; and

starting, by the secondary playback device, playback from a target audio data frame corresponding to the reference playback timestamp;

wherein starting by the secondary playback device playback from the target audio data frame corresponding to the reference playback timestamp comprises:

calculating, by the secondary playback device, a time difference between the secondary playback device and the reference clock device in each period at a second preset period to obtain a system time difference of the secondary playback device;

determining, by the secondary playback device, an output sampling rate of the secondary playback device according to the system time difference of the secondary playback device;

moving, by the secondary playback device, to the target audio data frame corresponding to the reference playback timestamp for decoding; and

starting, by the secondary playback device, sampling and playback from the decoded target audio data frame based on the output sampling rate of the secondary playback device.

10. The audio synchronization playback method according to claim 9 , wherein playing by the secondary playback device the target audio data in response to receiving the target audio data from the primary playback device comprises:

determining, by the secondary playback device, whether there exists audio data matching the target audio data in a preset database in response to receiving the target audio data from the primary playback device;

deleting, by the secondary playback device, the audio data matching the target audio data and storing, by the secondary playback device, the target audio data in the preset database in response to that there exists the audio data matching the target audio data in the preset database;

determining, by the secondary playback device, whether available storage space in the preset database is greater than a size of the target audio data in response to that there does not exist the audio data matching the target audio data in the preset database;

storing, by the secondary playback device, the target audio data in the preset database in response to that the available storage space in the preset database is greater than the size of the target audio data; and

in response to that the available storage space in the preset database is not greater than the size of the target audio data, deleting, by the secondary playback device, historical data in the preset database on an individual basis until the available storage space in the preset database is greater than the size of the target audio data, storing, by the secondary playback device, the target audio data in the preset database, and playing, by the secondary playback device, the target audio data.

11. The audio synchronization playback method according to claim 9 , wherein synchronizing by the secondary playback device the local time of the secondary playback device with reference local time of the reference clock device based on the target audio synchronization signal in response to receiving the target audio synchronization signal and obtaining by the secondary playback device the reference playback timestamp of the target audio synchronization signal comprises:

analyzing, by the secondary playback device, the target audio synchronization signal to obtain the reference local time and the reference playback timestamp of the reference clock device in response to receiving the target audio synchronization signal; wherein the reference playback timestamp indicates a position of the audio data frame currently being played by the reference clock device; and

performing, by the secondary playback device, time synchronization based on the reference local time of the reference clock device.

12. The audio synchronization playback method according to claim 11 , wherein performing by the secondary playback device time synchronization based on the reference local time of the reference clock device comprises:

determining, by the secondary playback device, current local time of the secondary playback device based on the reference local time of the reference clock device and the delay calibration value of the secondary playback device.

Assignments (1)

Priority Claims (1)

References Cited (30)

Cited By (1)

US 12,418,870