IP Library Granted Patent US 11,196,899
Granted Patent B1
US 11,196,899 · App. 16/905,166 · Granted Dec 7, 2021

Synchronization of wireless-audio to video

Inventors: Brant Candelore (San Diego, CA); Mahyar Nejat (San Diego, CA); Peter Shintani (San Diego, CA); Robert Blanchard (San Diego, CA)
Assignee: SONY GROUP CORPORATION
H04N5/04G11B27/10H04W80/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,196,899
App. No.
16/905,166
Granted
Dec 7, 2021
Kind
B1
Abstract

An electronic apparatus and method for synchronization of wireless audio to video is provided. The electronic apparatus determines a first wireless audio processing delay associated with the electronic apparatus and receives media content comprising video content and audio content associated with the video content. The electronic apparatus transmits the audio content to the wireless audio device and controls playback of the video content on the display device based on the determined first wireless audio processing delay such that the playback of the video content is time-synchronized with playback of the audio content on the wireless audio device.

Claims (72)

1. An electronic apparatus, comprising:

circuitry communicatively coupled to a display device and a wireless audio device, wherein the circuitry is configured to:

determine a first wireless audio processing delay associated with the electronic apparatus;

determine a Media Access Control (MAC) address of the wireless audio device;

determine, based on the determined MAC address, a second wireless audio processing delay associated with the wireless audio device;

receive media content comprising video content and audio content associated with the video content;

transmit the audio content to the wireless audio device; and

control playback of the video content on the display device based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that the playback of the video content is time-synchronized with playback of the audio content on the wireless audio device.

2. The electronic apparatus according to claim 1 , wherein the playback of the video content is delayed by at least the determined first wireless audio processing delay to match a time of the playback of the audio content on the wireless audio device.

3. The electronic apparatus according to claim 1 , further comprising a memory configured to store a delay profile for the electronic apparatus,

wherein the delay profile comprises the first wireless audio processing delay of the electronic apparatus.

4. The electronic apparatus according to claim 3 , wherein the circuitry is further configured to determine the first wireless audio processing delay based on the delay profile.

5. The electronic apparatus according to claim 1 , further comprising an Audio/Video (AV) source configured to output compressed media comprising compressed audio data and compressed video data.

6. The electronic apparatus according to claim 5 , further comprising a buffer memory coupled to the AV source, wherein the circuitry is further configured to:

store the compressed video data in the buffer memory for a holding duration that includes the determined first wireless audio processing delay while the compressed audio data is decoded as the audio content and transmitted to the wireless audio device;

extract the compressed video data from the buffer memory after the holding duration;

after the extraction, decode the compressed video data as the video content; and

control the playback of the video content on the display device to match with a timing of the playback of the audio content on the wireless audio device.

7. The electronic apparatus according to claim 5 , further comprising a buffer memory coupled to the AV source, wherein the circuitry is further configured to:

decode the compressed video data to obtain the video content;

after the decode, store the video content in the buffer memory for a holding duration that includes the determined first wireless audio processing delay while the compressed audio data is decoded as the audio content and transmitted to the wireless audio device;

extract the stored video content from the buffer memory after the holding duration; and

control the playback of the video content on the display device to match with a timing of the playback of the transmitted audio content on the wireless audio device.

8. The electronic apparatus according to claim 1 , wherein the circuitry is further configured to:

control the display device to display a test video;

transmit a test audio associated with the test video to the wireless audio device;

receive, via the wireless audio device, a user input comprising a duration by which playback of the test video is to be delayed to match a time of playback of the transmitted test audio on the wireless audio device; and

set the first wireless audio processing delay as the duration included in the user input.

9. A method, comprising:

in an electronic apparatus communicatively coupled to a wireless audio device and a display device:

determining a first wireless audio processing delay associated with the electronic apparatus;

determining a Media Access Control (MAC) address of the wireless audio device;

determining, based on the determined MAC address, a second wireless audio processing delay associated with the wireless audio device;

receiving media content comprising video content and audio content associated with the video content;

transmitting the audio content to the wireless audio device; and

controlling playback of the video content on the display device based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that the playback of the video content is time-synchronized with playback of the audio content on the wireless audio device.

10. The method according to claim 9 , wherein the control of the playback of the video content corresponds to a delay in the playback of the video content by at least the determined first wireless audio processing delay to match a time of the playback of the audio content on the wireless audio device.

11. The method according to claim 9 , further comprising determining the first wireless audio processing delay based on a first delay profile for the electronic apparatus, wherein the first delay profile comprises the first wireless audio processing delay.

12. The method according to claim 9 , further comprising outputting, via an Audio/Video (AV) source of the electronic apparatus, compressed media comprising compressed audio data and compressed video data.

13. The method according to claim 12 , further comprising:

storing the compressed video data in a buffer memory of the electronic apparatus for a holding duration that includes the determined first wireless audio processing delay while the compressed audio data is decoded as the audio content and transmitted to the wireless audio device;

extracting the compressed video data from the buffer memory after the holding duration;

after the extraction, decoding the compressed video data as the video content; and

controlling the playback of the video content on the display device to match with a timing of the playback of the audio content on the wireless audio device.

14. The method according to claim 12 , further comprising:

decoding the compressed video data to obtain the video content;

after the decoding, storing the video content in a buffer memory of the electronic apparatus for a holding duration that includes the determined first wireless audio processing delay while the compressed audio data is decoded as the audio content and transmitted to the wireless audio device;

extracting the stored video content from the buffer memory after the holding duration; and

controlling the playback of the video content on the display device to match with a timing of the playback of the transmitted audio content on the wireless audio device.

15. The method according to claim 9 , further comprising:

controlling the display device to display a test video;

transmitting a test audio associated with the test video to the wireless audio device;

receiving, via the wireless audio device, a user input comprising a duration by which playback of the test video is to be delayed for matching a time of playback of the transmitted test audio on the wireless audio device; and

setting the first wireless audio processing delay as the duration included in the user input.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer in an electronic apparatus, cause the computer to execute operations, the operations comprising:

determining a first wireless audio processing delay associated with the electronic apparatus;

determining a Media Access Control (MAC) address of a wireless audio device communicatively coupled to the electronic apparatus;

determining, based on the determined MAC address, a second wireless audio processing delay associated with the wireless audio device;

receiving media content comprising video content and audio content associated with the video content;

transmitting the audio content to the wireless audio device; and

controlling playback of the video content on a display device associated with the electronic apparatus based on the determined first wireless audio processing delay and the determined second wireless audio processing delay such that the playback of the video content is time-synchronized with playback of the audio content on the wireless audio device.

17. An electronic apparatus, comprising:

an Audio/Video (AV) source configured to output compressed media comprising compressed audio data and compressed video data;

a buffer memory coupled to the AV source; and

circuitry communicatively coupled to a display device and a wireless audio device, wherein the circuitry is configured to:

determine a first wireless audio processing delay associated with the electronic apparatus;

decode the compressed audio data as audio content;

transmit the audio content to the wireless audio device;

store the compressed video data in the buffer memory for a holding duration that includes the determined first wireless audio processing delay while the compressed audio data is decoded as the audio content and transmitted to the wireless audio device;

extract the compressed video data from the buffer memory after the holding duration;

after the extraction, decode the compressed video data as video content; and

control playback of the video content on the display device to match with a timing of playback of the audio content on the wireless audio device.

Assignments (2)
CHANGE OF NAME Recorded Aug 19, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057246/0328 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: CANDELORE, BRANT; NEJAT, MAHYAR; SHINTANI, PETER; BLANCHARD, ROBERT
To: SONY CORPORATION
Reel/Frame 054139/0793 →
Cited By (2)
US 12,192,560 US 12,720,143