IP Library Granted Patent US 11,870,941
Granted Patent B2
US 11,870,941 · App. 17/740,114 · Granted Jan 9, 2024

Audio processing method and electronic device

Inventor: Daiting Chen (Shenzhen, CN)
Assignee: Honor Device Co., Ltd.
H04M3/568H04M3/566H04M3/567
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,870,941
App. No.
17/740,114
Granted
Jan 9, 2024
Kind
B2
Abstract

Embodiments of this application belong to the field of audio processing technologies and provide an audio processing method and an electronic device. The method is applicable to an electronic device including a camera. The electronic device records a plurality of channels of audio and video pictures corresponding to the audio in a video recording mode, and plays, during video playback, some video pictures and audio obtained after the plurality of channels of audio are combined. When a speaker in a video picture starts to speak, played audio is switched to audio corresponding to the video picture in which the speaker is located; thereby resolving a feeling of a sudden change of sound caused by switching required for obtaining audio content when the electronic device that does not support playback of a plurality of channels of audio plays a video.

Claims (59)

1. An audio processing method, the method comprising:

entering, by an electronic device, a video recording mode in response to an input of a user, wherein the electronic device comprises a first camera and a second camera, wherein the first camera performs photographing from a first viewing angle, and the second camera performs photographing from a second viewing angle;

in the video recording mode:

recording, by the first camera, a first video picture from the first viewing angle, and recording, by the second camera, a second video picture from the second viewing angle, wherein the first video picture and the second video picture are recorded simultaneously; and

simultaneously recording, by the electronic device, a plurality of sound channels of audio, wherein the plurality of sound channels of audio comprise first audio corresponding to the first viewing angle and second audio corresponding to the second viewing angle;

generating, by the electronic device, a target video recording file, wherein the target video recording file comprises the plurality of sound channels of audio;

detecting, by the electronic device, an action of a first speaker at a first moment, wherein the first speaker is located in the second viewing angle; and

playing, by the electronic device, the target video recording file in response to a playback operation input by the user for the target video recording file, wherein when a picture corresponding to the first moment is being played, a volume of the second audio in the target video recording file is increased and a volume of the first audio in the target video recording file is decreased based on the detecting the action of the first speaker at the first moment.

2. The method according to claim 1 , wherein in response to the video picture corresponding to the first moment being played, the volume of the second audio is gradually increased, and the volume of the first audio is gradually decreased.

3. The method according to claim 1 , wherein:

in the video recording mode, the electronic device displays a photographing interface, and the photographing interface comprises the first video picture and the second video picture;

the target video recording file further comprises the second video picture; and

during playback of the target video recording file, at least one of the first video picture or the second video picture is displayed.

4. The method according to claim 1 , wherein:

in the video recording mode, the electronic device displays a photographing interface, and the photographing interface does not comprise the second video picture; and

during playback of the target video recording file, the second video picture is not displayed.

5. The method according to claim 1 , wherein in the video recording mode, the second camera records the second video picture from the second viewing angle, and the first speaker in the second video picture opens a mouth at the first moment.

6. The method according to claim 1 , wherein:

in the video recording mode, a second speaker speaks at a second moment, wherein the second speaker is within the first viewing angle; and

during playback of the target video recording file, when a picture corresponding to the second moment is being played, the volume of the first audio in the target video recording file is increased and the volume of the second audio in the target video recording file is decreased based on the second speaker speaking at the second moment.

7. The method according to claim 6 , wherein in response to the picture corresponding to the second moment being played, the volume of the first audio in the target video recording file is gradually increased, and the volume of the second audio in the target video recording file is gradually decreased.

8. The method according to claim 1 , wherein a second speaker speaks at a previous moment of the first moment, and the second speakers is within the first viewing angle.

9. The method according to claim 1 ,

wherein the electronic device comprises a first microphone and a second microphone; and

wherein:

in the video recording mode, the first microphone records the first audio, and the second microphone records the second audio; or

in the video recording mode, the first microphone records the second audio, and the second microphone records the first audio.

10. The method according to claim 1 ,

wherein the electronic device comprises a first microphone, and a second microphone is in a wireless connection with the electronic device; and

wherein:

in the video recording mode, the first microphone records the first audio, the second microphone records the second audio, and the second audio is sent to the electronic device through the wireless connection; or

in the video recording mode, the first microphone records the second audio, the second microphone records the first audio, and the first audio is sent to the electronic device through the wireless connection.

11. The method according to claim 1 ,

wherein both a first microphone and a second microphone are in a wireless connection with the electronic device, and the first audio and the second audio are sent to the electronic device through the wireless connection; and

wherein:

in the video recording mode, the first microphone records the first audio, and the second microphone records the second audio; or

in the video recording mode, the first microphone records the second audio, and the second microphone records the first audio.

12. The method according to claim 1 , further comprising:

buffering an audio frame of the first audio, an audio frame of the second audio, and a video frame of the first video picture in the video recording mode; and

in response to the detecting the action of the first speaker at the first moment, adjusting an audio feature of the first audio in the third audio and adjusting an audio feature of the second audio in the third audio starting from i audio frames before a current audio frame, wherein i is greater than or equal to 1.

13. The method according to claim 1 , wherein the first viewing angle and the second viewing angle are any two of a front-facing viewing angle, a wide-angle viewing angle, or a zoom viewing angle.

14. An electronic device, comprising:

a plurality of cameras, configured to acquire video pictures;

a screen, configured to display an interface;

an audio playback component, configured to play audio;

one or more processors; and

a memory, wherein one or more computer programs are stored in the memory, wherein the one or more computer programs comprise instructions, and the instructions, when executed by the one or more processors, cause the electronic device to perform the audio processing method according to claim 1 .

15. An electronic device, comprising a screen, a computer memory, and a camera, wherein the electronic device is configured to perform the audio processing method according to claim 1 .

16. An audio processing method, the method comprising:

entering, by an electronic device, a video recording mode in response to an input of the user, wherein the electronic device comprises a first camera and a second camera, wherein the first camera performs photographing from a first viewing angle, and the second camera performs photographing from a second viewing angle;

in the video recording mode:

recording, by the first camera, a first video picture from the first viewing angle, and recording, by the second camera, a second video picture from the second viewing angle, wherein the first video picture and the second video picture are recorded simultaneously; and

simultaneously recording, by the electronic device, a plurality of sound channels of audio, wherein the plurality of sound channels of audio comprise first audio corresponding to the first viewing angle and second audio corresponding to the second viewing angle;

generating, by the electronic device, a target video recording file, wherein the target video recording file comprises the plurality of sound channels of audio;

detecting, by the electronic device, an action of a first speaker at a first moment, wherein the first speaker is located in the first viewing angle; and

playing, by the electronic device, the target video recording file in response to a playback operation input by the user for the target video recording file, wherein when a picture corresponding to the first moment is being played, a volume of the second audio in the target video recording file is decreased and a volume of the first audio in the target video recording file is increased based on the detecting the action of the first speaker at the first moment.

17. The method according to claim 16 , wherein the audio feature comprises a volume, and the playing the target video recording file comprises:

increasing the volume of the first audio in response to a video picture corresponding to the first moment being played.

18. The method according to claim 17 , wherein in response to the video picture corresponding to the first moment being played, the volume of the first audio is gradually increased, and the volume of the second audio is gradually decreased.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: CHEN, DAITING
To: HONOR DEVICE CO., LTD.
Reel/Frame 060322/0543 →
Priority Claims (1)
CN 202011063396.6 · Sep 30, 2020 · national
Continuity (2)
Continuation PCTCN2021119048 · Sep 17, 2021
Related Publication 20220272200A1 · Aug 25, 2022