IP Library › Granted Patent US 12,461,709
Granted Patent B2
US 12,461,709 · App. 18/367,345 · Granted Nov 4, 2025

Electronic apparatus and control method therefor

Inventors: Jiyoun Kim (Suwon-si, KR); Saebyuk Sheen (Suwon-si, KR); Jaehan Lee (Suwon-si, KR); Nari Choi (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/165G06V20/70G11B27/036H04N23/632H04R1/028H04R3/00G06F3/0482H04R2430/01H04R2499/11H04R2499/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,461,709
App. No.
18/367,345
Granted
Nov 4, 2025
Kind
B2
Abstract

An electronic apparatus includes: a microphone; a camera; a display; a speaker; and a processor operatively connected to the camera, the display, and the speaker, where the processor displays, on the display, a live view image obtained through the camera, when a camera application is executed; obtain a characteristic text for the live view image based on ae piece of object information included in the live view image, displays the characteristic text together with the live view image, identifies a sound source including metadata which matches the characteristic text, from among sound sources; displays information about the sound source together with the live view image, and when a user manipulation for capturing a moving image is input, outputs a first sound source from among the sound source through the speaker and capture a moving image through the microphone and the camera.

Claims (55)

1 . An electronic device, comprising:

a microphone;

a camera;

a display;

a speaker;

memory storing instructions; and

at least one processor operatively connected to the camera, the display, the speaker, and the memory, wherein the instructions, when executed by the at least one processor, cause the electronic device to:

display, based on a camera application being executed, a live view image obtained through the camera on the display;

obtain at least one feature text for the live view image based on at least one piece of object information included in the live view image;

display the obtained at least one feature text with the live view image;

identify at least one sound source including metadata, which matches the at least one feature text, among a plurality of sound sources;

display information about the identified at least one sound source with the live view image;

output, based on a user manipulation for video taking being input, a sound of a first sound source among the at least one sound source through the speaker; and

take a video through the microphone and the camera, while outputting the sound of the first sound source.

2 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to obtain the at least one feature text based on at least one of location information, date information, or time information where the live view image is obtained.

3 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to display the at least one piece of object information on the live view image.

4 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:

generate a sound source list including the at least one sound source based on a similarity between the at least one feature text and the metadata of the at least one sound source; and

identify a sound source having a highest similarity among the at least one sound source in the sound source list as the first sound source.

5 . The electronic device of claim 4 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:

display, based on a user manipulation for displaying the sound source list is input, the sound source list with the live view image; and

change, based on a user manipulation for selecting a second sound source among the at least one sound source in the sound source list is input, the first sound source into the second sound source.

6 . The electronic device of claim 1 ,

wherein the at least one sound source is stored in the memory or obtained through a sound source application.

7 . The electronic device of claim 6 , wherein the instructions, when executed by the at least one processor, cause the electronic device to display a user interface for controlling the sound source application with the live view image.

8 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to decrease a volume of the sound of the first sound source based on a magnitude of a sound other than the first sound source among sounds obtained through the microphone while taking the video being greater than or equal to a set value.

9 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to, change, based on the live view image being changed, change, in real-time, the at least one sound source based on the changed live view image.

10 . The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:

display, based on the video taking being complete, a user interface for sharing the taken video on an SNS application; and

share, based on a user manipulation for sharing being input through the user interface, the taken video through the SNS application.

11 . A method for controlling an electronic device, the method comprising:

displaying, based on a camera application being executed, a live view image obtained through a camera on a display;

obtaining at least one feature text for the live view image based on at least one piece of object information included in the live view image;

displaying the obtained at least one feature text with the live view image;

identifying at least one sound source including metadata, which matches the at least one feature text, among a plurality of sound sources;

displaying information about the identified at least one sound source with the live view image;

outputting, based on a user manipulation for video taking being input, a sound of a first sound source among the at least one sound source through a speaker; and

taking a video through a microphone and the camera, while outputting the sound of the first sound source.

12 . The method of claim 11 , wherein the obtaining the at least one feature text includes obtaining the at least one feature text based on at least one of location information, date information, or time information where the live view image is obtained.

13 . The method of claim 11 , further comprising:

displaying the at least one piece of object information on the live view image.

14 . The method of claim 11 , wherein the identifying the at least one sound source includes:

generating a sound source list including the at least one sound source based on a similarity between the at least one feature text and the metadata of the at least one sound source; and

identifying a sound source having a highest similarity among the at least one sound source in the sound source list as the first sound source.

15 . The method of claim 14 , further comprising:

displaying, based on a user manipulation for displaying the sound source list being input, the sound source list with the live view image; and

changing, based on a user manipulation for selecting a second sound source among the at least one sound source in the sound source list being input, the first sound source into the second sound source.

16 . The method of claim 11 ,

wherein the at least one sound source is stored in a memory of the electronic device or obtained through a sound source application.

17 . The method of claim 16 , further comprising displaying a user interface for controlling the sound source application with the live view image.

18 . The method of claim 11 , further comprising decreasing a volume of the sound of the first sound source based on a magnitude of a sound other than the first sound source among sounds obtained through the microphone while taking the video being greater than or equal to a set value.

19 . The method of claim 11 , further comprising changing, based on the live view image being changed, in real-time, the at least one sound source based on the changed live view image.

20 . The method of claim 11 , further comprising:

displaying, based on the video taking being complete, a user interface for sharing the taken video on an SNS application; and

sharing, based on a user manipulation for sharing being input through the user interface, the taken video through the SNS application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2023
From: KIM, JIYOUN; SHEEN, SAEBYUK; CHOI, NARI; LEE, JAEHAN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 064941/0581 →
Priority Claims (1)
KR 10-2021-0032930 · Mar 12, 2021 · national
Continuity (2)
Continuation PCTKR2022003480 · Mar 11, 2022
Related Publication 20230418553A1 · Dec 28, 2023
References Cited (25)
US 9161006B1 · Wang · 2015 [cited by examiner]
US 20100254676A1 · Ebato · 2010 [cited by applicant]
US 20160027209A1 · Demirli · 2016 [cited by examiner]
US 20180173701A1 · Kim et al. · 2018 [cited by applicant]
US 20190075343A1 · Cohen · 2019 [cited by examiner]
US 20200019562A1 · Imbruce et al. · 2020 [cited by applicant]
US 20200265614A1 · Jung et al. · 2020 [cited by applicant]
US 20210098110A1 · Periyasamy · 2021 [cited by examiner]
CN 104199876A · 2014 [cited by applicant]
EP 3758358A1 · 2020 [cited by applicant]
KR 20050079071A · 2005 [cited by applicant]
KR 20080000100A · 2008 [cited by applicant]
KR 20140126556A · 2014 [cited by applicant]
KR 20160031226A · 2016 [cited by applicant]
KR 20170130729A · 2017 [cited by applicant]
KR 20190020281A · 2019 [cited by applicant]
KR 20190040822A · 2019 [cited by applicant]
KR 20190108027A · 2019 [cited by applicant]
KR 20200000104A · 2020 [cited by applicant]
KR 20200038688A · 2020 [cited by applicant]
KR 20200077176A · 2020 [cited by applicant]
KR 102161080B1 · 2020 [cited by applicant]
International Search Report mailed Jun. 14, 2022 for PCT/KR2022/003480. [cited by applicant]
The extended European search report for EP Application No. 22767567.5 mailed on Jul. 30, 2024. [cited by applicant]
Korean Office Action for KR Application No. 10-2021-0032930 mailed on Jun. 5, 2025. [cited by applicant]