IP Library › Granted Patent US 9,967,658
Granted Patent B2
US 9,967,658 · App. 15/187,271 · Granted May 8, 2018

Method for processing sound by electronic device and electronic device thereof

Inventors: Jun-Tai Kim (Gyeonggi-do, KR); Min-Ho Bae (Seoul, KR); Hyun-Min Choi (Chungcheongbuk-do, KR); Han-Ho Ko (Gyeonggi-do, KR); Gang-Youl Kim (Gyeonggi-do, KR); Jae-Mo Yang (Gyeonggi-do, KR); Chul-Min Choi (Seoul, KR); Beak-Kwon Son (Gyeonggi-do, KR); Nam-Il Lee (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
H04R1/406G06F3/01H04N1/2112H04N5/232H04N5/23219H04R3/005G06K9/00255H04R5/027H04R2400/01H04R2430/20H04R2499/11H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,967,658
App. No.
15/187,271
Granted
May 8, 2018
Kind
B2
Abstract

An electronic device is provided. The electronic includes a camera module and a processor configured to capture at least one image of an object using the camera module, obtain a sound using a microphone operably connected to the processor when the at least one image is captured, determine whether the sound is related to the object, when the sound is determined to be unrelated to the object, change at least one attribute of the sound and store the changed at least one attribute of the sound.

Claims (32)

1. An electronic device, comprising:

a camera module; and

a processor configured to capture at least one image of an object using the camera module, obtain a sound using a microphone operably connected to the processor when the at least one image is captured, determine whether the sound is related to the object, when the sound is determined to be unrelated to the object, change at least one attribute of the sound and store the changed at least one attribute of the sound.

2. The electronic device of claim 1 , wherein the processor is further configured to store visual information which is related to the sound.

3. The electronic device of claim 1 , further comprising a memory for storing information corresponding to one of the at least one image, information corresponding to the sound, and visual information related to the sound.

4. The electronic device of claim 1 , wherein the processor is further configured to determine a direction of the sound, and when it is determined that the sound is a sound coming from a direction from a rear surface of the camera module, determine that the sound is unrelated to the object.

5. The electronic device of claim 4 , wherein the processor is further configured to determine the direction of the sound using a direction of arrival (DOA) estimation technique.

6. The electronic device of claim 4 , wherein the processor is further configured to, when the direction of the sound is a first direction, assign the sound to a first sound channel of multiple sound channels, and when the direction of the sound is a second direction, assign the sound to a second sound channel of the multiple sound channels.

7. The electronic device of claim 1 , wherein the microphone is functional as one of a speaker and a receiver.

8. The electronic device of claim 1 , wherein the processor is further configured to, when the sound is determined to be related to the object, not change the at least one attribute of the sound.

9. The electronic device of claim 1 , further comprising at least one sensor for obtaining a distance from an object corresponding to the sound, and wherein the processor is further configured to determine whether the sound is related to the object based on a distance between the electronic device and the object.

10. The electronic device of claim 1 , further comprising another camera module, wherein the processor is further configured to determine whether the at least one image obtained through the another camera module includes a face, when the at least one image obtained through the another camera module includes the face, recognize a mouth portion of the face, and determine whether the sound is related to the object based on whether the mouth portion moves.

11. A method for processing a sound by an electronic device, the method comprising:

capturing at least one image of an object using a camera operably connected to the electronic device;

obtaining a sound using at least one microphone operably connected to the electronic device when the at least one image is captured;

determining whether the sound is related to the object; and

when the sound is determined to be unrelated to the object, changing at least one attribute of the sound and storing the changed at least one attribute of the sound.

12. The method of claim 11 , further comprising storing visual information which is related to the sound.

13. The method of claim 11 , wherein determining whether the sound is related to the object includes determining a direction of the sound, and when the sound is coming from a direction from a rear surface of the camera, determining that the sound is unrelated to the object.

14. The method of claim 13 , wherein determining the direction of the sound includes using a direction of arrival (DOA) estimation technique.

15. The method of claim 13 , further comprising, when a direction of the sound is a first direction, assigning the sound to a first sound channel of multiple sound channels, and when the direction of the sound is a second direction, assigning the sound to a second sound channel of the multiple sound channels.

16. The method of claim 11 , wherein the microphone is functional as one of a speaker and a receiver, and wherein the method further comprises activating at least one of the speaker function and the receiver function of the microphone upon capturing the at least one image.

17. The method of claim 11 , wherein when the sound is determined to be related to the object, the at least one attribute of the sound is not changed.

18. The method of claim 11 , wherein determining whether the sound is related to the object is based on a distance between the electronic device and the object.

19. The method of claim 11 , further comprising:

determining whether at least one image obtained through another camera includes a face; and

when the at least one image obtained through the another camera includes the face, recognizing a mouth portion of the face, and wherein determining whether the sound is related to the object is based on whether the mouth portion moves.

20. A non-transitory computer-readable storage medium having thereon a program that executes a method for processing a sound by an electronic device, the method comprising:

capturing at least one image of an object using a camera operably connected to the electronic device;

obtaining a sound using at least one microphone operably connected to the electronic device when the at least one image is captured;

determining whether the sound is related to the object; and

when the sound is determined to be unrelated to the object, changing at least one attribute of the sound and storing the changed at least one attribute of the sound.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2016
From: KIM, JUN-TAI; BAE, MIN-HO; CHOI, HYUN-MIN; KO, HAN-HO; KIM, GANG-YOUL; YANG, JAE-MO; CHOI, CHUL-MIN; SON, BEAK-KWON; LEE, NAM-IL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 039157/0646 →
Priority Claims (1)
KR 10-2015-0118088 · Aug 21, 2015 · national
Continuity (1)
Related Publication 20170055072A1 · Feb 23, 2017