IP Library Granted Patent US 9,560,271
Granted Patent B2
US 9,560,271 · App. 14/319,667 · Granted Jan 31, 2017

Removing unwanted objects from photographed image

Inventors: Jinhee Na (Seoul, KR); Kihuk Lee (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23229H04N5/23222H04N5/2621G06T5/00G09G2320/106H04N5/23254H04N5/23293H04N5/265H04N5/2625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,560,271
App. No.
14/319,667
Granted
Jan 31, 2017
Kind
B2
Abstract

A device and method for processing an image in a device having a camera is disclosed. A motion vector of an unwanted object in preview frames of the desired image is identified. A photographing interval in accordance with the motion vector may be set. Continuous frames of the desired image may be photographed in accordance with the photographing interval. The unwanted object is removed from the desired image.

Claims (71)

1. A method comprising:

identifying a motion vector of an unwanted object in preview frames of a desired image obtained by a camera;

setting a photographing interval in accordance with the motion vector, wherein the motion vector comprises a size of the unwanted object and a speed of the unwanted object;

photographing continuous frames of the desired image in accordance with the photographing interval; and

removing the unwanted object from the desired image so as to restore a background behind the unwanted object using the continuous frames and the photographing interval,

wherein setting the photographing interval comprises:

identifying the size of the unwanted object as it moves; and

analyzing the size of the unwanted object and the speed of the unwanted object,

wherein setting the photographing interval further comprises:

dividing the size of each unwanted object with the motion vector of each unwanted object; and

identifying a maximum photographing frames per second based at least partially on a slowest unwanted object having a largest size.

2. The method of claim 1 , further comprising displaying the desired image by synthesizing frames of the desired image with the object removed.

3. The method of claim 2 , wherein removing the object comprises selecting a plurality of the continuous frames without any blur such that the selected frames render the background in an area from which the object is removed.

4. The method of claim 2 , wherein identifying the motion vector comprises:

identifying pixels having a similar brightness difference between the preview frames; and

defining a size and direction of the identified pixels as the motion vector.

5. The method of claim 1 , wherein setting the photographing interval comprises:

identifying a size of each unwanted object; and

analyzing the size and a speed of each unwanted object.

6. A method comprising:

identifying a motion vector of an unwanted object in preview frames of a desired image obtained by a camera;

setting a photographing interval in accordance with the motion vector;

photographing continuous frames of the desired image in accordance with the photographing interval; and

removing the unwanted object from the desired image so as to restore a background behind the unwanted object using the continuous frames and the photographing interval,

wherein setting the photographing interval comprises:

calculating an average motion vector of unwanted objects identified in a predetermined number of frames;

calculating a difference of a given motion vector detected in a given frame and the average motion vector;

setting a photographing time and the photographing interval based at least partially on the difference; and

applying the photographing time and the photographing interval against the continuous frames so as to remove the unwanted object.

7. An apparatus for processing an image in an electronic device, the apparatus comprising:

a camera;

a control unit to:

identify a motion vector of an unwanted object in preview frames of a desired image obtained by the camera;

set a photographing interval in accordance with the motion vector, wherein the motion vector comprises a size of the unwanted object and a speed of the unwanted object;

photograph continuous frames of the desired image with the camera in accordance with the photographing interval;

remove the unwanted object from the desired image so as to restore a background behind the unwanted object with the continuous frames and the photographing interval,

wherein the control unit to further:

identify the size of the unwanted object as it moves; and

analyzing the size of the unwanted object and the speed of the unwanted object to determine a photographing time and the photographing interval applied against the continuous frames so as to remove the unwanted object,

wherein to set the photographing interval the control unit to further:

divide the size of each unwanted object with the motion vector of each unwanted object: and

identify a maximum photographing frames per second based at least partially on a slowest unwanted object having a largest size.

8. The apparatus of claim 7 , wherein the control unit comprises:

an image processing unit to process the preview frames;

a buffer to buffer the preview frames;

an analyzer to identify motion vectors of unwanted objects in the preview frames;

a shooting time setting unit to identify the photographing interval in accordance with the motion vector; and

an image synthesizer to select a plurality of the continuous frames in the buffer in accordance with the photographing interval so as to replace the unwanted object with the background.

9. The apparatus of claim 8 , wherein the control unit to further:

store the continuous frames in the buffer;

generate the desired image by synthesizing continuous frames without the unwanted object;

display the desired image on a display unit; and

store the desired image in a storage unit.

10. The apparatus of claim 9 , wherein the control unit to further select a plurality of the continuous frames without any blur such that the selected frames render the background in an area from which the object is removed.

11. The apparatus of claim 9 , wherein the control unit to further:

identify pixels having a similar brightness difference between the preview frames; and

define a size and direction of the identified pixels as the motion vector.

12. The apparatus of claim 7 , wherein to set the photographing interval the control unit to further:

identify a size of each unwanted object; and

analyze the size and a speed of each unwanted object.

13. An apparatus for processing an image in an electronic device, the apparatus comprising:

a camera;

a control unit to:

identify a motion vector of an unwanted object in preview frames of a desired image obtained by the camera;

set a photographing interval in accordance with the motion vector;

photograph continuous frames of the desired image with the camera in accordance with the photographing interval;

remove the unwanted object from the desired image so as to restore a background behind the unwanted object with the continuous frames and the photographing interval

wherein to set the photographing interval the control unit to further:

calculate an average motion vector of unwanted objects identified in a predetermined number of frames;

calculate a difference of a given motion vector detected in a given frame and the average motion vector; and

set a photographing time and the photographing interval based at least partially on the difference.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2014
From: NA, JINHEE; LEE, KIHUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 033213/0351 →
Priority Claims (1)
KR 10-2013-0083326 · Jul 16, 2013 · national
Continuity (1)
Related Publication 20150022698A1 · Jan 22, 2015