IP Library Patent Application 14018779
Patent Application
App. No. 14/018,779

IMAGE ENHANCEMENT APPARATUS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/018,779
Abstract

A method comprising: analysing at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion; generating an animated image based on the at least two images, wherein the at least one object is animated; determining at least one audio signal associated with the at least one object; and combining the at least one audio signal with the animated image to generate an audio enabled animated image.

Claims (71)

1 . An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus at least to:

analyse at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion;

generate an animated image based on the at least two images, wherein the at least one object is animated;

determine at least one audio signal associated with the at least one object; and

combine the at least one audio signal with the animated image to generate an audio enabled animated image.

2 . The apparatus as claimed in claim 1 , wherein determining the at least one audio signal associated with the at least one object causes the apparatus to:

receive the at least one audio signal; and

filter the at least one audio signal.

3 . The apparatus as claimed in claim 2 , wherein receiving the at least one audio signal causes the apparatus to:

receive at least a portion of the at least one audio signal from at least one microphone at substantially the same time as the captured at least two images.

4 . The apparatus as claimed in claim 2 , wherein filtering the at least one audio signal causes the apparatus to:

determine at least one foreground sound source of the at least one audio signal; and

filter the at least one audio signal to remove the at least one foreground sound source from the at least one audio signal to generate an ambience audio signal as the at least one audio signal.

5 . The apparatus as claimed in claim 2 , wherein filtering the at least one audio signal causes the apparatus to:

determine at least one foreground sound source of the at least one audio signal; and

filter the at least one audio signal to extract the at least one foreground sound source from the at least one audio signal to generate a dominant sound component as the at least one audio signal.

6 . The apparatus as claimed in claim 1 , wherein determining the at least one audio signal associated with the at least one object causes the apparatus to:

receive an indication of the at least one object mutual to the at least two images;

identify the at least one object mutual to the at least two images; and

generate the at least one audio signal based on the identified object.

7 . The apparatus as claimed in claim 6 , wherein identifying the at least one object causes the apparatus to:

determine a location associated with the at least two images;

identify the at least one object based on the location of the at least two images;

select the at least one object.

8 . The apparatus as claimed in claim 6 , wherein identifying the at least one object causes the apparatus to:

pattern recognition analysis of the at least one object mutual to the at least two images.

9 . The apparatus as claimed in claim 1 , wherein determining the at least one audio signal associated with the at least one object causes the apparatus to at least one of:

receive the at least one audio signal from an external audio database;

receive the at least one audio signal from an internal audio database;

receive the at least one audio signal from a memory; and

synthesize the at least one audio signal.

10 . The apparatus as claimed in claim 2 , wherein receiving the at least one audio signal further causes the apparatus to:

generate an audio flow model to control a presentation of the at least one audio signal; and

process the at least one audio signal using the audio flow model.

11 . The apparatus as claimed in claim 10 , wherein generating the audio flow model causes the apparatus to at least one of:

determine an audio signal process;

determine an audio signal volume;

determine an audio signal playback speed;

determine an audio signal repetition periodicity;

determine an audio signal start time; and

determine an audio signal end time.

12 . The apparatus as claimed in claim 1 , wherein the apparatus is further caused to:

time synchronise the at least one audio signal with the animated image to generate a synchronised audio enabled animated image.

13 . The apparatus as claimed in claim 1 , wherein analysing the at least two images to determine the at least one object mutual to the at least two images further causes the apparatus to:

receive the at least two images from an image source;

output the at least two images on a display; and

receive at least one user input determining the at least one object mutual to the at least two images.

14 . The apparatus as claimed in claim 1 , wherein analysing the at least two images to determine the at least one object mutual to the at least two images further causes the apparatus to:

correlate the at least two images to determine at least one candidate object, the at least one candidate object being mutual to the at least two images and having a periodicity of motion; and

select the at least one candidate object as the at least one object.

15 . An electronic device comprising the apparatus of claim 1 .

16 . A method comprising:

analysing at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion;

generating an animated image based on the at least two images, wherein the at least one object is animated;

determining at least one audio signal associated with the at least one object; and

combining the at least one audio signal with the animated image to generate an audio enabled animated image.

17 . The method as claimed in claim 16 , wherein determining the at least one audio signal associated with the at least one object comprises:

receiving the at least one audio signal; and

filtering the at least one audio signal.

18 . The method as claimed claim 17 , wherein filtering the at least one audio signal comprises at least one of:

determining at least one foreground sound source of the at least one audio signal;

filtering the at least one audio signal to remove the at least one foreground sound source from the at least one audio signal to generate an ambience audio signal as the at least one audio signal associated with the at least one object; and

filtering the at least one audio signal to extract the at least one foreground sound source from the at least one audio signal to generate at least one synthetic audio signal associated with the at least one object.

19 . The method as claimed in claim 16 , wherein determining the at least one audio signal associated with the at least one object comprises at least one of:

receiving an indication of the at least one object mutual to the at least two images;

identifying the at least one object mutual to the at least two images;

generating the at least one audio signal based on the identified object;

determining a location associated with the at least two images;

identifying at least one object based on the location of the at least two images; and

selecting the at least one object.

20 . The method as claimed in claim 16 , wherein the method is further comprising time synchronising the at least one audio signal with the animated image to generate a synchronised audio enabled animated image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035215/0973 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2013
From: KANNAN, RAJESWARI; SHENOY, RAVI; PATWARDHAN, PUSHKAR PRASAD
To: NOKIA CORPORATION
Reel/Frame 031305/0153 →