IP Library Granted Patent US 9,269,158
Granted Patent B2
US 9,269,158 · App. 14/028,748 · Granted Feb 23, 2016

Method, apparatus and computer program product for periodic motion detection in multimedia content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,269,158
App. No.
14/028,748
Granted
Feb 23, 2016
Kind
B2
Abstract

In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating selection of a region of interest (ROI) in a plurality of frames of a multimedia content. The ROI is associated with a motion of at least one object. An object mobility data matrix associated with the ROI is determined in the plurality of frames. The object mobility data matrix is indicative of a difference in motion of the at least one object in the plurality of frames. A projection of the object mobility data matrix is determined on a line. The motion of the at least one object in the ROI is determined across the plurality of frames to as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix.

Claims (40)

1. A method comprising:

facilitating selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content is;

determining, by a processor, an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determining a projection of the object mobility data matrix on a line; and

determining the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises:

computing a cepstrum based on the projection; and

determining the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

2. The method as claimed in claim 1 , wherein the line is orthogonal to a diagonal of the object mobility data matrix.

3. The method as claimed in claim 1 , further comprising determining a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

4. The method as claimed in claim 1 , further comprising determining the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

5. The method as claimed in claim 1 , wherein the multimedia content comprises a video content.

6. The method as claimed in claim 1 further comprising generating an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.

7. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

facilitate selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content;

determine an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determine a projection of the object mobility data matrix on a line; and

determine the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises:

compute a cepstrum based on the projection; and

determine the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

8. The apparatus as claimed in claim 7 , wherein the line is orthogonal to a diagonal of the object mobility data matrix.

9. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part to determine a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

10. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part to determine the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

11. The apparatus as claimed in claim 7 , wherein the multimedia content comprises a video content.

12. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part to generate an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.

13. A non-transitory computer readable medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus to at least perform:

facilitate selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content;

determine an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determine a projection of the object mobility data matrix on a line; and

determine the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises:

compute a cepstrum based on the projection; and

determine the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

14. The non-transitory computer readable medium as claimed in claim 13 , wherein the line is orthogonal to a diagonal of the object mobility data matrix.

15. The non-transitory computer readable medium as claimed in claim 13 , wherein the apparatus is further caused, at least in part to determine a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

16. The non-transitory computer readable medium as claimed in claim 13 , wherein the apparatus is further caused, at least in part to determine the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

17. The non-transitory computer readable medium as claimed in claim 13 , wherein the apparatus is further caused, at least in part to generate an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035231/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 26, 2013
From: UKIL, SOUMIK; GOVINDARAO, KRISHNA ANNASAGAR; SHENOY, RAVI
To: NOKIA CORPORATION
Reel/Frame 031681/0570 →