IP Library Granted Patent US 10,453,207
Granted Patent B2
US 10,453,207 · App. 15/748,576 · Granted Oct 22, 2019

Method and system for global motion estimation and compensation

Inventors: Shing Chow Chan (Hong Kong, CN); Zhong Liu (Baoding, CN)
Assignee: VERSITECH LIMITED
G06T7/579G06T7/529H04N19/527H04N19/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,453,207
App. No.
15/748,576
Granted
Oct 22, 2019
Kind
B2
Abstract

It is proposed a Method and System for Global Motion Estimation and Compensation. The system operates on two depth maps which contain a reference depth map and a current depth map as well as their associated texture images if available. The system executes four major steps which are feature detection (step 1), global motion compensation (GMC) (step 2), major moving objects (MMO) detection and the estimation of their motion parameters denoted as major motion parameters (MMPs) (step 3), and local motion compensation (LMC) of macroblocks or other coding/prediction units (step 4). The output of the system is the global motion parameters (GMPs), major moving objects (MMOs) and MMPs, the local motion vectors (LMVs), and the coding modes.

Claims (20)

1. A method for efficient estimation and realization of inter-frame global camera motion prediction and compensation of stationary or nearly stationary objects in videos having a reference depth map and a current depth map, comprising the steps of:

detecting features in a depth map video using a modified Ramer-Douglas-Peucker algorithm;

extracting the features;

performing global motion compensation on the data from the current depth video followed by the reference depth video using template matching based on the features extracted,

estimating global motion parameters using an M-estimator Sample Consensus method;

detecting major moving objects in the depth video and estimating their parameters by comparing the current depth map and the compensated depth map from the reference image; and

estimating the motion parameters denoted as major motion parameters, and local motion compensation of macroblocks or other coding/prediction units by dividing the current depth map into non-overlapping blocks and performing the local motion correction.

2. The method of claim 1 wherein the video includes texture images and the estimation is also based on an analysis of those texture images.

3. A system for global and major objects motion estimation, compensation and depth compression, comprising:

a feature detector configured to receive at least a current depth map and a reference depth map, said feature detector acting to extract feature points from the maps and sets global motion compensation to its default values;

a global motion compensator configured to receive feature points from said feature detector when the number of feature points extracted exceeds a threshold, said compensator acting to match features from the two maps, estimate the global motion compensation and apply compensation to the features based on the estimate;

a motion detector configured to detect major moving object from the output of the compensator and estimate major motion parameters; and

a local motion compensator configured to receive global motion compensation and major motion parameters from said motion detector and output coded video information.

4. The method of claim 1 , wherein said compensated depth map is generated by wrapping said reference image by using either said estimated global motion parameters or a default global motion parameters.

5. The method of claim 1 further comprising a step of evaluating said global motion compensation by comparing a value derived from said estimated global motion parameters to a predetermined value.

6. The method of claim 5 , wherein said predetermined value is derived from said reference depth map.

7. The method of claim 5 , wherein said compensated depth map is generated by wrapping said reference image by using either said estimated global motion parameters or a default global motion parameters.

8. The method of claim 7 , wherein if said global motion compensation is not effective, said compensated depth map is generated by wrapping said reference image by using said default global motion parameters.

9. The system of claim 3 , wherein said compensation is based on either an estimated global motion parameters or a default global motion parameters.

10. The system of claim 9 , wherein the global motion compensator is further configured to adopt said compensation based on said default global motion parameters if said estimated global motion compensation is ineffective.

Assignments (3)
CHANGE OF NAME Recorded May 1, 2026
From: VERSITECH LIMITED
To: UNIVERSITY OF HONG KONG VERSITECH LIMITED
Reel/Frame 075506/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: CHAN, SHING CHOW; LIU, ZHONG
To: THE UNIVERSITY OF HONG KONG
Reel/Frame 050373/0428 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: THE UNIVERSITY OF HONG KONG
To: VERSITECH LIMITED
Reel/Frame 050373/0545 →
Continuity (2)
Provisional Application 62199754 · Jul 31, 2015
Related Publication 20180218511A1 · Aug 2, 2018