IP Library › Granted Patent US 10,657,668
Granted Patent B2
US 10,657,668 · App. 15/465,471 · Granted May 19, 2020

Systems and methods for detecting and tracking a marker

Inventors: Ehtesham Hassan (Gurgaon, IN); Gaurav Gupta (Gurgaon, IN)
Assignee: Tata Consultancy Services Limited
G06T7/70G06F3/012G06K9/00234G06K9/3216G06K9/4604G06K9/6267G06K9/66G06T3/40G06T5/20G06T7/11G06T7/12G06T7/248G06T7/90G06K2009/3225G06K2009/3291G06T2207/10024G06T2207/20061G06T2207/20081G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,668
App. No.
15/465,471
Granted
May 19, 2020
Kind
B2
Abstract

Systems and methods for detecting and tracking a marker in real time is disclosed. Shape based segmentation of at least one object detected in a first frame from a sequence of frames is performed to define a region of interest (ROI) surrounding an object of interest corresponding to the marker. A marker detection model is dynamically trained based on sampling points from a plurality of pixels in and around the ROI. The marker is then tracked in real-time based on projected ROI in subsequent frames and the trained marker detection model. To optimize computation time required in classifying the pixels as marker pixels or non-marker pixels, the ROI is reduced to half its size, classification is performed on the reduced ROI and to improve accuracy, blob detection and classifying pixels along the boundary of the reduced ROI is performed by processing the ROI in original resolution.

Claims (48)

1. A method for detecting and tracking a marker, the method comprising:

performing shape based segmentation of at least one object detected in a first frame from a sequence of frames, the at least one object having a shape in line with shape of the marker to define a region of interest (ROI) surrounding an object of interest corresponding to the marker, the ROI comprising a plurality of pixels, wherein performing shape based segmentation comprises:

receiving the first frame containing the at least one object;

performing shape based feature extraction on the first frame to detect the at least one object;

eliminating false objects from the at least one object to identify the object of interest, wherein eliminating the false objects comprises use of a color density based band-pass filter and

defining the region of interest (ROI) surrounding the object of interest; and

iteratively performing until a last frame from the sequence of frames is received:

dynamically training and updating a marker detection model based on sampling points from the plurality of pixels in and around the ROI, wherein dynamically training and updating a marker detection model comprises;

classifying the plurality of pixels in the ROI as marker pixels and pixels around the ROI as non-marker pixels;

training and updating the marker detection model being a support vector machine (SVM), using the marker pixels, the non-marker pixels and velocity of the marker corresponding to one or more frames under consideration in relation to a previous frame in the sequence of frames; and

tracking the marker in real-time based on projected ROI in subsequent frames of the sequence of frames and the marker detection model.

2. The method of claim 1 , wherein performing shape based segmentation comprises applying Hough transform technique.

3. The method of claim 1 , wherein the shape of the marker and the object of interest is circular.

4. The method of claim 1 , wherein classifying the plurality of pixels as marker pixels and pixels around the ROI as non-marker pixels is based on a color intensity histogram.

5. The method of claim 1 , wherein the velocity of the marker is computed based on a centroid of the marker detected in the one or more frames under consideration in relation to a previous frame in the sequence of frames.

6. The method of claim 1 , wherein tracking the marker in real-time comprises:

projecting the ROI in the subsequent frames based on location of the ROI in the first frame and one or more temporal parameters associated with the shape of the object of interest; and

classifying the pixels in the projected ROI in the subsequent frames as marker pixels and non-marker pixels based on the marker detection model to predict location of the marker in the subsequent frames.

7. The method of claim 6 , wherein the one or more temporal parameters are position of the ROI, the velocity of the marker, radius and centroid of the circular object of interest.

8. The method of claim 1 , wherein the ROI is square shaped and surrounds the circular object of interest.

9. The method of claim 8 , wherein an edge of the square shaped ROI is 1.4142 times diameter of the circular object of interest.

10. The method of claim 1 , wherein classifying the pixels in the projected ROI comprises:

resizing the projected ROI to half its original size to generate a reduced ROI having reduced resolution;

performing classification of the pixels in the reduced ROI as marker pixels and non-marker pixels; and

performing blob detection and classifying the pixels along boundary of the reduced ROI by processing the ROI in original resolution.

11. The method of claim 10 , wherein performing blob detection comprises:

generating a binary equivalent image of the reduced ROI, the binary equivalent image being characterized by labels based on classification of the pixels in the reduced ROI;

resizing the binary equivalent image with a circular blob in the reduced ROI to original resolution; and

refining pixels at boundary of the circular blob in the binary equivalent image by relating it with pixel locations in the ROI with original resolution.

12. A system comprising:

one or more processors; and

one or more internal data storage devices operatively coupled to the one or more processors for storing instructions configured for execution by the one or more processors, the instructions being comprised in:

an image segmenter configured to:

perform shape based segmentation of at least one object detected in a first frame from a sequence of frames, the at least one object having a shape in line with shape of the marker to define a region of interest (ROI) surrounding an object of interest corresponding to the marker, the ROI comprising a plurality of pixels, wherein the image segmenter is further configured to:

receive the first frame containing the at least one object;

perform shape based feature extraction on the first frame to detect the at least one object;

eliminate false objects from the at least one object to identify the object of interest, wherein

eliminating the false objects comprises use of a color density based band-pass filter; and

define the region of interest (ROI) surrounding the object of interest;

a marker detection model trainer configured to:

dynamically train and update a marker detection model based on sampling points from the plurality of pixels in and around the ROI;

classify the plurality of pixels in the ROI as marker pixels and pixels around the ROI as non-marker pixels; and

train and update the marker detection model being a support vector machine (SVM), using the marker pixels, the non-marker pixels and velocity of the marker corresponding to one or more frames under consideration in relation to a previous frame in the sequence of frames, and

a marker tracker configured to:

tracking the marker in real-time based on projected ROI in subsequent frames of the sequence of frames and the marker detection model.

13. The system of claim 12 , wherein the marker tracker is further configured to:

projecting the ROI in the subsequent frames based on location of the ROI in the first frame and one or more temporal parameters associated with the shape of the object of interest; and

classifying the pixels in the projected ROI in the subsequent frames as marker pixels and non-marker pixels based on the marker detection model to predict location of the marker in the subsequent frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2017
From: HASSAN, EHTESHAM; GUPTA, GAURAV
To: TATA CONSULTANCY SERVICES LIMITED
Reel/Frame 041748/0897 →
Priority Claims (1)
IN 201621010035 · Mar 22, 2016 · national
Continuity (1)
Related Publication 20170278266A1 · Sep 28, 2017
Cited By (2)
US 12,190,243 US 12,361,268