IP Library Granted Patent US 8,890,936
Granted Patent B2
US 8,890,936 · App. 13/271,738 · Granted Nov 18, 2014

Utilizing depth information to create 3D tripwires in video

Inventors: Vinay Sharma (Dallas, TX); Goksel Dedeoglu (Plano, TX)
Assignee: Texas Instruments Incorporated
G06K9/00771H04N13/0022G06T2207/30232H04N13/0296G06T2207/30196G06T2207/10028G06T2200/24H04N13/0239G06T2207/30241G06T7/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,890,936
App. No.
13/271,738
Granted
Nov 18, 2014
Kind
B2
Abstract

A method of processing a digital video sequence is provided that includes detecting a foreground object in an image captured by a depth camera, determining three-dimensional (3D) coordinates of the foreground object, and comparing the 3D coordinates to a 3D video tripwire to determine if the foreground object has crossed the 3D video tripwire. A method of defining a 3D video tripwire is also provided.

Claims (25)

1. A method of processing a digital video sequence, the method comprising:

detecting a foreground object in an image captured by a depth camera;

determining three-dimensional (3D) coordinates of the foreground object; and

comparing the 3D coordinates to a 3D video tripwire to determine if the foreground object has crossed the 3D video tripwire, wherein the 3D video tripwire comprises a user interface and wherein the user interface is further configured to receive two-dimensional (2D) coordinates of a first point in the scene selected by the user; and determine 3D coordinates of a first pixel corresponding to the first point using depth information corresponding to the scene.

2. The method of claim 1 , further comprising:

adding the 3D coordinates to a history of three-dimensional (3D) coordinates of the foreground object; and

wherein comparing the 3D coordinates further comprises comparing 3D coordinates in the history to the 3D video tripwire to determine if the foreground object has crossed the 3D video tripwire.

3. The method of claim 1 , further comprising signaling a crossing event when the foreground object is determined to have crossed the 3D video tripwire.

4. The method of claim 1 , wherein the comparing the 3D coordinates is performed periodically.

5. The method of claim 1 , wherein the 3D video tripwire is defined using a user interface configured to:

display images of a scene monitored by the depth camera on a display screen, wherein the images are captured by the depth camera; and

define the 3D video tripwire based on 3D coordinates of pixels corresponding to points selected in the scene by a user.

6. The method of claim 5 , wherein the depth information corresponding to the scene is comprised in one selected from a group consisting of a depth image and a depth background model.

7. The method of claim 5 , wherein the user interface is further configured to display an overlay on the displayed images, wherein the overlay visually indicates depths of pixels in the scene relative to a depth of the first pixel corresponding to the first point.

8. The method of claim 7 , wherein the overlay uses one of color shading or grayscale to indicate the depths of the pixels.

9. The method of claim 7 , wherein the user interface is further configured to

receive 2D coordinates of a second point in the scene selected by the user while viewing the overlaid displayed images; and

determine 3D coordinates of a second pixel corresponding to the second point using depth information corresponding to the scene,

wherein the 3D video tripwire is generated based on the 3D coordinates of the first pixel and the 3D coordinates of the second pixel.

10. A surveillance system comprising:

a three-dimensional (3D) imaging system configured to capture depth images of a scene; and

a video analytics component configured to

detect a foreground object in an image captured by the 3D imaging system;

determine 3D coordinates of the foreground object; and

compare the 3D coordinates to a 3D video tripwire to determine if the foreground object has crossed the 3D video tripwire, wherein the 3D video tripwire comprises a user interface and wherein the user interface is further configured to receive two-dimensional (2D) coordinates of a first point in the scene selected by the user; and determine 3D coordinates of a first pixel corresponding to the first point using depth information corresponding to the scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2011
From: SHARMA, VINAY; DEDEOGLU, GOKSEL
To: TEXAS INSTRUMENTS INCORPORATED
Reel/Frame 027059/0248 →
Continuity (2)
Provisional Application 61392078 · Oct 12, 2010
Related Publication 20120086780A1 · Apr 12, 2012