IP Library Granted Patent US 9,729,834
Granted Patent B2
US 9,729,834 · App. 15/242,699 · Granted Aug 8, 2017

Identifying spatial locations of events within video image data

Inventors: Michael J. Desimone (Ridgefield, CT); Arun Hampapur (Norwalk, CT); Zuoxuan Lu (Yorktown Heights, NY); Carl P. Mercier (New Milford, CT); Christopher S. Milite (Oxford, CT); Stephen R. Russo (Southbury, CT); Chiao-Fe Shu (Scarsdale, NY); Chek K. Tan (Danbury, CT)
Assignee: International Business Machines Corporation
H04N7/18G06F17/30061G06F17/30277G06F17/30802G06F17/30825G06K9/00335G06K9/00711G06K9/00771G06K9/48G06T7/97G06K2009/00738G06T2207/30232G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,729,834
App. No.
15/242,699
Granted
Aug 8, 2017
Kind
B2
Abstract

An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for detecting an object and obtaining trajectory data of a trajectory of the object within the video image data from a sensor device; converting the trajectory data into a contour-coded compressed image; generating, based on the trajectory data, a searchable code that contains a set of locations traversed by the trajectory of the object within the video image; associating the searchable code with the contour-coded compressed image in a database; and returning, in response to a query having a selected location that corresponds a location of the set of locations in the searchable code, an image of the trajectory data corresponding to the object based on the contour-coded compressed image in the database.

Claims (65)

1. A method for identifying a spatial location of an event within video image data comprising:

generating, by at least one computer device, based on trajectory data of a trajectory of an object within video image data, a searchable code that contains a set of locations traversed by the trajectory of the object within the video image, wherein the generating further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the searchable code that corresponds to the pixel region;

converting, by the at least one computer device, the trajectory data into a contour-coded compressed image; and

returning from a database, in response to a query having a selected location that corresponds a location of the set of locations in the searchable code, an image of the trajectory data corresponding to the object based on the contour-coded compressed image in the database.

2. The method according to claim 1 , further comprising searching the database to identify a spatial location of the event within the video image data.

3. The method according to claim 2 , the searching comprising:

converting the area of interest to a lossy query code; and

comparing the lossy query code to the searchable code of the trajectory data within the video image data.

4. The method according to claim 3 , further comprising:

decompressing the contour-coded compressed image corresponding to the lossy query code based on the comparing; and

plotting the trajectory of the trajectory data within the video image data from the contour-coded compressed image.

5. The method according to claim 1 , wherein the converting further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the contour-coded compressed image that corresponds to the pixel region.

6. The method according to claim 5 , the converting further comprising:

determining, for each pixel region that the trajectory intersects, a direction of the trajectory from a location in the video image associated with the pixel region; and

assigning a value that indicates the direction of the trajectory from the associated location to the memory location in the contour-coded compressed image that corresponds to each pixel region that the trajectory intersects.

7. A system for identifying a spatial location of an event within video image data comprising:

at least one processing device;

memory operably associated with the at least one processing device; and

a spatial representation tool storable in memory and executable by the at least one processing device, the spatial representation tool causing the at least one processing device to:

generate, based on trajectory data of a trajectory of an object within video image data, a searchable code that contains a set of locations traversed by the trajectory of the object within the video image, wherein the generating further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the searchable code that corresponds to the pixel region;

convert the trajectory data into a contour-coded compressed image; and

return from a database, in response to a query having a selected location that corresponds a location of the set of locations in the searchable code, an image of the trajectory data corresponding to the object based on the contour-coded compressed image in the database.

8. The system of claim 7 , the spatial representation tool further causing the at least one processing device to search the database to identify a spatial location of the event within the video image data.

9. The system of claim 8 , the searching comprising:

converting the area of interest to a lossy query code; and

comparing the lossy query code to the searchable code of the trajectory data within the video image data.

10. The spatial representation tool according to claim 9 further causing the at least one processing device to:

decompress the contour-coded compressed image corresponding to the lossy query code based on the comparing; and

plot the trajectory of the trajectory data within the video image data from the contour-coded compressed image.

11. The system according to claim 7 , wherein the converting further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the contour-coded compressed image that corresponds to the pixel region.

12. The system according to claim 11 , the converting further comprising:

determining, for each pixel region that the trajectory intersects, a direction of the trajectory from a location in the video image associated with the pixel region; and

assigning a value that indicates the direction of the trajectory from the associated location to the memory location in the contour-coded compressed image that corresponds to each pixel region that the trajectory intersects.

13. A computer-readable storage device storing computer instructions, which when executed, enables a computer system to identify a spatial location of an event within video image data, the computer instructions comprising:

generating, based on trajectory data of a trajectory of an object within video image data, a searchable code that contains a set of locations traversed by the trajectory of the object within the video image, wherein the generating further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the searchable code that corresponds to the pixel region;

converting the trajectory data into a contour-coded compressed image; and

returning from a database, in response to a query having a selected location that corresponds a location of the set of locations in the searchable code, an image of the trajectory data corresponding to the object based on the contour-coded compressed image in the database.

14. The computer-readable storage device according to claim 13 , further comprising computer instructions for searching the database to identify a spatial location of the event within the video image data, the searching comprising:

converting the area of interest to a lossy query code; and

comparing the lossy query code to the searchable code of the trajectory data within the video image data.

15. The computer-readable storage device according to claim 14 , further comprising computer instructions for:

decompressing the contour-coded compressed image corresponding to the lossy query code based on the comparing; and

plotting the trajectory of the trajectory data within the video image data from the contour-coded compressed image.

16. The computer readable storage device according to claim 13 , wherein the converting further comprises:

dividing the video image data into a plurality of pixel regions;

determining, for each pixel region in the plurality of pixel regions, whether the trajectory intersects any pixel in the pixel region; and

indicating, for each pixel region, a result of the determining in a memory location in the contour-coded compressed image that corresponds to the pixel region.

17. The computer readable storage device according to claim 16 , the converting further comprising:

determining, for each pixel region that the trajectory intersects, a direction of the trajectory from a location in the video image associated with the pixel region; and

assigning a value that indicates the direction of the trajectory from the associated location to the memory location in the contour-coded compressed image that corresponds to each pixel region that the trajectory intersects.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 057885/0644 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2016
From: DESIMONE, MICHAEL J.; HAMPAPUR, ARUN; LU, ZUOXUAN; MERCIER, CARL P.; MILITE, CHRISTOPHER S.; RUSSO, STEPHEN R.; SHU, CHIAO-FE; TAN, CHEK K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039494/0001 →
Continuity (5)
Continuation 14864007 · Sep 24, 2015
Continuation 14595726 · Jan 13, 2015
Continuation 13903237 · May 28, 2013
Continuation 12407499 · Mar 19, 2009
Related Publication 20160360156A1 · Dec 8, 2016