IP Library Granted Patent US 8,253,831
Granted Patent B2
US 8,253,831 · App. 12/325,178 · Granted Aug 28, 2012

Location-aware event detection

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,253,831
App. No.
12/325,178
Granted
Aug 28, 2012
Kind
B2
Abstract

Techniques for detecting one or more events are provided. The techniques include using one or more regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the one or more regions of interest, applying multiple-instance learning to the video sequence to construct one or more location-aware event models, and applying the models to the video sequence to determine the one or more regions of interest that are associated with the one or more events.

Claims (37)

1. A method for detecting one or more events, comprising the steps of:

using multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest;

applying multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models;

using a support vector machine- (SVM)-based multiple-instance learning technique to learn one or more event models for a pickup and a drop; and

applying the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

2. The method of claim 1 , wherein the one or more events comprise one or more events at a point of sale.

3. The method of claim 2 , wherein the one or more events at a point of sale comprise a pickup, a scan and a drop, wherein a pickup comprises a cashier picking up an item, a scan comprises a cashier at least one of reading the barcode on an item via a scanner and weighing an item, and a drop comprises a cashier placing an item onto a take-away belt area.

4. The method of claim 1 , wherein the multiple overlapping regions of interest comprise one or more shapes.

5. The method of claim 1 , wherein the multiple overlapping regions of interest comprise one or more sizes.

6. The method of claim 1 , further comprising extracting one or more features from each region of interest.

7. The method of claim 6 , wherein the one or more features comprise at least one of color, edge and motion.

8. A computer program product comprising a tangible non-transitory computer readable recordable storage medium having computer readable program code for detecting one or more events, said computer program product including:

computer readable program code for using multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest;

computer readable program code for applying multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models;

computer readable program code for using a support vector machine- (SVM)-based multiple-instance learning technique to learn one or more event models for a pickup and a drop; and

computer readable program code for applying the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

9. The computer program product of claim 8 , wherein the one or more events comprise one or more events at a point of sale.

10. The computer program product of claim 9 , wherein the one or more events at a point of sale comprise a pickup, a scan and a drop, wherein a pickup comprises a cashier picking up an item, a scan comprises a cashier at least one of reading the barcode on an item via a scanner and weighing an item, and a drop comprises a cashier placing an item onto a take-away belt area.

11. The computer program product of claim 8 , further comprising computer readable program code for extracting one or more features from each region of interest.

12. The computer program product of claim 11 , wherein the one or more features comprise at least one of color, edge and motion.

13. The computer program product of claim 8 , wherein the multiple overlapping regions of interest comprise one or more shapes and one or more sizes.

14. A system for detecting one or more events, comprising:

a memory; and

at least one processor coupled to said memory and operative to:

use multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest;

apply multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models;

use a support vector machine-(SVM)-based multiple-instance learning technique to learn one or more event models for a pickup and a drop; and

apply the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

15. The system of claim 14 , wherein the one or more events comprise one or more events at a point of sale.

16. The system of claim 15 , wherein the one or more events at a point of sale comprise a pickup, a scan and a drop, wherein a pickup comprises a cashier picking up an item, a scan comprises a cashier at least one of reading the barcode on an item via a scanner and weighing an item, and a drop comprises a cashier placing an item onto a take-away belt area.

17. The system of claim 14 , wherein the at least one processor coupled to said memory is further operative to extract one or more features from each region of interest.

18. The system of claim 17 , wherein the one or more features comprise at least one of color, edge and motion.

19. An apparatus for detecting one or more events, said apparatus comprising:

means for using multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest;

means for applying multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models;

means for using a support vector machine-(SVM)-based multiple-instance learning technique to learn one or more event models for a pickup and a drop; and

means for applying the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

Assignments (2)
PATENT ASSIGNMENT AND RESERVATION Recorded Sep 4, 2012
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORATION
Reel/Frame 028895/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2009
From: BOBBITT, RUSSELL PATRICK; FAN, QUANFU; HAMPAPUR, ARUN; KJELDSEN, FREDERIK; PANKANTI, SHARATHCHANDRA UMAPATHIRAO; YANAGAWA, AKIRA; ZHAI, YUN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 022141/0738 →