IP Library Granted Patent US 10,275,608
Granted Patent B2
US 10,275,608 · App. 15/294,694 · Granted Apr 30, 2019

Object-centric video redaction

Inventors: Russell P Bobbitt (New York, NY); Curtis H Brobst (Elgin, MN); Rogerio S Feris (Hartford, CT); Yun Zhai (Pound Ridge, NY)
Assignee: International Business Machines Corporation
G06F21/6209G06F3/04842G06F3/04845G06K9/00718G06K9/621G06K9/6254G06T7/20G11B27/034G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,275,608
App. No.
15/294,694
Granted
Apr 30, 2019
Kind
B2
Abstract

Techniques are described for video redaction. In one aspect, techniques include receiving a video for redaction; analyzing the video to generate an appearance model for the video, providing a user interface (UI) allowing a user to modify the appearance model, and responsive to a user selecting an object from the appearance model, extending and completing a trajectory of the selected object with enhanced marking based on the user input.

Claims (52)

1. A computer-implemented method for video redaction, the method comprising:

receiving a video for redaction having a plurality of frames;

analyzing the video to generate an appearance model for the video;

providing a user interface (UI) allowing a user to modify the appearance model with a plurality of user-placed marks;

receiving the plurality of user-placed marks corresponding with a plurality of sample frames selected from the plurality of frames;

interpolating a bounding box on the plurality of sample frames based on the received plurality of user-placed marks;

responsive to a user selecting an object from the appearance model based on the interpolated bounding box, extending and completing a trajectory of the selected object within a plurality of remainder frames from the plurality of frames, and placing automatically generated marks to enclose the selected object within each remainder frame of the plurality of remainder frames based on the received plurality of user-placed marks and the extended and completed trajectory of the selected object; and

redacting the plurality of frames of the video based on the modified appearance model.

2. The method of claim 1 , further comprising:

designating weightings for trajectory observations in the appearance model.

3. The method of claim 2 , further comprising:

designating a higher weighting for the trajectory observations of the selected object than the weighting for observations that have not been selected.

4. The method of claim 1 , further comprising:

receiving user input selecting a boundary for identify an object in the appearance model.

5. The method of claim 1 , further comprising:

receiving further user input and making further modifications to the appearance model iteratively.

6. The method of claim 1 , wherein the video is a video used for law enforcement.

7. A computer system comprising:

one or more processors, one or more computer-readable memories, and one or more computer-readable, tangible storage devices;

program instructions, stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories to perform operations comprising:

receiving a video for redaction having a plurality of frames;

analyzing the video to generate an appearance model for the video;

providing a user interface (UI) allowing a user to modify the appearance model with a plurality of user-placed marks;

receiving the plurality of user-placed marks corresponding with a plurality of sample frames selected from the plurality of frames;

interpolating a bounding box on the plurality of sample frames based on the received plurality of user-placed marks;

responsive to a user selecting an object from the appearance model based on the interpolated bounding box, extending and completing a trajectory of the selected object within a plurality of remainder frames from the plurality of frames, and placing automatically generated marks to enclose the selected object within each remainder frame of the plurality of remainder frames based on the received plurality of user-placed marks and the extended and completed trajectory of the selected object; and

redacting the plurality of frames of the video based on the modified appearance model.

8. The system of claim 7 , wherein the operations further comprise:

designating weightings for trajectory observations in the appearance model.

9. The system of claim 8 , wherein the operations further comprise:

designating a higher weighting for the trajectory observations of the selected object than the weighting for observations that have not been selected.

10. The system of claim 7 , wherein the operations further comprise:

receiving user input selecting a boundary for identify an object in the appearance model.

11. The system of claim 7 , wherein the operations further comprise:

receiving further user input and making further modifications to the appearance model iteratively.

12. A computer program product comprising a non-transitory computer-readable storage medium having program code embodied therewith, the program code executable by a computing device to perform operations comprising:

receiving a video for redaction having a plurality of frames;

analyzing the video to generate an appearance model for the video;

providing a user interface (UI) allowing a user to modify the appearance model with a plurality of user-placed marks;

receiving the plurality of user-placed marks corresponding with a plurality of sample frames selected from the plurality of frames;

interpolating a bounding box on the plurality of sample frames based on the received plurality of user-placed marks;

responsive to a user selecting an object from the appearance model based on the interpolated bounding box, extending and completing a trajectory of the selected object within a plurality of remainder frames from the plurality of frames, and placing automatically generated marks to enclose the selected object within each remainder frame of the plurality of remainder frames based on the received plurality of user-placed marks and the extended and completed trajectory of the selected object; and

redacting the plurality of frames of the video based on the modified appearance model.

13. The program product of claim 12 , wherein the operations further comprise:

designating weightings for trajectory observations in the appearance model.

14. The program product of claim 13 , wherein the operations further comprise:

designating a higher weighting for the trajectory observations of the selected object than the weighting for observations that have not been selected.

15. The program product of claim 12 , wherein the operations further comprise:

receiving user input selecting a boundary for identify an object in the appearance model.

16. The program product of claim 12 , wherein the operations further comprise:

receiving further user input and making further modifications to the appearance model iteratively.

17. The program product of claim 12 , wherein the video is a video used for law enforcement.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2016
From: BOBBITT, RUSSELL P; BROBST, CURTIS H; FERIS, ROGERIO S; ZHAI, YUN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 040024/0742 →
Continuity (1)
Related Publication 20180107830A1 · Apr 19, 2018