IP Library › Granted Patent US 11,244,168
Granted Patent B2
US 11,244,168 · App. 16/899,002 · Granted Feb 8, 2022

Method of highlighting an object of interest in an image or video

Inventors: Simon Dahlberg (Lund, SE); Anders Kruger (Lund, SE)
Assignee: AXIS AB
G06K9/00718G06K9/00288G06K9/00362G06K9/325
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,168
App. No.
16/899,002
Granted
Feb 8, 2022
Kind
B2
Abstract

A method of highlighting an object of interest comprises providing a digital image, determining a region of interest in the digital image covering an object of interest in the digital image having a person identifier, masking all image data in the digital image in a surrounding area to the region of interest, within the detected region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and forming an output image comprising image data from the digital image of the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area. A device for performing the method is also disclosed. The method may be performed on an image sequence, for example in the form of a surveillance video.

Claims (48)

1. A method of highlighting an object of interest in an image, the method comprising:

providing a digital image;

receiving data representing one or more bounding boxes determined for objects in the digital image;

determining, by selecting one of the one or more bounding boxes, a region of interest, inside the digital image, covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified;

masking all image data in the digital image in a surrounding area to the region of interest;

within the region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier; and

forming an output image comprising image data from the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area.

2. The method according to claim 1 , wherein the surrounding area corresponds to the rest of the digital image.

3. The method according to claim 1 , wherein the image data is masked by manipulation of image data from the digital image.

4. The method according to claim 1 , wherein the object of interest is a human.

5. The method according to claim 4 , further comprising receiving an identity of a human, and wherein the act of determining the region of interest is performed based on the received identity.

6. The method according to claim 1 , wherein the act of determining a region of interest or determining a region of exclusion comprises executing an object detection algorithm on the digital image.

7. The method according to claim 1 , wherein the person identifier comprises a face, a license plate, or an id tag.

8. A method of highlighting an object of interest in a video sequence, the method comprising:

providing a video sequence comprising digital images,

for each image of a selection of digital images from the video sequence, applying the method according to claim 1 , and

forming an output video sequence comprising the output images.

9. A method of highlighting an object of interest in a video sequence, the method comprising:

providing a video sequence comprising digital images;

for a first image selected from the video sequence,

receiving data representing one or more bounding boxes determined for objects in the first image, and

determining, by selecting one of the one or more bounding boxes, a first region of interest, inside the first image, covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified;

for a second image selected from the video sequence,

receiving data representing one or more bounding boxes determined for objects in the second image, and

determining, by selecting one of the one or more bounding boxes, a second region of interest, inside the second image, covering the object of interest;

for temporally intermediate images located between the first image and the second image in the video sequence,

determining respective regions of interest by interpolation between the first region of interest in the first image and the second region of interest in the second image;

for each digital image of the first image, the second image, and the temporally intermediate images,

masking all image data in the digital image that are in a surrounding area to the digital image's respective region of interest,

within the respective region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier, and

forming an output image comprising image data from the respective region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area; and

forming an output video sequence comprising the output images.

10. A non-transitory computer-readable storage medium with instructions adapted to carry out a method when executed by a device having processing capability, the method comprising:

providing a digital image;

receiving data representing one or more bounding boxes determined for objects in the digital image;

determining, by selecting one of the one or more bounding boxes, a region of interest inside, the digital image, covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified;

masking all image data in the digital image in a surrounding area to the region of interest;

within the region of interest, determining a region of exclusion covering an object of exclusion in the digital image having another person identifier; and

forming an output image comprising image data from the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area.

11. A device arranged to highlight a region of interest in a digital image, the device comprising:

a detector arranged to

receive data representing one or more bounding boxes determined for objects in the digital image,

determine, by selecting one of the one or more bounding boxes, a region of interest, inside the digital image, covering an object of interest having a person identifier, wherein the person identifier is a feature, characteristic or object from which a person identity can be uniquely identified, and

within the region of interest, determine a region of exclusion covering an object of exclusion in the digital image having another person identifier; and

a processor arranged to

mask all image data in the digital image in a surrounding area to the region of interest, and

form an output image comprising image data from the region of interest, wherein the region of exclusion thereof is masked, and comprising the masked image data of the surrounding area.

12. The device according to claim 11 , arranged in a video card of a video management system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: DAHLBERG, SIMON; KRUGER, ANDERS
To: AXIS AB
Reel/Frame 052912/0105 →
Priority Claims (1)
EP 19180289 · Jun 14, 2019 · regional
Continuity (1)
Related Publication 20200394411A1 · Dec 17, 2020