IP Library › Granted Patent US 12,260,605
Granted Patent B2
US 12,260,605 · App. 17/717,233 · Granted Mar 25, 2025

Device and a method for merging candidate areas

Inventors: Jiandan Chen (Lund, SE); Hanna Björgvinsdóttir (Lund, SE); Ludvig Pettersson (Lund, SE)
Assignee: Axis AB
G06V10/267G06V10/25
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,605
App. No.
17/717,233
Granted
Mar 25, 2025
Kind
B2
Abstract

A device and method merge a first candidate area relating to a candidate feature in a first image and a second candidate area relating to a candidate feature in a second image. The first and second images have an overlapping region, and at least a portion of the first and second candidate areas are located in the overlapping region. An image overlap size is determined indicating a size of the overlapping region of the first and second images, and a candidate area overlap ratio is determined indicating a ratio of overlap between the first and second candidate areas. A merging threshold is then determined based on the image overlap size, and, on condition that the candidate area overlap ratio is larger than the merging threshold, the first candidate area and the second candidate area are merged, thereby forming a merged candidate area.

Claims (34)

1. A method for merging a first candidate area relating to a candidate feature in a first image and a second candidate area relating to a candidate feature in a second image, wherein the first image and the second image have an overlapping region, and wherein at least a portion of the first candidate area and at least a portion of the second candidate area are located in the overlapping region, the method comprising:

determining an image overlap size indicating a size of the overlapping region of the first image and the second image;

determining a candidate area overlap ratio indicating a ratio of overlap between the first candidate area and the second candidate area;

determining a merging threshold based on the image overlap size; and

on condition that the candidate area overlap ratio is larger than the merging threshold, merging the first candidate area and the second candidate area, thereby forming a merged candidate area.

2. The method according to claim 1 , wherein the merging threshold is determined to be proportional to the image overlap size.

3. The method according to claim 1 , wherein the candidate area overlap ratio is determined as the intersection of the first candidate area and the second candidate area divided by the union of the first candidate area and the second candidate area.

4. The method according to claim 1 , wherein the first candidate area and the second candidate area are identified in coordinates of a combined image comprising the first image and the second image.

5. The method according to claim 1 , wherein the first image is a first transformed view of a first portion of a fisheye image and the second image is a second transformed view of a second portion of the fisheye image, and wherein the first candidate area and the second candidate area are identified in coordinates of the fisheye image.

6. The method according to claim 1 , wherein the merged candidate area consists of the union of the first candidate area and the second candidate area.

7. The method according to claim 1 , wherein the first and second candidate areas are one of bounding boxes, pixel masks, and polygon areas.

8. A non-transitory computer readable storage medium having stored thereon instructions for implementing a method, when executed on a device having processing capabilities, the method for merging a first candidate area relating to a candidate feature in a first image and a second candidate area relating to a candidate feature in a second image, wherein the first image and the second image have an overlapping region, and wherein at least a portion of the first candidate area and at least a portion of the second candidate area are located in the overlapping region, the method comprising:

determining an image overlap size indicating a size of the overlapping region of the first image and the second image;

determining a candidate area overlap ratio indicating a ratio of overlap between the first candidate area and the second candidate area;

determining a merging threshold based on the image overlap size; and

on condition that the candidate area overlap ratio is larger than the merging threshold, merging the first candidate area and the second candidate area, thereby forming a merged candidate area.

9. The non-transitory computer readable storage medium method according to claim 8 , wherein the merging threshold is determined to be proportional to the image overlap size.

10. The non-transitory computer readable storage medium method according to claim 8 , wherein the candidate area overlap ratio is determined as the intersection of the first candidate area and the second candidate area divided by the union of the first candidate area and the second candidate area.

11. The non-transitory computer readable storage medium method according to claim 8 , wherein the first candidate area and the second candidate area are identified in coordinates of a combined image comprising the first image and the second image.

12. The non-transitory computer readable storage medium method according to claim 8 , wherein the first image is a first transformed view of a first portion of a fisheye image and the second image is a second transformed view of a second portion of the fisheye image, and wherein the first candidate area and the second candidate area are identified in coordinates of the fisheye image.

13. The non-transitory computer readable storage medium method according to claim 8 , wherein the merged candidate area consists of the union of the first candidate area and the second candidate area.

14. A device for merging a first candidate area relating to a candidate feature in a first image and a second candidate area relating to a candidate feature in a second image, wherein the first image and the second image have an overlapping region, and wherein at least a portion of the first candidate area and at least a portion of the second candidate area are located in the overlapping region, the device comprising:

circuitry configured to execute:

an image overlap size determining function configured to determine an image overlap size indicating a size of the overlapping region of the first image and the second image;

a candidate area overlap ratio determining function configured to

determine a candidate area overlap ratio indicating an overlap between the first candidate area and the second candidate area;

a merging threshold determining function configured to determine a merging threshold based on the image overlap size; and

a merging function configured to, on condition that the candidate area overlap ratio is larger than the merging threshold, merge the first candidate area and the second candidate area, thereby forming a merged candidate area.

15. The device according to claim 14 , wherein the merging threshold determining function is configured to determine merging threshold to be proportional to the image overlap size.

16. The device according to claim 14 , wherein the candidate area overlap ratio determining function is configured to determine the candidate area overlap ratio as the intersection of the first candidate area and the second candidate area divided by the union of the first candidate area and the second candidate area.

17. The device according to claim 14 , wherein the first candidate area and second candidate area are identified in coordinates of a combined image comprising the first image and the second image.

18. The device according to claim 14 , wherein the first image is a first transformed view of a first portion of a fisheye image and the second image is a second transformed view of a second portion of the fisheye image, and wherein the first candidate area and second candidate area are identified in coordinates of the fisheye image.

19. The device according to claim 14 , wherein the merged candidate area consists of the union of the first candidate area and the second candidate area.

20. The device according to claim 9 , wherein the first and second candidate areas are one of bounding boxes, pixel masks, and polygon areas.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2022
From: CHEN, JIANDAN; BJÖRGVINSDÓTTIR, HANNA; PETTERSSON, LUDVIG
To: AXIS AB
Reel/Frame 059559/0211 →
Priority Claims (1)
EP 21171173 · Apr 29, 2021 · regional
Continuity (1)
Related Publication 20220351485A1 · Nov 3, 2022
References Cited (11)
US 20150248591A1 · Shi et al. · 2015 [cited by applicant]
US 20160344935A1 · Ardo · 2016 [cited by applicant]
US 20180047193A1 · Gao et al. · 2018 [cited by applicant]
US 20190172209A1 · Yokoi · 2019 [cited by examiner]
US 20210350129A1 · Muhrbeck · 2021 [cited by examiner]
CN 111754394A · 2020 [cited by applicant]
Extended European Search Report dated Oct. 19, 2021 for European Patent Application No. 21171173.4. [cited by applicant]
Kim et al., “Detecting regions of interest in dynamic scenes with camera motions,” 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1258-1265 (2012). [cited by applicant]
Bochinski et al., “High-Speed tracking-by-detection without using image information,” 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-6 (2017). [cited by applicant]
Rezatofighi et al., “Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 658-666 (2019). [cited by applicant]
Ruan et al., “An Improved Algorithm for Dense Object Detection Based on YOLO,” 10.1007/978-3-030-14680-1_65, AISC 905, pp. 592-599 (2020). [cited by applicant]