IP Library › Granted Patent US 11,734,908
Granted Patent B2
US 11,734,908 · App. 17/228,750 · Granted Aug 22, 2023

Randomly generated blobs to improve object-detection training for framed video content

Inventors: Mayank Kandpal (Zurich, CH); Bakhodir Ashirmatov (Zurich, CH); Filip Pavetic (Zurich, CH)
Assignee: GOOGLE LLC
G06V10/25G06N3/08G06V10/26G06V10/462
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,734,908
App. No.
17/228,750
Granted
Aug 22, 2023
Kind
B2
Abstract

Generating a training image for use in training a region-of-interest detector that is trained to detect regions-of-interest within images includes generating a closed geometric shape; filling the closed geometric shape with a filler to obtain a blob; overlaying the blob on an edge of an image to obtain the training image, where the image includes a region-of-interest and a background region, and where the edge separates the region-of-interest from the background region; and using the training image to train the region-of-interest detector to detect a boundary of the region-of-interest. An input to the region-of-interest detector in a training phase includes the training image and a first indication of coordinates of the region-of-interest in the training image. An output of the region-of-interest detector includes a second indication of an area of the training image and a probability of the area of the training image being the region-of-interest.

Claims (52)

1. A method for generating a training image for use in training a region-of-interest detector, wherein the region-of-interest detector is trained to detect regions-of-interest within images, comprising:

generating a closed geometric shape;

filling the closed geometric shape with a filler to obtain a blob;

overlaying the blob on an edge of an image to obtain the training image,

wherein the image comprises a region-of-interest and a background region, and

wherein the edge separates the region-of-interest from the background region; and

using the training image to train the region-of-interest detector to detect a boundary of the region-of-interest,

wherein an input to the region-of-interest detector in a training phase comprises:

the training image; and

a first indication of coordinates of the region-of-interest in the training image; and

wherein an output of the region-of-interest detector comprises:

a second indication of an area of the training image, and

a probability of the area of the training image being the region-of-interest.

2. The method of claim 1 , wherein generating the closed geometric shape comprises:

obtaining the closed geometric shape using a Fourier series.

3. The method of claim 2 , wherein obtaining the closed geometric shape using the Fourier series comprises:

obtaining the closed geometric shape using a random number of sine waves or random amplitudes of Fourier coefficients.

4. The method of claim 1 , wherein the filler is a random noise.

5. The method of claim 1 , wherein the filler is a single color.

6. The method of claim 1 , wherein the filler is a filler image.

7. The method of claim 1 , wherein the blob is overlaid on a vertex of the region-of-interest.

8. An apparatus for generating a training image for use in training a region-of-interest detector, wherein the region-of-interest detector is trained to detect regions-of-interest within images, the apparatus comprising:

a processor configured to:

generate a closed geometric shape;

fill the closed geometric shape with a filler to obtain a blob;

overlay the blob on an edge of an image to obtain the training image,

wherein the image comprises a region-of-interest and a background region, and

wherein the edge separates the region-of-interest from the background region; and

train, using the training image, the region-of-interest detector to detect a boundary of the region-of-interest,

wherein an input to the region-of-interest detector in a training phase comprises the training image, and

wherein an output of the region-of-interest detector comprises an indication of an area of the training image as being the region-of-interest.

9. The apparatus of claim 8 , wherein to generate the closed geometric shape comprises to:

obtain the closed geometric shape using a Fourier series.

10. The apparatus of claim 9 , wherein to obtain the closed geometric shape using the Fourier series comprises to:

obtain the closed geometric shape using a random number of sine waves or random amplitudes of Fourier coefficients.

11. The apparatus of claim 8 , wherein the filler is a random noise.

12. The apparatus of claim 8 , wherein the filler is a single color.

13. The apparatus of claim 8 , wherein the filler is a filler image.

14. The apparatus of claim 8 , wherein the blob is overlaid on a vertex of the region-of-interest.

15. A non-transitory computer-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations for generating a training image for use in training a region-of-interest detector, wherein the region-of-interest detector is trained to detect regions-of-interest within images, the operations comprising operations to:

generate a closed geometric shape;

fill the closed geometric shape with a filler to obtain a blob; and

overlay the blob on an edge of an image to obtain the training image,

wherein the image comprises a region-of-interest and a background region, and

wherein the edge separates the region-of-interest from the background region.

16. The non-transitory computer-readable storage medium of claim 15 , wherein to generate the closed geometric shape comprises to:

obtain the closed geometric shape using a Fourier series.

17. The non-transitory computer-readable storage medium of claim 16 , wherein to obtain the closed geometric shape using the Fourier series comprises to:

obtain the closed geometric shape using a random number of sine waves or random amplitudes of Fourier coefficients.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the filler is a random noise.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the filler is a single color.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the blob is overlaid on a vertex of the region-of-interest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: KANDPAL, MAYANK; ASHIRMATOV, BAKHODIR; PAVETIC, FILIP
To: GOOGLE LLC
Reel/Frame 055898/0583 →
Continuity (1)
Related Publication 20220327322A1 · Oct 13, 2022