IP Library Granted Patent US 11,640,667
Granted Patent B2
US 11,640,667 · App. 17/529,836 · Granted May 2, 2023

Method for property feature segmentation

Inventors: Fabian Richter (Mountain View, CA); Matthieu Portail (Mountain View, CA); Jason Erickson (Mountain View, CA)
Assignee: Cape Analytics, Inc.
G06T7/11G06F16/90335G06N20/00G06T7/155G06T2207/10032G06T2207/20041G06T2207/20081G06T2207/30184G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,640,667
App. No.
17/529,836
Granted
May 2, 2023
Kind
B2
Abstract

The method for determining property feature segmentation includes: receiving a region image for a region; determining parcel data for the region; determining a final segmentation output based on the region image and parcel data using a trained segmentation module; optionally generating training data; and training a segmentation module using the training data S 500.

Claims (40)

1. A method, comprising:

receiving a region image depicting a property feature;

determining an instance-aware mask for the property feature based on the region image;

determining a semantic segmentation mask for the property feature based on the region image;

computing a distance transform from the instance-aware mask; and

generating a pixel-accurate mask by associating instance identifiers for different property feature instances with pixels of the semantic segmentation mask based on the distance transform.

2. The method of claim 1 , wherein generating the pixel-accurate mask comprises determining a nearest property feature instance for pixels lacking an instance identifier within the semantic segmentation mask, based on the distance transform.

3. The method of claim 2 , wherein the nearest property feature instance is determined using a watershed transform.

4. The method of claim 1 , wherein the instance-aware mask is further determined based on parcel data for a geographic region depicted in the region image.

5. The method of claim 4 , wherein the parcel data comprises a parcel mask for the geographic region.

6. The method of claim 1 , wherein the instance identifiers are further assigned to pixels of the semantic segmentation mask based on parcel data for a region depicted in the region image.

7. The method of claim 1 , wherein the instance-aware mask comprises an under-segmented mask of the property feature.

8. The method of claim 1 , wherein the instance-aware mask is determined by an instance-aware segmentation module trained on training data, wherein the training data is determined by:

determining a set of polygons for a training image depicting a plurality of property features in a geographic region;

determining a set of parcels for the geographic region;

generating a set of instance polygons from the polygon set by combining adjacent polygons sharing a common parcel; and

determining labels for each instance polygon in the set, wherein the training image and the labels are used to train the instance-aware segmentation module.

9. The method of claim 1 , wherein the region image comprises a remote image.

10. The method of claim 1 , wherein the property feature comprises at least one of: a roof, driveway, paved surface, vegetation, or waterfront.

11. A method, comprising:

receiving a region image depicting a set of instances of a property feature;

retrieving parcel data representative of parcel extents for parcels associated with the region image;

determining a segmentation mask for the property feature based on the region image;

determining an instance-aware mask for the property feature based on the region image and the parcel data, using an instance-aware segmentation module trained on training data determined by:

determining a set of polygons for a training image depicting a plurality of property features in a geographic region;

determining a set of parcels for the geographic region;

generating a set of instance polygons from the polygon set by combining adjacent polygons sharing a common parcel; and

labelling each instance polygon in the set, wherein the training image and the labels are used to train the instance-aware segmentation module; and

determining property feature image segments corresponding to property feature instances based on the segmentation mask, the instance-aware mask, and the parcel data.

12. The method of claim 11 , wherein the property feature image segments are pixel-accurate representations of the respective property feature instance depicted in the region image.

13. The method of claim 11 , wherein the instance-aware mask comprises an under-segmented mask of the property feature.

14. The method of claim 11 , wherein determining the property feature image segments comprises:

dilating each instance within the instance-aware mask to generate a dilated mask; and

masking the dilated mask using the segmentation mask.

15. The method of claim 11 , wherein determining the property feature image segments comprises segmenting the segmentation mask using the parcel data.

16. The method of claim 15 , wherein segmenting the segmentation mask using the parcel data comprises:

identifying property feature pixels, from the semantic segmentation mask, that share a common parcel; and

treating the identified property feature pixels as part of a shared property feature image segment.

17. The method of claim 11 , wherein the region image is comprises a remote image.

18. The method of claim 11 , wherein the property feature comprises at least one of: a roof, driveway, paved surface, vegetation, or waterfront.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: RICHTER, FABIAN; PORTAIL, MATTHIEU; ERICKSON, JASON
To: CAPE ANALYTICS, INC.
Reel/Frame 058153/0460 →
Continuity (3)
Continuation 17336134 · Jun 1, 2021
Provisional Application 63033757 · Jun 2, 2020
Related Publication 20220076423A1 · Mar 10, 2022
Cited By (1)
US 12,417,516