IP Library Granted Patent US 12,536,632
Granted Patent B2
US 12,536,632 · App. 17/383,551 · Granted Jan 27, 2026

Systems and methods for detecting blight and code violations in images

Inventors: Erik Barry Johnson (Northport, AL); Brendan August Moore (Tuscaloosa, AL)
Assignee: The Board of Trustees of the University of Alabama
G06T7/0002G06F18/2178G06N5/04G06N20/00G06Q30/018G06Q50/26G06V10/40G06V20/56B60R11/04G06T7/0004G06T2207/10024G06T2207/20081G06T2207/30184G06T2207/30188G06V10/761G06V20/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,632
App. No.
17/383,551
Granted
Jan 27, 2026
Kind
B2
Abstract

A system for blight and code violation detection is provided. The system includes a machine learning model that is trained using photographs of properties that are associated with blight and code violations and photographs that are not associated with blight and code violations. A fleet of vehicles, such as trash trucks, are equipped with cameras to take photographs of properties along their routes. The trained model may generate a score for each photograph that indicates whether or not a property is blighted or has code violations. Those properties with a score that exceeds a threshold may be provided to a reviewer who may verify the finding. If the finding is verified, the reviewer may issue a letter or citation to the owner of the property, and positive feedback may be provided to the model. If the finding is not verified, negative feedback may be provided to the model.

Claims (64)

1 . A method for detecting blighted properties or determining code violations comprising:

receiving training data by a computing device, wherein the training data comprises a first plurality of images of properties with code violations and a second plurality of images of properties without code violations, wherein a property has a code violation when it does not comply with a particular state or local regulation, wherein the properties consist of homes or buildings;

extracting a first set of features from the first plurality of images of properties with code violations by the computing device;

extracting a second set of features of the second plurality of images of properties without code violations by the computing device;

using machine-learning to generate, from the first and second set of features extracted from the first and second plurality of images, a model by the computing device;

receiving a third plurality of images by the computing device, wherein each image of the third plurality of images depicts a property other than the properties associated with the first plurality of images or the properties associated with the second plurality of images, wherein each image of the third plurality of images is associated with GPS coordinates, and each image of the third plurality of images was captured automatically by a municipal vehicle upon detection by the municipal vehicle using a location determination component of the municipal vehicle that the municipal vehicle has advanced to the property depicted in the image; and

for each image of the third plurality of images:

using the model, generating a score for the property depicted in the image based on the image;

based on the score, determining whether the property depicted in the image has one or more code violations; and

providing the image to a reviewer by the computing device.

2 . The method of claim 1 , wherein each property is one or more of a house, a sidewalk, a road segment, or a tree.

3 . The method of claim 1 , further comprising, for each image of the third plurality of images:

receiving feedback from the reviewer regarding the determination; and

adjusting the model based on the received feedback.

4 . The method of claim 1 , further comprising, for each image of the third plurality of images:

identifying one or more features of the image that are associated with the score;

for each identified one or more features, detecting an object corresponding to the one or more features; and

generating a report for the property associated with the image, wherein the report identifies the detected object.

5 . The method of claim 4 , further comprising:

for each detected object, determining a portion of the score that is attributable to the detected object; and

providing the determined portion for each detected object in the report.

6 . The method of claim 4 , further comprising, for each image of the third plurality of images:

providing the report to an address associated with the property depicted in the image.

7 . The method of claim 6 , wherein the report comprises a fine or a required action.

8 . The method of claim 1 , wherein the municipal vehicle is a garbage truck.

9 . The method of claim 1 , further comprising, weighting the score generated for the property depicted in the image by the scores generated for properties that are neighboring the property depicted in the image to generate a relative score, and determining whether the property depicted in the image has one or more code violations based on the relative score.

10 . The method of claim 1 , further comprising, based on the one or more code violations, recommending one or more repairs to the property depicted in the image.

11 . A system for detecting blighted properties or code violations comprising:

at least one processor; and

a memory storing instructions that when executed by the at least one processor cause the at least one processor to:

receive training data, wherein the training data comprises a first plurality of images of properties with code violations and a second plurality of images of properties without code violations, wherein a property has a code violation when it does not comply with a particular state or local regulation, wherein the properties consist of homes or buildings;

extract a first set of features from the first plurality of images of properties with code violations;

extract a second set of features of the second plurality of images of properties without code violations;

use machine-learning to generate, from the first and second set of features extracted from the first and second plurality of images, a model;

receive a third plurality of images, wherein each image of the third plurality of images depicts a property other than the properties associated with the first plurality of images or the properties associated with the second plurality of images, wherein each image of the third plurality of images is associated with GPS coordinates, and each image of the third plurality of images was captured automatically by a municipal vehicle upon detection by the municipal vehicle using a location determination component of the municipal vehicle that the municipal vehicle has advanced to the property depicted in the image; and

for each image of the third plurality of images:

using the model, generate a score for the property depicted in the image based on the image;

based on the score, determine whether the property depicted in the image has one or more code violations; and

provide the image and the determination to a reviewer.

12 . The system of claim 11 , wherein each property is one or more of a house, a sidewalk, a road segment, or a tree.

13 . The system of claim 11 , further comprising, for each image of the third plurality of images:

receiving feedback from the reviewer regarding the determination; and

adjusting the model based on the received feedback.

14 . The system of claim 11 , further comprising, for each image of the third plurality of images:

identifying one or more features of the image that are associated with the score;

for each identified one or more features, detecting an object corresponding to the one or more features; and

generating a report for the property associated with the image, wherein the report identifies the detected object.

15 . The system of claim 14 , further comprising:

for each detected object, determining a portion of the score that is attributable to the detected object; and

providing the determined portion for each detected object in the report.

16 . The system of claim 14 , further comprising, for each image of the third plurality of images:

providing the report to an address associated with the property depicted in the image.

17 . The system of claim 16 , wherein the report comprises a fine or a required action.

18 . The system of claim 11 , wherein the municipal vehicle is a garbage truck.

19 . A method for automatically detecting blighted properties or determining code violations comprising:

attaching a camera and a location determination component to a municipal vehicle associated with a route;

for each property of a plurality of properties along the route, wherein the properties of the plurality of properties consist of homes or buildings:

detecting that the municipal vehicle has moved to a next property of the plurality of properties on the route by a computing device using the location determination component; and

in response to the detection, automatically causing the camera to capture an image of the next property;

transmitting captured images of each property of the plurality of properties to a detector by the computing device;

for each image of the captured images:

using a model and the image, generate a score for a property depicted in the image by the detector;

based on the score, determine whether the property depicted in the image has one or more code violations by the detector; and

provide the image and the determination to a reviewer by the detector.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: MOORE, BRENDAN AUGUST
To: THE CITY OF TUSCALOOSA
Reel/Frame 071727/0396 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: JOHNSON, ERIK BARRY
To: THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ALABAMA
Reel/Frame 071982/0183 →
Continuity (2)
Provisional Application 63057592 · Jul 28, 2020
Related Publication 20220036537A1 · Feb 3, 2022
References Cited (15)
US 9898688B2 · Bleiweiss · 2018 [cited by examiner]
US 10182214B2 · Gornik · 2019 [cited by examiner]
US 20160048934A1 · Gross · 2016 [cited by examiner]
US 20190304026A1 · Lyman · 2019 [cited by examiner]
US 20200088534A1 · Nakirikanti · 2020 [cited by examiner]
Pough, Bradley and Qian Wan. 2007. Data Analytics and the Fight Against Housing Blight: A Guide for Local Leaders. Responsive Communities (Mar. 2017). (Year: 2017). [cited by examiner]
Wheelie Waste. Garbage Trucks With Cameras Will Report on Residents Who Put Rubbish in The Wrong Bins. (Oct. 2017) (Year: 2017). [cited by examiner]
Prince William County Government, “PCE Overview”, pwcva.org, 2020. (Year: 2020). [cited by examiner]
Crothers, H., “Fight Blight with ArcGIS and Artificial Intelligence”, esri, 2018. (Year: 2018). [cited by examiner]
Mertz et al., “City-Wide Road Distress Monitoring with Smartphones”, 2014, pp. 1-9. (Year: 2014). [cited by examiner]
Esmaili, Rohollah, et al. “Mapping of understory infested boxwood trees using high resolution imagery.” Remote Sensing Applications: Society and Environment 18 (Apr. 2020): 100289. [cited by applicant]
Pough, Bradley, and Qian Wan. “Data analytics and the fight against housing blight: A guide for local leaders.” (2017). [cited by applicant]
Zou, Shengyuan, and Le Wang. “Individual vacant house detection in very-high-resolution remote sensing images.” Annals of the American Association of Geographers 110.2 (2020): 449-461. Published online: Oct. 22, 2019. [cited by applicant]
City of Memphis: Detecting potholes for better citizen experiences. City of Memphis Case Study | Google Cloud. Link: [cited by applicant]
Howard Crothers, Fight Blight with ArcGIS and Artificial Intelligence Fight Blight with ArcGIS and Artificial Intelligence (esri.com) Link: [cited by applicant]