Granted Patent B2

US 12,333,581 · App. 17/676,701 · Granted Jun 17, 2025

Inventors: Michael T. Cornelison (LaGrange Highlands, IL); Anurag Sharma (Buffalo Grove, IL); Daniel Brickman (Chicago, IL); David M. Zahn (Lake Villa, IL); Andrew Daniels (Columbus, OH); Pinal Patel (Libertyville, IL); David L Gilkison (Libertyville, IL); Steven Genc (Hainesville, IL)

Assignee: Allstate Insurance Company

G06Q30/0283G06N3/02G06N20/00G06Q10/20G06T7/13G06T2210/12G06V40/162

Abstract

Claims (56)

1. A method comprising:

receiving, by an image analysis and device control system and from a mobile device, at least one image;

determining, by the image analysis and device control system and using edge detection, an indication of boundaries of a surface comprising included in the at least one image, comprising:

determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and

inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining, by the image analysis and device control system, pixel dimensions for the surface;

determining, by the image analysis and device control system and based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and

transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

2. The method of claim 1 , further comprising transmitting, by the image analysis and device control system and to the mobile device, an instruction to capture the at least one image.

3. The method of claim 2 , further comprising receiving, by the image analysis and device control system and from the mobile device, a damage indication output, wherein the transmitting the instruction to capture the at least one image is responsive to the receiving the damage indication output.

4. The method of claim 2 , wherein the instruction to capture the at least one image comprises a link to download a damage processing application.

5. The method of claim 1 , wherein the reference object comprises at least one of: a light switch, an outlet, an outlet plate, a light bulb, a can light, a phone outlet, a data jack, a base board, a nest, a smoke detector, a kitchen sink, a faucet, a stove, a dishwasher, a floor tile, hot and cold faucets, a heat vent, a key hole, a door handle, a door frame, a deadbolt, a door, a stair, a railing, a table, a chair, a bar stool, a toilet, and a cabinet.

6. The method of claim 1 , further comprising:

transmitting, by the image analysis and device control system and to the mobile device, an instruction to prompt for a room indication input comprising an indication of a type of room in which the at least one image was captured;

receiving, by the image analysis and device control system and from the mobile device, the room indication input;

determining, by the image analysis and device control system and based on the room indication input, a room indication output; and

determining, by the image analysis and device control system and based on the room indication output, a plurality of reference objects.

7. The method of claim 6 , wherein the at least one image comprises at least one of the plurality of reference objects.

8. An image analysis and device control system comprising:

a memory; and

a processor coupled to the memory and programmed with computer-executable instructions for performing operations comprising:

receiving, from a mobile device, at least one image;

determining, using edge detection, an indication of boundaries of a surface included in the at least one image, comprising:

determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and

inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining pixel dimensions for the surface;

determining, based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and

transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

9. The system of claim 8 , the operations further comprising transmitting, to the mobile device, an instruction to capture the at least one image.

10. The system of claim 9 , the operations further comprising receiving, from the mobile device, a damage indication output, wherein the transmitting the instruction to capture the at least one image is responsive to the receiving the damage indication output.

11. The system of claim 9 , wherein the instruction to capture the at least one image comprises a link to download a damage processing application.

12. The system of claim 8 , wherein the reference object comprises at least one of: a light switch, an outlet, an outlet plate, a light bulb, a can light, a phone outlet, a data jack, a base board, a nest, a smoke detector, a kitchen sink, a faucet, a stove, a dishwasher, a floor tile, hot and cold faucets, a heat vent, a key hole, a door handle, a door frame, a deadbolt, a door, a stair, a railing, a table, a chair, a bar stool, a toilet, and a cabinet.

13. The system of claim 8 , the operations further comprising:

transmitting, by the image analysis and device control system and to the mobile device, an instruction to prompt for a room indication input comprising an indication of a type of room in which the at least one image was captured;

receiving, by the image analysis and device control system and from the mobile device, the room indication input;

determining, by the image analysis and device control system and based on the room indication input, a room indication output; and

determining, by the image analysis and device control system and based on the room indication output, a plurality of reference objects.

14. The system of claim 13 , wherein the at least one image comprises at least one of the plurality of reference objects.

15. A non-transitory computer-readable medium storing computer executable instructions, which when executed by a processor, cause an image analysis and device control system to perform operations comprising:

receiving, from a mobile device, at least one image;

determining, using edge detection, an indication of boundaries of a surface included in the at least one image, comprising:

determining, using one or more machine learning algorithms, a plurality of bounding boxes corresponding to the at least one image, wherein determining the plurality of bounding boxes includes adjusting dimensions of the plurality of bounding boxes to match predetermined dimensions for a neural network, and

inputting, into the neural network, the plurality of bounding boxes for analysis by the one or more machine learning algorithms to determine whether the at least one image comprises a reference object;

determining pixel dimensions for the surface;

determining, based at least on the pixel dimensions for the surface, an actual surface dimension comprising actual dimensions for the surface; and

transmitting, by the image analysis and device control system and to the mobile device, the actual surface dimension output.

16. The media of claim 15 , the operations further comprising transmitting, to the mobile device, an instruction to capture the at least one image.

17. The media of claim 16 , the operations further comprising receiving, from the mobile device, a damage indication output, wherein the transmitting the instruction to capture the at least one image is responsive to the receiving the damage indication output.

18. The media of claim 16 , wherein the instruction to capture the at least one image comprises a link to download a damage processing application.

19. The media of claim 15 , wherein the reference object comprises at least one of: a light switch, an outlet, an outlet plate, a light bulb, a can light, a phone outlet, a data jack, a base board, a nest, a smoke detector, a kitchen sink, a faucet, a stove, a dishwasher, a floor tile, hot and cold faucets, a heat vent, a key hole, a door handle, a door frame, a deadbolt, a door, a stair, a railing, a table, a chair, a bar stool, a toilet, and a cabinet.

20. The media of claim 15 , the operations further comprising:

transmitting, by the image analysis and device control system and to the mobile device, an instruction to prompt for a room indication input comprising an indication of a type of room in which the at least one image was captured;

receiving, by the image analysis and device control system and from the mobile device, the room indication input;

determining, by the image analysis and device control system and based on the room indication input, a room indication output; and

determining, by the image analysis and device control system and based on the room indication output, a plurality of reference objects,

wherein the at least one image comprises at least one of the plurality of reference objects.

Assignments (1)

Continuity (2)

References Cited (171)