IP Library › Granted Patent US 11,823,337
Granted Patent B2
US 11,823,337 · App. 17/587,607 · Granted Nov 21, 2023

Systems and methods for enhancing and developing accident scene visualizations

Inventors: Brian Mark Fields (Normal, IL); Lee Marvin John Assam (El Paso, IL)
Assignee: State Farm Mutual Automobile Insurance Company
G06T19/006G06F40/169G06Q40/08G06T11/00H04L67/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,823,337
App. No.
17/587,607
Filed
Jan 28, 2022
Granted
Nov 21, 2023
Kind
B2
Art Unit
2611
USPC
345/633
Abstract

Systems and methods are disclosed for enhancing and developing a damage scene virtual reality (VR) visualization. Annotated immersive multimedia image(s) may be received from a first user, where the annotated immersive multimedia image(s) can be associated with a damage scene. A VR visualization of the annotated immersive multimedia image(s) may be rendered using a VR device associated with a second user. The VR visualization may be used to determine a damage amount, where the damage amount is determined from one or more damaged items identifiable in the annotated immersive multimedia image(s).

Claims (83)

1. A damage scene visualization system, comprising:

a virtual reality (VR) device; and

a visualization processor communicatively coupled to the VR device, the visualization processor configured to:

receive a digital image depicting a damage item located within a damage scene;

receive telematics data associated with the damage item;

generate, based on the digital image, a VR image of the damage scene, wherein the VR image illustrates

the damage item, and

a visual representation of an environment at which the damage item is disposed;

augment the VR image based on the telematics data, wherein the augmented VR image provides at least a portion of the telematics data;

receive, from the VR device, first information indicative of a head location;

based at least in part on the first information, cause the VR device to render a 3D visualization of the damage scene from a first viewpoint corresponding to the head location, the 3D visualization including the augmented VR image;

receive second information, the second information being indicative of a value of the damage item in an undamaged condition; and

determine a damage amount of the damage item based on the value, and the 3D visualization of the damage scene as rendered from the first viewpoint.

2. The damage scene visualization system of claim 1 , wherein the visualization processor is further configured to:

receive an annotation to be applied to the VR image;

generate, based on the annotation, a mixed reality VR image comprising the VR image augmented to include the annotation; and

cause the VR device to render the mixed reality VR image.

3. The damage scene visualization system of claim 2 , wherein the annotation comprises a graphic illustrating an additional item and identifying a location of the additional item in the environment.

4. The damage scene visualization system of claim 2 , wherein the visualization processor is further configured to:

receive third information, from the VR device, indicative of a voice command or body gesture; and

modify, based on the third information, the mixed reality VR image, wherein modifying the mixed reality VR image comprises one or more of moving, altering, or highlighting the annotation.

5. The damage scene visualization system of claim 1 , wherein the digital image includes metadata comprising a time of capture and a geographic location of capture, and the visualization processor is further configured to:

generate a mixed reality VR image comprising the VR image augmented to include the metadata; and

cause the VR device to render the mixed reality VR image.

6. The damage scene visualization system of claim 5 , wherein the visualization processor is further configured to:

access a map of the geographic location of capture; and

update the mixed reality VR image to include at least one of an image of the map, a link to the map, a location name derived from the map, or an aerial image of the geographic location of capture.

7. The damage scene visualization system of claim 6 , wherein updating the mixed reality VR image comprises causing the VR device to render an overlay of an image of the map on the VR image.

8. The damage scene visualization system of claim 5 , wherein the visualization processor is further configured to:

access weather information associated with the geographic location of capture, the weather information indicating a weather condition, of the geographic location of capture, at a time of occurrence of damage; and

update the mixed reality VR image to include the weather information.

9. The damage scene visualization system of claim 1 , wherein the digital image is a first digital image and the visualization processor is further configured to:

receive a second digital image of the damage item in the undamaged condition;

generate a mixed reality VR image comprising the second digital image overlaid on the VR image; and

cause the VR device to render, the mixed reality VR image.

10. The damage scene visualization system of claim 1 , wherein the visualization processor is further configured to:

receive location information indicative of a location of a witness in the environment; and

based at least in part on the location information, cause the VR device to render the 3D visualization of the damage scene from a second viewpoint corresponding to the location of the witness.

11. The damage scene visualization system of claim 1 , wherein the visualization processor is further configured to:

cause the VR device to render a selectable list of one or more annotations and a visible indicator indicative of a current position on the selectable list;

receive third information, from the VR device, of a confirmation associated with the selectable list; and

based on receiving the confirmation, associate a particular annotation located at the current position on the selectable list with the VR image.

12. The damage scene visualization system of claim 1 , wherein the damage amount is associated with an insurance claim filed for the damage item and is determined based on damage illustrated in the 3D visualization.

13. A computer-implemented visualization method, comprising:

receiving, at a visualization processor communicatively coupled to a virtual reality (VR) device, a digital image depicting a damage item located within a damage scene;

receiving, at the visualization processor, telematics data associated with the damage item;

generating, by the visualization processor, based on the digital image, a VR image of the damage scene, the VR image illustrating

the damage item, and

a visual representation of a geographic location at which the damage item is disposed;

augmenting, by the visualization processor, the VR image based on the telematics data, wherein the augmented VR image provides at least a portion of the telematics data;

receive, from the VR device, first information indicative of a head location;

based at least in part on the first information, causing the VR device to render a 3D visualization of the damage scene from a first viewpoint corresponding to the head location, the 3D visualization including the augmented VR image;

receiving, by the visualization processor, second information, the second information being indicative of a predetermined value of the damage item in an undamaged condition; and

determining, by the visualization processor, a damage amount of the damage item based on the predetermined value, and the 3D visualization of the damage scene from the first viewpoint.

14. The computer-implemented visualization method of claim 13 , further comprising:

receiving, by the VR device, an input comprising a request to modify the damage amount of the damage item;

determining, by the visualization processor, an adjustment amount based on the 3D visualization; and

determining, by the visualization processor, a modified damage amount of the damage item based at least in part on the predetermined value of the damage item, the input, and the adjustment amount.

15. The computer-implemented visualization method of claim 13 , wherein the damage item is a vehicle, and the telematics data comprises at least one of a speed of the vehicle, a deployment status of an airbag of the vehicle, or proximity information of another vehicle.

16. The computer-implemented visualization method of claim 13 , wherein the damage item is a vehicle, and the telematics data is captured by a sensor associated with the vehicle or an additional vehicle disposed proximate to the vehicle.

17. One or more non-transitory computer-readable media storing instructions that, when executed by a visualization processor operable to visualize images in virtual reality (VR), cause the visualization processor to:

receive a digital image depicting a damage item located within a damage scene;

receive telematics data associated with the damage item;

generate, based on the digital image, a VR image of the damage scene, the VR image illustrating

the damage item, and

a visual representation of a geographic location at which the damage item is disposed;

augment the VR image based on the telematics data, wherein the augmented VR image provides at least a portion of the telematics data;

receive first information indicative of a head location;

based at least in part on the first information, cause a VR device to render a 3D visualization of the damage scene from a first viewpoint corresponding to the head location, the 3D visualization including the augmented VR image;

receive second information, the second information being indicative of a predetermined value of the damage item in an undamaged condition; and

determine a damage amount of the damage item based on the predetermined value, and the 3D visualization of the damage scene from the first viewpoint.

18. The one or more non-transitory computer-readable media of claim 17 , wherein the visualization processor is further configured to:

generate a simulated video of the damage item and the damage scene, based at least in part on the telematics data; and

render, within the VR device, the simulated video.

19. The one or more non-transitory computer-readable media of claim 17 , wherein the visualization processor is further configured to:

cause the VR device to render a selectable list of one or more annotations;

receive, by the VR device, an input comprising a selection of a particular annotation of the one or more annotations;

determine an adjustment amount based on the 3D visualization and the particular annotation; and

determine a modified damage amount of the damage item based at least in part on the predetermined value of the damage item and the adjustment amount.

20. The one or more non-transitory computer-readable media of claim 17 , wherein the visualization processor is further configured to:

generate based on the telematics data, an annotation to be applied to the VR image;

generate based on the annotation, a mixed reality VR image including the annotation; and

cause the VR device to render the mixed reality VR image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2023
From: FIELDS, BRIAN MARK; ASSAM, LEE MARVIN JOHN
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 062666/0220 →
Continuity (3)
Continuation 16457011 · Jun 28, 2019
Continuation 15482120 · Apr 7, 2017
Related Publication 20220157031A1 · May 19, 2022
Cited By (1)
US 12,524,967