IP Library Granted Patent US 10,535,201
Granted Patent B1
US 10,535,201 · App. 16/277,843 · Granted Jan 14, 2020

Utilizing machine learning to generate augmented reality vehicle information for a scale model of a vehicle

Inventors: Micah Price (McLean, VA); Qiaochu Tang (McLean, VA); Jason Hoover (McLean, VA); Stephen Wylie (McLean, VA); Geoffrey Dagley (McLean, VA); Kristen Przano (McLean, VA)
Assignee: Capital One Services, LLC
G06T19/006G06F3/04812G06Q40/02G06T11/60G08G1/202G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,535,201
App. No.
16/277,843
Granted
Jan 14, 2020
Kind
B1
Abstract

A device receives an image including image data of a scale model of a vehicle, and processes the image data, with a model, to identify a make, a model, and a year represented by the scale model. The device determines augmented reality (AR) vehicle information based on the make, the model, and the year represented by the scale model of the vehicle, and provides the AR vehicle information to enable a user device to associate the AR vehicle information with the image of the scale model of the vehicle. The device receives an input associated with the AR vehicle information, and determines updated AR vehicle information based on the input associated with the AR vehicle information. The device provides the updated AR vehicle information to enable the user device to associate the updated augmented reality vehicle information with the image of the scale model of the vehicle.

Claims (125)

1. A method, comprising:

receiving, by a device, live streaming image data of a scale model of a vehicle,

wherein the live streaming image data is transmitted by a user device to the device;

processing, by the device and with a model, at least a portion of the live streaming image data to determine vehicle information associated with the scale model of the vehicle,

wherein the vehicle information includes at least one of:

information identifying a year of the vehicle,

information identifying a make of the vehicle, or

information identifying a vehicle model of the vehicle;

providing, by the device, the vehicle information to the user device;

receiving, by the device and from the user device, an input associated with the vehicle information,

the input indicating a vehicle option affecting an appearance of the vehicle;

determining, by the device, augmented reality vehicle information based on the input associated with the vehicle information,

wherein the augmented reality vehicle information includes data enabling the user device to display, with the live streaming image data, the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle; and

providing, by the device, the augmented reality vehicle information to the user device to enable the user device to associate the augmented reality vehicle information with the live streaming image data of the scale model of the vehicle,

the augmented reality vehicle information causing the user device to display the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle, and

the augmented reality vehicle information being associated with the live streaming image data based on augmented reality markers associated with the scale model of the vehicle,

the augmented reality markers indicating where to provide the augmented reality vehicle information in relation to the scale model of the vehicle.

2. The method of claim 1 , further comprising:

determining a particular vehicle in inventory that includes features that substantially match the vehicle option;

determining financial information for the particular vehicle,

wherein the financial information includes at least one of:

information indicating a price of the particular vehicle, or

information indicating financing terms for the particular vehicle; and

providing the financial information to the user device.

3. The method of claim 2 , further comprising:

receiving, from the user device, an input associated with the financial information;

determining updated financial information based on the input associated with the financial information; and

providing the updated financial information to the user device.

4. The method of claim 1 , further comprising:

determining test drive information based on the vehicle information associated with the scale model of the vehicle,

wherein the test drive information includes at least one of:

information indicating that a test drive is available for the vehicle, or information indicating a time of the test drive;

receiving, from the user device, an input associated with the test drive information;

determining updated test drive information based on the input associated with the test drive information,

wherein the updated test drive information includes information indicating an updated time for the test drive of the vehicle;

providing, to the vehicle, instructions to drive to a location of the user device at the updated time; and

providing the updated test drive information to the user device.

5. The method of claim 1 , further comprising:

determining updated vehicle information based on the input associated with the vehicle information; and

providing the updated vehicle information to the user device.

6. The method of claim 1 , further comprising:

determining projector information based on the input associated with the vehicle information,

wherein the projector information includes information to be projected on the scale model of the vehicle; and

providing, to a projector associated with the scale model of the vehicle, the projector information to enable the projector to project the projector information on the scale model of the vehicle.

7. The method of claim 1 , further comprising:

providing, to the user device, an augmented reality application to enable the user device to display the augmented reality vehicle information.

8. A device, comprising:

one or more memories; and

one or more processors, communicatively coupled to the one or more memories, configured to:

receive live streaming image data of a scale model of a vehicle,

wherein the live streaming image data is captured by a user device;

process at least a portion of the live streaming image data, with a model, to identify a make, a vehicle model, and a year represented by the scale model of the vehicle;

determine augmented reality vehicle information based on the make, the vehicle model, and the year represented by the scale model of the vehicle,

wherein the augmented reality vehicle information includes data enabling the user device to display, with the live streaming image data, a vehicle option using augmented reality to reflect an appearance of the vehicle on the scale model of the vehicle;

provide the augmented reality vehicle information to the user device to enable the user device to associate the augmented reality vehicle information with the live streaming image data of the scale model of the vehicle,

the augmented reality vehicle information causing the user device to display the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle, and

the augmented reality vehicle information being associated with the live streaming image data based on augmented reality markers associated with the scale model of the vehicle,

the augmented reality markers indicating where to provide the augmented reality vehicle information in relation to the scale model of the vehicle;

receive, from the user device, an input associated with the augmented reality vehicle information;

determine updated augmented reality vehicle information based on the input associated with the augmented reality vehicle information; and

provide the updated augmented reality vehicle information to the user device to enable the user device to associate the updated augmented reality vehicle information with the live streaming image data of the scale model of the vehicle.

9. The device of claim 8 , wherein the one or more processors are further configured to:

determine financial information of a real-world version of the vehicle based on the make, the vehicle model, and the year represented by the scale model of the vehicle,

wherein the financial information includes at least one of:

information indicating a price of the real-world version of the vehicle, or

information requesting information associated with a user of the user device; and

provide the financial information to the user device.

10. The device of claim 9 , wherein the one or more processors are further configured to:

receive, from the user device, the information associated with the user of the user device;

determine updated financial information based on the information associated with the user of the user device,

wherein the updated financial information includes information indicating financing terms for the user; and

provide the updated financial information to the user device.

11. The device of claim 8 , wherein the one or more processors are further configured to:

determine test drive information for a real-world version of the vehicle that includes features substantially similar to the make, the vehicle model, and the year represented by the scale model of the vehicle,

wherein the test drive information includes information indicating that a test drive is available for the real-world version of the vehicle;

determine augmented reality test drive information based on the test drive information; and

provide, to the user device, the augmented reality test drive information to enable the user to experience an augmented reality test drive of the vehicle via the user device.

12. The device of claim 8 , wherein the vehicle option includes one or more of:

an optional color of the vehicle, or

an optional accessory of the vehicle.

13. The device of claim 8 , wherein the one or more processors are further configured to:

determine projector information based on the make, the vehicle model, and the year represented by the scale model of the vehicle,

wherein the projector information includes information to be projected on the scale model of the vehicle; and

provide, to a projector associated with the scale model of the vehicle, the projector information to enable the projector to project the projector information on the scale model of the vehicle.

14. The device of claim 8 , wherein the one or more processors are further configured to:

provide, to the user device, an application to enable the user device to display the augmented reality vehicle information and the updated augmented reality vehicle information.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a user device, cause the one or more processors to:

receive, via an electronic viewfinder of a camera of the user device, live streaming image data of a scale model of a vehicle;

process at least a portion of the live streaming image data, with a model, to identify a vehicle type associated with the scale model of the vehicle;

determine augmented reality vehicle information based on the vehicle type associated with the scale model of the vehicle,

wherein the augmented reality vehicle information includes data enabling the user device to display, with the live streaming image data, a vehicle option using augmented reality to reflect an appearance of the vehicle on the scale model of the vehicle;

provide, for display by the user device, the augmented reality vehicle information in association with the live streaming image data of the scale model of the vehicle,

the augmented reality vehicle information causing the user device to display the vehicle option using augmented reality to reflect the appearance of the vehicle on the scale model of the vehicle, and

the augmented reality vehicle information being displayed in association with the live streaming image data of the scale model of the vehicle based on augmented reality markers associated with the scale model of the vehicle,

the augmented reality markers indicating where to provide the augmented reality vehicle information in relation to the scale model of the vehicle;

receive an input associated with the augmented reality vehicle information;

determine updated augmented reality vehicle information based on the input associated with the augmented reality vehicle information; and

provide, for display, the updated augmented reality vehicle information in association with the live streaming image data of the scale model of the vehicle.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions further comprise:

one or more instructions that, when executed by the one or more processors, cause the one or more processors to:

provide, to a device, the vehicle type associated with the scale model of the vehicle; and

receive, from the device, test drive information based on the vehicle type associated with the scale model of the vehicle,

wherein the test drive information includes at least one of:

information indicating that a test drive is available for a real-world version of a vehicle represented by the scale model of the vehicle,

information indicating a location of the test drive, or

information indicating a time of the test drive.

17. The non-transitory computer-readable medium of claim 15 , wherein the instructions further comprise:

one or more instructions that, when executed by the one or more processors, cause the one or more processors to:

provide, to a device, the vehicle type associated with the scale model of the vehicle; and

receive, from the device, financial information based on the vehicle type associated with the scale model of the vehicle,

wherein the financial information includes at least one of:

information indicating a price of a real-world version of a vehicle represented by the scale model of the vehicle, or

information indicating financing terms for the real-world version of the vehicle.

18. The non-transitory computer-readable medium of claim 15 , wherein the instructions further comprise:

one or more instructions that, when executed by the one or more processors, cause the one or more processors to:

receive, from a device, an application to enable the user device to display the augmented reality vehicle information and the updated augmented reality vehicle information.

19. The non-transitory computer-readable medium of claim 15 , wherein the vehicle option includes one or more of:

a color of a real-world version of a vehicle represented by the scale model of the vehicle, or

an accessory of the real-world version of the vehicle.

20. The non-transitory computer-readable medium of claim 15 , wherein the instructions further comprise:

one or more instructions that, when executed by the one or more processors, further cause the one or more processors to:

determine projector information based on the vehicle type associated with the scale model of the vehicle,

wherein the projector information includes information to be projected on the scale model of the vehicle; and

provide, to a projector associated with the scale model of the vehicle, the projector information to enable the projector to project the projector information on the scale model of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2019
From: PRICE, MICAH; TANG, QIAOCHU; HOOVER, JASON; WYLIE, STEPHEN; DAGLEY, GEOFFREY; PRZANO, KRISTEN
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 048399/0768 →
Cited By (2)
US 12,423,920 US 12,475,657