IP Library › Granted Patent US 10,839,217
Granted Patent B2
US 10,839,217 · App. 16/536,024 · Granted Nov 17, 2020

Augmented reality assisted pickup

Inventors: John Conway Badalamenti (San Francisco, CA); Joshua Inch (Seattle, WA); Christopher Michael Sanchez (San Francisco, CA); Theodore Russell Sumers (San Francisco, CA)
Assignee: Uber Technologies, Inc.
G06K9/00671G06K9/00711G06T19/006H04B17/27H04B17/318H04B17/373G06K2209/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,839,217
App. No.
16/536,024
Granted
Nov 17, 2020
Kind
B2
Abstract

A network system, such as a transport management system, uses augmented reality (AR) to identify an approaching vehicle. Responsive to receiving a trip request, a trip management module matches the rider with an available driver and instructs a trip monitoring module to monitor the location of the driver's vehicle as it travels to the pickup location. When the driver's vehicle is within a threshold distance of the pickup location, an AR control module instructs the rider client device to begin a live video stream and instructs an image recognition module to monitor the video stream for the driver's vehicle. Responsive to the driver's vehicle entering the field of view of the camera on the rider client device, the AR control module selects computer-generated AR elements and instructs the rider client device to visually augment the video stream to identify the driver's vehicle as it approaches the pickup location.

Claims (44)

1. A computer-implemented method for providing augmented reality identification of a vehicle comprising:

receiving, at a network system including one or more processors, from a computing device associated with a rider, a set of service data, the set of service data including an origin location and a request for a driver to transport the rider from the origin location;

matching the rider with one of a plurality of available drivers, the driver associated with a vehicle and a computing device;

monitoring a location of the vehicle based on location information received from the driver computing device;

responsive to determining that the vehicle is within a threshold distance of a pickup location associated with the origin location, instructing the rider computing device to display a live video feed, the video feed being captured by a camera on the rider computing device;

comparing a plurality of characteristics of an approaching vehicle with stored information associated with the vehicle to determine a vehicle score, the plurality of characteristics including an estimated time of arrival of the vehicle at the pickup location;

responsive to the vehicle score exceeding a vehicle score threshold, identifying the approaching vehicle as the vehicle; and

instructing an augmented reality application on the computing device to visually augment the video feed with augmented reality elements indicating the vehicle.

2. The computer-implemented method of claim 1 , further comprising identifying driver information associated with the driver and the vehicle.

3. The computer-implemented method of claim 2 , wherein the driver information includes a designation of whether the driver is associated with an indication device configured to receive a rider-specified output configuration.

4. The computer-implemented method of claim 1 , wherein the augmented reality elements include one or more of images, video, text, and graphics.

5. The computer-implemented method of claim 1 , wherein the augmented reality elements include a graphical overlay in a shape of the vehicle.

6. The computer-implemented method of claim 1 , wherein the augmented reality elements include a graphical representation of a rider-specified output configuration for an indication device.

7. The computer-implemented method of claim 1 , further comprising:

instructing the rider computing device and the driver computing device to transmit unique radio signals and report received radio signals to the network system; and

responsive to the signal strength of the received radio signals exceeding a signal strength threshold, determining that the driver computing device is within a threshold distance of the pickup location.

8. A non-transitory computer-readable storage medium storing computer-executable instructions that, in response to executing, cause a device comprising a processor to perform operations, comprising:

receiving, at a network system including one or more processors, from a computing device associated with a rider, a set of service data, the set of service data including an origin location and a request for a driver to transport the rider from the origin location;

matching the rider with one of a plurality of available drivers, the driver associated with a vehicle and a computing device;

monitoring a location of the vehicle based on location

information received from the driver computing device;

responsive to determining that the vehicle is within a threshold distance of a pickup location associated with the origin location, instructing the rider computing device to display a live video feed, the video feed being captured by a camera on the rider computing device;

comparing a plurality of characteristics of an approaching vehicle with stored information associated with the vehicle to determine a vehicle score, the plurality of characteristics including an estimated time of arrival of the vehicle at the pickup location;

responsive to the vehicle score exceeding a vehicle score threshold, identifying the approaching vehicle as the vehicle; and

instructing an augmented reality application on the computing device to visually augment the video feed with augmented reality elements indicating the vehicle.

9. The non-transitory computer-readable storage medium of claim 8 , further comprising identifying driver information associated with the driver and the vehicle.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the driver information includes a designation of whether the driver is associated with an indication device configured to receive a rider-specified output configuration.

11. The non-transitory computer-readable storage medium of claim 8 , further comprising:

instructing the rider computing device and the driver computing device to transmit unique radio signals and report received radio signals to the network system; and

responsive to the signal strength of the received radio signals exceeding a signal strength threshold, determining that the driver computing device is within a threshold distance of the pickup location.

12. A computer system comprising:

one or more computer processors for executing computer program instructions; and

a non-transitory computer-readable storage medium storing instructions executable by the one or more computer processors to perform steps comprising:

receiving at a network system including one or more processors, from a computing device associated with a rider, a set of service data, the set of service data including an origin location and a request for a vehicle to transport the rider from the origin location;

matching the rider with one of a plurality of available vehicles;

monitoring a location of the vehicle;

responsive to determining that the vehicle is within a threshold distance of a pickup location associated with the origin location, instructing the rider computing device to display a live video feed, the video feed being captured by a camera on the rider computing device;

comparing a plurality of characteristics of an approaching vehicle with stored information associated with the vehicle to determine a vehicle score, the plurality of characteristics including an estimated time of arrival of the vehicle at the pickup location;

responsive to the vehicle score exceeding a vehicle score threshold, identifying the approaching vehicle as the vehicle; and

instructing an augmented reality application on the rider computing device to visually augment the video feed with augmented reality elements indicating the vehicle.

13. The computer system of claim 12 , further comprising identifying vehicle information associated with the vehicle.

14. The computer system of claim 12 , further comprising:

instructing the rider computing device and an on-board computing system of the vehicle to transmit unique radio signals and report received radio signals to the network system; and

responsive to the signal strength of the received radio signals exceeding a signal strength threshold, determining that the vehicle is within a threshold distance of the pickup location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2019
From: BADALAMENTI, JOHN; INCH, JOSHUA; SANCHEZ, CHRISTOPHER MICHAEL; SUMERS, THEODORE RUSSELL
To: UBER TECHNOLOGIES, INC.
Reel/Frame 050020/0505 →
Continuity (3)
Continuation 16020118 · Jun 27, 2018
Provisional Application 62553055 · Aug 31, 2017
Related Publication 20190362153A1 · Nov 28, 2019
Cited By (1)
US 12,515,523