IP Library › Granted Patent US 11,263,787
Granted Patent B2
US 11,263,787 · App. 16/810,652 · Granted Mar 1, 2022

Augmented reality detection for locating autonomous vehicles

Inventors: Matthew Hortop (Ann Arbor, MI); Patrick Hunt (Evanston, IL); Lacey Trelfa (Aliso Viejo, CA)
Assignee: Rivian IP Holdings, LLC
G06T11/00G06K9/00671H04N5/23222G06K2209/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,263,787
App. No.
16/810,652
Granted
Mar 1, 2022
Kind
B2
Abstract

Disclosed embodiments include methods, systems, and non-transitory computer readable medium for augmented reality detection for locating a particular autonomous vehicle. In a non-limiting embodiment, an illustrative method includes providing, by an electronic device to a remote server, a request for an autonomous vehicle. A first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger is received by an electronic device. The passenger is prompted by the electronic device to orient an image sensor of the electronic device towards a designated area of the accessible range. The designated area is imaged by the image sensor for the autonomous vehicle. A visual representation of the imaged designated area is generated on a graphical user interface of the electronic device. The autonomous vehicle is identified within the generated visual representation.

Claims (57)

1. A method of augmented reality detection for locating a particular autonomous vehicle, the method comprising:

providing, by an application executing on an electronic device associated with an intended passenger and to a remote server, a request for an autonomous vehicle;

receiving, by the application, a first signal indicating that the autonomous vehicle is within an accessible range of the intended passenger;

prompting, by the application, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;

upon receiving imaging data from the image sensor associated with the designated area for the autonomous vehicle, generating, by the remote server, a visual representation of the imaged designated area for presentation on a graphical user interface of the application executing on the electronic device;

determining, by the remote server and based on inertial data embedded in the received imaging data, an orientation of the electronic device;

causing, by the remote server, a second signal to be transmitted from the autonomous vehicle, the second signal being a line of sight signal transmitted by the autonomous vehicle for capture by the image sensor of the electronic device;

upon receiving an indication that the second signal has been captured by the image sensor of the electronic device, identifying, by the remote server, the autonomous vehicle within the generated visual representation; and

causing, by the remote server and within the graphical user interface of the application, a presentation of the autonomous vehicle to the identified within the generated visual representation.

2. The method of claim 1 , wherein the processing of the second signal includes recording an intensity of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

3. The method of claim 1 , further comprising:

receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;

determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and

providing, by the autonomous vehicle, the designated area to the remote server or the application on the electronic device,

wherein the designated area includes the position and the application on the electronic device causes a display of the high definition maps on the electronic device.

4. The method of claim 1 , further comprising:

selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and

providing, by the remote server, the request to the autonomous vehicle.

5. The method according to claim 1 , wherein causing the presentation of the autonomous vehicle to be identified within the generated visual representation includes the application causing, on a display of the electronic device, an indication highlighting the autonomous vehicle to be displayed by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, and highlighting the autonomous vehicle with a color annotation.

6. The method of claim 1 , wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

7. The method of claim 1 , wherein the first signal includes a Wi-Fi signal, a Bluetooth signal, or a pulsating laser light.

8. The method of claim 1 , further comprising providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the application displayed on the electronic device.

9. A system for locating autonomous vehicles, the system comprising:

a computer processing system; and a computer memory,

wherein the computer processing system is configured to execute steps including:

providing, by an application executing on an electronic device associated with an intended passenger and to a remote server, a request for an autonomous vehicle;

receiving, by the application, a first signal indicating that the autonomous vehicle is within an accessible range of the intended passenger;

prompting, by the application, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;

upon receiving imaging data from the image sensor associated with the designated area for the autonomous vehicle, generating, by the electronic device, a visual representation of the imaged designated area on a graphical user interface of the electronic device;

determining, by the remote server and based on inertial data embedded in the received imaging data, an orientation of the electronic device;

causing, by the remote server, a second signal to be transmitted from the autonomous vehicle, the second signal being a line of sight signal transmitted by the autonomous vehicle for capture by the image sensor of the electronic device;

upon receiving an indication that the second signal has been captured by the image sensor of the electronic device, identifying, by the remote server, the autonomous vehicle within the generated visual representation; and

causing, by the remote server and within the graphical user interface of the application, a presentation of the autonomous vehicle to be identified within the generated visual representation.

10. The system of claim 9 , wherein the processing the second signal includes recording an intensity of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

11. The system of claim 9 , further comprising:

receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;

determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and

providing, by the autonomous vehicle, the designated area to the remote server or the application on the electronic device,

wherein the designated area includes the position and the application on the electronic device causes a display of the high definition maps on the electronic device.

12. The system of claim 9 , further comprising:

selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and

providing, by the remote server, the request to the autonomous vehicle.

13. The system according to claim 9 , wherein causing the presentation of the autonomous vehicle to be identified within the generated visual representation includes the application causing, on a display of the electronic device, an indication highlighting the autonomous vehicle to be displayed by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, or highlighting the autonomous vehicle with a color annotation.

14. The system of claim 9 , wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

15. The system of claim 9 , wherein the first signal includes a WiFi signal, a Bluetooth signal, or a pulsating laser light.

16. The system of claim 9 , further comprising providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the application displayed on the electronic device.

17. A non-transitory computer readable medium comprising:

program instructions for locating autonomous vehicles, the program instructions when executed causing a computer processing system to execute steps including:

providing, by an application executing on an electronic device associated with an intended passenger and to a remote server, a request for an autonomous vehicle;

receiving, by the application, a first signal indicating that the autonomous vehicle is within an accessible range of the intended passenger;

prompting, by the application, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;

upon receiving imaging data from the image sensor associated with the designated area for the autonomous vehicle, generating, by the remote server, a visual representation of the imaged designated area for presentation on a graphical user interface of the application executing on the electronic device;

determining, by the remote server and based on inertial data embedded in the received imaging data, an orientation of the electronic device;

causing, by the remote server, a second signal to be transmitted from the autonomous vehicle, the second signal being a line of sight signal transmitted by the autonomous vehicle for capture by the image sensor of the electronic device;

upon receiving an indication that the second signal has been captured by the image sensor of the electronic device, identifying, by the remote server, the autonomous vehicle within the generated visual representation; and

causing, by the remote server and within the graphical user interface of the application, a presentation of the autonomous vehicle to be identified within the generated visual representation.

18. The non-transitory computer readable medium of claim 17 , wherein the steps further include providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the application displayed on the electronic device.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: HORTOP, MATTHEW; HUNT, PATRICK; TRELFA, LACEY
To: RIVIAN AUTOMOTIVE, LLC
Reel/Frame 052032/0719 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: RIVIAN AUTOMOTIVE, LLC
To: RIVIAN AUTOMOTIVE, INC.
Reel/Frame 052032/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: RIVIAN AUTOMOTIVE, INC.
To: RIVIAN IP HOLDINGS, LLC
Reel/Frame 052032/0769 →
Continuity (1)
Related Publication 20210279913A1 · Sep 9, 2021