IP Library Granted Patent US 11,794,755
Granted Patent B2
US 11,794,755 · App. 17/525,831 · Granted Oct 24, 2023

Vehicle teleoperator ranking and selection

Inventors: Shay Magzimof (Palo Alto, CA); David Parunakian (Moscow, RU); Michael Kris (Campbell, CA)
Assignee: Phantom Auto Inc.
B60W40/09G05D1/0038G07C5/008B60W2540/30G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,794,755
App. No.
17/525,831
Granted
Oct 24, 2023
Kind
B2
Abstract

A system provides on-demand remote support services including teleoperation of vehicles. In response to a remote support request, the system assesses environmental conditions, historical data, and/or parameters of a request for remote support to rank available operators capable of fulfilling the request, and selects an optimal operator for the remote support request based on desired criteria.

Claims (64)

1. A method performed by a teleoperation server for selecting a teleoperator to remotely operate a vehicle over a network in response to a remote support request, the method comprising:

storing respective operator scores for a plurality of candidate operators to a teleoperator scoring database of a data storage system, each of the respective operator scores associated with a vehicle class, and each of the respective operator scores derived from performance data collected from a real or simulated test driving session for the vehicle class in which the plurality of candidate operators are requested to perform a specified set of driving maneuvers via controls of respective remote support terminals;

receiving over the network, the remote support request from the vehicle;

identifying, based on the remote support request, a vehicle class associated with the request;

performing a lookup in the teleoperator scoring database of the data storage system to determine, based on the vehicle class associated with the request, the respective operator scores for the plurality of candidate operators associated with the vehicle class;

matching the vehicle to a chosen operator from among the plurality of candidate operators based at least in part on the respective operator scores;

assigning the chosen operator to service the remote support request;

initiating, via a network connection of the network, a remote support session between a remote support terminal of the chosen operator and the vehicle; and

facilitating, via the network connection, teleoperation of the vehicle during the remote support session.

2. The method of claim 1 , further comprising:

facilitating the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform teleoperation of a real test vehicle; and

generating the respective operator scores based on the performance data from the one or more test driving sessions.

3. The method of claim 1 , further comprising:

facilitating the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform a simulated teleoperation of a simulated test vehicle; and

generating the respective operator scores based on the performance data from the one or more test driving sessions.

4. The method of claim 1 , further comprising:

obtaining, during service of the remote support request, telemetry data pertaining the service of the remote support request; and

generating an updated operator score for the chosen operator based on the telemetry data.

5. The method of claim 1 , wherein the chosen operator comprises a human teleoperator.

6. The method of claim 1 , wherein the chosen operator comprises an artificial intelligence agent executing on a computing system.

7. The method of claim 1 , wherein the performance data comprises at least one of: a speed optimality parameter, an acceleration optimality parameter, a steering angle performance parameter, a braking performance parameter, an experience parameter, a physiological parameter, a supervisor feedback parameter, a customer feedback parameter, and an environmental condition parameter.

8. A non-transitory computer-readable storage medium storing instructions for selecting by a teleoperation server, a teleoperator to remotely operate a vehicle over a network in response to a remote support request, the instructions when executed by one or more processors causing the one or more processors to perform a method comprising:

storing respective operator scores for a plurality of candidate operators to a teleoperator scoring database of a data storage system, each of the respective operator scores associated with a vehicle class, and each of the respective operator scores derived from performance data collected from a real or simulated test driving session for the vehicle class in which the plurality of candidate operators are requested to perform a specified set of driving maneuvers via controls of respective remote support terminals;

receiving over the network, the remote support request from the vehicle;

identifying, based on the remote support request, a vehicle class associated with the request;

performing a lookup in the teleoperator scoring database of the data storage system to determine, based on the vehicle class associated with the request, the respective operator scores for the plurality of candidate operators associated with the vehicle class;

matching the vehicle to a chosen operator from among the plurality of candidate operators based at least in part on the respective operator scores;

assigning the chosen operator to service the remote support request;

initiating, via a network connection of the network, a remote support session between a remote support terminal of the chosen operator and the vehicle; and

facilitating, via the network connection, teleoperation of the vehicle during the remote support session.

9. The non-transitory computer-readable storage medium of claim 8 , the instructions when executed further causing the one or more processors to perform steps comprising:

facilitating the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform teleoperation of a real test vehicle; and

generating the respective operator scores based on the performance data from the one or more test driving sessions.

10. The non-transitory computer-readable storage medium of claim 8 , further comprising:

facilitating the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform a simulated teleoperation of a simulated test vehicle; and

generating the respective operator scores based on the performance data from the one or more test driving sessions.

11. The non-transitory computer-readable storage medium of claim 8 , the instructions when executed further causing the one or more processors to perform steps comprising:

obtaining, during service of the remote support request, telemetry data pertaining the service of the remote support request; and

generating an updated operator score for the chosen operator based on the telemetry data.

12. The non-transitory computer-readable storage medium of claim 8 , wherein the chosen operator comprises a human teleoperator.

13. The non-transitory computer-readable storage medium of claim 8 , wherein the chosen operator comprises an artificial intelligence agent executing on a computing system.

14. The non-transitory computer-readable storage medium of claim 8 , wherein the performance data comprises at least one of: a speed optimality parameter, an acceleration optimality parameter, a steering angle performance parameter, a braking performance parameter, an experience parameter, a physiological parameter, a supervisor feedback parameter, a customer feedback parameter, and an environmental condition parameter.

15. A computer system comprising:

one or more processors; and

a non-transitory computer-readable storage medium storing instructions for selecting a teleoperator to remotely operate a vehicle over a network in response to a remote support request, the instructions when executed by the one or more processors causing the one or more processors to:

store respective operator scores for a plurality of candidate operators to a teleoperator scoring database of a data storage system, each of the respective operator scores associated with a vehicle class, and each of the respective operator scores derived from performance data collected from a real or simulated test driving session for the vehicle class in which the plurality of candidate operators are requested to perform a specified set of driving maneuvers via controls of respective remote support terminals;

receive over the network, the remote support request from the vehicle;

based on the remote support request, a vehicle class associated with the request;

perform a lookup in the teleoperator scoring database of the data storage system to determine, based on the vehicle class associated with the request, the respective operator scores for the plurality of candidate operators associated with the vehicle class;

match the vehicle to a chosen operator from among the plurality of candidate operators based at least in part on the respective operator scores;

assign the chosen operator to service the remote support request;

initiate via a network connection of the network, a remote support session between a remote support terminal of the chosen operator and the vehicle; and

facilitate via the network connection, teleoperation of the vehicle during the remote support session.

16. The computer system of claim 15 , the instructions when executed further causing the one or more processors to:

facilitate the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform teleoperation of a real test vehicle; and

generate the respective operator scores based on the performance data from the one or more test driving sessions.

17. The computer system of claim 15 , the instructions when executed further causing the one or more processors to:

facilitate the one or more test driving sessions by issuing instructions for the plurality of candidate operators to perform a simulated teleoperation of a simulated test vehicle; and

generate the respective operator scores based on the performance data from the one or more test driving sessions.

18. The computer system of claim 15 , the instructions when executed further causing the one or more processors to:

obtain, during service of the remote support request, telemetry data pertaining the service of the remote support request; and

generate an updated operator score for the chosen operator based on the telemetry data.

19. The computer system of claim 15 , wherein the chosen operator comprises a human teleoperator.

20. The computer system of claim 15 , wherein the chosen operator comprises an artificial intelligence agent executing on a computing system.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2025
From: PHANTOM AUTO INC.
To: SERVE OPERATING CO.
Reel/Frame 072835/0759 →
SECURITY INTEREST Recorded Feb 12, 2024
From: PHANTOM AUTO INC.
To: TRIPLEPOINT PRIVATE VENTURE CREDIT INC.
Reel/Frame 066439/0180 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: MAGZIMOF, SHAY; PARUNAKIAN, DAVID; KRIS, MICHAEL
To: PHANTOM AUTO INC.
Reel/Frame 059657/0012 →
Continuity (3)
Continuation 16544779 · Aug 19, 2019
Provisional Application 62721418 · Aug 22, 2018
Related Publication 20220073083A1 · Mar 10, 2022