Granted Patent B2

US 12,530,025 · App. 18/144,095 · Granted Jan 20, 2026

Inventors: Auver Cedric Austria (San Francisco, CA); Timothy David Kentley-Klay (Stanford, CA); Jannie Wing Sze Lai (Berkeley, CA); Frank Reinaldo Ramirez (San Francisco, CA); Dennis Schaefer (Menlo Park, CA)

Assignee: Zoox, Inc.

G05D1/0016G05D1/0022G05D1/0027G05D1/0038G05D1/005G05D1/223G05D1/224G05D1/2244G05D1/692

Abstract

Claims (48)

1 . A system comprising:

one or more processors; and

one or more non-transitory computer-readable media storing instructions that, when executed, cause the one or more processors to perform operations comprising:

causing a display to present a user interface to a remote operator, the user interface comprising:

a representation of a vehicle traversing an environment, and

a vehicle control interface including an input element;

receiving, via the input element, first data indicating a component that is to be controlled;

causing, based at least in part on the first data, the display to present an additional input element associated with causing the component of the vehicle to perform an action;

receiving, via the additional input element, second data;

transmitting a signal to the vehicle, the vehicle configured to control the component based at least in part on the signal;

receiving feedback from the vehicle associated with the component; and

updating the representation of the vehicle to indicate that the component performed or is performing the action.

2 . The system of claim 1 , wherein the user interface further comprises at least one of:

a communication interface configured to receive input to enable remotely communicating with at least one of an occupant of the vehicle or another remote operator, or

a status interface configured to provide information representing at least one of a speed of the vehicle, an intended trajectory of the vehicle, or a traffic rule associated with a route the vehicle is traversing.

3 . The system of claim 1 , wherein the feedback received from the vehicle is sensor data associated with a sensor associated with the component, and

wherein updating the representation of the vehicle on the user interface to indicate that the component performed or is performing the action is based at least in part on analyzing the sensor data.

4 . The system of claim 1 , wherein the component is at least one of a door of the vehicle, a window of the vehicle, a heating, ventilation, and air conditioning (HVAC) controller of the vehicle, a stereo of the vehicle, a light of the vehicle, a window shade of the vehicle, or a ride setting of the vehicle.

5 . The system of to claim 1 , wherein the component comprises a passenger accessible component.

6 . A method comprising:

continuously presenting, on a first portion of a display, a representation of an environment and at least a portion of a vehicle traversing the environment;

continuously presenting, on a second portion of the display, a control interface associated with providing remote control over a component of the vehicle other than a powertrain component of the vehicle;

receiving, via an input element, first data indicating the component that is to be controlled;

receiving, via the input element of the control interface, an indication of an action to be performed by the component;

based at least in part on the indication, causing the component of the vehicle to perform the action; and

updating the representation of the portion of the vehicle to indicate that the component performed or is performing the action.

7 . The method of claim 6 , wherein the component is a door of the vehicle and the action comprises at least one of opening the door, closing the door, locking the door, or unlocking the door.

8 . The method of claim 6 , wherein the component is a light of the vehicle and the action comprises at least one of powering the light on, powering the light off, or changing an intensity of the light.

9 . The method of claim 6 , wherein the component is at least one of a window of the vehicle, a window shade of the vehicle, a heating, ventilation, and air conditioning (HVAC) controller of the vehicle, a stereo of the vehicle, or a ride setting of the vehicle.

10 . The method of claim 6 , further comprising presenting, on a third portion of the display, a status interface associated with providing at least one of a speed of the vehicle, an intended trajectory of the vehicle, or a traffic rule associated with a route the vehicle is traversing.

11 . The method of claim 6 , further comprising receiving, from the vehicle, sensor data associated with the component, and wherein updating the representation of the portion of the vehicle to indicate that the component performed or is performing the action is based at least in part on the sensor data.

12 . The method of claim 6 , wherein the representation of the environment includes an object that is disposed in the environment, the object comprising at least one of another vehicle, a pedestrian, or a traffic control annotation.

13 . The method of claim 6 , wherein the input element is a first input element, the method further comprising:

receiving, via a second input element of the control interface, an input to remotely control operation of the component; and

at least partially responsive to the input, causing presentation, on the display, of the first input element, the first input element suppressed from presentation prior to receiving the input.

14 . One or more non-transitory computer-readable media storing instructions that, when executed, cause one or more processors to perform operations comprising:

continuously presenting, on a first portion of a display, a representation of an environment and at least a portion of a vehicle traversing the environment;

continuously presenting, on a second portion of the display, a control interface associated with providing remote control over a component of the vehicle other than a powertrain component of the vehicle;

receiving, from the vehicle, a request to alter a control of the component;

receiving, via an input element of the control interface, first data indicating the component that is to be controlled, and an indication of an action to be performed by the component;

based at least in part on the indication, causing the component of the vehicle to perform the action; and

updating the representation of the portion of the vehicle to indicate that the component performed or is performing the action.

15 . The one or more non-transitory computer-readable media of claim 14 , wherein the component is a door of the vehicle and the action comprises at least one of opening the door, closing the door, locking the door, or unlocking the door.

16 . The one or more non-transitory computer-readable media of claim 14 , wherein the component is a light of the vehicle and the action comprises at least one of powering the light on, powering the light off, or changing an intensity of the light.

17 . The one or more non-transitory computer-readable media of claim 14 , wherein the component is at least one of a window of the vehicle, a window shade of the vehicle, a heating, ventilation, and air conditioning (HVAC) controller of the vehicle, a stereo of the vehicle, or a ride setting of the vehicle.

18 . The one or more non-transitory computer-readable media of claim 14 , the operations further comprising presenting, on a third portion of the display, a communication interface associated with providing remote communication with an occupant of the vehicle.

19 . The one or more non-transitory computer-readable media of claim 14 , the operations further comprising presenting, on a third portion of the display, at least one of a speed of the vehicle, an intended trajectory of the vehicle, or a traffic rule associated with a route the vehicle is traversing.

20 . The one or more non-transitory computer-readable media of claim 14 , the operations further comprising receiving, from the vehicle, sensor data associated with the component, and wherein updating the representation of the portion of the vehicle to indicate that the component performed or is performing the action is based at least in part on the sensor data.

Assignments (1)

Continuity (2)

References Cited (63)