IP Library Granted Patent US 10,976,178
Granted Patent B2
US 10,976,178 · App. 15/762,347 · Granted Apr 13, 2021

Systems and methods for generating an interactive user interface

Inventors: Patrick S. Piemonte (San Francisco, CA); Jason D. Gosnell (San Jose, CA); Kjell F. Bronder (San Francisco, CA); Daniel De Rocha Rosario (San Francisco, CA); Shaun D. Budhram (San Jose, CA); Scott Herz (San Jose, CA)
G01C21/3697G01C21/367G01C21/3664G01C21/3667G05D1/0088G05D1/0212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,976,178
App. No.
15/762,347
Granted
Apr 13, 2021
Kind
B2
Abstract

Implementations described and claimed herein provide systems and methods for interaction between a user and a machine. In one implementation, machine status information for the machine is received at a dedicated machine component. The machine status information is published onto a distributed node system network of the machine. The machine status information is ingested at a primary interface controller, and an interactive user interface is generated using the primary interface controller. The interactive user interface is generated based on the machine status information. In some implementations, input is received from the user at the primary interface controller through the interactive user interface, and a corresponding action is delegated to one or more subsystems of the machine using the distributed node system network.

Claims (45)

1. A method for interaction with an autonomous vehicle, the method comprising:

obtaining an origination point of the autonomous vehicle at a primary interface controller;

receiving a destination point for the autonomous vehicle at the primary interface controller, the destination point captured with at least one input device of an interactive interface of the autonomous vehicle;

determining a travel path for the autonomous vehicle from the origination point to the destination point using the primary interface controller, the travel path being determined using machine status information ingested at the primary interface controller, the machine status information received over a distributed node system network having one or more machine components, the machine status information being captured and published to distributed node system network;

generating a timeline using the primary interface controller, the timeline including an interactive representation of a schedule of events including a duration of time of the travel path; and

outputting the timeline for interactive presentation using the interactive interface of the autonomous vehicle.

2. The method of claim 1 , wherein the interactive representation of the schedule of events includes the origination point depicted as a first graphical icon and the destination point depicted as a second graphical icon, the duration of time of the travel path depicted as a line connecting the first graphical icon to the second graphical icon, a current progress of time elapsed within the duration of time depicted as a third graphical icon moving along the line towards the second graphical icon.

3. The method of claim 2 , wherein each of the first, second, and third graphical icons have a bubble shape.

4. The method of claim 1 , wherein the interactive representation of the duration of time of the travel path identifies a time period within the duration of time corresponding to a portion of the travel path that will be driven autonomously by the autonomous vehicle.

5. The method of claim 1 , wherein the schedule of events includes at least one of: one or more upcoming movements by the autonomous vehicle; one or more autonomous decisions made by the autonomous vehicle; one or more upcoming obstacles along the travel path; one or more events; one or more reminders; or user activity.

6. The method of claim 1 , wherein the schedule of events includes one or more actions of the autonomous vehicle scheduled to occur during the duration of time of the travel path.

7. The method of claim 1 , wherein the travel path is determined based on a selection of the travel path from a set of travel path options presented using the interactive interface of the autonomous vehicle.

8. The method of claim 1 , wherein the interactive representation of the duration of time of the travel path identifies a time period within the duration of time corresponding to a portion of the travel path that will experience a delay.

9. The method of claim 1 , wherein the timeline further includes a map displaying a route of the travel path.

10. The method of claim 1 , further comprising:

receiving a request for a second destination at the primary interface controller, the request captured with the at least one input device of the interactive interface of the autonomous vehicle;

generating a set of options for the second destination using the primary interface controller, the set of options presented using the interactive interface of the autonomous vehicle;

receiving a destination selection of one of the set of options at the primary interface controller, the destination selection captured with the at least one input device of the interactive interface of the autonomous vehicle;

generating an updated timeline using the primary interface controller based on the destination selection; and

generating one or more commands for modifying an operation of the autonomous vehicle based on the updated timeline using the primary interface controller.

11. The method of claim 1 , wherein at least one of the one or more machine components is a dedicated machine component having a primary function for the autonomous vehicle.

12. The method of claim 1 , further comprising:

receiving a modification to the timeline captured with the at least one input device of the interactive interface of the autonomous vehicle;

communicating the modification to the primary interface controller; and

delegating an action corresponding to the modification to one or more subsystems of the machine using the distributed node system network.

13. The method of claim 1 , wherein at least one operation of the autonomous vehicle is controlled using the interactive interface.

14. The method of claim 1 , wherein the timeline includes the duration of time of the travel path represented as a line between an origination point and an estimated time of arrival at a destination point, the linear timeline including a current location representing a current progress of time elapsed within the duration of time towards the estimated time of arrival at the destination point, the linear timeline automatically adjusting a visual scale of the travel path with past destinations being stacked.

15. A system for interaction with an autonomous vehicle, the system comprising:

at least one input device of an interactive interface of the autonomous vehicle, the at least one input device capturing a destination point for the autonomous vehicle;

a distributed node system network of the autonomous vehicle, machine status information being captured and published to the distributed node system network, a travel path for the autonomous vehicle from an origination point to a destination point being determined based on the machine status information being received over the distributed node system network;

a primary interface controller generating a timeline including an interactive representation of a schedule of events including a duration of time of the travel path; and

at least one output device of the interactive interface of the autonomous vehicle in communication with the primary interface controller, the at least one output device presenting the timeline as an interactive presentation.

16. The system of claim 15 , wherein the at least one machine component associated with the distributed node system network includes a dedicated machine component having a primary function for the autonomous vehicle.

17. The system of claim 15 , further comprising:

one or more subsystems of the autonomous vehicle, the primary interface controller delegating an action to the one or more subsystems of the autonomous vehicle using the distributed node network.

18. The system of claim 15 , wherein an operation of the autonomous vehicle along the travel path is controlled using the interactive interface.

19. The system of claim 15 , wherein the interactive representation of the schedule of events includes the origination point depicted as a first graphical icon and the destination point depicted as a second graphical icon, the duration of time of the travel path depicted as a line connecting the first graphical icon to the second graphical icon, a current progress of time elapsed within the duration of time depicted as a third graphical icon moving along the line towards the second graphical icon.

20. The system of claim 15 , wherein the schedule of events includes at least one of: one or more upcoming movements by the autonomous vehicle; one or more autonomous decisions made by the autonomous vehicle; one or more upcoming obstacles along the travel path; one or more events; one or more reminders; or user activity.

21. One or more non-transitory computer-readable data storage media comprising instructions that, when executed by at least one computing unit of a computing system, cause the computing system to perform operations comprising:

obtaining a travel path for an autonomous vehicle from an origination point to a destination point, the destination point captured with at least one input device of an interactive interface of the autonomous vehicle, the travel path being determined using machine status information received over a distributed node system network having one or more machine components, the machine status information being captured and published to distributed node system network;

generating a timeline, the timeline including an interactive representation of a schedule of events including a duration of time of the travel path; and

outputting the timeline for interactive presentation using the interactive interface of the autonomous vehicle.

22. The one or more non-transitory computer-readable data storage media of claim 21 , further comprising:

generating an updated timeline based on a request for a second destination captured with the at least one input device.

23. The one or more non-transitory computer-readable data storage media of claim 21 , wherein the schedule of events includes at least one of: one or more upcoming movements by the autonomous vehicle; one or more autonomous decisions made by the autonomous vehicle; one or more upcoming obstacles along the travel path; one or more events; one or more reminders; or user activity.

Continuity (2)
Provisional Application 62232322 · Sep 24, 2015
Related Publication 20180283896A1 · Oct 4, 2018
Cited By (2)
US 12,252,154 US 12,578,203