IP Library Granted Patent US 11,148,671
Granted Patent B2
US 11,148,671 · App. 17/014,486 · Granted Oct 19, 2021

Autonomous systems human controller simulation

Inventors: Gregory Welch (Orlando, FL); Gerd Bruder (Orlando, FL)
Assignee: University of Central Florida Research Foundation, Inc.
B60W40/08B60K35/00B60W50/0098G02B27/0172G06F3/011G06F3/017G06T13/40B60K2370/1529B60K2370/165B60K2370/175B60K2370/785
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,148,671
App. No.
17/014,486
Granted
Oct 19, 2021
Kind
B2
Abstract

Dynamic online and real-time virtual humans exhibit behaviors associated with inputs and outputs of an autonomous control system. To foster the awareness and trust, the virtual humans exhibit situational awareness via apparent (e.g., rendered) behaviors based on inputs such as direct system measures, functions of the measures, estimates of state based on measures, and estimates of state based on a priori constraints. The virtual humans also exhibit situational control via apparent behaviors associated with outputs such as direct control of devices, functions of control, actions based on high-level goals, and the optional use of virtual versions of conventional physical controls. A dynamic virtual human who continually exhibits awareness of the system state and relevant contextual circumstances, along with the ability to directly control the system, is used to reduce negative feelings associated with the system such as uncertainty, concern, stress, or anxiety on the part of real humans.

Claims (13)

1. A computer-implemented method of conveying to a vehicle non-occupant their spatial detection by a trust-sensitive autonomous vehicle control system operating the vehicle, a computer processor generating attentive gesture images through a vehicle-mounted display device viewable by the non-occupant, the method comprising the steps of: providing a computer comprising the computer processor accessing non-transitory computer-readable memory, the memory storing computer-readable instructions that, when executed by the processor, cause the processor to evaluate input data and logically modify the output of the display device in response; receiving, by one or more sensors communicatively coupled to the processor, relative location data of the non-occupant used by the trust-sensitive autonomous control system to make real-world automation decisions; and generating a plurality of attentive gesture images through the display device viewable to the non-occupant wherein the attentive gesture images change in response to the location of the non-occupant relative to the vehicle wherein the attentive gestures images are selected from the group consisting of head orientation, pupil orientation, limb orientation, and facial expression whereby the attentive gestures track the location of the non-occupant relative to the vehicle.

2. The method of claim 1 , wherein the attentive gesture images include turning a head of a virtual human driver in the spatial direction of the non-occupant.

3. The method of claim 1 , wherein the attentive gesture images include a graphically rendered virtual human driver actions include graphically rendered rotation of vehicle steering wheel.

4. The method of claim 1 , wherein the attentive gesture images include a graphically rendered virtual human driver actions include graphically rendered vehicle pedal engagement.

5. The method of claim 1 , wherein the attentive gesture images include a virtual human driver positionally rendered over the controls of the existent vehicle.

6. The method of claim 1 , wherein the display is a two-dimensional, flat panel display integral to the vehicle.

7. The method of claim 1 , wherein the display is a heads-up, projected display integral to the vehicle.

8. The method of claim 1 , wherein the display is a transparent, organic light-emitting diode display integral to the vehicle.

9. The method of claim 1 , wherein the attentive gesture images are displayed through an embedded organic light emitting diode screen within a window of the vehicle.

10. The method of claim 1 , wherein the attentive gesture images are displayed through a heads-up display projected onto a window of the vehicle.

11. A computer-implemented method of conveying to a vehicle non-occupant their spatial detection by a trust-sensitive autonomous vehicle control system operating the vehicle, a computer processor generating attentive gesture images through an augmented reality display device worn by the non-occupant, the method comprising the steps of: providing a computer comprising the computer processor accessing non-transitory computer-readable memory, the memory storing computer-readable instructions that, when executed by the processor, cause the processor to evaluate input data and logically modify the output of the display device in response; receiving, by one or more sensors communicatively coupled to the processor, relative location data of the non-occupant used by the trust-sensitive autonomous control system to make real-world automation decisions; and generating a plurality of attentive gesture images and transmitting the images to the augmented reality headset wherein the attentive gesture images change in response to the location of the non-occupant relative to the vehicle and the attentive gestures track the location of the non-occupant relative to the vehicle.

12. The method of claim 11 , wherein the attentive gesture images of the non-occupant's spatial location detected by the vehicle are presented through the non-occupant's augmented reality headset as an object external to the current spatial location of the vehicle.

13. The method of claim 12 , wherein the object is an anthropomorphic form.

Assignments (3)
CONFIRMATORY LICENSE Recorded May 21, 2024
From: UNIVERSITY OF CENTRAL FLORIDA
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 067472/0439 →
CONFIRMATORY LICENSE Recorded Jan 23, 2024
From: UNIVERSITY OF CENTRAL FLORIDA
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 066205/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: WELCH, GREGORY; BRUDER, GERD
To: UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION, INC.
Reel/Frame 054141/0667 →
Continuity (2)
Provisional Application 62896875 · Sep 6, 2019
Related Publication 20210070307A1 · Mar 11, 2021