IP Library Granted Patent US 11,284,051
Granted Patent B2
US 11,284,051 · App. 16/523,931 · Granted Mar 22, 2022

Systems and methods for autonomous vehicle interactive content presentation

Inventor: Hao Song (Sunnyvale, CA)
Assignee: Pony AI Inc.
H04N9/3179B60W10/04B60W10/18B60W10/20B60W50/0097G05D1/0088H04N9/3185B60R11/0229B60W2710/18B60W2710/20B60W2720/106G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,051
App. No.
16/523,931
Filed
Jul 26, 2019
Granted
Mar 22, 2022
Kind
B2
Art Unit
3661
USPC
701/23
Abstract

A method comprises obtaining autonomous vehicle sensor data of an autonomous vehicle. One or more autonomous vehicle actions of the autonomous vehicle are predicted based on the autonomous vehicle sensor data. Interactive content is identified from a library of interactive content. The interactive content is adjusted based on the predicted one or more autonomous vehicle actions, and the adjusted interactive content is presented within the autonomous vehicle.

Claims (39)

1. A system comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the system to perform:

obtaining sensor data from a first sensor and from a second sensor of a vehicle, the second sensor being associated with a seat of the vehicle;

predicting one or more actions of the vehicle based on the sensor data from the first sensor;

estimating a behavior of a passenger or a driver within the vehicle based on the sensor data from the second sensor;

receiving an initial identification of interactive content from a library of interactive content based on an input from the passenger or the driver;

adjusting the initially identified interactive content based on the predicted one or more actions and based on the estimated behavior; and

presenting the adjusted initially identified interactive content within the vehicle.

2. The system of claim 1 , wherein the one or more actions include any of steering, accelerating, and braking.

3. The system of claim 1 , wherein the adjusting the initially identified interactive content comprises adjusting a playback speed of the initially identified interactive content.

4. The system of claim 1 , wherein the adjusting the initially identified interactive content comprises rotating at least a portion of the initially identified interactive content.

5. The system of claim 1 , wherein the presenting the adjusted initially identified interactive content within the vehicle comprises projecting the adjusted initially identified interactive content on an interior surface of the vehicle.

6. The system of claim 5 , wherein the surface comprises a curved interior surface.

7. The system of claim 6 , wherein the curved interior surface comprises a window of the vehicle.

8. The system of claim 5 , wherein the adjusted initially identified interactive content is projected from a projector mounted within the vehicle.

9. The system of claim 1 , wherein the presenting of the adjusted initially identified interactive content is further based on conditions exterior to the vehicle.

10. A method being implemented by a computing system including one or more physical processors and storage media storing machine-readable instructions, the method comprising:

obtaining sensor data from a first sensor and from a second sensor of a vehicle, the second sensor being associated with a seat of the vehicle;

predicting one or more actions of the vehicle based on the sensor data from the first sensor;

estimating a behavior of a passenger or a driver within the vehicle based on the sensor data from the second sensor;

receiving an initial identification of interactive content from a library of interactive content based on an input from the passenger or the driver;

adjusting the initially identified interactive content based on the predicted one or more actions and based on the estimated behavior; and

presenting the adjusted initially identified interactive content within the vehicle.

11. The method of claim 10 , wherein the one or more actions include any of steering, accelerating, and braking.

12. The method of claim 10 , wherein the adjusting the initially identified interactive content comprises adjusting a playback speed of the initially identified interactive content.

13. The method of claim 10 , wherein the adjusting the initially identified interactive content comprises rotating at least a portion of the interactive content.

14. The method of claim 10 , wherein the presenting the adjusted initially identified interactive content within the vehicle comprises projecting the adjusted initially identified interactive content on an interior surface of the vehicle.

15. The method of claim 14 , wherein the surface comprises a curved interior surface.

16. The method of claim 15 , wherein the curved interior surface comprises a window of the vehicle.

17. The method of claim 14 , wherein the adjusted initially identified interactive content is projected from a projector mounted within the vehicle.

18. A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:

obtaining sensor data from a first sensor and from a second sensor of a vehicle, the second sensor being associated with a seat of the vehicle;

predicting one or more actions of the vehicle based on the sensor data from the first sensor;

estimating a behavior of a passenger or a driver within the vehicle based on the sensor data from the second sensor;

receiving an initial identification of interactive content from a library of interactive content based on an input from the passenger or the driver;

adjusting the initially identified interactive content based on the predicted one or more actions and based on the estimated behavior; and

presenting the adjusted initially identified interactive content within the vehicle.

19. The non-transitory computer readable medium of claim 18 , wherein the adjusting the initially identified interactive content comprises rotating at least a portion of the initially identified interactive content.

Continuity (2)
Provisional Application 62712049 · Jul 30, 2018
Related Publication 20200036948A1 · Jan 30, 2020