IP Library Granted Patent US 9,956,876
Granted Patent B2
US 9,956,876 · App. 15/164,838 · Granted May 1, 2018

System and method for providing content in autonomous vehicles based on real-time traffic information

Inventors: Shuang Wu (Fremont, CA); Liyun Li (San Jose, CA); Shaoshan Liu (Fremont, CA); James Peng (Fremont, CA)
Assignee: BAIDU USA LLC
B60K35/00B60W50/00G01C21/3697G06K9/00791G06K9/46G06K9/6267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,956,876
App. No.
15/164,838
Granted
May 1, 2018
Kind
B2
Abstract

In one embodiment, location and route information of a route associated with the autonomous vehicle is obtained, where the route includes a starting location and a destination. Real-time traffic information of the route is obtained based on the location and route information. A driving mode of the autonomous vehicle is determined based on the location and route information and the real-time traffic information. A content item is selected from a list of content items obtained from a content database based on the determined driving mode. The selected content item is displayed in a display device within the autonomous vehicle.

Claims (58)

1. A computer-implemented method for content delivery in an autonomous vehicle, the method comprising:

obtaining location and route information of a route associated with the autonomous vehicle;

obtaining real-time traffic information of the route based on the location and route information;

obtaining first point of interest (POI) information of the route based on the location and route information;

determining a driving mode of the autonomous vehicle based on the location and route information and the real-time traffic information;

selecting a content item from a list of content items obtained from a content database based on the determined driving mode and the first POI information, including extracting a first set of features from the location and route information,

extracting a second set of features from the real-time traffic information,

extracting a third set of features from the first POI information, and

applying a content selection model to the first set, the second set, and the third set of features, generating an output for content selection; and

displaying the selected content item on a display device within the autonomous vehicle.

2. The method of claim 1 , wherein the driving mode includes one of a fast driving mode, a slow driving mode, and a stop mode.

3. The method of claim 2 , wherein the selected content item is a media content that can be played by a media player with a playing time configured for the driving mode at a point in time.

4. The method of claim 2 , wherein the content item is selected and displayed in response to determining that the driving mode is either a slow driving mode or a stop mode.

5. The method of claim 1 , wherein the list of content items are obtained from the content database based on a user profile of a user as a passenger of the autonomous vehicle.

6. The method of claim 1 , further comprising:

capturing an image of an object external to the autonomous vehicle using a camera attached to the autonomous vehicle, while the autonomous vehicle is traveling along the route; and

performing an image recognition of the image to recognize the object and derive second POI information describing a POI associated with the object, wherein the list of content items are obtained from the content database further based on the second POI information.

7. The method of claim 1 , wherein the list of content items are obtained from content database based on the output of the content selection model.

8. The method of claim 1 , further comprising ranking the list of content items based on the output of the content selection model, wherein the selected content item is selected based on the rankings of the list.

9. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of providing content in an autonomous vehicle, the operations comprising:

obtaining location and route information of a route associated with the autonomous vehicle;

obtaining real-time traffic information of the route based on the location and route information;

obtaining first point of interest (POI) information of the route based on the location and route information;

determining a driving mode of the autonomous vehicle based on the location and route information and the real-time traffic information;

selecting a content item from a list of content items obtained from a content database based on the determined driving mode and the first POI information, including extracting a first set of features from the location and route information, extracting a second set of features from the real-time traffic information, extracting a third set of features from the first POI information, and

applying a content selection model to the first set, the second set, and the third set of features, generating an output for content selection; and

displaying the selected content item on a display device within the autonomous vehicle.

10. The non-transitory machine-readable medium of claim 9 , wherein the driving mode includes one of a fast driving mode, a slow driving mode, and a stop mode.

11. The non-transitory machine-readable medium of claim 10 , wherein the selected content item is a media content that can be played by a media player with a playing time configured for the driving mode at a point in time.

12. The non-transitory machine-readable medium of claim 10 , wherein the content item is selected and displayed in response to determining that the driving mode is either a slow driving mode or a stop mode.

13. The non-transitory machine-readable medium of claim 9 , wherein the list of content items are obtained from the content database based on a user profile of a user as a passenger of the autonomous vehicle.

14. The non-transitory machine-readable medium of claim 9 , wherein the operations further comprise:

capturing an image of an object external to the autonomous vehicle using a camera attached to the autonomous vehicle, while the autonomous vehicle is traveling along the route; and

performing an image recognition of the image to recognize the object and derive second POI information describing a POI associated with the object, wherein the list of content items are obtained from the content database further based on the second POI information.

15. The non-transitory machine-readable medium of claim 9 , wherein the list of content items are obtained from content database based on the output of the content selection model.

16. The non-transitory machine-readable medium of claim 9 , wherein the operations further comprise ranking the list of content items based on the output of the content selection model, wherein the selected content item is selected based on the rankings of the list.

17. A data processing system, comprising:

a processor; and

a memory coupled to the processor for storing instructions, which when executed by the processor, cause the processor to perform operations of providing content in an autonomous vehicle, the operations including

obtaining location and route information of a route associated with the autonomous vehicle,

obtaining real-time traffic information of the route based on the location and route information,

obtaining first point of interest (POI) information of the route based on the location and route information,

determining a driving mode of the autonomous vehicle based on the location and route information and the real-time traffic information,

selecting a content item from a list of content items obtained from a content database based on the determined driving mode and the first POI information, including

extracting a first set of features from the location and route information,

extracting a second set of features from the real-time traffic information,

extracting a third set of features from the first POI information, and

applying a content selection model to the first set, the second set, and the third set of features, generating an output for content selection, and

displaying the selected content item on a display device within the autonomous vehicle.

18. The system of claim 17 , wherein the driving mode includes one of a fast driving mode, a slow driving mode, and a stop mode.

19. The system of claim 18 , wherein the selected content item is a media content that can be played by a media player with a playing time configured for the driving mode at a point in time.

20. The system of claim 18 , wherein the content item is selected and displayed in response to determining that the driving mode is either a slow driving mode or a stop mode.

21. The system of claim 17 , wherein the list of content items are obtained from the content database based on a user profile of a user as a passenger of the autonomous vehicle.

22. The system of claim 17 , wherein the operations further comprise:

capturing an image of an object external to the autonomous vehicle using a camera attached to the autonomous vehicle, while the autonomous vehicle is traveling along the route; and

performing an image recognition of the image to recognize the object and derive second POI information describing a POI associated with the object, wherein the list of content items are obtained from the content database further based on the second POI information.

23. The system of claim 17 , wherein the list of content items are obtained from content database based on the output of the content selection model.

24. The system of claim 17 , wherein the operations further comprise ranking the list of content items based on the output of the content selection model, wherein the selected content item is selected based on the rankings of the list.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2016
From: WU, SHUANG; LI, LIYUN; LIU, SHAOSHAN; PENG, JAMES
To: BAIDU USA LLC
Reel/Frame 038721/0719 →
Continuity (1)
Related Publication 20170341513A1 · Nov 30, 2017