IP Library › Granted Patent US 10,532,697
Granted Patent B2
US 10,532,697 · App. 16/008,574 · Granted Jan 14, 2020

Augmented reality-based roadside content viewing within primary field of view

Inventors: Sarbajit K. Rakshit (Kolkata, IN); Martin G. Keen (Cary, NC); James E. Bostick (Cedar Park, TX); John M. Ganci, Jr. (Cary, NC)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
B60R1/001B60R11/04B60W30/095G02B27/01G06K9/00671G06K9/00791G06T19/006B60R2300/205B60R2300/308B60R2300/8026B60R2300/8093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,532,697
App. No.
16/008,574
Granted
Jan 14, 2020
Kind
B2
Abstract

A display of roadside objects on a vehicle windshield within a primary field of view of a driver, with an indication of a level of importance of the object is provided. A method includes: detecting, by a computer device, a roadside object in a vehicle driver's peripheral view; analyzing, by the computer device, the detected roadside object to assign a level of importance to the object based on predefined levels of importance; and displaying, by the computer device, the roadside object as a semi-transparent object in a display area of a windshield of the vehicle with an indication of the level of importance of the object.

Claims (35)

1. A method comprising:

detecting, by a computer device, a roadside object in a vehicle driver's peripheral view;

analyzing, by the computer device, the roadside object to assign a level of importance to the roadside object based on predefined levels of importance;

displaying, by the computer device, the roadside object as a semi-transparent object in a display area of a windshield of the vehicle with an indication of the level of importance of the roadside object; and

detecting, by the computer device, information regarding distance and time to reach the roadside object using sensors mounted on the vehicle.

2. The method of claim 1 , wherein the roadside object is in at least one of a vehicle driver's mid peripheral view and far peripheral view, which is at least 30° or greater on either side of a centerline of the driver's view looking directly ahead of the vehicle, and the level of importance of the roadside object is provided by color coding of a portion of the displayed semi-transparent object.

3. The method of claim 2 , wherein the display area is on a driver's side of the windshield within a near peripheral area of the driver's view, which is less than 30° on either side of the centerline of the driver's view looking directly ahead of the vehicle.

4. The method of claim 2 , wherein the display area is within a paracentral display area of 4° on either side of a centerline of the driver's view.

5. The method of claim 4 , wherein the display area is in a lower portion of the windshield.

6. The method of claim 4 , wherein the display area is in an upper portion of the windshield.

7. The method of claim 1 , wherein the predefined levels of importance are stored in a database as high severity objects, medium severity objects and low severity objects in accordance with expected amounts of damage and injury if the vehicle strikes the roadside object.

8. The method of claim 7 , wherein the high severity objects are color-coded as a first color, the medium severity objects are color-coded as a second color and the low severity objects are color-coded with a third color.

9. The method of claim 1 , wherein the roadside object is detected by a camera mounted on a side of the vehicle.

10. The method of claim 1 , further comprising displaying, by the computer device, the information regarding distance and time to reach the roadside object in the display area adjacent the displayed semi-transparent object.

11. The method of claim 1 , further comprising displaying, by the computer device, text identifying the roadside object adjacent the displayed semi-transparent object.

12. The method of claim 1 , further comprising disabling, by the computer device, the display of the semi-transparent object in the display area if a high severity object is detected directly ahead of the vehicle which the vehicle will strike if it continues to move in the same direction.

13. A computer-based system for augmenting roadside content viewing in a moving vehicle comprising:

a processor, a computer readable memory, and a computer readable storage medium associated with a computer device;

program instructions to detect, via at least one of front and side cameras on the vehicle, an object of interest in a driver's mid and far peripheral view, which is 30° or greater on either side of a centerline of the driver's view looking directly ahead of the vehicle;

program instructions to analyze the object of interest, using image analytics, to determine a level of importance of the object of interest relative to predefined levels of importance; and

program instructions to, if the analysis determines the object of interest exceeds a predetermined level of importance, color code the object in accordance with the determined level of importance and display the object of interest as a semi-transparent object in a display area of a windshield of the moving vehicle,

wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory, and

wherein the level of importance of the object of interest includes levels of severity regarding possible damage and injury if the moving vehicle strikes the object of interest.

14. The system of claim 13 , wherein the level of importance is based upon a determination a level of interest of the driver based upon at least one of a biometric feedback from the driver and a historical analysis of the driver's interests and preferences.

15. The system of claim 13 , wherein the display area is on a driver's-side of the windshield within a near peripheral area of the driver's view, which is less than 30° on either side of a centerline of the driver's view looking directly ahead of the moving vehicle.

16. The system of claim 15 , wherein the display area is in a lower portion of the windshield.

17. The system of claim 13 , further comprising program instructions to disable the display of the semi-transparent object in the display area if an object is detected directly ahead of the vehicle which the vehicle will strike if it continues to move in the same direction.

18. A computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer device to cause the computer device to:

detect a roadside object in at least one of a vehicle driver's mid and/or far peripheral view, which is 30° or greater on either side of a centerline of the driver's view looking directly ahead of the vehicle;

analyze the roadside object to assign a level of severity to the roadside object based on predefined levels of severity;

display the roadside object as a semi-transparent object in a display area of a windshield of the vehicle with an indication of the level of severity of the roadside object; and

detect information regarding distance and time to reach the roadside object using sensors mounted on the vehicle,

wherein the indication of the level of severity of the roadside object is provided by color coding of a portion of the displayed semi-transparent object.

19. The computer program product of claim 18 , wherein the predefined levels of severity are stored in a database as high severity objects, medium severity objects and low severity objects in accordance with expected amounts of damage and injury if the vehicle strikes the roadside object.

20. The computer program product of claim 19 , wherein the high severity objects are color-coded as a first color, the medium severity objects are color-coded as a second color and the low severity objects are color-coded with a third color.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2018
From: RAKSHIT, SARBAJIT K.; KEEN, MARTIN G.; BOSTICK, JAMES E.; GANCI, JOHN M., JR.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 046090/0514 →
Continuity (1)
Related Publication 20190381937A1 · Dec 19, 2019