IP Library Granted Patent US 9,905,128
Granted Patent B2
US 9,905,128 · App. 15/685,875 · Granted Feb 27, 2018

System and method for providing augmented reality notification

Inventors: Min Ji Yoon (Seongnam-si, KR); Ye Seul Jeong (Seongnam-si, KR); Youn Joo Shin (Seongnam-si, KR); Won Jun Heo (Seongnam-si, KR)
Assignee: Thinkware Corporation
G08G1/0962
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,905,128
App. No.
15/685,875
Granted
Feb 27, 2018
Kind
B2
Abstract

A system and a method for providing augmented reality (AR) notification are provided. The system includes a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image and a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element.

Claims (38)

1. A system for providing a notification on an image for driving guidance, the system comprising:

a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on the image; and

a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element,

wherein the recognizing unit recognizes a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and

wherein the controller adjusts at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

2. The system of claim 1 , wherein the recognizing unit detects the horizon from the image and recognizes the ground region relative to the horizon.

3. The system of claim 1 , wherein the recognizing unit detects a line from the image and recognizes the ground region relative to a vanishing point of the line.

4. The system of claim 1 , wherein the recognizing unit identifies a caution section of the road and/or a global positioning system (GPS) shadow section of the road based on the recognized attribute, and

wherein the caution section includes at least one of a school zone and a senior zone, and the GPS shadow section includes at least one of an underground section and a tunnel section.

5. The system of claim 1 , wherein the recognizing unit recognizes the driving state as the speeding driving state when the current driving speed of the vehicle exceeds a speed limit of the road.

6. The system of claim 5 , wherein the controller changes the color of the ground region to red when the speeding driving state is recognized.

7. The system of claim 1 , wherein the recognizing unit identifies that the vehicle is in a caution section of the road based on the recognized attribute.

8. The system of claim 7 , wherein the controller changes the color of the ground region to yellow when the recognizing unit identifies that the vehicle is in the caution section.

9. The system of claim 1 , wherein the recognizing unit identifies that the vehicle is in a global positioning system (GPS) shadow section of the road based on the recognized attribute.

10. The system of claim 9 , wherein the controller applies a gray horizontal stripe pattern to the ground region when the recognizing unit identifies that the vehicle is in the GPS shadow section, the gray horizontal stripe pattern being not moved.

11. The system of claim 1 , wherein the controller adjusts the at least one of the color and the pattern differently in accordance with the recognized driving state and/or attribute.

12. The system of claim 1 , wherein the controller adjusts the pattern which is applied to the ground region based on the driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the driving speed.

13. The system of claim 12 , wherein the controller adjusts the pattern which is moving in accordance with the driving speed to stop when the vehicle is driven in a GPS shadow section where the vehicle GPS functionality is unstable.

14. The system of claim 1 , further comprising:

a sensing unit configured to sense a turn point which is located in a certain distance ahead,

wherein the controller exposes destination information on a position of the turn point on the image.

15. The system of claim 14 , wherein the controller expresses a rotation direction at the turn point and a remaining distance to the turn point on the position of the turn point.

16. The system of claim 14 , wherein the controller expresses an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when the vehicle passes through the turn point.

17. A method for providing a notification on an image for driving guidance, implemented with a computer, the method comprising:

recognizing a ground region, which is a region corresponding to the ground, on the image; and

adding a display element to the ground region and expressing notification associated with driving through the display element,

wherein the recognizing comprises recognizing a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and

wherein the adjusting comprises adjusting at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

18. The method of claim 17 , wherein the recognizing of the ground region comprises:

detecting the horizon from the image; and

recognizing the ground region relative to the horizon.

19. The method of claim 17 , wherein the recognizing comprises identifying a caution section of the road and/or a global positioning system (GPS) shadow section of the road based on the recognized attribute, and

wherein the caution section includes at least one of a school zone and a senior zone, and the GPS shadow section includes at least one of an underground section and a tunnel section.

20. A non-transitory computer-readable medium to control a computer system, storing an instruction for controlling provision of a notification on an image for driving guidance, comprising:

recognizing a ground region, which is a region corresponding to the ground, on the image; and

adding a display element to the ground region and expressing notification associated with driving through the display element,

wherein the recognizing comprises recognizing a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and

wherein the adjusting comprises adjusting at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: THINKWARE CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 057102/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2017
From: YOON, MIN JI; JEONG, YE SEUL; SHIN, YOUN JOO; HEO, WON JUN
To: THINKWARE CORPORATION
Reel/Frame 043392/0494 →
Priority Claims (1)
KR 10-2014-0090288 · Jul 17, 2014 · national
Continuity (2)
Continuation 14799237 · Jul 14, 2015
Related Publication 20170372606A1 · Dec 28, 2017