IP Library Granted Patent US 11,650,069
Granted Patent B2
US 11,650,069 · App. 15/946,767 · Granted May 16, 2023

Content visualizing method and device

Inventors: HeeSae Lee (Yongin-si, KR); KeeChang Lee (Seongnam-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G01C21/365B60K35/00G02B27/0179G06F3/013B60K2370/1529B60K2370/166B60K2370/31B60K2370/347G02B2027/0181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,650,069
App. No.
15/946,767
Granted
May 16, 2023
Kind
B2
Abstract

Provided are a content visualizing device and method that changes positions and shapes of route guidance content and driving related content based on a distance to an adjacent object, a current driving state, and an occurrence of a driving related event.

Claims (70)

1. A content visualizing method, comprising:

generating route guidance content based on position information of a vehicle and road information;

displaying, through a projection plane of a head-up display (HUD), the generated route guidance content between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle; and

deforming the displaced route guidance content along a road alignment in response to the first distance being less than or equal to a threshold, the indication start point being a point at which the displayed route guidance content indicates the vehicle is to begin to perform an action:

determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;

determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and

displaying the deformed route guidance content to the depth in the projection plane;

further adjusting the depth and the adjusting comprises:

detecting an event based on driving related information from a plurality of events;

selecting a first driving related content from among the driving related information based on the detected event;

moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and

moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated.

2. The content visualizing method of claim 1 , wherein the deforming of the route guidance content comprises bending the route guidance content along the road alignment and a proceeding direction of the vehicle from a position of the vehicle to an indication end point, in response to the vehicle passing the indication start point and approaching the indication end point.

3. The content visualizing method of claim 1 , wherein the displaying comprises disposing the route guidance content on a ground surface between the indication start point and an indication end point.

4. The content visualizing method of claim 1 , wherein the deforming comprises increasing a height of the route guidance content from the ground surface, in response to the distance from the vehicle to the indication start point being less than or equal to a threshold.

5. The content visualizing method of claim 1 , wherein the deforming comprises:

deforming the route guidance content, in response to error information calculated from a position of the vehicle and route guidance information being less than or equal to a threshold error; and

terminating deformation of the route guidance content and generating new route guidance content, in response to the error information exceeding the threshold error.

6. The content visualizing method of claim 1 , wherein the deforming comprises

setting the indication start point to be a point a first distance from the vehicle, and setting an indication end point to be a point a second distance from the vehicle, in response to the route guidance content indicating a straight advance from a position of the vehicle, wherein the second distance is greater than the first distance.

7. The content visualizing method of claim 1 , wherein the deforming comprises determining the indication start point and an indication end point along a center of a lane region to which the vehicle is to proceed based on the route guidance content.

8. The content visualizing method of claim 1 , further comprising:

displaying driving direction content together with the route guidance content, in response to the vehicle departing from a route corresponding to the route guidance content.

9. The content visualizing method of claim 1 , wherein the deforming of the route guidance content comprises displaying summary content corresponding to the route guidance content at a depth less than a distance to a preceding object, in response to the route guidance content being occluded by the preceding object.

10. The content visualizing method of claim 1 , wherein the generating of the route guidance content comprises generating the route guidance content, in response to acquisition of route guidance information.

11. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to implement a method comprising:

generating route guidance content based on position information of a vehicle and road information;

displaying, through a projection plane of a head-up display (HUD), the generated route guidance content between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle; and

deforming the displaced route guidance content along a road alignment in response to the first distance being less than or equal to a threshold, the indication start point being a point at which the displayed route guidance content indicates the vehicle is to begin to perform an action:

determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;

determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and

displaying the deformed route guidance content to the depth in the projection plane;

further adjusting the depth and the adjusting comprises:

detecting an event based on driving related information from a plurality of events;

selecting a first driving related content from among the driving related information based on the detected event;

moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and

moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated.

12. A content visualizing method, comprising:

collecting driving related information from a vehicle;

displaying, through a projection plane of a head-up display (HUD), driving related contents based on the driving related information in front of the vehicle between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle;

adjusting a depth of a first driving related content of the displayed driving related contents in response to an event being detected based on the driving related information,

wherein the adjusting comprises:

detecting the event based on the driving related information from a plurality of events;

selecting the first driving related content from among the driving related contents based on the detected event;

moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and

moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated;

determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;

determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and

displaying a second driving related content, of the displayed driving related contents, to the depth in the projection plane.

13. The content visualizing method of claim 12 , wherein the displaying of the driving related contents comprises:

displaying at least a portion of the driving related contents to the first depth; and

displaying a remaining portion of the driving related contents to the second depth.

14. The content visualizing method of claim 12 , wherein the displaying of the driving related contents comprises displaying at least a portion of the driving related contents to a depth corresponding to a focus of a user of the vehicle.

15. The content visualizing method of claim 12 , wherein the adjusting comprises moving the driving related content the depth corresponding to the focus of a user of the vehicle.

16. The content visualizing method of claim 12 , wherein the detecting of the event comprises:

detecting the event based on the driving related information comprising any one or any combination of a speed, an acceleration, a position, fuel, and a maintenance of the vehicle.

17. The content visualizing method of claim 12 , wherein the displaying of the driving related contents comprises providing a left image to a left eye of a user of the vehicle and a right image to a right eye of the user of the vehicle through the projection plane formed by the HUD.

18. A content visualizing apparatus, comprising:

a processors configured to:

generate route guidance content based on position information of a vehicle and road information;

display, through a projection plane of a head-up display (HUD), the generated route guidance content between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle;

deform the displaced route guidance content along a road alignment in response to the first distance being less than or equal to a threshold, the indication start point being a point at which the displayed route guidance content indicates the vehicle is to begin to perform an action:

determine a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;

determine the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and

display the deformed route guidance content to the depth in the projection plane;

further adjusting the depth and the adjusting comprises:

detect an event based on driving related information from a plurality of events;

select a first driving related content from among the driving related information based on the detected event;

move the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and

move the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2018
From: LEE, HEESAE; LEE, KEECHANG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 045457/0907 →
Priority Claims (1)
KR 10-2017-0171411 · Dec 13, 2017 · national
Continuity (1)
Related Publication 20190178669A1 · Jun 13, 2019
Cited By (3)
US 12,399,027 US 12,523,487 US 12,600,234