IP Library › Granted Patent US 11,869,162
Granted Patent B2
US 11,869,162 · App. 17/140,777 · Granted Jan 9, 2024

Apparatus and method with virtual content adjustment

Inventors: Heesae Lee (Ansan-si, KR); Hyun Sung Chang (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T19/20B60K35/00G02B27/0101G02B27/0172G06F3/013G06T19/006B60K2370/149B60K2370/1529B60K2370/177G02B2027/014G02B2027/0178G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,869,162
App. No.
17/140,777
Filed
Jan 4, 2021
Granted
Jan 9, 2024
Kind
B2
Art Unit
2617
USPC
345/419
Abstract

A processor-implemented method includes: adjusting a virtual content object based on a shape of the virtual content object projected onto a projection plane; and visualizing the adjusted virtual content object on the projection plane.

Claims (72)

1. A processor-implemented method, comprising:

determining an adjustment of a virtual content object, for projection onto a projection plane, based on a shape to be projected of the virtual content object;

generating an adjusted virtual content object by adjusting the virtual content object based on the determined adjustment; and

visualizing the adjusted virtual content object on the projection plane,

wherein the shape to be projected is dependent on a physical depth represented by a reference element in a virtual space used for the adjusting of the virtual content object, and

wherein the adjusting of the virtual content object is performed based on information regarding the reference element, within the virtual space, separated from positions of the adjusted virtual content object as represented in the virtual space.

2. The method of claim 1 , wherein the adjusting of the virtual contact object comprises:

setting one of points in the virtual space corresponding to the virtual content object as a reference point; and

changing the virtual content object based on the set reference point.

3. The method of claim 2 , wherein the changing of the virtual content object includes changing of a current shape of the virtual content object by extending the current shape of the virtual content object along a direction axis oriented from a user toward the reference point.

4. The method of claim 2 , wherein the changing of the virtual content object includes changing a current shape of the virtual content object, comprising:

setting a reference axis, perpendicular to a direction axis oriented from a user toward the reference point, including the reference point; and

rotating the virtual content object based on the reference axis.

5. The method of claim 2 , wherein the setting of the one of the points as the reference point comprises determining one of the points at which a direction axis parallel to a reference plane, in the virtual space, and oriented from a user toward the virtual content object passes through the virtual content object as the reference point.

6. The method of claim 2 , wherein the setting of the one of the points as the reference point comprises selecting the one of the points based on a distance between a viewpoint of a user and physical positions of the points.

7. The method of claim 6 , wherein the selecting of the one of the points comprises determining a point closest to the viewpoint of the user among the points as the reference point.

8. The method of claim 1 , wherein the adjusting of the virtual content object comprises changing a height-to-width (h/w) ratio of the virtual content object based on a height-to-width (h/w) ratio of the shape of the virtual content object projected onto the projection plane.

9. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises disposing a lower end portion of the virtual content object on a reference plane and visualizing the virtual content object with the lower end portion disposed on the reference plane.

10. The method of claim 9 , wherein the reference plane corresponds to a bottom surface of the virtual space in which the virtual content object is visualized.

11. The method of claim 1 , wherein the adjusting of the virtual content object comprises:

setting a first reference point and a first reference axis in a first graphic object corresponding to a left image;

adjusting the first graphic object based on the first reference point and the first reference axis;

setting a second reference point and a second reference axis in a second graphic object corresponding to a right image; and

adjusting the second graphic object based on the second reference point and the second reference axis.

12. The method of claim 11 , wherein the visualizing of the adjusted virtual content object comprises providing the adjusted first reference point to a left eye of a user and providing the adjusted second reference point to a right eye of the user.

13. The method of claim 11 , wherein the visualizing of the adjusted virtual content object comprises differently visualizing the adjusted first graphic object and the adjusted second graphic object on the projection plane based on a binocular disparity.

14. The method of claim 1 , wherein the adjusting of the virtual content object comprises changing the shape of the virtual content object in response to a movement of a viewpoint of a user being detected.

15. The method of claim 1 , wherein the adjusting of the virtual content object comprises:

reducing a length of the virtual content object along a direction axis parallel to a reference plane and oriented from a user toward a reference point, in response to a distance between a viewpoint of the user and a physical position of the virtual content object decreasing; or

increasing the length of the virtual content object along the direction axis parallel to the reference plane and oriented from the user toward the reference point, in response to the distance between the viewpoint of the user and the physical position of the virtual content object increasing.

16. The method of claim 1 , wherein the adjusting of the virtual content object comprises:

reducing an angle between a reference plane and a bottom surface of the virtual content object based on a reference axis, in response to a distance between a viewpoint of a user and a physical position of the virtual content object decreasing; or

increasing the angle between the reference plane and the bottom surface of the virtual content object based on the reference axis, in response to the distance between the viewpoint of the user and the physical position of the virtual content object increasing.

17. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises overlaying the adjusted virtual content object over a physical environment outside of the apparatus by visualizing the adjusted virtual content object using a display of an augmented reality (AR) glasses apparatus.

18. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises visualizing the adjusted virtual content object, using a head-up display (HUD) of a vehicle.

19. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

20. The method of claim 1 , further comprising:

projecting the adjusted virtual content object on the projection plane.

21. A processor-implemented method, comprising:

determining an adjustment of a virtual content object, for projection onto a projection plane, based on a shape to be projected of the virtual content object;

adjusting the virtual content object based on the determined adjustment; and

visualizing the adjusted virtual content object on the projection plane,

wherein the adjusting of the virtual contact object comprises:

setting one of points belonging to a space corresponding to the virtual content object as a reference point; and

changing the virtual content object based on the set reference point, and

wherein the setting of the one of the points as the reference point comprises selecting the one of the points based on a distance between a viewpoint of a user and physical positions of the points.

22. The method of claim 21 , wherein the selecting of the one of the points comprises determining a point closest to the viewpoint of the user among the points as the reference point.

23. A processor-implemented method, comprising:

adjusting a virtual content object based on a shape of the virtual content object projected onto a projection plane; and

visualizing the adjusted virtual content object on the projection plane,

wherein the adjusting of the virtual content object comprises changing the virtual content object based on a height-to-width (h/w) ratio of the shape of the virtual content object projected onto the projection plane, and

wherein the changing of the virtual content object comprises fitting the h/w ratio to a target ratio designated for a reference distance.

24. The method of claim 23 , wherein the changing of the virtual content object comprises:

calculating a height of the virtual content object based on a position of a proximal point closest to a viewpoint on the projection plane and a position of a distal point farthest from the viewpoint on the projection plane among points belonging to a space corresponding to the virtual content object; and

calculating a width of the virtual content object along a reference axis.

25. An apparatus with content visualizing, comprising:

a processor configured to generate an adjusted virtual content object by performing an adjustment, before the adjusted virtual content object is visualized on a projection plane, on a corresponding virtual content object based on a shape of to be projected of the corresponding virtual content object as if the corresponding virtual content object is being projected on the projection plane; and

a display configured to visualize the adjusted virtual content object on the projection plane and projecting the adjusted virtual content object on the projection plane,

wherein the shape to be projected is dependent on a physical depth represented by a reference element in a virtual space used for the adjusting of the virtual content object,

wherein the processor is further configured to retrieve the virtual content object from among a plurality of candidate objects stored in memory, other than a memory storing the virtual content object projected onto the projection plane, based on a position of the apparatus or based on the projection plane and a field of view of a viewpoint of a user of the apparatus.

26. The apparatus of claim 25 , wherein the display is an augmented reality (AR) glasses display.

27. The apparatus of claim 26 , wherein

the display is a transparent display configured to provide the adjusted virtual content object by overlaying the adjusted virtual content object over a physical environment outside of the apparatus while visualizing the adjusted virtual content object using the projection plane.

28. The apparatus of claim 25 , wherein the display is a head-up display (HUD) of a vehicle.

29. The apparatus of claim 25 , wherein the adjustment of the virtual content object is performed based on information regarding the reference element, within the virtual space, separated from positions of the adjusted virtual content object as represented in the virtual space.

30. An apparatus, comprising:

a processor configured to:

select a virtual content object, from among previously adjusted one or more objects in a virtual space corresponding a current projection of the previously adjusted one or more objects projected on a projection plane visualizing the previously adjusted one or more objects within a physical environment outside of the apparatus; and

adjust the selected virtual content object based on a shape of the selected virtual content object; and

a display configured to visualize the adjusted virtual content object within the physical environment outside of the apparatus, by projecting the adjusted virtual content object on the projection plane,

wherein the shape of the selected virtual content object is dependent on a physical depth represented by a reference element in a virtual space used for the adjusting of the selected virtual content object,

wherein the adjustment of the selected virtual content object is performed based on information regarding the reference element, within the virtual space, separated from positions of the adjusted virtual content object as represented in the virtual space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2021
From: LEE, HEESAE; CHANG, HYUN SUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 054803/0252 →
Priority Claims (1)
KR 10-2020-0103404 · Aug 18, 2020 · national
Continuity (1)
Related Publication 20220058885A1 · Feb 24, 2022
Cited By (1)
US 12,485,755