IP Library › Granted Patent US 11,682,171
Granted Patent B2
US 11,682,171 · App. 16/862,730 · Granted Jun 20, 2023

Method and apparatus for acquiring virtual object data in augmented reality

Inventors: Seokyeol Kim (Suwon-si, KR); Sangjun Ahn (Suwon-si, KR); Haekyung Jung (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO.. LTD.
G06T17/20G06F30/12G06F30/17G06T15/506G06T19/006G06T19/20G06V20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,171
App. No.
16/862,730
Granted
Jun 20, 2023
Kind
B2
Abstract

Provided are a method and apparatus for acquiring virtual object data in augmented reality, the method including identifying at least one exposed component from three-dimensional image data corresponding to a target device, the exposed component being exposed to a view from outside of the target device, identifying a type of the target device from the three-dimensional image data corresponding to the target device, determining at least one main direction of the target device based on the type of the target device, and acquiring virtual object data for representing an appearance of the target device based on the at least one exposed component and at least one main direction.

Claims (63)

1. A method of acquiring virtual object data in augmented reality, the method comprising:

identifying at least one component of a target device from three-dimensional image data corresponding to the target device, the at least one component being exposed to a view from outside of the target device;

identifying a product type of the target device from the three-dimensional image data corresponding to the target device;

identifying a plurality of directions of the target device based on the product type of the target device;

obtaining a component weight and a direction weight corresponding to the at least one component based on the product type of the target device; and

acquiring virtual object data for representing an appearance of the target device based on the at least one component, the plurality of directions, and the component weight, and the direction weight,

wherein the component corresponds to a structural element in the target device, and the component weight corresponds to a weight set for the structural element in the target device.

2. The method of claim 1 , wherein the three-dimensional image data comprises computer-aided design (CAD) data.

3. The method of claim 1 , wherein the identifying the at least one component of the target device comprises:

arranging the target device and at least one virtual light source in a virtual space, based on the three-dimensional image data; and

identifying a component reached by light emitted from the at least one virtual light source, from among a plurality of components included in the target device, as the at least one component.

4. The method of claim 3 , wherein the identifying the component reached by light emitted from the at least one virtual light source, from among the plurality of components included in the target device, as the at least one component comprises:

rotating the at least one virtual light source about a virtual line passing through the target device as a central axis; and

identifying a component reached by the light emitted from the at least one virtual light source while the at least one virtual light source is rotating, from among the plurality to components included in the target device, as the at least one component.

5. The method of claim 3 , wherein the identifying of the component reached by light emitted from the at least one virtual light source, from among the plurality of components included in the target device, as the at least one component comprises:

moving a component that is movable from among the plurality of components included in the target device; and

identifying the component reached by the light emitted from the at least one virtual light source while the other component is moved, from among the plurality of components included in the target device, as the at least one component.

6. The method of claim 3 ,

wherein the acquiring of the virtual object data for representing the appearance of the target device comprises identifying a size of the virtual object data based on at least one of the at least one component or the set component weight.

7. The method of claim 1 , wherein the identifying of the plurality of directions of the target device based on the product type of the target device comprises:

obtaining a database including information about a preset product type of the target device and a main direction corresponding to the preset product type of the target device;

matching the preset product type of the target device in the database with the identified product type of the target device; and

identifying the plurality of directions of the target device based on a result of the matching.

8. The method of claim 7 ,

wherein the acquiring of the virtual object data for representing the appearance of the target device comprises determining a size of the virtual object data based on a direction weight.

9. The method of claim 8 , wherein the direction weight is set corresponding to the plurality of defined directions from which the target device is to be visualized in the virtual object data.

10. The method of claim 1 , wherein the plurality of directions of the target device is defined based on a three-dimensional coordinate system set in a virtual space.

11. The method of claim 1 , wherein the three-dimensional image data is acquired from a network including a cloud.

12. The method of claim 1 , wherein the component weight is set according to each individual component of the target device to be visualized in the virtual object data.

13. The method of claim 1 , wherein the component weight is set according to a priority order in which each individual component of the target device is to be visualized in the virtual object data.

14. An electronic device for acquiring virtual object data in augmented reality, the electronic device comprising:

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions to:

identify at least one component of a target device from three-dimensional image data corresponding to the target device, the at least one component being exposed to a view from outside of the target device,

identify a product type of the target device from the three-dimensional image data corresponding to the target device,

identify a plurality of directions of the target device based on the identified product type of the target device,

obtain a component weight and a direction weight corresponding to the at least one component based on the product type of the target device, and

acquire virtual object data for representing an appearance of the target device based on the at least one component, the plurality of directions, and the component weight and the direction weight,

wherein the component corresponds to a structural element in the target device, and the component weight corresponds to a weight set for the structural element in the target device.

15. The electronic device of claim 14 , wherein the three-dimensional image data comprises computer-aided design (CAD) data.

16. The electronic device of claim 14 , wherein the processor is further configured to execute the one or more instructions to:

arrange the target device and at least one virtual light source in a virtual space based on the three-dimensional image data, and

identify a component reached by light emitted from the at least one virtual light source, from among a plurality of components included in the target device, as the at least one component.

17. The electronic device of claim 16 , wherein the processor is further configured to execute the one or more instructions to:

rotate the at least one virtual light source about a virtual line passing through the target device as a central axis, and

identify the component reached by the light emitted from the at least one virtual light source while the at least one virtual light source is rotating, from among the plurality of components included in the target device, as the at least one component.

18. The electronic device of claim 16 , wherein the processor is further configured to execute the one or more instructions to:

move another component that is movable from among the plurality of components included in the target device, and

identify the component reached by the light emitted from the at least one virtual light source reaches while other component is moved, as the at least one component, from among the plurality of components included in the target device.

19. The electronic device of claim 16 , wherein the processor is further configured to execute the one or more instructions to identify a size of the virtual object data based on the at least one component and the set component weight.

20. The electronic device of claim 14 , wherein the processor is further configured to execute the one or more instructions to:

obtain a database including information about a preset product type of the target device and a main direction corresponding to the preset product type of the target device,

match the preset product type of the target device included in the database with the identified product type of the target device, and

identify the plurality of directions of the target device based on a result of the matching.

21. The electronic device of claim 20 , wherein the processor is further configured to execute the one or more instructions to determine a size of the virtual object data based on a direction weight.

22. The electronic device of claim 14 , wherein the plurality of directions of the target device is defined based on a three-dimensional coordinate system set in a virtual space.

23. A non-transitory computer-readable recording medium having recorded thereon a program for executing, on a computer, a method of acquiring virtual object data in augmented reality, wherein the method comprises:

identifying at least one component of a target device from three-dimensional image data corresponding to the target device, the at least one component being exposed to a view from outside of the target device;

identifying a product type of the target device from the three-dimensional image data corresponding to the target device;

identifying a plurality of directions of the target device based on the product type of the target device;

obtaining a component weight and a direction weight corresponding to the at least one component based on the product type of the target device; and

acquiring virtual object data for representing an appearance of the target device based on the at least one component, the plurality of directions, and the component weight, and the direction weight,

wherein the component corresponds to a structural element in the target device, and the component weight corresponds to a weight set for the structural element in the target device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: KIM, SEOKYEOL; AHN, SANGJUN; JUNG, HAEKYUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 052535/0871 →
Priority Claims (1)
KR 10-2019-0122508 · Oct 2, 2019 · national
Continuity (2)
Provisional Application 62854533 · May 30, 2019
Related Publication 20200380771A1 · Dec 3, 2020