IP Library › Granted Patent US 10,950,056
Granted Patent B2
US 10,950,056 · App. 16/524,384 · Granted Mar 16, 2021

Apparatus and method for generating point cloud data

Inventors: Jae Wan Park (Ulsan, KR); Gi Seok Kwon (Gyeonggi-do, KR); Kyu Sung Cho (Sejong-si, KR); Seung Lee Kim (Seoul, KR)
Assignee: MAXST CO., LTD.
G06T19/006G06T7/73G06T17/20G06T19/20G06T2207/10028G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,950,056
App. No.
16/524,384
Granted
Mar 16, 2021
Kind
B2
Abstract

According to the disclosed embodiments, virtualized information of a three-dimensional position for a position selected by the user is provided so that the user can place virtual content at an accurate position when authoring AR content. According to an embodiment, an apparatus for generating point cloud data includes a hardware processor to implement a feature point extractor to extract feature points from images obtained by capturing a three-dimensional region, a point cloud data generator to generate point cloud data related to the three-dimensional region on the basis of the extracted feature points, an overlay image display to display the generated point cloud data by overlaying the point cloud data on a currently captured image, and a three-dimensional position determiner to determine a three-dimensional position for a position selected by a user in the image.

Claims (24)

1. An apparatus for generating point cloud data, comprising at least one hardware processor configured to implement:

a feature point extractor configured to extract a plurality of feature points from a plurality of images obtained by capturing a three-dimensional region;

a point cloud data generator configured to generate point cloud data related to the three-dimensional region on the basis of the plurality of extracted feature points;

an overlay image display configured to display the generated point cloud data by overlaying the point cloud data on a currently captured image of the three-dimensional region; and

a three-dimensional position determiner configured to determine a three-dimensional position for a position selected by a user in the image on which the point cloud data is overlaid,

wherein the overlay image display is configured to overlay and display visualized information of the determined three-dimensional position together with the point cloud data on the currently captured image; and

the three-dimensional position determiner is further configured to generate a three-dimensional ray connecting the selected position and a focal point of a camera lens capturing the three-dimensional region and determine a point with a shortest distance to the three-dimensional ray among a plurality of points included in the point cloud data as the three-dimensional position.

2. The apparatus of claim 1 , wherein the three-dimensional region comprises at least one of a three-dimensional object and a three-dimensional space.

3. The apparatus of claim 1 , wherein the three-dimensional position determiner is further configured to generate a mesh having a plurality of points included in the point cloud data as vertices and determine a point of contact between the three-dimensional ray and the mesh as the three-dimensional position.

4. The apparatus of claim 1 , wherein the three-dimensional position determiner is further configured to project each of a plurality of points included in the point cloud data onto the image on which the point cloud data is overlaid and determine a point with the shortest distance to the selected position among the plurality of projected points as the three-dimensional position.

5. The apparatus of claim 1 , wherein when a plurality of positions are selected, the overlay image display is further configured to display information obtained by visualizing a three-dimensional position for each of the plurality of selected positions with a different color.

6. The apparatus of claim 1 , wherein the overlay image display is further configured to display the visualized information together with information input by the user regarding the selected position.

7. A method of generating point cloud data, comprising:

extracting a plurality of feature points from a plurality of images obtained by capturing a three-dimensional region;

generating point cloud data related to the three-dimensional region on the basis of the plurality of extracted feature points;

displaying the generated point cloud data by overlaying the point cloud data on a currently captured image of the three-dimensional region;

determining a three-dimensional position for a position selected by a user in the image on which the point cloud data is overlaid; and

overlaying and displaying visualized information of the determined three-dimensional position together with the point cloud data on the currently captured image,

wherein the determining of the three-dimensional position comprises generating a three-dimensional ray connecting the selected position and a focal point of a camera lens capturing the three-dimensional region and determining a point with a shortest distance to the three-dimensional ray among a plurality of points included in the point cloud data as the three-dimensional position.

8. The method of claim 7 , wherein the three-dimensional region comprises at least one of a three-dimensional object and a three-dimensional space.

9. The method of claim 7 , wherein the determining of the three-dimensional position comprises generating a mesh having a plurality of points included in the point cloud data as vertices and determining a point of contact between the three-dimensional ray and the mesh as the three-dimensional position.

10. The method of claim 7 , wherein the determining of the three-dimensional position comprises projecting each of a plurality of points included in the point cloud data onto the image on which the point cloud data is overlaid and determining a point with the shortest distance to the selected position among the plurality of projected points as the three-dimensional position.

11. The method of claim 7 , wherein the overlaying and displaying of the visualized information together with the point cloud data on the currently captured image comprises, when a plurality of positions are selected, displaying information obtained by visualizing a three-dimensional position for each of the plurality of selected positions with a different color.

12. The method of claim 7 , wherein the overlaying and displaying of the visualized information together with the point cloud data on the currently captured image comprises displaying the visualized information together with information input by the user regarding the selected position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2019
From: PARK, JAE WAN; KWON, GI SEOK; CHO, KYU SUNG; KIM, SEUNG LEE
To: MAXST CO., LTD.
Reel/Frame 049888/0889 →
Priority Claims (1)
KR 10-2019-0053219 · May 7, 2019 · national
Continuity (1)
Related Publication 20200357177A1 · Nov 12, 2020
Cited By (1)
US 12,347,056