IP Library Granted Patent US 8,699,787
Granted Patent B2
US 8,699,787 · App. 12/666,813 · Granted Apr 15, 2014

Method and system for generating a 3D model from images

Inventors: Anton John van den Hengel (Rose Park, AU); Anthony Robert Dick (Maylands, AU); Thorsten Thormaehlen (Saaubruccken, DE); Benjamin William Stephen Ward (Adelaide, AU); Philip Hilaire Sean Torr (Rose Park, AU)
Assignee: Three Pixels Wide Pty Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,699,787
App. No.
12/666,813
Granted
Apr 15, 2014
Kind
B2
Abstract

A method for generating a three dimensional (3D) model of an object from a series of two dimensional (2D) images is described. The series of 2D images depict varying views of the object and have associated camera parameter information. The method includes the steps of tracing the object in a first 2D image selected from the series of 2D images to provide a first set of tracing information, then tracing the object in a second 2D image selected from the series of 2D images to provide a second set of tracing information. The 3D model of the object is then generated based on the camera parameter information and the first and second sets of tracing information.

Claims (25)

1. A method for generating a three dimensional (3D) model of an object from a series of two dimensional (2D) images, wherein the series of 2D images depict varying views of the object and have associated camera parameter information, the method comprising:

tracing the object in a first 2D image selected from the series of 2D images to provide a first set of tracing information;

displaying a second 2D image selected from the series of 2D images on a display;

projecting, on the display, an estimated representation of the object derived from the first set of tracing information onto the second 2D image selected from the series of 2D images;

modifying, on the display, the estimated representation of the object that is projected on the second 2D image based on the second 2D image that is displayed on the display to provide a second set of tracing information; and

generating the 3D model of the object based on the camera parameter information and the first and second sets of tracing information.

2. The method of claim 1 further comprising:

refining, on the display, the estimated representation of the object that is projected onto the second 2D image for further providing the second set of tracing information.

3. The method of claim 1 , wherein the generating of the 3D model includes basing the generation on additional 3D point information related to the object.

4. The method of claim 1 , wherein the series of 2D images is a sequence of 2D images.

5. The method of claim 4 , wherein the sequence of 2D images is a video image sequence.

6. The method of claim 5 , wherein the camera parameter information is derived from a structure from motion analysis of the video image sequence.

7. The method of claim 1 , wherein the modifying is facilitated by snap fitting to pixel boundaries.

8. A method for generating a three dimensional (3D) model of an object from a series of two dimensional (2D) images, wherein the plurality of 2D images depict varying views of the object and have associated camera parameter information, the method comprising:

selecting a geometric primitive and lining up the geometric primitive with shape characteristics of the object to trace the object in a first 2D image;

displaying a second 2D image selected from the series of 2D images on a display;

projecting, on the display, the geometric primitive as traced in the first 2D image onto the second 2D image selected from the series of 2D images;

modifying, on the display, the projected geometric primitive that is projected on the second 2D image based on the second 2D image that is displayed on the display to trace the object in the second 2D image; and

generating the 3D model based on the modified geometric primitive and the camera parameter information associated with the first and second 2D images.

9. The method of claim 8 , wherein the geometric primitive is a 3D geometric primitive.

10. The method of claim 8 , wherein the generating of the 3D model includes basing the generation on additional 3D point information related to the object.

11. The method of claim 8 , wherein the series of 2D images is a sequence of 2D images.

12. The method of claim 11 , wherein the sequence of 2D images is a video image sequence.

13. The method of claim 12 , wherein the camera parameter information is derived from a structure from motion analysis of the video image sequence.

14. The method of claim 8 , wherein the modifying is facilitated by snap fitting to pixel boundaries.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE FIRST INVENTOR'S NAME PREVIOUSLY RECORDED ON REEL 032018 FRAME 0627. ASSIGNOR(S) HEREBY CONFIRMS THE THE FIRST INVENTOR'S NAME SHOULD READ "ANTON JOHN VAN DEN HENGEL (VAN DEN HENGEL, ANTON JOHN)". Recorded Mar 26, 2014
From: VAN DEN HENGEL, ANTON JOHN; DICK, ANTHONY ROBERT; THORMAEHLEN, THORSTEN; WARD, BENJAMIN W. STEPHEN; TORR, PHILIP H. SEAN
To: THREE PIXELS WIDE PTY LTD.
Reel/Frame 032536/0261 →
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST INVENTORS NAME PREVIOUSLY RECORDED ON REEL 024696 FRAME 0756. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST INVENTORS NAME SHOULD READ "ANTON JOHN VAN DEN HENGEL. Recorded Jan 14, 2014
From: HENGEL, ANTON JOHN VAN DEN; DICK, ANTHONY ROBERT; THORMAEHLEN, THORSTEN; WARD, BENJAMIN W. STEPHEN; TORR, PHILIP H. SEAN
To: THREE PIXELS WIDE PTY LTD.
Reel/Frame 032018/0627 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2010
From: VA DEN HENGEL, ANTON JOHN; DICK, ANTHONY ROBERT; THORMAEHLEN, THORSTEN; WARD, BENJAMIN W. STEPHEN; TORR, PHILIP H. SEAN
To: THREE PIXELS WIDE PTY LTD.
Reel/Frame 024696/0756 →
Continuity (2)
Provisional Application 60929501 · Jun 29, 2007
Related Publication 20100284607A1 · Nov 11, 2010