IP Library Granted Patent US 11,029,452
Granted Patent B2
US 11,029,452 · App. 16/257,355 · Granted Jun 8, 2021

Vehicle and 3D object information capturing system and method thereof

Inventor: Sin-Jhong Song (Taoyuan, TW)
Assignee: TDK TAIWAN CORP.
G02B3/12F03G7/065G02B3/14G02B6/0025G02B6/0066G02B7/023G02B7/08G02B7/09G02B7/102G02B7/182G02B7/1805G02B7/1821G02B13/009G02B13/0065G02B13/0075G02B26/004G02B26/0816G02B26/0883G02B27/0068G02B27/0955G02B27/0972G02B27/0977G02B27/646G03B5/00G03B9/06G03B9/14G03B13/36G03B17/17G06F1/1686G06T7/521G06T7/97G06T15/08G09G5/003H02K41/0356H04N5/2252H04N5/2253H04N5/2254H04N5/2256H04N5/2257H04N5/2258H04N5/2353G02B5/003G02B13/004G03B5/04G03B2205/0007G03B2205/0015G03B2205/0069G06T2207/10028G06T2207/10048G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,029,452
App. No.
16/257,355
Granted
Jun 8, 2021
Kind
B2
Abstract

A 3D object information capturing system is provided, including a camera module, a distance measuring module, and a processing module. The camera module captures image information of an object, and the distance measuring module captures distance information of the object. The processing module receives the image information and the distance information respectively from the camera module and the distance measuring module, and constructs a 3D model of the object according to the image information and the distance information.

Claims (58)

1. A 3D object information capturing method, comprising:

providing a camera module and capturing a 2D image of an object using the camera module;

analyzing the 2D image and generating first outline information of the object according to the 2D image;

providing a distance-measuring module and capturing 2D distance matrix information of the object's surface using the distance-measuring module;

analyzing the 2D distance matrix information and generating second outline information of the object according to the 2D distance matrix information;

establishing a 3D model of the object according to the first outline information and the second outline information;

providing an infrared sensing module and sensing the object with the infrared sensing module to obtain an infrared image of the object;

analyzing the infrared image and generating third outline information according to the infrared image; and

establishing the 3D model of the object according to the first outline information, the second outline information, and the third outline information.

2. The 3D object information capturing method as claimed in claim 1 , further comprising:

generating the first outline information by performing binarization on the 2D image.

3. The 3D object information capturing method as claimed in claim 1 , further comprising:

generating the second outline information by calculating the differences between adjacent elements of the 2D distance matrix information.

4. The 3D object information capturing method as claimed in claim 1 , further comprising:

transmitting infrared light to the object with the distance-measuring module; and receiving the infrared light that is reflected by the object using the infrared sensing module.

5. The 3D object information capturing method as claimed in claim 4 , further comprising:

providing a light measuring module to measure environmental light; and

transmitting infrared light to the object with the distance-measuring module when the illumination by environmental light is lower than a predetermined value, and receiving the infrared light that is reflected by the object using the infrared sensing module.

6. A 3D object information capturing method, comprising:

providing a camera module and capturing a 2D image of an object using the camera module;

analyzing the 2D image and generating first outline information of the object according to the 2D image;

providing a distance-measuring module and capturing 2D distance matrix information of the object's surface using the distance-measuring module;

analyzing the 2D distance matrix information and generating second outline information of the object according to the 2D distance matrix information; and

establishing a 3D model of the object according to the first outline information and the second outline information;

capturing a plurality of 2D images of the object from different locations using the camera module, and generating a plurality of first outline informations of the object according to the 2D images;

capturing a plurality of 2D distance matrix informations of the object from different locations using the distance-measuring module, and generating a plurality of second outline informations of the object according to the 2D distance matrix informations; and

establishing the 3D model of the object according to the first outline information and the second outline information.

7. A 3D object information capturing method, comprising:

providing a camera module and capturing a 2D image of an object using the camera module;

analyzing the 2D image and generating first outline information of the object according to the 2D image;

providing a distance-measuring module and capturing 2D distance matrix information of the object's surface using the distance-measuring module;

analyzing the 2D distance matrix information and generating second outline information of the object according to the 2D distance matrix information; and

establishing a 3D model of the object according to the first outline information and the second outline information;

capturing a plurality of 2D images of the object from different angles using the camera module, and generating a plurality of first outline informations of the object according to the 2D images;

capturing a plurality of 2D distance matrix informations of the object from different angles using the distance-measuring module, and generating a plurality of second outline informations of the object according to the 2D distance matrix informations; and

establishing the 3D model of the object according to the first and second outline informations.

8. The 3D object information capturing method as claimed in claim 1 , further comprising:

providing a GPS module and capturing location information of the camera module and the distance measuring module relative to the object; and

establishing the 3D model of the object according to the location information and the first and second outline informations.

9. The 3D object information capturing method as claimed in claim 1 , further comprising:

providing an inertial sensor GPS module and capturing posture information of the camera module and the distance measuring module relative to the object.

10. The 3D object information capturing method as claimed in claim 1 , wherein the 2D image includes color information of the object.

11. The 3D object information capturing method as claimed in claim 1 , further comprising:

providing a plurality of 3D object information capturing systems, wherein each of the 3D object information capturing systems comprises the camera module and the distance measuring module; and

detecting the object using the 3D object information capturing systems from different angles at the same time, to establish the 3D model of the object.

12. A 3D object information capturing system, comprising:

a camera module, capturing a plurality of 2D images of an object from different angles;

a distance measuring module, capturing a plurality of 2D distance matrix informations of the object from different angles;

a processing unit, receiving the image information and the distance information respectively from the camera module and the distance measuring module, generating a plurality of first outline informations of the object according to the 2D images, generating second outline information of the object according to the 2D distance matrix information, and constructing a 3D model of the object according to the first and second outline informations.

13. The 3D object information capturing system as claimed in claim 12 , further comprising an infrared sensing module for sensing the object with infrared light.

14. The 3D object information capturing system as claimed in claim 12 , further comprising a light measuring module to measure environmental light.

15. The 3D object information capturing system as claimed in claim 12 , further comprising a GPS module to capture location information of the camera module and the distance measuring module relative to the object.

16. The 3D object information capturing system as claimed in claim 12 , further comprising an inertial sensor to capture posture information of the camera module and the distance measuring module relative to the object.

17. The 3D object information capturing system as claimed in claim 12 , further comprising a temperature sensor for sensing the temperature around the 3D object information capturing system.

18. The 3D object information capturing system as claimed in claim 12 , further comprising a magnetic field sensor for sensing the magnetic field around the 3D object information capturing system.

19. A vehicle, comprising:

a 3D object information capturing system as claimed in claim 12 ; and

a computing unit, wherein the 3D object information capturing system transmits the 3D model of the object to the computing unit, and the computing unit establishes a moving path of the vehicle according to the 3D model of the object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2026
From: TDK TAIWAN CORP.
To: ACTUTEK CORPORATION
Reel/Frame 074858/0498 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2019
From: SONG, SIN-JHONG
To: TDK TAIWAN CORP.
Reel/Frame 048401/0543 →