IP Library Granted Patent US 11,544,873
Granted Patent B2
US 11,544,873 · App. 16/807,179 · Granted Jan 3, 2023

High resolution 3D image processing apparatus and method thereof

Inventors: Shu-Lu Chen (Hsinchu County, TW); Yu-Shiuan Li (Hsinchu County, TW); Yun-Chung Na (Hsinchu County, TW)
Assignee: ARTILUX, INC.
G06T7/80G06T17/00G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,873
App. No.
16/807,179
Granted
Jan 3, 2023
Kind
B2
Abstract

Image processing apparatus and image processing method are provided. The image processing apparatus may include an image sensor having a plurality of photodetectors and include a 3D image calculating module. The image sensor may be configured to generate a first set of input information at a first time/first location and a second set of input information at a second time/second location, where the first set of input information may be associated with a first weighting value, and the second set of input information may be associated with a second weighting value. The 3D image calculating module may be configured to generate output information based on the first and the second sets of input information and the first and the second weighting values, wherein at least one of the plurality of photodetectors includes germanium.

Claims (33)

1. An image processing apparatus, comprising:

an image sensor comprising a depth-image pixel array, the image sensor being configured to generate a first set of input information representing a first depth image at a first time and a second set of input information representing a second depth image at a second time, the first set of input information being associated with a first weighting value, the second set of input information being associated with a second weighting value;

a moving sensor configured to detect a movement of the image processing apparatus and to output a movement information based on the movement of the image processing apparatus; and

a three-dimensional (3D) image calculating module configured to determine the first and the second weighting values based on the movement information and to generate an output information based on the first and the second sets of input information and the first and the second weighting values;

wherein the depth-image pixel array comprises germanium.

2. The image processing apparatus of claim 1 , wherein the image sensor further comprises a non-depth image pixel array.

3. The image processing apparatus of claim 1 , wherein the moving sensor comprises an accelerator or a micro-electro-mechanical system (MEMS) gyroscope, wherein the first set of input information is generated before the movement, and wherein the second set of input information is generated after the movement.

4. The image processing apparatus of claim 1 , wherein the output information is generated at least partially based on a binning calculation.

5. The image processing apparatus of claim 4 , wherein the binning calculation is performed by dividing the first and the second sets of input information into a plurality of binning clusters.

6. The image processing apparatus of claim 5 , wherein the plurality of binning clusters are dynamically adjusted.

7. The image processing apparatus of claim 1 , wherein the output information is generated at least partially based on an interpolation calculation.

8. The image processing apparatus of claim 1 , wherein the output information is generated at least partially based on a calibration.

9. The image processing apparatus of claim 1 , wherein the output information is generated at least partially based on any combination of a binning calculation, interpolation calculation and a calibration.

10. An image processing method of an image processing apparatus, comprising:

generating, by an image sensor comprising a depth-image pixel array, a first set of input information representing a first depth image at a first time and a second set of input information representing a second depth image at a second time;

determining, by a moving sensor, a movement information based on a movement of the image processing apparatus;

determining a first weighting value based on the movement information;

determining a second weighting value based on the movement information; and

generating an output frame based on the first set of input information, the second set of input information, the first weighting value and the second weighting value;

wherein the depth-image pixel array comprises germanium.

11. The image processing method of claim 10 , wherein the image sensor further comprises a non-depth image pixel array.

12. The image processing method of claim 10 , wherein the moving sensor comprises an accelerator or a micro-electro-mechanical system (MEMS) gyroscope.

13. The image processing method of claim 10 , further comprising generating the output frame at least partially based on a binning calculation or an interpolation calculation.

14. The image processing method of claim 10 , further comprising generating the output frame at least partially based on a calibration.

15. An image processing apparatus, comprising:

an image sensor comprising a depth-image pixel array, the image sensor being configured to generate a first set of input information representing a first depth image at a first location and a second set of input information representing a second depth image at a second location, the first set of input information being associated with a first weighting value, the second set of input information being associated with a second weighting value;

a moving sensor configured to detect a movement of the image processing apparatus and to output a movement information based on the movement of the image processing apparatus; and

a three-dimensional (3D) image calculating module configured to determine the first and second weighting values based on the movement information and to generate output information based on the first and the second sets of input information and the first and the second weighting values;

wherein the depth-image pixel array comprises germanium.

16. The image processing apparatus of claim 15 , wherein the image sensor further comprises depth image pixel array.

17. The image processing apparatus of claim 15 , wherein the moving sensor comprises an accelerometer or a micro-electro-mechanical system (MEMS) gyroscope, wherein the first set of input information is generated before the movement, and wherein the second set of input information is generated after the movement.

18. The image processing apparatus of claim 15 , wherein the output information is generated at least partially based on a binning calculation or an interpolation calculation.

19. The image processing apparatus of claim 15 , wherein the output information is generated at least partially based on a calibration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2020
From: CHEN, SHU-LU; LI, YU-SHIUAN; NA, YUN-CHUNG
To: ARTILUX, INC.
Reel/Frame 051985/0375 →
Continuity (3)
Provisional Application 62869570 · Jul 2, 2019
Provisional Application 62813776 · Mar 5, 2019
Related Publication 20200286260A1 · Sep 10, 2020